Im leaving the baffles in on my bike. Sure some bikes are going to be louder, but having the loudest pipes around doesn't mean you have the best bike around. Besides your pipes will sound better then they do now when you get some miles racked up on them. Give them some time, before you make the mod. just my humble oppionion.
Also if your running in a pack, stay to the left of the other bikers and they will have to listen to your pipes instead of you listening to theirs. Then they will think their pipes are too quiet.