i go by the old adage, "if you can't tuck em, pluck em." if they're blocking a growth tip, and you can't move it out of the way, cut it!
you never want to trim too much at any one time. spread it out over a couple days. if it's only a few leaves, cut them at one time. i try to to keep it to about 10-12. that's leaves, not branches.