I've copped a few knocks. Never actually punched though (I'm a gentleman player).
Often times the lens gets knocked to the back of my eye which is really annoying because it gets folded over and I can't even see it in the mirror! I usually have to hold my eye open and look right into a corner and get one of my team-mates to fish it out with a finger. Often they can't even find it though!