I think that is exactly why you SHOULD bring it up to someone in charge. This is affecting everyone's grades, and stress, and that is not fair to any of you. If he is such an issue that even mentioning it to a teacher is going to make it worse, that right there should be reason enough to have him removed. That's just going to get worse no matter what you do, so at least you can have it on record and hopefully those in charge can do something about it.