If you can go en masse, definitely do so. Your professor may be mild, but he can't ignore it when a huge chunk of his class is complaining and upset and is seeing visible academic decline.