The things you should worry about: if you can't move your head forward so your chin touches your chest, if you lose consciousness even briefly, vision changes or vomiting. If those things happen, go to emergency, otherwise you can probably wait for the MRI. That's a really common place to get whiplash-type injuries which can develop over several days.
Re: Should I worry?