I'd go in and get an x-ray. You really need to know one way or another. Luckily, most broken toes don't need any kind of surgery.

Good luck to you and be sure to keep us updated!