There are definitely quite a few other things that could happen besides fracturing your patella. It depends greatly on the direction of force, the point of contact of force, and the position that his knee was in at the time of contact.
Just pay attention to your symptoms. If it doesn't seem to be getting better, or if it's getting worse, go get it checked out. If you have health insurance, maybe get it checked out just for peace of mind.