Yeah, your jacket must be massive on you. I put on a L mens and it hangs 4 inches past my fingers and I'm 5'7.
Medium is mean for around a 33 - 36 but they are long and pretty baggy. If you are thinnish they could be massive on you. Length generally isn't too big of a deal, but you will have super awkward bunching around the waste with a belt.