Get it checked out. I dislocated mine, was told to take 6 weeks off and get stronger. I took a week off and dislocated it again my first day back. Put it in myself and went home. Since then I've been dislocating it almost once a week for the past 4 years. I finally got surgery on Monday of last week.
Don't fuck around with it. Take a month or two off, go lift weights, swim, etc. Just get your shoulder stronger or else you're gonna end up with shit like this and you'll go from a month or two off the skis to 2 years off the skis like me.