Here's my advice
Ask yourself. Do you really like him? Is he the one for you? Do you love eachother? If you answered no, or are uncertain about any of these, spend time and find out.
Not every relationship is constantly spending time together. Seeing him twice a week? That's great! My friend see's his girl once every 2 and they love eachother to bits. Sometimes it's good to spend time away from eachother be able to discover how you feel without him. Don't worry, he's probably stoaked he has you in the first place! He isn't feeling held back by you. Keep your interests in mind, but don't blow him off. Keep in touch, snap chat, and make the time you spend together real quality time, since you don't get to do it often.
Call me if it doesn't work out for you two ;)