It all depends. Is your jacket insulated or is it just a shell?
Here's a few good layering techniques.
For a base layer, I recommend a material that's whicking like Underarmor or something polyester. You don't want cotton for a base layer because it absorbs moisture and will only make you colder where as synthetics disperse it.
Next, you need an insulation layer. This all depends on how cold it is outside. My jacket is lightly insulated, so I'm usually fine with just a few cotton tall-T's underneath if it's 30 outside. On colder days like 15-20 I'll layer up with a hoodie on top of T's (my hood is removeable) or a fleece if it starts to get really cold.