just go check out your fabric shop. you can use whatever, and if it's baggy you don't really have to worry about stretch. but you can use regular jersey and make a thinner one, or even like a quilted fabric for like a warmer one. you'll probably just have to continue using ribbing for the cuffs and hem.
scandinavians give me boners