Yeah I do the same thing. It's normal. As long as your skis are parallel and close when you're carving, you're fine.
Your feet automatically do that at low speeds for stabilization. Like when you're riding a bike slowly, you're not nearly as stable as when you're going fast or going down a hill.