In that case... my guess is that your skis aren't center mounted. The center mount is what throws me back seat.
My guess is you are standing too tall or dragging your polls in the sense that you don't actually know how to use them. My apologizes if you do, but you can usually tell people in lazy stance that know how to use their poles from people in lazy stance cause they don't know how to use their polls.
If you do know how to use your poles, do a few runs keeping them up and use them even on the flat terrain. You should notice the pain going away and they should actively keep you more forward.
If you don't know how to use them, take a lesson and say you want your primary focus to be staying forward and using your poles properly.
Once you know how to use them properly, you should get used to the stance and be able to drop them with out it throwing you back seat.