what is your motherboard/bios manufacturer? I know a few BIOS make no noise on a clean POST, but most beep once I think. But they all make noise if the POST fails, so I don't think it's an issue with that. This probably means the issue is somehow related to the power supply, or the HDD itself.
To test and see if your overloading your psu, unplug the computer for 30 sec, hit power button with it unplugged, then plug it back it and hit the power button. If it does not immediately begin the post, you are overloading your psu, i had this issue with my last psu and after i plugged it in, it would take it at least 45-50 seconds to "charge" all the capacitors and everything before it would even attempt a boot, and that's how I learned that my PSU was the weak link...
also you should probs post specs so we can be jelly.