Consult the manual on how to reset the bios (aka cmos). You generally have to have POWER going to the motherboard (but the computer will not be on -- just powered), and you switch around a jumper. By power, I mean from a power supply -- you should just leave the battery in at all times unless there is no reset jumper. Then, do as
Xoxol said.
Can you even get into the BIOS? Check its settings for something unusual - even if you reset it as it may not reset.
Anyways, do as people have said and have as few items as connected as possible. For example, start with only the following connected:
- Power Supply
- Processor (and its heatsink/fan)
- Memory
- Video card, but only if there is no onboard video
The computer should start up, it should do a memory test, and then beep/give you errors. You'll most likely get a keyboard not found error. That's good. Turn the computer off, plug in the keyboard, and boot it up again. You should get the same thing, minus the keyboard error, but it should get further along until you get a message.
^^ Lather, rinse, and repeat until you get everything connected. If you get to a point and can't resolve the error message, or it just hangs, then troubleshoot based on how the computer is setup and what the last thing connected. There are too many possible outcomes to give you a step by step guide here.
Alternatively, if you think it's the hard drive -- try setting the BIOS to boot from CD, and use a bootable CD to see what happens.
It's going to be a trial and error process, but you'll find it. If you have the ability to make a video of exactly what happens from when you first apply power, that would be helpful to see. Or even if you can post some pictures of your motherboard setup so we can rule out other things.