Problem with booting pc

Problem is that if I shut down my system, then if I boot it again, it starts restarting (red lights blinking) and simply wont boot.

Though right now I found a way to bypass that by powering off system fully (flipping the power switch) and then turning it on again. In this case system boots just fine.

My guess is that problem is either in system settings (or bios) or with power supply as it redistributes power incorrecly or not enough?

Though thats just a guess.

Question is how to fix issue, so system would boot normally and correctly?