However, panic evolved for a reason. Perhaps it is just a perfect storm of side-effects that hasn't been weeded out yet. Most likely, it has survived thousands upon thousands or even millions of years of evolution. Literally, all your potential ancestors who didn't panic, died. It has a purpose, a function.
Figure out what the function is. Then, in those situations characterizing its purpose, panic.
Panic, like every emotion, is a tool. Use it. Exploit yourself for your own gain.