Oven that won't turn off

We replaced the burned out heating element and turned the breaker back on. We then noticed that the heating element was heating up, without us turning the oven on. Could this bee the control panel and if it is, how difficult is it to fix? Any tips on how to correct this situation?