GPU usage and framerate are low but skyrocket when game is paused

Hi y'all. When I'm playing the Extended Edition, my GPU usage is low and so is my framerate. But when I pause it, both my GPU usage and my framerate skyrocket. Here are comparison pictures of the game and the task manager (fps in bottom left corner of game window): http://ift.tt/2yu7mBJ

As the game went on the difference became even more drastic (sub-20 FPS and 40% usage when unpaused.) Is there any way to fix this on my end or is it the game's fault?

Specs: Windows 10 Ryzen 5 1400 R7 250 2GB DDR5 8GB DDR4 RAM Not sure what motherboard and power supply I have but I can find out tomorrow if anyone thinks they could be relevant.