GPUs run hotter than CPUs. While 61°C for a CPU would make me nervous, that is a comfortable temperature for a GPU.GPU is still overheating , i put a desk fan near it and its temperature at the minimum is 58 C . Most is 61 C .
You said you found a fan that was not spinning. Which fan? If the CPU fan, did you remove the heat sink too? If so, you need a fresh application of TIM.
Is the system clean of heat trapping dust?
The specs for your computer do not show the fan support capability of your case. That means you will have to inspect it to see if the case can support another or larger fan, and you need to find a spare power connector (4-pin molex used for old style drives).