How can I alter the £ sign back it's proper symbol from a capital "J"

Make sure that your regional settings are set to English (UK).

Click on control panel, then date time and regional options, then regional options, and set them both to english. That should work...