Remove the outlet cover & shine a flashlight into the crack of the outlet box.
You should be able to see if there is insulation in the wall and possibly how thick it is.