Have you tried aloe vera gel? It's very cooling and calms area.

Have you tried using hydrocortisone cream on that area? It's supposed to be an anti-itch item to use. Can't hurt to try it

Ice can be drying if it gets the skin too cold. Try putting olive oil on it with some heat, then try the ice. Heat drives the oil deeper into the skin.