How do you thaw/remove ice from the sides of the ice box in the fridge?

I once had a cleaning lady who had this quick way of removing the ice that aculates on the sides of my ice box. Does anyone know of a quick way to do this without turning my fridge off for hours?