Sand works quite well.

If you need to use soap, look for something like Lava with pumice or some other grit that is good for scrubbing like ground grain hulls.