Had a go with some acetone, hasn't done a bad job so far. Only a 10mins scrub with a nail brush.
Hasn't damaged the rubber at all, and already looking much more detailed / less shit.
Will try it more throughly when I'm not busy and report back.