Hi Felix,
Why not just substitute for the actual character in your rule? E.g. substitute space for #, substitute space for --- (long dash) and so on. (Yes you get that extra space in the text, no way around that AFAIK.) This is what we have done.
We also trained our users to not utilize these special characters, so the conversion rule engages very seldom now.
Regards,
Sue