I totally agree. I looked at the keyboard and I couldn't find anything else. '$' would have been even worse...
And I think you might have to hack the MzScheme reader really deeply to make it accept '|' as a conventional character, since it is used to be able to embed special characters into symbols...
