Unsafe code only really helps in a few very specific kinds of situation, though. It isn't a generally useful way to speed up your entire codebase. As a general rule, any time you find yourself doing a ton of data manipulation shuffling things around inside a single array (for instance generating a dynamic vertex buffer, or writing directly into a generated texture, or mixing audio data) that's where unsafe code might be able to help.
XNA Framework Developer -
blog -
homepage