Learning C#, programming and game programming all at the same time can be a lot for some people and very easy for otehrs. But in general its best to learn some C# and programming without worrying about game stuff.
Most of the DirectX or XNA GS books assume you can already program in C# or C++ so they won't teach that. So yes there are books that just teach game programming - in fact most of them are just that.