What's New:
With the release of XNA Game Studio 3.1, we have replaced all the version 3.0 starter kit installers with new MSI files to address an installation problem when XNA Game Studio 3.1 is installed. If you downloaded any XNA Game Studio 3.0 starter kit installer before June 11, 2009, you may wish to download the new installer so the starter kit will install properly in XNA Game Studio 3.1. If the starter kit is already installed, you do not have to uninstall or reinstall it.
Background:
When you run the installers, they check to make sure you have the right version of Game Studio installed. Even though Game Studio 3.1 supports both 3.0 and 3.1 projects, the earlier installers did not recognize this new version of Game Studio. They think 3.0 is no longer available on your system. The newer installers fix this. The starter kits themselves are the same, however (with the exception of a minor fix to Net Rumble, as mentioned in the 3.1 readme).
Never tried a starter kit? Find out what you've been missing, here.