Here are several Linux-related links from a Computer Shopper that I'm about to throw out. They did a nice little story on how non-techies can try to get Linux going on a PC.
- the linux documentation product site
These next links were included as sites where you can buy CD's of specific Linux builds for a small amount:
Indeed, I just checked out one of the sites, and found a complete set of disks for less than $10.