[iMore.com]

Safari, by default, saves your web history and all the data that pertains to it. If you don't like this behavior, you can use private browsing sessions so Safari doesn't save any info about your session. Perhaps there are small children in the home that you don't want accessing web histories. This is a example of when private browsing is a good idea. Here's how to use it:

Full story from the iMore Blog...