If you are interested in the archeology of the internet (i.e. digging up dead sites) you should check out Ghostsites of the Web. Steve Baldwin (not the semi-famous one) keeps track of sites that are dead or dying. He has even put together a gallery of screenshots ranging from 1998 to 2005.
While this site isn’t as functional as the Way Back Machine archives, it is still an interesting site.