Re: Search Engine Sizes Scrutinized

Gregory Alan Bolcer (
Tue, 13 Apr 1999 08:59:20 -0700

Another in the stupid idea series. What ever happened to the projec that
was trying to store everything that was ever put up on the WWW? Here's
a plan, build super-storage array with super fast computers that's big
enough to store the 1/2 Terabyte a day that is being generated, have
back ends constantly updating it, have various arrays of front ends
leased out to the different search engine vendors.

If IBM can spend all that money on building deep blue, I don't see
why Compaq can't put a couple of tens of million into indexing and
deep storing everything on the WWW.

Why donate money for a building? Donate money for a new project
instead. Something that you wouldn't be able to do otherwise.

Think Different. Oh Gawd, I can't believe I just typed that.


"Joseph M. Reagle Jr." wrote:
> Having just seen Gates speak at LCS's 35 Anniversary, I naturally compare
> the Gates phenomena to the Web phenomena, and then I read this: the whole
> Web is 320 million pages? That means every Web page could represent ~$300 of
> his net worth. Or he just gave LCS about $.08 for every page out there to
> build a new building.