Reflections as the Internet Archive turns 25

Photo by Rory Mitchell, The Mercantile, 2020 – CC by 4.0
(L-R) Brewster Kahle, Tamiko Thiel, Carl Feynman at Thinking Machines, May 1985. Photo courtesy of Tamiko Thiel.

A Library of Everything

As a young man, I wanted to help make a new medium that would be a step forward from Gutenberg’s invention hundreds of years before. 

By building a Library of Everything in the digital age, I thought the opportunity was not just to make it available to everybody in the world, but to make it better–smarter than paper. By using computers, we could make the Library not just searchable, but organizable; make it so that you could navigate your way through millions, and maybe eventually billions of web pages.

The first step was to make computers that worked for large collections of rich media. The next was to create a network that could tap into computers all over the world: the Arpanet that became the Internet. Next came augmented intelligence, which came to be called search engines. I then helped build WAIS–Wide Area Information Server–that helped publishers get online to anchor this new and open system, which came to be enveloped by the World Wide Web.  

By 1996, it was time to start building the library.

This library would have all the published works of humankind. This library would be available not only to those who could pay the $1 per minute that LexusNexus charged, or only at the most elite universities. This would be a library available to anybody, anywhere in the world. Could we take the role of a library a step further, so that everyone’s writings could be included–not only those with a New York book contract? Could we build a multimedia archive that contains not only writings, but also songs, recipes, games, and videos? Could we make it possible for anyone to learn about their grandmother in a hundred years’ time?

From the San Francisco Chronicle, Business Section, May 7, 1988. Photo by Jerry Telfer.

Not about an Exit or an IPO

From the beginning, the Internet Archive had to be a nonprofit because it contains everybody else’s things. Its motives had to be transparent. It had to last a long time.

In Silicon Valley, the goal is to find a profitable exit, either through acquisition or IPO, and go off to do your next thing. That was never my goal. The goal of the Internet Archive is to create a permanent memory for the Web that can be leveraged to make a new Global Mind. To find patterns in the data over time that would provide us with new insights, well beyond what you could do with a search engine.  To be not only a historical reference but a living part of the pulse of the Internet.

John Perry Barlow, lyricist for the Grateful Dead & founder of the Electronic Frontier Foundation, accepting the Internet Archive Hero Award, October 21, 2015. Photograph by Brad Shirakawa – CC by 4.0

Looking Way Back

My favorite things from the early era of the Web were the dreamers. 

In the early Web, we saw people trying to make a more democratic system work. People tried to make publishing more inclusive.

We also saw the other parts of humanity: the pornographers, the scammers, the spammers, and the trolls. They, too, saw the opportunity to realize their dreams in this new world. At the end of the day, the Internet and the World Wide Web–it’s just us. It’s just a history of humankind. And it has been an experiment in sharing and openness.

The World Wide Web at its best is a mechanism for people to share what they know, almost always for free, and to find one’s community no matter where you are in the world. 

Brewster Kahle speaking at the 2019 Charleston Library Conference. Photo by Corey SeemanCC by 4.0

Looking Way Forward

Over the next 25 years, we have a very different challenge. It’s solving some of the big problems with the Internet that we’re seeing now. Will this be our medium or will it be theirs? Will it be for a small controlling set of organizations or will it be a common good, a public resource? 

So many of us trust the Web to find recipes, how to repair your lawnmower, where to buy new shoes, who to date. Trust is perhaps the most valuable asset we have, and squandering that trust will be a global disaster. 

We may not have achieved Universal Access to All Knowledge yet, but we still can.

In another 25 years, we can have writings from not a hundred million people, but from a billion people, preserved forever. We can have compensation systems that aren’t driven by advertising models that enrich only a few. 

We can have a world with many winners, with people participating, finding communities of like-minded people they can learn from all over the world.  We can create an Internet where we feel in control. 

I believe we can build this future together. You have already helped the Internet Archive build this future. Over the last 25 years, we’ve amassed billions of pages, 70 petabytes of data to offer to the next generation. Let’s offer it to them in new and exciting ways. Let’s be the builders and dreamers of the next twenty-five years.

See a timeline of Key Moments in Access to Knowledge, videos & an invitation to our 25th Anniversary Virtual Celebration at anniversary.archive.org.

18 thoughts on “Reflections as the Internet Archive turns 25

  1. testeronline

    You are one of a few which have wonderful achievements of a wonderful dream…and we all may enjoy.
    Thank you!

    Reply
  2. Duncan

    Thank you for all your hard work and dedication over the years. Your work here is incredibly important. Here’s to another 25 years and many more petabytes of data!

    Reply
  3. Adam

    So happy to read this. 25 years onward and you’re still working towards the most noble of goals. Please dont change Brewster!

    Reply
  4. Dana Jones

    Congratulations! As a legal research librarian I must correct one thing in your post-the correct spelling for Lexis is LexisNexis, not LexusNexus.

    Reply
  5. Peter Marreck

    I can almost hear “She Blinded Me With Science” playing in my mind when I look at some of these photos

    Reply
  6. Andrew Morgan

    Ahh, yes the dream of helpful knowledge & Empowerment for all: I love it! : Now if we can get it all running on solar power and free tablets and free wifi and free satellite uplinks: Then we can all learn how to feed the world, share the seeds of success and heal the masses and control overpopulation with even distribution of assets and applied effort, we can then move beyond our bounds here on earth: Now…Then we just need to do it!

    Reply
  7. Piotr

    Congratulations.

    Personally I think it time to look step further. If Musk or anyone else would take us to Mars, what should we take? Of course Internet Archive data. It would be not only the preserving the humankind of another planet(if we achieve being interplanetary civilization), but also, and we shouldn’t be afraid to say the entertainment medium, which can help people travel for months, and maybe spend years in the “new colony”.

    Reply
  8. Mike Marinacci

    Mr. Kahle, thank you for inventing and perfecting this incredible resource. You are doing an incalculable service for not only the Internet, but for human civilization, by making this immense collection of text, imagery, sound, and cinema available to all.

    Reply
  9. Jay

    And what’s amazing is their headquarters are on the corner of my old street! Could not be happier about that!

    Reply
  10. Dart Hollow

    happy silver anniversary.
    are we going to have to wait until the pearl anniversary for the site to add some transparency about how collections are managed and curated, or what the site’s policy on “deemphasized” content is, or what technical changes are being made in the background?

    Reply
  11. Delib

    Have always been thankful for the resources you’ve maintained. Please include activity-pub (mastodon compatible) versions of your blog posts. There is a ‘fediverse’ of people who will be glad to know more about archive.org.

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *