Skip to Content
Big Data Now: Current Perspectives from O'Reilly Radar
book

Big Data Now: Current Perspectives from O'Reilly Radar

by O'Reilly Radar Team
August 2011
Beginner to intermediate
124 pages
3h 30m
English
O'Reilly Media, Inc.
Content preview from Big Data Now: Current Perspectives from O'Reilly Radar

Chapter 3. The Application of Data: Products and Processes

How the Library of Congress is building the Twitter archive

Checking in on the Library of Congress’ Twitter archive, one year later.

by Audrey Watters

In April 2010, Twitter announced it was donating its entire archive of public tweets to the Library of Congress. Every tweet since Twitter’s inception in 2006 would be preserved. The donation of the archive to the Library of Congress may have been in part a symbolic act, a recognition of the cultural significance of Twitter. Although several important historical moments had already been captured on Twitter when the announcement was made last year (the first tweet from space, for example, Barack Obama’s first tweet as President, or news of Michael Jackson’s death), since then our awareness of the significance of the communication channel has certainly grown.

That’s led to a flood of inquiries to the Library of Congress about how and when researchers will be able to gain access to the Twitter archive. These research requests were perhaps heightened by some of the changes that Twitter has made to its API and firehose access.

But creating a Twitter archive is a major undertaking for the Library of Congress, and the process isn’t as simple as merely cracking open a file for researchers to peruse. I spoke with Martha Anderson, the head of the library’s National Digital Information Infrastructure and Preservation Program (NDIIP), and Leslie Johnston, the manager of the NDIIP’s Technical ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Big Data Now: 2016 Edition

Big Data Now: 2016 Edition

O'Reilly Media, Inc.
Global HR Competencies: Mastering Competitive Value from the Outside-In

Global HR Competencies: Mastering Competitive Value from the Outside-In

Dave Ulrich, Wayne Brockbank, Jon Younger, Mike Ulrich
Corporate Information Factory

Corporate Information Factory

W. H. Inmon, Claudia Imhoff, Ryan Sousa

Publisher Resources

ISBN: 9781449316297Errata Page