Chapter 1. Finding Information in Your Data
Ever since people began recording information, we have needed to find that information. More than 4,000 years ago, in ancient Sumer, bureaucrats were creating catalogs to help organize and locate information. In ancient Greece 2,250 years ago, the scholar Callimachus created the Pinakes—a table of authors and works in the Library of Alexandria.1 Numerous concordances and indices surround ancient texts to help readers find relevant portions.
The story of search and search engines is intimately tied to language. This report is thus largely about language: the means by which people capture information and the tool they use to find information. When you search, whether you’re talking to a librarian or typing words into a search box, you’re asking a question with words to get something you need. Language is the central element of searching.
Until recently, computers could not simulate human-level comprehension, so finding information was a tedious and error-prone process. The search engine, much like when you use a library card catalog, matches the words you type with words in its catalog of information (its index). This is called lexical or keyword search. This process of locating information is iterative, manual, and often frustrating (Figure 1-1).
Figure 1-1. The traditional method of iterative searching puts all the work on the searcher ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access