book

Codebreaking

by Elonka Dunin, Klaus Schmeh

September 2023

Intermediate to advanced

488 pages

12h 49m

English

No Starch Press

Read now

Unlock full access

Praise for Codebreaking
Also by Elonka Dunin and Klaus Schmeh
Title page
Copyright
Dedication
About the Authors
Preface
Chapter 1: How can I break an encrypted message? And other introductory questions
What is this book about?Which technical terms do I need to know?How can I break an encrypted text?How do I know what kind of encryption I am dealing with?I have found an encrypted text in the attic; can you decipher it for me?I have encrypted a text myself; can you break it?I have invented a new encryption method; can you take a look at it?I have solved a famous unsolved cryptogram; what should I do?What tools do I need for codebreaking?How can I encrypt my files and email?I have a comment on this book; what should I do?Who contributed to this book?
Chapter 2: The Caesar cipher
How the Caesar cipher worksHow to detect a Caesar cipherHow to break a Caesar cipherSuccess storiesA prison inmate’s cipherA spy’s encrypted sheetAn encrypted journal from the movie The PrestigeChallengesHerbert Yardley’s first challengeA series of newspaper advertisements from 1900
Chapter 3: Simple substitution ciphers
How simple substitution ciphers workHow to detect a simple substitution cipherExample of a cipher that is not a simple substitution cipherIndex-of-coincidence techniqueHow to break a simple substitution cipherPerforming a frequency analysisGuessing frequent wordsGuessing words with unusual letter patternsSuccess storiesHow Gary Klivans broke a prison inmate’s codeHow Kent Boklan broke encrypted diary entries from the Civil WarBeatrix Potter’s diaryChallengesA prison codeA postcardAnother postcardThe Friedmans’ wedding centennial nickelAn Aristocrat from the ACAUnsolved cryptogramsAn encrypted newspaper ad from 1888The Zodiac Celebrity CypherThe Furlong postcard

Chapter 4: Simple substitution ciphers without spaces between words: Patristocrats
How a Patristocrat, a simple substitution cipher without spaces, worksHow to detect a PatristocratHow to break a PatristocratFrequency analysis using digraphsWord guessingSuccess storiesA prison messageThe Cheltenham Number StoneChallengesRudyard Kipling’s encrypted messageNSA’s second Monday ChallengeUnsolved cryptogramsThe Dorabella cryptogramThe Chinese gold bars mysteryJames Hampton’s notebook
Chapter 5: Simple substitution ciphers in non-English languages
Detecting the language usedHow to break a non-English simple substitution cipherFrequency analysis and word guessingWord pattern guessingSuccess storiesA girl’s pigpen cipher (Spanish)The La Buse cryptogram (French)A postcard with a love message (German)A Mafia message (Italian)ChallengesAn encrypted postcardThe third NSA Monday ChallengeChristlieb Funk’s challenge cryptogramUnsolved cryptogramsThe Voynich manuscriptThe cigarette case cryptogramNSA’s fourth Monday ChallengeThe Moustier altar inscriptions
Chapter 6: Homophonic ciphers
How homophonic ciphers workHow to detect a homophonic cipherHow to break a homophonic cipherSuccess storiesThe first Zodiac message (Z408)The Zodiac Killer’s second message (Z340)Ferdinand III’s lettersA postcard from HawaiiChallengesA message to the Zodiac KillerEdgar Allan Poe’s second challengeUnsolved cryptogramsBeale Papers #1 and #3The Zodiac Killer’s third message (Z13)The Zodiac Killer’s fourth message (Z32)The Scorpion cryptogramsHenry Debosnys’s messages
Chapter 7: Codes and nomenclators
CodesNomenclatorsTerminologyThe history of codes and nomenclatorsSuperencryption of codes and nomenclatorsHow to detect a code or nomenclatorHow to break a code or nomenclatorFinding the nomenclator table or codebookExploiting weaknesses of codes and nomenclatorsSolving codes and nomenclators with cribsSuccess storiesA telegram sent to Tel AvivEncrypted messages by Mary, Queen of ScotsCollinson’s search expeditionThe Japanese JN-25 codeChallengesThe Mount Everest telegramUnsolved cryptogramsThe silk dress cryptogramThe train station robbery cryptogramA Pollaky newspaper advertisementLord Manchester’s letter
Chapter 8: Polyalphabetic ciphers
How a polyalphabetic cipher worksVigenère cipherOther polyalphabetic ciphersOne-time padHow to detect a polyalphabetic cipherHow to break a polyalphabetic cipherWord guessingChecking for repeating patterns (Kasiski’s method)Using the index of coincidenceDictionary attacksTobias Schrödel’s methodOther Vigenère breaking methodsHow to break a one-time padSuccess storiesThe Diana Dors messageKryptos 1 and 2The Cyrillic ProjectorThouless’s second cryptogram from the cryptThe Smithy CodeChallengesThe Schooling challengeA German radio message from the Second World WarUnsolved cryptogramsWood’s cryptogram from the crypt
Chapter 9: Complete columnar transposition ciphers
How complete columnar transposition ciphers workHow to detect a complete columnar transposition cipherHow to break a complete columnar transposition cipherThe arrange-and-read methodVowel frequencies and multiple anagrammingSuccess storiesDonald Hill’s diaryThe Pablo Waberski spy caseChallengesThe Lampedusa messageThe Friedmans’ love messagesAn encrypted “agony” adYardley’s eleventh ciphergramEdgar Allan Poe’s first challengeAn IRA message
Chapter 10: Incomplete columnar transposition ciphers
How an incomplete columnar transposition cipher worksHow to detect an incomplete columnar transposition cipherHow to break an incomplete columnar transposition cipherSuccess storiesKryptos K3Antonio Marzi’s radio messagesChallengesYet another IRA messageThe Double Columnar Transposition Reloaded challengeUnsolved cryptogramsThe Catokwacopa ad series
Chapter 11: Turning grille transposition ciphers
How turning grille encryption worksHow to detect a turning grille encryptionHow to break a turning grille encryptionSuccess storiesPaolo Bonavoglia’s turning grille solutionAndré Langie’s turning grille solutionKarl de Leeuw’s turning grille solutionThe Mathias Sandorf cryptogramChallengesThe Friedmans’ Christmas cardJew-Lee and Bill’s CryptocablegramA MysteryTwister challengeA Kerckhoffs cryptogram
Chapter 12: Digraph substitution
How general digraph substitution worksHow the Playfair cipher worksHow to detect a general digraph substitutionHow to detect a Playfair cipherHow to break a digraph substitutionFrequency analysisDictionary attacksManual attacksSuccess storiesThouless’s first messageThouless’s third messageChallengesThe cryptogram in National Treasure: Book of SecretsUnsolved cryptogramsThe world record digraph challengeThe world record Playfair challenge
Chapter 13: Abbreviation ciphers
How abbreviation ciphers workHow to detect an abbreviation cipherHow to break an abbreviation cipherSuccess storiesEmil Snyder’s bookletChallengesA birthday cardUnsolved cryptogramsThe Tamám Shud mysteryTwo unsolved postcards
Chapter 14: Dictionary codes and book ciphers
How dictionary codes and book ciphers workHow to detect a dictionary code or book cipherHow to break a dictionary code or book cipherIdentifying the book or dictionaryReconstructing the dictionaryTreating a book cipher like a simple substitution cipherSuccess storiesThe FIDES adsNicholas Trist’s key bookHow William Friedman broke a Hindu conspiracy encryptionA dictionary code message sent to Robert E. LeeChallengesDan Brown’s book cipher challengeA dictionary code challengeUnsolved cryptogramsTwo encrypted newspaper advertisements from 1873
Chapter 15: Additional encryption methods
Cipher toolsVoice encryptionCode talkingShorthand (stenography)Hidden messages (steganography)Success story: How Elonka found a hidden message on a tombstoneSuccess story: Deciphering SteganographiaSuccess story: Mysterious Stranger messageChallenge: Another steganographic message by the FriedmansCipher machines
Chapter 16: Solving ciphers with hill climbing
Solving simple substitution ciphers with hill climbingSimulated annealingSuccess story: Bart Wenmeckers’s solution to the Baring-Gould cryptogramSuccess story: The Florida murder case cryptogramSolving a homophonic cipher with simulated annealingSuccess story: Dhavare, Low, and Stamp’s Zodiac Killer solutionsSolving a Vigenère cipher with hill climbingSuccess story: Jim Gillogly’s solution to IRA Vigenère cryptogramsSolving a columnar transposition with hill climbingSuccess story: Jim Gillogly’s solution to IRA transposition cryptogramsSuccess story: Richard Bean’s solution to the last unsolved IRA cryptogramSuccess story: George Lasry’s solution of the double columnar transposition challengeSolving a turning grille cipher with hill climbingSuccess story: Bart Wenmeckers’s solution to a turning grille cryptogramSuccess story: Armin Krauss’s solution to a turning grille challengeSolving a general digraph substitution with hill climbingSuccess story: Some digraph challengesSolving a Playfair cipher with hill climbingSuccess story: Dan Girard’s solution to the Cheltenham Letter StoneSuccess story: Playfair world recordsSolving machine ciphers with hill climbingSuccess story: Breaking original Enigma messages
Chapter 17: What next?
More unsolved cryptogramsThe fourth Kryptos message (K4)The Rubin cryptogramRicky McCormick’s encrypted notesThe carrier pigeon message from World War IIThe encrypted NKRYPT pillarsEven more unsolved cryptogramsCodebreaking toolsOther books about codebreakingWebsites about codebreakingJournals and newslettersEvents
Appendix A: Kryptos
Appendix B: Useful language statistics
Appendix C: Glossary
Appendix D: Morse code
Appendix E: Figure sources
Appendix F: References
Index

Content preview from Codebreaking

16 Solving ciphers with hill climbing

Many of the encryption methods introduced in this book can be broken with a strategy called hill climbing. Computer scientists developed this technique to solve certain kinds of optimization problems, most of which are not crypto related. It is well suited, for instance, to finding the shortest route that includes certain cities or determining the most efficient configuration of a production facility. The method is named “hill climbing” because it aims to improve a given configuration iteratively, until the “top of the mountain” is reached and no further improvement is possible, as represented in Figure ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781098163457

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Codebreaking

by Elonka Dunin, Klaus Schmeh

16 Solving ciphers with hill climbing

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.