Intro to Python for Computer Science and Data Science: Learning to Program with AI, Big Data and The Cloud

8.9 Splitting and Joining Strings

When you read a sentence, your brain breaks it into individual words, or tokens, each of which conveys meaning. Interpreters like IPython tokenize statements, breaking them into individual components such as keywords, identifiers, operators and other elements of a programming language. Tokens typically are separated by whitespace characters such as blank, tab and newline, though other characters may be used—the separators are known as delimiters.

Splitting Strings

We showed previously that string method split with no arguments tokenizes a string by breaking it into substrings at each whitespace character, then returns a list of tokens. To tokenize a string at a custom delimiter (such as each comma-and-space ...