book

The Shape of Data

by Colleen M. Farrelly, Yaé Ulrich Gaba

September 2023

Intermediate to advanced

264 pages

7h 27m

English

No Starch Press

Read now

Unlock full access

Praise for The Shape of Data
Title Page
Copyright
Dedication
About the Authors
Foreword
Acknowledgments
Introduction
Who Is This Book For?About This BookDownloading and Installing RInstalling R PackagesGetting Help with RSupport for Python UsersSummary
Chapter 1: The Geometric Structure of Data
Machine Learning CategoriesSupervised LearningUnsupervised LearningMatching Algorithms and Other Machine LearningStructured DataThe Geometry of Dummy VariablesThe Geometry of Numerical SpreadsheetsThe Geometry of Supervised LearningUnstructured DataNetwork DataImage DataText DataSummary
Chapter 2: The Geometric Structure of Networks
The Basics of Network TheoryDirected NetworksNetworks in RPaths and Distance in a NetworkNetwork Centrality MetricsThe Degree of a VertexThe Closeness of a VertexThe Betweenness of a VertexEigenvector CentralityPageRank CentralityKatz CentralityHub and AuthorityMeasuring Centrality in an Example Social NetworkAdditional Quantities of a NetworkThe Diversity of a VertexTriadic ClosureThe Efficiency and Eccentricity of a VertexForman–Ricci CurvatureGlobal Network MetricsThe Interconnectivity of a NetworkSpreading Processes on a NetworkSpectral Measures of a NetworkNetwork Models for Real-World BehaviorErdös–Renyi GraphsScale-Free GraphsWatts–Strogatz GraphsSummary

Chapter 3: Network Analysis
Using Network Data for Supervised LearningMaking Predictions with Social Media Network MetricsPredicting Network Links in Social MediaUsing Network Data for Unsupervised LearningApplying Clustering to the Social Media DatasetCommunity Mining in a NetworkComparing NetworksAnalyzing Spread Through NetworksTracking Disease Spread Between TownsTracking Disease Spread Between WindsurfersDisrupting Communication and Disease SpreadSummary
Chapter 4: Network Filtration
Graph FiltrationFrom Graphs to Simplicial ComplexesExamples of Betti NumbersThe Euler CharacteristicPersistent HomologyComparison of Networks with Persistent HomologySummary
Chapter 5: Geometry in Data Science
Common Distance MetricsSimulating a Small DatasetUsing Norm-Based Distance MetricsComparing Diagrams, Shapes, and Probability DistributionsK-Nearest Neighbors with Metric GeometryManifold LearningUsing Multidimensional ScalingExtending Multidimensional Scaling with IsomapCapturing Local Properties with Locally Linear EmbeddingVisualizing with t-Distributed Stochastic Neighbor EmbeddingFractalsSummary
Chapter 6: Newer Applications of Geometry in Machine Learning
Working with Nonlinear SpacesIntroducing dgLARSPredicting Depression with dgLARSPredicting Credit Default with dgLARSApplying Discrete Exterior DerivativesNonlinear Algebra in Machine Learning AlgorithmsComparing Choice Rankings with HodgeRankSummary
Chapter 7: Tools for Topological Data Analysis
Finding Distinctive Groups with Unique BehaviorValidating Measurement ToolsUsing the Mapper Algorithm for Subgroup MiningStepping Through the Mapper AlgorithmUsing TDAmapper to Find Cluster Structures in DataSummary
Chapter 8: Homotopy Algorithms
Introducing HomotopyIntroducing Homotopy-Based RegressionComparing Results on a Sample DatasetSummary
Chapter 9: Final Project: Analyzing Text Data
Building a Natural Language Processing PipelineThe Project: Analyzing Language in PoetryTokenizing Text DataTagging Parts of SpeechNormalizing VectorsAnalyzing the Poem Dataset in RUsing Topology-Based NLP ToolsSummary
Chapter 10: Multicore and Quantum Computing
Multicore Approaches to Topological Data AnalysisQuantum Computing ApproachesUsing the Qubit-Based ModelUsing the Qumodes-Based ModelUsing Quantum Network AlgorithmsSpeeding Up Algorithms with Quantum ComputingUsing Image Classifiers on Quantum ComputersSummary
References
Index

Content preview from The Shape of Data

9 Final Project: Analyzing Text Data

In this chapter, we’ll put together some of the tools developed in previous chapters by working on a project related to linguistics and psychology. Many important data projects today deal with text data, from text matching to chatbots to customer sentiment analysis to authorship discernment and linguistic analysis. We’ll look at a small dataset of linguistic features derived from different creative writing samples to see how language usage varies over genres; some genres encourage a different writing process that reflects a different author mindset, such as writing a personal essay versus writing a spontaneous ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781098156886

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

The Shape of Data

by Colleen M. Farrelly, Yaé Ulrich Gaba

9 Final Project: Analyzing Text Data

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.