book

Unifying Business, Data, and Code

by Ron Itelman, Juan Cruz Viotti

January 2024

Intermediate to advanced

356 pages

9h 53m

English

O'Reilly Media, Inc.

Audio summary available

Read now

Unlock full access

Includes

Quizzes

Preface
What You Can’t See Can Kill You, and the Same Is True for DataHidden Threats to Organizations: A Modern ParallelYour AI Is Only as Good as Your DataAligning Problem-Solving Strategies, Data, and AIA New Paradigm to Optimize Data Management and Business Strategy for the Age of AIThe Origin Story of UnifyingOrchestrating Alignment at Organizational ScaleConventions Used in This BookO’Reilly Online LearningHow to Contact UsAcknowledgments
1. The Need for a Unifying Data Strategy
Your Quest for Data-Driven Breakthroughs Begins There Are Usually Multiple, Conflicting North StarsThe Good, the Bad, and the Ugly of Data ProblemsThe Problem with ProblemsUnifying Concepts: The Key to InnovationWhat a Unifying Data Strategy Will Do for AgileDefining Being AgileAgile TheaterAgile, Waterfall, and UnifyingDefining a Unifying Data Strategy ApproachUnderstanding the Phrase Being Data DrivenTo Be Data Driven, Be Data CentricBottlenecks Preventing Teams from Being Data DrivenThis Book’s Project: Intelligence.AI Coffee BeansSummary
2. The Lingua Franca of Data: JSON
Introducing JSONA Simple JSON ExampleJSON Viewing and Authoring ToolsOverview of JSON GrammarBooleansNumbersStringsArraysObjectsNullLearning MoreMinificationAlternative RepresentationsCreating a JSON DocumentA Product EntryA Store OrderSummary
3. Data-Centric Innovation: A Guide for Data Champions
Data Transformations Require Data ChampionsThe Rise of the Data Product ManagerAlignment Is a Journey, Not a DestinationEvaluating Alignment from a Holistic PerspectiveThe Goal Isn’t Alignment, It’s Effective AlignmentStrategies for Setting Up Teams for SuccessIncorporating a Product Management MindsetDefining Data Users’ NeedsDefining Product FeaturesDefining and Measuring SuccessUnifying Versus AligningSummary
4. Concept-First Design for Data Products
Packaging and Products: An Example Using CoffeeThe Four Facets of a Data ProductGetting Started with Concept-First DesignA Blueprint for UnifyingMapping the Conceptual Terrain: Assessing ConceptsFacilitating Assessments of Conceptual Alignment Across Technical and Nontechnical TeamsSmooth Is Slow, Slow Is FastSummary
5. A Universal Language for Data
What Is JSON Schema?What Is a Schema?The Building Blocks of JSON SchemaVocabularies and DialectsMeta-Schemas: Schemas That Describe Other SchemasUnderstanding JSON SchemasStep 1: Determining the Schema Dialect: The $schema KeywordStep 2: Determining the Schema VocabulariesStep 3: Understanding Schema VocabulariesStep 4: Understanding Schema KeywordsJSON Schema as a Recursive Data StructureReferencing SchemasWhat does duplication look like?Local referencingRemote referencingYour First JSON Schema ProjectWriting a Schema: Step by StepGenerating a Web FormSummary
6. The Art of Alignment
Enemies of Alignment: Ambiguity and AssumptionsAmbiguity: The Culprit in the Illusion of CommunicationAssumptions: Ambiguity’s Best FriendDefining Success: Symmetry Between Concepts and JSON Schema Equals Minimal AmbiguityIlluminating Misalignment with a Concept CompassStep 1: Harmonizing the WhatStep 2: Harmonizing the WayStep 3: Harmonizing the HowHarmonized Concepts Validating Concepts: Belief Scoring and HypotheticalsCounterfactualsBelief ScoringSummary
7. The Science of Synchronization
An Introduction to Thinking in NetworksExample of Thinking in Networks: Athletes Versus ArtistsGraphs: The Visual Language of NetworksNetworks of Entities: Knowledge GraphsA Simple Knowledge GraphChallenges with Knowledge GraphsAligning Knowledge for the 99%Fundamentals of CLEAN Data GovernanceCollaborationKnowledgeBusiness LogicActivityCLEAN Data Governance in PracticeThe Four Facets of Data Products and CLEANThe Four Horsemen of Data DeathIgnoranceSiloed IncentivesShortsightednessIndecisivenessThe Power of Design in Collaborative NetworksSummary
8. The Two Fundamental Operations of Schemas
Validating the Structure of DataUsing an Online ValidatorValidation ExampleJSON Schema as a Constraints LanguageBoolean SchemasHeterogeneous Data StructuresThe format KeywordUsing Annotations to Define MeaningAnnotation Extraction ExampleA Simple Use Case: DeprecationsRuntime ExtractionStandard Output FormatsRevisiting the format KeywordUsing an Online ValidatorThinking in SchemasSummary
9. Illuminating Pathways of Acceleration
How Ambiguity, Knowledge Gaps, and Blind Spots Influence Decisions and Progress Toward GoalsWhich Is Bigger: Greenland or the US?Mapping Pathways of Processes and ProgressMeasuring Progress Toward GoalsDefining Decisions and Steps with Process MapsHow Process Maps Reveal AmbiguityVisualizing and Removing Ambiguity in ProcessesEnriching Process Maps with AnnotationsProcess Maps Reveal Innovation OpportunitiesSummary

10. Spectrums of Success
An Introduction to Knowledge FrameworksKnowledge Experiences and PathwaysA Tool for Designing Knowledge ExperiencesFrom Structured Knowledge to Computational KnowledgeSuccess SpectrumsMapping Progress and ValueVisualizing and Adding “Next Best States” Removing Blind SpotsEmbracing Multiperspective Design and Road MapsDefining KPIs for Success Measures and Metrics (Assessments)Using Demons and Magical Thinking for InnovationFaster HorsesImagining Magical PossibilitiesProblem Landscapes: Quantifying Pain Points Threatening ValueNudges: The Right Information at the Right TimeA Real-Life Problem Landscape and Demon Example That Led to a Unified Data Product ModelUnderstanding the Problem LandscapeThe Staggering ImpactA Meeting of Minds and the Birth of a SolutionBeyond Data Products: Data Product ManagementThe Circular Nature of UnifyingSummary
11. Deploying a JSON Schema Registry
Schemas Over HTTPStep 1: Setting Up a GitHub RepositoryCreating a GitHub RepositoryUploading Your First SchemaStep 2: Deploying to Cloudflare PagesCreating a New Cloudflare Pages Website ProjectStep 3: Configuring HTTP HeadersInspecting the Current HTTP HeadersDeclaring Custom HTTP Headers on Cloudflare PagesChecking the ResultsStep 4: Creating a Landing PageAdding an HTML Entry PointStep 5: Adding a Custom DomainConfiguring a Custom Domain in Cloudflare PagesSetting Up a CNAME DNS RecordChecking the ResultsBest PracticesSchemas Are ImmutableAdopt a Versioning StrategySummary
12. Designing Data Products Using JSON Schema
First Facet: DataAn Example CSV DatasetA JSON Row RepresentationSecond Facet: StructureGeneral-Purpose ConceptsApplication-Specific ConceptsDataset EntriesThe Dataset SchemaThird Facet: MeaningTimestampIP AddressEmailUS StateCurrencyPriceMilestoneAnalytics EntryFourth Facet: ContextThe Signup Analytics SchemaSummaryAutomated Schema ExtractionNext Steps
13. Extending JSON Schema
Simple Case: Unknown KeywordsExtracting Unknown Keywords as AnnotationsPros and Cons of This ApproachComplex Case: Authoring VocabulariesThe JSON Schema Vocabulary SystemStep 1: Writing a SpecificationStep 2: Writing a Vocabulary Meta-SchemaStep 3: Extending an ImplementationConsuming VocabulariesDefining a DialectMaking Use of the DialectExample: Extracting Annotations with HyperjumpSummary
14. Introducing JSON Unify
Introducing the Dataset VocabularyRevisiting the Signup Analytics ExampleJSON Schema BundlingThe Bundling ProcessBundling Our Example Data ProductReferencing Remote DataThe Problem of Streaming JSONIntroducing JSON LinesExtracting MeaningA Simple ExampleUsing Logic OperatorsThe Signup Analytics ExampleDataset LineageFilteringTransformingAggregationSummary
15. Principles of Designing Intelligence
Your Unifying Journey So FarA Constellation of Deeper Principles Guides Unifying1. The Principle of AlignmentTransforming the Abstract to ConcreteWhat You See Can Kill You, and the Same Is True in Data2. The Principle of InformationUnderstanding Uncertainty3. The Principle of LearningDefining LearningDefining Errors4. The Principle of Integrated SimplicityComplexity ReductionDecompositionCompressionMemoizationIntegrating in Communication Networks5. The Principle of ContinuumsMaking Things MeasurableThe Dangers of Misusing MeasurementsA Continuum Example for a Control Strategy Problem6. The Principle of State TransitionsA Simple State MachineSimplifying State Transitions7. The Principle of Decidability What Is Decidability?Two Key Approaches to Problem SolvingMaking Informed DecisionsReal-World Decidability to Reduce Misalignment in Teams8. The Principle of HeuristicsAwareness and Ethical ConsiderationsConnection to Decision Making in Business9. The Principle of MasteryLevels of Mastery in KnowledgeStrategies for Mastery10. The Principle of WisdomSummary
16. Toward Unified Intelligence
Functional Artificial IntelligenceYour AI Is Only as Good as Your DataBeware Illusions Within Vetting ProcessesQuestion AssumptionsCollective IntelligenceCollaborative IntelligenceUnified IntelligenceCollaborative Learning NetworksPersonalized KnowledgeAnticipatory Design: Personalization and Digital TwinsCodifying Principles of IntelligenceContinuous Human–Machine Learning LoopsApplying Wisdom in PracticeConceptual ZoomabilityWisdom Graphs: Connecting Concepts, Actions, and OutcomesCognitive Primitives: Standardizing Cognitive Experience DesignThe Value of UnifyingPrioritize Knowledge Before AIA Tale of Simple Knowledge Versus Complex IntelligenceFollow the Principle of Integrated SimplicitySummaryGoing Beyond This Book
Index
About the Authors

Content preview from Unifying Business, Data, and Code

About the Authors

Ron Itelman is cofounder of Intelligence.AI, which aims to help organizations align their business and data strategies for a scientific approach to innovation. Ron previously worked on Personalized Learning & Analytics and Computational Psychometrics in education, and Collaborative Intelligence in Life Sciences and BioPharma.

Juan Cruz Viotti is a computer scientist with ample experience in IoT and systems programming. He graduated from the University of Oxford, and his research led to the proposal of an award-winning novel data serialization technology: JSON BinPack. He currently researches data interchange technologies at his own research lab: Sourcemeta, leads the Desktop Engineering team at Postman, and collaborates in the JSON Schema organization. Juan previously served as the Engineering Lead at Balena.

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Unlock Complex and Streaming Data with Declarative Data Pipelines

Publisher Resources

ISBN: 9781098144999Errata Page

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Unifying Business, Data, and Code

by Ron Itelman, Juan Cruz Viotti

About the Authors

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.