Implementing a Smart Data Platform

Implementing a Smart Data Platform

by Yifei Lin, Wenfeng Xiao
Released July 2017
Publisher(s): O'Reilly Media, Inc.
ISBN: 9781491983485

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

With the big data boom, the rise of the Internet of Things (IoT), and the development of artificial intelligence (AI) applications, we’ve entered a new era of smart data. Unfortunately, not many enterprises are ready for it. Some companies are deficient in data management, while others lack standard data engineering systems. Some simply lag behind in data science.

The bottom line is that many enterprises have no advanced technical platform for building IoT-driven AI applications. But there is a practical solution.

This report examines how the Smart Data Platform, or SmartDP, enables enterprises to enhance their capacities in data management, data engineering, and data science. Authors Yifei Lin and Xiao Wenfeng of TalkingData describe a complete SmartDP solution that involves data, platform products, data applications, and consulting services—components that together can supplement and strengthen your current data platforms.

Explore SmartDP from concept to practice and discover how implementing this solution will allow your organization to achieve new business value.

Table of contents

  1. 1. The Advent of the Smart Data Era
    1. Three Elements of the Smart Data Era: Data, AI, and Human Wisdom
  2. 2. Challenges of the Smart Data Era for Enterprises
    1. Challenges in Data Management
    2. Challenges in Data Engineering
    3. Challenges in Data Science
    4. Challenges in Technical Platform
  3. 3. The Advent of Smart Enterprises and SmartDP
  4. 4. Data Management, Data Engineering, and Data Science Overview
    1. Data Management
      1. Metadata Management
      2. Data Quality Management
      3. Data Security Management
    2. Data Engineering
      1. Implementation Flow of Data Engineering
      2. Data Acquisition
      3. Data Organization
      4. Data Analytics
      5. Action
      6. Roles of the Data Engineering Team
    3. Data Science
  5. 5. SmartDP Solutions
    1. Data Market
    2. Platform Products
      1. Data Management
      2. Data Engineering
      3. Data Science
    3. Data Applications
    4. Consulting and Services
      1. Relationship of SmartDP with Existing Data Platforms
      2. Commercial Models of SmartDP
  6. 6. SmartDP Reference Architecture
    1. Data Layer
      1. Self-Owned Data
      2. Third-Party Data
    2. Data Access Layer
    3. Infrastructure Layer
      1. Data Storage
      2. Data Computing
      3. Data Science
      4. Workflow Management
      5. Message and Service Bus
    4. Data Application Layer
      1. Data Catalog
      2. Data Factory
      3. Business Applications
    5. Operation Management Layer
      1. Business Operations
      2. Data Operations
      3. Technical Operations
  7. 7. Case Studies
    1. SmartDP Drives Growth in Banks
      1. Multisource Data Concentration and ETL
      2. Contextual Data Labels and Data Management
      3. Machine Learning and Data Application
      4. Application Contexts
    2. Real Estate Development Groups Integrate Online and Offline Marketing with SmartDP
    3. Common Market Practices and Disadvantages
    4. Methodology
    5. Description of the Overall Plan
      1. Data Harvest and Organization
      2. Data Analytics and Strategy Formulation
    6. Conclusion

Product information

  • Title: Implementing a Smart Data Platform
  • Author(s): Yifei Lin, Wenfeng Xiao
  • Release date: July 2017
  • Publisher(s): O'Reilly Media, Inc.
  • ISBN: 9781491983485