SAS Data Integration Studio 4.9

SAS Data Integration Studio 4.9

by SAS Documentation
Released August 2014
Publisher(s): SAS Institute
ISBN: 9781629593104

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Describes the main tasks that you can perform in SAS Data Integration Studio, including: data access; data integration; metadata management; data cleansing and enrichment; extract, transform, and load (ETL); extract, load, and transform (ELT); and service-oriented architecture (SOA) and message queue integration.

Table of contents

  1. Contents (1/2)
  2. Contents (2/2)
  3. What's New in SAS Data Integration Studio 4.9
    1. Overview
    2. New Source Designer Wizard for Cloudera Impala
    3. High Performance Analytics Transformations Are Now Production
    4. Enterprise Decision Management Transformation Is Now Production
    5. Support Added for SAS Lineage
    6. Code Generation Supports Credential Lookup for DataFlux Authentication Servers
    7. SAS Package Wizards Have Better Support for DataFlux Data Management Server
  4. Introduction
    1. Overview of SAS Data Integration
      1. About SAS Data Integration
      2. Advantages of SAS Data Integration
      3. A Basic Data Integration Environment
        1. Overview of a Data Integration Environment
        2. SAS Management Console
        3. SAS Data Integration Studio
        4. Servers
        5. Libraries
        6. Additional Information
      4. How to Get Help for SAS Data Integration Studio
      5. Installing SAS Data Integration Studio
      6. Administrative Documentation for SAS Data Integration Studio
      7. Accessibility Features in SAS Data Integration Studio
        1. Overview
        2. Enabling Assistive Technologies
        3. Accessibility Standards
  5. General User Tasks
    1. Getting Started
      1. Security for SAS Data Integration Studio
        1. Overview of Security
        2. Authorization Tab
      2. Main Tasks for Creating Process Flows
      3. Starting SAS Data Integration Studio
        1. Problem
        2. Solution
        3. Tasks
      4. Connecting to a SAS Metadata Server
        1. Problem
        2. Solution
        3. Tasks
      5. Working with the Folders Tree
        1. Overview of the Folders Tree
        2. Add a Folder
        3. Add Metadata Objects to a Folder
        4. Copy to Folder
        5. Drag to Folder
        6. Move to Folder
        7. Rename a Folder
        8. Considerations When You Change a Folder Path
      6. Selecting a Default SAS Application Server
        1. Problem
        2. Solution
        3. Tasks
      7. Registering SAS Libraries
        1. Problem
        2. Solution
        3. Tasks
      8. Working with User-Defined Formats
        1. Problem
        2. Solution
        3. Tasks
      9. Registering Tables and Cubes
        1. Problem
        2. Solution
        3. Tasks
      10. Overview of Transformations (1/3)
      11. Overview of Transformations (2/3)
      12. Overview of Transformations (3/3)
        1. Introduction to Transformations
        2. Overview of the Transformations Tree
        3. Access Folder
        4. Analysis Folder
        5. Archived Folder
        6. Change Data Capture Folder
        7. Control Folder
        8. Data Folder
        9. Data Quality Folder
        10. Hadoop Folder
        11. High-Performance Analytics Folder
        12. Output Folder
        13. Publish Folder
        14. SPD Server Dynamic Cluster Folder
        15. SQL Folder
        16. Ungrouped Folder
      13. Working with Stored Processes
        1. Overview
        2. View the Version Number for a Stored Process
        3. Deploy a Job as a Version 1.0 or Version 2.0 Stored Process
        4. Create a Version 2.0 Stored Process
        5. Convert a Stored Process from One Version to Another
      14. Working with Web Services
      15. Specifying Global Options in SAS Data Integration Studio
        1. Problem
        2. Solution
        3. Tasks
      16. Working with Change Management
        1. Problem
        2. Solution
        3. Tasks
      17. Search Metadata
        1. Problem
        2. Solution
        3. Tasks
      18. Add a Note or Document to a Registered Object
        1. Problem
        2. Solution
        3. Tasks
      19. View the Content of Notes or Documents
        1. Problem
        2. Solution
        3. Tasks
    2. Importing, Exporting, and Copying Metadata
      1. Metadata Import and Export in SAS Data Integration Studio
      2. Working with SAS Package Metadata
        1. About Importing and Exporting SAS Package Metadata
        2. Objects That Can Be Imported and Exported in SAS Package Format
      3. Preparing to Import or Export SAS Package Metadata
        1. General Preparation
        2. Preparing to Export and Import Jobs with Data Quality Transformations
      4. Exporting SAS Package Metadata
        1. Problem
        2. Solution
        3. Tasks
      5. Importing SAS Package Metadata
        1. Problem
        2. Solution
        3. Tasks
        4. Usage Notes
      6. Copying and Pasting Metadata Objects
        1. Problem
        2. Solution
        3. Tasks
        4. Usage Notes
      7. Working with SAS Metadata Bridges
        1. About SAS Metadata Bridges
        2. Objects That Can be Imported or Exported with a SAS Metadata Bridge
      8. Usage Notes for Importing or Exporting with a SAS Metadata Bridge
      9. Preparing to Import or Export with a SAS Metadata Bridge
      10. Importing New Metadata with a SAS Metadata Bridge
        1. Problem
        2. Solution
        3. Tasks
      11. Importing Updated Metadata with a SAS Metadata Bridge
        1. Problem
        2. Solution
        3. Tasks
      12. Exporting Metadata with a SAS Metadata Bridge
        1. Problem
        2. Solution
        3. Tasks
    3. Working with Tables
      1. About Tables
      2. Registering Existing Tables with the Register Tables Wizard
        1. Problem
        2. Solution
        3. Tasks
      3. Registering New Tables with the New Table Wizard
        1. Problem
        2. Solution
        3. Tasks
      4. Viewing or Updating Table Metadata
        1. Problem
        2. Solution
      5. Using a Physical Table to Update Table Metadata
        1. Problem
        2. Solution
        3. Tasks
        4. Usage Note
      6. Specifying Options for Tables
        1. Problem
        2. Solution
        3. Tasks
      7. Supporting Case and Special Characters in Table and Column Names
        1. Overview
        2. About Case and Special Characters in SAS Names
        3. About Case and Special Characters in DBMS Names
        4. Set Default Name Options for New Tables
        5. Set Name Options in the Register Tables Wizard
        6. Set Name Options for Registered Tables
      8. Maintaining Column Metadata (1/2)
      9. Maintaining Column Metadata (2/2)
        1. Problem
        2. Solution
        3. Tasks
      10. Standardizing Columns (1/2)
      11. Standardizing Columns (2/2)
        1. Problem
        2. Solution
        3. Tasks
      12. Maintaining Keys
        1. Problem
        2. Solution
        3. Tasks
      13. Maintaining Indexes
        1. Problem
        2. Solution
        3. Tasks
      14. Browsing Table Data
        1. Problem
        2. Solution
        3. Tasks
      15. Editing SAS Table Data
        1. Problem
        2. Solution
        3. Tasks
      16. Using the View Data Window to Create a SAS Table
        1. Problem
        2. Solution
        3. Tasks
      17. Specifying Browse and Edit Options for Tables and External Files
        1. Problem
        2. Solution
    4. Working with External Files
      1. About External Files
      2. Registering a Delimited External File
        1. Problem
        2. Solution
        3. Tasks
      3. Registering a Fixed-Width External File
        1. Problem
        2. Solution
        3. Tasks
      4. Registering an External File with User-Written Code
        1. Problem
        2. Solution
        3. Tasks
      5. Viewing or Updating External File Metadata
        1. Problem
        2. Solution
      6. Overriding the Code Generated by the External File Wizards
        1. Problem
        2. Solution
        3. Tasks
      7. Specifying NLS Support for External Files
        1. Problem
        2. Solution
        3. Tasks
      8. Accessing an External File with an FTP Server or an HTTP Server
        1. Problem
        2. Solution
        3. Tasks
        4. Additional Information
      9. Viewing Data in External Files
        1. Problem
        2. Solution
        3. Tasks
      10. Registering a COBOL Data File That Uses a COBOL Copybook
        1. Problem
        2. Solution
        3. Tasks
      11. Using an External File in the Process Flow for a Job
        1. Problem
        2. Solution
        3. Tasks
      12. Using a Format File to Register a Fixed-Width External File
        1. Problem
        2. Solution
        3. Tasks
    5. Creating Jobs
      1. About Jobs
        1. Jobs with Generated Source Code
        2. Jobs with User-Supplied Source Code
        3. Run Jobs
        4. Manage Submitted Jobs
      2. Creating an Empty Job
        1. Problem
        2. Solution
        3. Tasks
      3. Creating a Process Flow for a Job
        1. Problem
        2. Solution
        3. Tasks
      4. Creating a Job That Contains Jobs
        1. Problem
        2. Solution
        3. Tasks
      5. Working with Default Temporary Output Tables
        1. Problem
        2. Solution
        3. Tasks
      6. Specifying Options for Jobs
      7. Documenting Process Flow Diagrams
        1. Problem
        2. Solution
        3. Tasks
      8. Accessing Local and Remote Data
        1. Data Access Overview
        2. Access Data in the Context of a Job
        3. Access Data Interactively
        4. Use a Data Transfer Transformation
      9. Viewing or Updating Job Metadata
        1. Problem
        2. Solution
        3. Tasks
      10. Displaying the SAS Code for a Job
        1. Problem
        2. Solution
        3. Tasks
      11. Common Code Generated for a Job
        1. Overview
        2. LIBNAME Statements
        3. SYSLAST Macro Statements
        4. Remote Connection Statements
        5. Macro Variables for Status Handling
        6. User Credentials in Generated Code
    6. Managing Jobs
      1. About Managing Jobs
      2. Submitting a Job for Immediate Execution
        1. Problem
        2. Solution
        3. Tasks
      3. Meeting Prerequisites for Collecting Job Statistics
      4. Reviewing a Successful Job
        1. Problem
        2. Solution
        3. Tasks
      5. Diagnosing and Correcting an Unsuccessful Job
        1. Problem
        2. Solution
        3. Tasks
      6. Adding a Transformation to an Existing Job
        1. Problem
        2. Solution
        3. Tasks
      7. Understanding the Job Has Changed Warning
      8. Understanding the Crossed Versions in a Job Warning
      9. Displaying Run-Time Statistics in SAS Job Monitor
        1. Overview
        2. Prerequisites for Monitoring Jobs in SAS Job Monitor
      10. Displaying Run-Time Statistics in SAS Web Report Studio or the SAS Stored Process Server
      11. Maintaining Column Mappings
        1. Problem
        2. Solution
        3. Tasks
      12. Managing the Scope of Column Changes in Jobs
        1. Problem
        2. Solution
        3. Tasks
      13. Managing Connections in Job Editor Windows
        1. Problem
        2. Solution
        3. Tasks
      14. Viewing the Code for a Transformation
        1. Problem
        2. Solution
        3. Tasks
      15. Specifying Options for Transformations
        1. Problem
        2. Solution
      16. Redirecting Temporary Output Tables
        1. Problem
        2. Solution
        3. Tasks
      17. Pushing ELT Job Code Down to a Database
        1. Problem
        2. Solution
      18. Using a Web Client to Orchestrate Jobs
        1. Problem
        2. Solution
    7. Restarting Jobs From Checkpoints
      1. About Restarting Jobs
      2. Prerequisites for Restarting Jobs
      3. Adding Checkpoints to a Job
        1. Problem
        2. Solution
        3. Tasks
      4. Restarting a Job
        1. Problem
        2. Solution
        3. Tasks
    8. Managing the Status of Jobs and Transformations
      1. About Status Handling for Jobs and Transformations
      2. Default Conditions, Actions, and Conditional Action Sets
        1. Overview
        2. Default Conditions
        3. Default Actions
        4. Conditional Action Sets
      3. Prerequisites for Actions
      4. Perform Actions Based on the Status of a Job
        1. Problem
        2. Solution
        3. Tasks
      5. Perform Actions Based on the Status of a Transformation
        1. Problem
        2. Solution
        3. Tasks
      6. Macro Variables for Status Handling (1/2)
      7. Macro Variables for Status Handling (2/2)
        1. Overview
        2. Example: Macro Variables for Status Handling in Generated Code
        3. Macro Variables for Status Handling in User-Written Code
    9. Deploying Jobs
      1. About Deploying Jobs
      2. About Deploying Jobs for Scheduling
      3. Prerequisites for Deploying a Job for Scheduling
      4. Deploying Jobs for Scheduling
        1. Problem
        2. Solution
        3. Tasks
      5. Using a Command Line to Deploy Jobs
        1. Problem
        2. Solution
        3. Tasks
      6. Redeploying Jobs for Scheduling
        1. Problem
        2. Solution
        3. Tasks
      7. Using Scheduling to Handle Complex Process Flows
        1. Problem
        2. Solution
        3. Tasks
      8. Using Deploy for Scheduling to Execute Jobs on a Remote Host
        1. Problem
        2. Solution
        3. Tasks
      9. About Deploying Jobs as Stored Processes
      10. Prerequisites for Deploying a Job as a Stored Process
        1. For Administrators
        2. For Users
      11. Deploying Jobs as Stored Processes
        1. Problem
        2. Solution
        3. Tasks
      12. Redeploying Jobs to Stored Processes
        1. Problem
        2. Solution
        3. Tasks
      13. Viewing or Updating Stored Process Metadata
        1. Problem
        2. Solution
        3. Tasks
      14. About Deploying Jobs as Web Services
      15. Prerequisites for Web Service Jobs
        1. For Administrators
        2. For Users
      16. Requirements for Web Service Jobs
      17. Creating a Web Service Job
        1. Problem
        2. Solution
        3. Tasks
      18. Deploying a Web Service Job as a Stored Process
        1. Problem
        2. Solution
        3. Tasks
      19. Deploying a Stored Process as a Web Service
        1. Problem
        2. Solution
        3. Tasks
    10. Working with Versions
      1. About Versions
      2. Prerequisites for Version Control
        1. Overview
        2. Usage Notes
      3. Example Setup for an Apache Subversion (SVN) Server
        1. Overview
        2. Remove the CVS Plug-in
        3. Install and Configure the Apache Subversion (SVN) Server
        4. Specify the SVN Server on the SVN Plug-in Tab
      4. Creating a Version
        1. Problem
        2. Solution
        3. Tasks
      5. Reviewing and Managing Versions
        1. Problem
        2. Solution
        3. Tasks
      6. Comparing Versions
        1. Problem
        2. Solution
        3. Tasks
    11. Working with Generated Code
      1. About Code Generated for Jobs
        1. Overview
        2. LIBNAME Statements
        3. SYSLAST Macro Statements
        4. Remote Connection Statements
        5. Macro Variables
        6. User Credentials in Generated Code
      2. Displaying the Code Generated for a Job
        1. Problem
        2. Solution
        3. Tasks
      3. Displaying the Code Generated for a Transformation
        1. Problem
        2. Solution
        3. Tasks
      4. Specifying Options for Jobs
        1. Problem
        2. Solution
        3. Tasks
      5. Specifying Options for a Transformation
        1. Problem
        2. Solution
        3. Tasks
      6. Modifying Configuration Files or SAS Start Commands for Application Servers
    12. Working with User-Written Code
      1. About User-Written Code
      2. Adding User-Written Code to the Precode and Postcode Tab
        1. Problem
        2. Solution
        3. Tasks
      3. Adding a User Written Code Transformation to a Job
        1. Problem
        2. Solution
        3. Tasks
      4. Creating and Using a Generated Transformation (1/2)
      5. Creating and Using a Generated Transformation (2/2)
        1. Problem
        2. Solution
        3. Tasks
      6. Updating a Generated Transformation
        1. Problem
        2. Solution
        3. Tasks
      7. Editing the Generated Code for a Job or Transformation
        1. Problem
        2. Solution
        3. Tasks
      8. Replacing the Generated Code for a Job or Transformation
        1. Problem
        2. Solution
        3. Tasks
      9. Converting a SAS Code File to a Job
        1. Problem
        2. Solution
        3. Tasks
    13. Optimizing Process Flows
      1. About Process Flow Optimization
      2. Managing Process Data
        1. Problem
        2. Solution
        3. Tasks
      3. Managing Columns
        1. Problem
        2. Solution
        3. Tasks
      4. Streamlining Process Flow Components
        1. Problem
        2. Solution
        3. Tasks
      5. Using Simple Debugging Techniques
        1. Problem
        2. Solution
        3. Tasks
      6. Using SAS Logs
        1. Problem
        2. Solution
        3. Tasks
      7. Reviewing Temporary Output Tables
        1. Problem
        2. Solution
        3. Tasks
      8. Additional Performance Optimization Information
    14. Working with Impact Analysis and Data Lineage
      1. Impact Analysis and Data Lineage
        1. Overview
        2. Using Impact Analysis in SAS Data Integration Studio
        3. Using SAS Lineage
      2. Performing an Impact Analysis
        1. Problem
        2. Solution
        3. Tasks
      3. Performing Impact Analysis on a Generated Transformation
        1. Problem
        2. Solution
        3. Tasks
      4. Performing Reverse Impact Analysis
        1. Problem
        2. Solution
        3. Tasks
      5. Using SAS Lineage
        1. Overview
        2. Prerequisites
        3. Use the Analyze in Web Viewer Option for Tables and External Files
    15. Working with Reports
      1. About Metadata Reports
      2. Opening the Reports Window
        1. Problem
        2. Solution
        3. Tasks
      3. Selecting the Reports Perspective
        1. Problem
        2. Solution
        3. Tasks
      4. Customizing the Tables Report
        1. Problem
        2. Solution
        3. Tasks
      5. Customizing the Job Documentation Report
        1. Problem
        2. Solution
        3. Tasks
      6. Running and Saving a Report
        1. Problem
        2. Solution
        3. Tasks
      7. Saving a Report As a Document Object
        1. Problem
        2. Solution
        3. Tasks
      8. Viewing a Report
        1. Opening a Report
        2. Contents of a Tables Report
        3. Contents of a Job Report
        4. Contents of Your Own Report
      9. Creating Your Own Report
        1. Problem
        2. Solution
        3. Tasks
    16. Working with Data Management Platform
      1. Integration with DataFlux Data Management Platform
        1. Overview
        2. Transformations in the Data Quality Folder
      2. General Prerequisites for Data Quality Transformations
        1. DataFlux Software
        2. Global Options on the Data Quality Tab
      3. Prerequisites for Running a DataFlux Job or Profile in a SAS Data Integration Studio Job
        1. Overview
        2. Verify How Users Are Authenticated on the DataFlux Data Management Server
        3. Deploy the DataFlux Job, Service, or Profile to a DataFlux Data Management Server
        4. Grant Privileges on the DataFlux Data Management Server
        5. Next Tasks
      4. Analyzing the Quality of Data Sources
      5. Standardizing Values with a Standardization Scheme
        1. Problem
        2. Solution
        3. Tasks
      6. Standardizing Values with a Definition
        1. Problem
        2. Solution
      7. Using Match Codes to Improve Record Matching
        1. Problem
        2. Solution
        3. Tasks
        4. Usage Notes
      8. Using a DataFlux Data Service in a SAS Data Integration Studio Job
        1. Problem
        2. Solution
        3. Tasks
      9. Using a DataFlux Job or Profile in a SAS Data Integration Studio Job
        1. Problem
        2. Solution
        3. Tasks
  6. Working with Transformations
    1. Working with Analysis Transformations
      1. About Analysis Transformations
      2. Creating a Correlation Analysis
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      3. Creating a Distribution Analysis (1/2)
      4. Creating a Distribution Analysis (2/2)
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      5. Generating Forecasts (1/2)
      6. Generating Forecasts (2/2)
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      7. Frequency of Eye Color By Hair Color Crosstabulation (1/3)
      8. Frequency of Eye Color By Hair Color Crosstabulation (2/3)
      9. Frequency of Eye Color By Hair Color Crosstabulation (3/3)
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      10. One-Way Frequency of Eye Color By Region (1/2)
      11. One-Way Frequency of Eye Color By Region (2/2)
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      12. Creating Summary Statistics for a Table (1/2)
      13. Creating Summary Statistics for a Table (2/2)
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      14. Creating a Summary Tables Report from Table Data (1/2)
      15. Creating a Summary Tables Report from Table Data (2/2)
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
    2. Working with Loader Transformations
      1. About Loader Transformations
      2. About the SPD Server Table Loader Transformation
      3. Teradata Table Loader Transformation
        1. Teradata Table Loader
        2. Teradata Indexes
        3. Teradata Custom Restart
      4. About the Table Loader Transformation
      5. About the Oracle Bulk Table Loader Transformation
      6. About the DB2 Bulk Table Loader
      7. Setting Table Loader Transformation Options
        1. Problem
        2. Solution
        3. Tasks
      8. Selecting a Load Technique in the Table Loader
        1. Problem
        2. Solution
        3. Tasks
      9. Removing Non-Essential Indexes and Constraints during a Load
        1. Problem
        2. Solution
      10. Considering a Bulk Load
        1. Problem
        2. Solution
        3. Tasks
    3. Working with SAS Sort Transformations
      1. About Sort Transformations
      2. Optimizing Sort Performance
        1. Problem
        2. Solution
      3. Creating a Table That Contains the Sorted Contents of a Source
        1. Problem
        2. Solution
        3. Tasks
    4. Working with SQL Join Transformations
      1. About Join Transformations
        1. Overview
      2. Using the Designer Window
        1. Problem
        2. Solution
        3. Tasks
      3. Reviewing and Modifying Clauses, Joins, and Tables in an SQL Query
        1. Problem
        2. Solution
        3. Tasks
      4. Understanding Automatic Joins
        1. The Autojoin Process
        2. A Sample Auto-Join Process
      5. Selecting the Join Type
        1. Problem
        2. Solution
        3. Tasks
      6. Adding User-Written SQL Code
        1. Problem
        2. Solution
        3. Additional Information
      7. Debugging an SQL Query
        1. Problem
        2. Solution
        3. Tasks
      8. Adding a Column to the Target Table
        1. Problem
        2. Solution
        3. Tasks
      9. Adding a Join to an SQL Query on the Designer Tab
        1. Problem
        2. Solution
        3. Tasks
      10. Creating a Simple SQL Query
        1. Problem
        2. Solution
        3. Tasks
      11. Configuring a SELECT Clause
        1. Problem
        2. Solution
        3. Tasks
      12. Adding a CASE Expression
        1. Problem
        2. Solution
        3. Tasks
      13. Creating or Configuring a WHERE Clause
        1. Problem
        2. Solution
        3. Tasks
      14. Adding a GROUP BY Clause and a HAVING Clause
        1. Problem
        2. Solution
        3. Tasks
      15. Adding an ORDER BY Clause
        1. Problem
        2. Solution
        3. Tasks
      16. Adding Subqueries
        1. Problem
        2. Solution
        3. Tasks
      17. Validating or Submitting an SQL Query
        1. Problem
        2. Solution
        3. Tasks
      18. Joining a Table to Itself
        1. Problem
        2. Solution
        3. Tasks
      19. Using Parameters with an SQL Join
        1. Problem
        2. Solution
      20. Constructing a SAS Scalable Performance Data Server Star Join
        1. Problem
        2. Solution
        3. Tasks
      21. Optimizing SQL Processing Performance
        1. Problem
        2. Solution
      22. Performing General Data Optimization
        1. Problem
        2. Solution
        3. Tasks
      23. Influencing the Join Algorithm
        1. Problem
        2. Solution
        3. Tasks
      24. Setting the Implicit Property for a Join
        1. Problem
        2. Solution
      25. Enabling Explicit Pass-Through Processing for SQL Join Transformations
        1. Problem
        2. Solution
        3. Tasks
      26. Using Properties Window Options to Optimize SQL Processing Performance
        1. Problem
        2. Solution
        3. Tasks
    5. Working with Other SQL Transformations
      1. About Other SQL Transformations
        1. Overview
        2. Query Builder Window
      2. Inserting Rows into a Target Table
        1. Problem
        2. Solution
        3. Tasks
      3. Using the SQL Set Operators Transformation (1/2)
      4. Using the SQL Set Operators Transformation (2/2)
        1. Problem
        2. Solution
        3. Tasks
      5. Enabling Explicit Pass-Through Processing for Other SQL Transformations
        1. Problem
        2. Solution
        3. Tasks
    6. Working with Iterative Jobs and Parallel Processing
      1. About Iterative Jobs
      2. Creating and Running an Iterative Job
        1. Problem
        2. Solution
        3. Tasks
      3. Creating a Parameterized Job
        1. Problem
        2. Solution
        3. Tasks
      4. Creating a Control Table
        1. Problem
        2. Solution
        3. Tasks
      5. About Parallel Processing
      6. Setting Options for Parallel Processing
        1. Problem
        2. Solution
        3. Tasks
    7. Working with Slowly Changing Dimensions
      1. About Slowly Changing Dimensions
        1. Slowly Changing Dimensions Defined
        2. Types of Slowly Changing Dimensions
        3. Transformations That Support Slowly Changing Dimensions
        4. SCD Project Stages
      2. About Dimension Tables
        1. About Change Tracking
        2. About Change Detection and Loading for SCD
        3. About Generated Keys
        4. About Cross-Reference Tables
        5. Two Methods for Generating the Change Digest Column
        6. About Type 1 Updates
      3. About Fact Tables
        1. Overview
        2. About the Loading of Fact Tables with the Lookup Transformation
      4. Usage Notes for Slowly Changing Dimensions
        1. Hadoop Tables That Are Also Hive Tables or Impala Tables Are Not Suitable for Slowly Changing Dimensions
      5. Loading a Dimension Table with Type 1 Updates
        1. Problem
        2. Solution
        3. Tasks
      6. Loading a Dimension Table with Type 1 and 2 Updates
        1. Problem
        2. Solution
        3. Tasks
      7. Comparing Tables (1/2)
      8. Comparing Tables (2/2)
        1. Problem
        2. Solution
        3. Tasks
      9. Loading a Fact Table Using Dimension Table Lookup (1/2)
      10. Loading a Fact Table Using Dimension Table Lookup (2/2)
        1. Problem
        2. Solution
        3. Tasks
      11. Loading a Table and Adding a Surrogate Primary Key
        1. Problem
        2. Solution
        3. Tasks
      12. Tracking Changes in Source Datetime Values
        1. Problem
        2. Solution
        3. Tasks
      13. Closing Out Rows in Datetime Change Tracking
        1. Problem
        2. Solution
    8. Working with Change Data Capture
      1. About the Change Data Capture Transformations
        1. Change Data Capture Defined
        2. Prerequisites for Change Data Capture
      2. About CDC Changed Data Tables
      3. About CDC Control Tables
      4. Capture Changed Data from Oracle (1/2)
      5. Capture Changed Data from Oracle (2/2)
        1. Problem
        2. Solution
        3. Tasks
    9. Working with Message Queues
      1. About Message Queues
      2. Prerequisites for Message Queues
      3. Selecting Message Queue Transformations
        1. Problem
        2. Solution
        3. Tasks
      4. Processing a WebSphere Queue
        1. Problem
        2. Solution
        3. Tasks
      5. Polling a Websphere Message Queue
        1. Problem
        2. Solution
        3. Tasks
      6. Processing a Microsoft Queue
        1. Problem
        2. Solution
        3. Tasks
    10. Working with SPD Server Cluster Tables
      1. About SPD Server Cluster Tables
      2. Creating an SPD Server Cluster Table
        1. Problem
        2. Solution
        3. Tasks
      3. Maintaining an SPD Server Cluster
        1. Problem
        2. Solution
    11. Working with Hadoop and SAS LASR Analytic Server
      1. Overview of the Hadoop Transformations
      2. Prerequisites for the Hadoop Transformations
        1. Prerequisites for the Hive Transformation
        2. Prerequisites for Other Hadoop Transformations
      3. Creating a Pig Job
        1. Problem
        2. Solution
        3. Tasks
      4. Creating a Hive Job
        1. Problem
        2. Solution
        3. Tasks
      5. Creating a Hadoop Container Job (1/2)
      6. Creating a Hadoop Container Job (2/2)
        1. Problem
        2. Solution
        3. Tasks
      7. Monitoring Hadoop Clusters
      8. Overview of the High-Performance Analytics Transformations
        1. High-Performance Analytics Transformations
        2. Software Used by These Transformations
      9. Prerequisites for the High-Performance Analytics Transformations
        1. For SAS Data Integration Studio Users
        2. For Administrators
      10. Loading a Table on the SAS LASR Analytic Server
        1. Problem
        2. Solution
        3. Tasks
      11. Usage Notes for HPA Software and Hadoop
        1. High-Performance Analytics Software
        2. Hadoop
  7. Appendixes
    1. Main Windows and Wizards
      1. Analysis Window
      2. Checkouts Tree
      3. Code Editor
      4. Comparison Results Window
      5. Connection Profile Window
      6. Desktop
      7. Details Pane
      8. Expression Builder
        1. Overview
        2. Database Functions
        3. User-Defined Functions
      9. Folders Tree
      10. Inventory Tree
      11. Job Editor
      12. Properties Windows
        1. Basic Properties
        2. Job Properties
        3. Transformation Properties
        4. Table Properties
      13. Reports Window
      14. Tools-Options Window
      15. Tree View
      16. View Data Windows
        1. View Data Window
        2. View File Window
      17. Wizards
        1. New Object Wizards
        2. Register Tables Wizards
        3. Cube Wizards
        4. Data Surveyor Wizards
        5. Metadata Import and Export Wizards
    2. Usage Notes
      1. General Usage Notes (1/2)
      2. General Usage Notes (2/2)
        1. Avoid Double Quotation Marks in DBMS Table and Column Names
        2. Concurrent Queries to Teradata Tables Can Fail
        3. Create as View Option Works Only When It Is Possible to Create a View
        4. Data Transfer Does Not Work for DBMS Tables with Special Characters in Table Names
        5. DBMS-Specific Functions Work Only with Explicit Pass-Through
        6. Do Not Include the << and >> Signs in the Column Descriptions of a Table That Could Be Used in an Information Map
        7. Do Not Use MLE Library Tables as Targets in SAS Data Integration Studio Jobs
        8. Enhanced Validation for Generated Code Can Be Turned Off
        9. External File Wizard: Cannot Sort Displayed Data by Column
        10. Jobs with Implicit Data Transfers between Different Hosts Fail
        11. Limit Line Lengths in the Expression Builder to 128 Characters
        12. Maximum Integer Value for a Field in SAS Data Integration Studio
        13. Microsoft Queue Writer Transformation Does Not Transform Missing Date Values
        14. Migrating from SAS/Warehouse Administrator to SAS Data Integration Studio
        15. Out-Of-Date Generated Transformations Are Updated Automatically When Included in Jobs That Are Deployed or Redeployed
        16. SAS Data Integration Studio Jobs Cannot Output HP Neoview Tables That Have Keys
        17. SAS Metadata Bridges
        18. Saving Metadata Changes in the Corresponding Physical Target
        19. Saving Temporary Output Tables to a Permanent Location
        20. Sign-on Scripts for SAS/CONNECT Servers
        21. SQL Join Transformations: Adding Multiple Sources with Primary Keys to an SQL Join Transformation Job
        22. SQL Merge Transformations: Input and Output Issues
        23. SQL Merge Transformations: Use the SQLNCLI10 Driver to Access SQL Server 2008
        24. SQL Update and SQL Merge Transformations: Manual Updates Are Required If Subqueries Are Used
        25. Synchpoint Option on WebSphere Queue Reader Does Not Prevent All Data Commits to Target When an Error Occurs
        26. Transformations That Use PROC SQL Rename SAS Reserved Words Unless Case Sensitive Names and Special Characters Are Recognized
        27. Unrestricted Users Cannot Perform Tasks That Require Logins from the Metadata Server
        28. Update Table Metadata Cannot Be Used for Some Tables
        29. Update Table Metadata on z/OS Platforms
        30. Updates Might Be Needed to the Names of Primary Keys for Oracle Tables
        31. Very Large Tables or Files in WebSphere Message Queues Can Cause Memory Overruns
      3. Usage Notes for Register Tables Wizards and the New Table Wizard
        1. Access to Data on z/OS Platforms
        2. Access to Tables Using ODBC DB2 z/OS Pass-through
        3. Case and Special Characters in DBMS Names
        4. Case and Special Characters in SAS Names
        5. Control Whether SAS Formats and Informats Are Automatically Applied to Table Columns
        6. Generic Register Tables Wizard: When to Use
        7. Importing Foreign Keys for DBMS Tables
        8. Importing Foreign Keys for SAS Tables
        9. Importing Keys and Indexes from SAS/SHARE Libraries
        10. LIBNAME Options Required for Support of Case and Special Characters in the Names for Keys and Indexes
        11. In a Register Tables Wizard, Limit Excel Connections to a Single User Name
        12. Limitations of Register Tables Wizards for MySQL and Informix
        13. Metadata for a Library and Its Tables Must Be Stored in the Same Metadata Repository
        14. Microsoft Windows Administrative Rights Required to Connect to OLE DB Data Sources
        15. ODBC Informix Library: Preserving Case in Table Names
        16. Registering SAS/SHARE Tables
        17. Registering a Sybase Table with a Clustered Index
        18. Separate Logon Credentials for Each Authentication Domain for Database Servers
        19. Setting Table Options in the New Table Wizard
        20. Table Names over 32 Characters Are Truncated in the New Table Wizard
        21. Teradata Register Tables Wizard Hangs Unless a User ID and Password Can Be Supplied
        22. Unrestricted Users Cannot Perform Tasks That Require Logon Credentials from the Metadata Server
      4. Usage Notes for the View Data Window
        1. About Usage Notes for the View Data Window
        2. Cannot Display Tables in an HDFS Library or a LASR Library
        3. Cannot View Cubes in SAS Data Integration Studio
        4. Cannot View Tables in Libraries That Are Not Defined in a Current Repository
        5. Close the View Data Window to Unlock a SAS Table
        6. Default Parameter Values Are Used When Parameterized Tables Are Viewed
        7. Error When Viewing SAP R/3 Tables
        8. Libraries for Any User-Defined Formats Must Be Available
        9. Permanent Data Set Formats Are Unaffected by the Apply Metadata Formats Option in the View Data Window
        10. Setting Multiple Column Heading Label Options
        11. Tables Might Not Be Editable Due to a Referential Integrity Issue
        12. Table Options Will Be Ignored When You Create a Table with View Data
        13. Using Columns with Leading or Trailing Spaces
        14. View Data Queries Construct SELECT Statements
        15. Viewing DBMS Tables Immediately After a Job Executes
        16. Viewing Formatted Data in Fixed-Width External Files
        17. Viewing Tables in a SAS WORK Library
        18. Viewing Teradata Tables
      5. Usage Notes for Iterative Jobs
        1. About Usage Notes for Iterative Jobs
        2. Iterative Jobs and Parameterized Jobs Behave as Completely Separate Jobs
        3. Iterative Processing Places Limits on the Number of Nesting Levels and Jobs
        4. Parameter Values That Include Special Characters Require Special Handling
        5. Control Table Jobs Display an Out of Order Warning
      6. Prerequisites for Running a Job When a DataFlux Server Is Used for Authentication
        1. Overview
        2. Verify How Users Are Authenticated on the DataFlux Data Management Server
        3. Deploy the Job, Service, or Profile
        4. Register a User on the DataFlux Authentication Server
        5. Grant Privileges on the DataFlux Data Management Server
        6. Update or Add a Data Management Server Definition in SAS Management Console
        7. Update User Accounts in SAS Management Console
        8. How the Connections Work
        9. Next Tasks
      7. Usage Notes for Loaders
        1. Cloudera Impala: Usage Notes for Loaders
        2. DBMS Notes for the SCD Type 2 Loader Transformation
        3. MINMAXVARLIST Options Are Supported by Both SPD Server Loaders and SPD Server Tables
        4. Setting the Autocommit Option in Table Loader Scenarios with a Vertica DBMS Target
    3. Miscellaneous Transformations
      1. Using a Business Rule Flow in a Job
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
        5. Usage Notes
      2. Creating a Table That Appends Two or More Source Tables
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      3. Creating a Publish to Archive Report from Table Data (1/2)
      4. Creating a Publish to Archive Report from Table Data (2/2)
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      5. Validating Product Data
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      6. Creating a Publish to Email Report from Table Data (1/2)
      7. Creating a Publish to Email Report from Table Data (2/2)
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      8. Integrating a SAS Enterprise Miner Model with Existing SAS Data (1/2)
      9. Integrating a SAS Enterprise Miner Model with Existing SAS Data (2/2)
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      10. Creating a Publish to Queue Report from Table Data (1/2)
      11. Creating a Publish to Queue Report from Table Data (2/2)
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      12. Extracting Data from a Source Table
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      13. Creating Reports from Table Data (1/2)
      14. Creating Reports from Table Data (2/2)
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      15. Create a Table That Ranks the Contents of a Source
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      16. Create Two Tables That Are Subsets of a Source
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      17. Moving Data Directly from One Machine to Another Machine
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      18. Creating Standardized Statistics from Table Data
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      19. Creating Transposed Data from Table Data
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      20. Converting a SAS or DBMS Table to an XML Table
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
      21. Using ODS to Specify Output from the XML Writer
        1. Problem
        2. Solution
        3. Tasks
      22. Using SOAP to Access a Third-Party Web Service
        1. Problem
        2. Solution
        3. Verify Prerequisites
        4. Create a Job That Uses a SOAP Transformation to Access a Web Service
      23. Using REST to Access a Third-Party Web Service
        1. Problem
        2. Solution
        3. Verify Prerequisites
        4. Create a Job That Uses a REST Transformation to Access a Web Service
      24. Generating Enterprise Decision Management Output (1/2)
      25. Generating Enterprise Decision Management Output (2/2)
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
        5. Usage Notes
      26. Running Conditional Processes (1/2)
      27. Running Conditional Processes (2/2)
        1. Overview
        2. Problem
        3. Solution
        4. Tasks
    4. Java Code and Methods for Report Plug-ins
      1. Example Java Code for a Report Plug-in
      2. Reporting Interface Methods (1/2)
      3. Reporting Interface Methods (2/2)
  8. Glossary (1/2)
  9. Glossary (2/2)
  10. Index (1/3)
  11. Index (2/3)
  12. Index (3/3)

Product information

  • Title: SAS Data Integration Studio 4.9
  • Author(s): SAS Documentation
  • Release date: August 2014
  • Publisher(s): SAS Institute
  • ISBN: 9781629593104