Measurement Demystified

Measurement Demystified

by David Vance, Peggy Parskey
Released November 2020
Publisher(s): Association for Talent Development
ISBN: 9781950496891

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Your Groundbreaking Framework for Measurement and Reporting

Most people find measurement, analytics, and reporting daunting—and L&D professionals are no different. As these practices have become critically important for organizations’ efforts to improve performance, talent development professionals have often been slow to embrace them for many reasons, including the seeming complexity and challenge of the practices. Few organizations have a well-thought-out measurement and reporting strategy, and there are often scant resources, limited time, and imperfect data to work with when organizations do attempt to create one.

Measurement Demystified: Creating Your L&D Measurement, Analytics, and Reporting Strategy is a much-needed and welcomed resource that breaks new ground with a framework to simplify the discussion of measurement, analytics, and reporting as it relates to L&D and talent development practitioners. This book helps practitioners select and use the right measures for the right reasons; select, create, and use the right types of reports; and create a comprehensive measurement and reporting strategy.

Recognizing the angst and reluctance people often show in these areas, authors and experts David Vance and Peggy Parskey break down the practices and processes by providing a common language and an easy-to-use structure. They describe five types of reports, four broad reasons to measure, and three categories of measures. Their method works for large and small organizations, even if yours is an L&D staff of one or two. The guidance remains the same: Start small and grow.

Measurement Demystified is a great first book for talent development professionals with no prior knowledge of or experience with measurement and a valuable resource for measurement experts. Those adept at lower levels of training evaluation will grow their knowledge base and capabilities, while measurement experts will discover shortcuts and nuggets of information to enhance their practices. A more comprehensive treatment of these important topics will not be found elsewhere.

Table of contents

  1. Cover
  2. Title Page
  3. Copyright
  4. Contents
  5. List of Figures
  6. List of Tables
  7. Foreword
  8. Preface
  9. Introduction
  10. Part I. Foundations of Measurement
    1. 1. The Talent Development Reporting Principles (TDRp) Framework
      1. Reasons for Measuring
      2. A Framework for Measurement
      3. Measurement Maturity
      4. TDRp Measures
      5. TDRp Reports
      6. The Complete TDRp Framework
      7. Integration of the TDRp Framework With Other Standard-Setting Efforts
      8. Conclusion
    2. 2. Introduction to Basic Measures
      1. The Consequences of Focusing on a Single Type of Measure
      2. The Solution: Be Purposeful About What You Measure
      3. Conclusion
  11. Part II. Measurement
    1. 3. Efficiency Measures
      1. Formal Learning Measures
      2. Informal Learning Measures
      3. Conclusion
    2. 4. Effectiveness Measures
      1. The Five Levels of Effectiveness Measures
      2. Level 1: Reaction
      3. Level 2: Learning
      4. Level 3: Behavior and Application
      5. Level 4: Results and Impact
      6. Level 5: ROI
      7. Conclusion
    3. 5. Outcome Measures
      1. The Importance of Outcome Measures
      2. Most Common Outcome Measures
      3. Types of Outcome Measures
      4. Application Rate as a Leading Indicator
      5. Flexibility in Creating Outcome Measures
      6. The Special Case of Competency Measures
      7. Conclusion
    4. 6. Creating a Measurement Strategy
      1. Why a Measurement and Reporting Strategy Is Important
      2. Steps to Create a Measurement Strategy
      3. Elements of a Measurement and Reporting Strategy
      4. Conclusion
    5. 7. Selecting Measures
      1. Measures for Programs
      2. Measures for General Studies Courses
      3. Department Initiatives
      4. Other Measures the CLO May Request
      5. Conclusion
  12. Part III. Reporting
    1. 8. Reporting
      1. Types of Reports and Data Displays
      2. Reporting to Inform
      3. Reporting to Monitor
      4. Reporting to Evaluate and Analyze
      5. Reporting to Manage
      6. Conclusion
    2. 9. The Three Management Reports
      1. Running Learning Like a Business
      2. The TDRp Management Reporting Framework
      3. Conclusion
    3. 10. Creating Your Reporting Strategy
      1. Elements of a Measurement and Reporting Strategy
      2. Report Types and Formats
      3. Plans to Generate and Distribute the Reports
      4. Resources Required for Reporting
      5. Conclusion
    4. 11. Creating Plans
      1. Creating Plans for Outcome Measures
      2. Creating Plans for Efficiency and Effectiveness Measures
      3. Conclusion
    5. 12. Reporting Year-to-Date Results and Making Forecasts
      1. Reporting YTD Results
      2. Making Forecasts
      3. Conclusion
  13. Part IV. Putting It All Together
    1. 13. Implementing Measurement and Reporting
      1. L&D’s Opportunity
      2. What’s Changing?
      3. Managing the Change
      4. Tools and Templates
      5. Conclusion
    2. 14. Pulling It All Together
      1. Key Takeaways
      2. Opportunities
      3. Closing Thoughts
  14. Appendixes
    1. A. History of the TDRp Approach
    2. B. Sample Roles and Responsibilities Agreement
    3. C. Sample Measurement and Reporting Strategy
    4. D. Sample TDRp Implementation Plan
    5. E. Glossary
    6. F. Resources on Survey Design
  15. References
  16. Index
  17. About the Authors
  18. Back Cover

Product information

  • Title: Measurement Demystified
  • Author(s): David Vance, Peggy Parskey
  • Release date: November 2020
  • Publisher(s): Association for Talent Development
  • ISBN: 9781950496891