Evaluating E-Learning

Table of contents

1. Copyright
2. Preface
   1. Who Is This Book for?
   2. What Will This Book Do for You?
   3. What’s Special About This Book?
3. The Value in Evaluation
   1. Why Evaluate Your E-Learning?
   2. Specific Reasons to Evaluate
   3. Anticipate Objections to Evaluation
   4. Characteristics of a Good Evaluation Process
   5. Your Turn
4. Perspectives of Evaluation
   1. Breadth of View
   2. Your Economic Role
   3. Timing of Evaluation
   4. Internal Versus External Evaluation
   5. Levels of Evaluation
   6. Your Turn
5. Level 1: Response Evaluations
   1. What a Response Evaluation Tells You
   2. Reasons to Perform a Level 1 Evaluation
   3. Techniques for Measuring Response
   4. Tips for Measuring
   5. Your Turn
6. Level 2: Learning Evaluations
   1. Reasons to Perform a Level 2 Evaluation
   2. How to Measure Learning
   3. Techniques for Measuring Learning
   4. Your Turn
7. Level 3: Performance Evaluations
   1. Reasons to Conduct a Level 3 Evaluation
   2. How to Measure Performance
   3. Techniques for Measuring Performance
   4. Your Turn
8. Level 4: Results Evaluations
   1. Reasons to Evaluate Business Results
   2. How to Measure Business Results
   3. Techniques for Measuring Results
   4. Your Turn
9. Calculating Return-on-Investment
   1. The Basic Formula for ROI
   2. The Scenario
   3. Your Turn
10. Including More Costs and Benefits
    1. Counting Hard, Soft, and Fuzzy Benefits
    2. Your Turn
11. Consider Both Producers and Consumers
    1. Producer’s Viewpoint
    2. Consumer’s Viewpoint
    3. Your Turn
12. Evaluating Course Quality
    1. When to Use a Quality Checklist
    2. Making the Checklist Work for You
    3. Your Turn
13. Creating Your Evaluation Plan
    1. What Are the Goals of Your Evaluation?
    2. What Is the Schedule of Activities?
    3. How Much Will Evaluation Cost?
    4. What Data Will You Gather?
    5. Who Can Provide the Data?
    6. How Will You Motivate Participants?
    7. How Will You Collect Data?
    8. When Will You Collect Data?
    9. Who Will Collect the Data?
    10. Who Will Analyze the Data?
    11. How Will You Analyze the Data?
    12. How Will You Isolate the Effects of Training?
    13. How Will You Report Results?
    14. Your Turn
14. Building Evaluation Into the Development Process
    1. Identify Business Goals Behind Training
    2. From Business Goals to Learning Goals
    3. Set Clear Learning Goals
    4. Transform Goals Into Objectives
    5. Stress Concrete Performance
    6. Set All Levels of Objectives
    7. Your Turn
15. Pragmatics and Professionalism
    1. Get Real and Stay That Way
    2. Measurement Is Not Evaluation
    3. Precision Is Not Accuracy
    4. Sensitivity-Test Your Assumptions
    5. Ponder the ROI of Your Evaluation Process
    6. Summary: A Cost-Effective Wrap-Up
    7. Beyond Evaluation as We Know It
16. References
17. Additional Resources
18. About the Author