Book description
The Phillips ROI Methodology™ utilizes five levels of evaluation, which are essential in determining the return on investment.At Level 1 - Reaction and Planned Action, attendee and stakeholder satisfaction from the meeting can be measured. Almost all organizations evaluate at Level 1, usually with a generic, end-of-meeting questionnaire. While this level of evaluation is important as a “stakeholder” satisfaction measure, a favorable reaction does not ensure that attendees have acquired new skills, knowledge, opinions or attitudes from the meeting.
At Level 2 - Learning, measurements focus on what participants learned during the meeting using tests, skill practices, role-plays, simulations, group evaluations, and other assessment tools. A learning check is helpful to ensure that attendees have absorbed the meeting material or messages and know how to use or apply it properly. It is also important at this level to determine the quantity and quality of new professional contacts acquired and whether existing professional contacts were strengthened due to the meeting. However, a positive measure at this level is no guarantee that what was learned or whether the professional contacts acquired will be used on the job.
At Level 3 - Job Applications, a variety of follow-up methods can be used to determine if attendees applied on the job what they learned or acquired at the meeting. The frequency and use of skills are important measures at Level 3. While Level 3 evaluations are important to gauge the success of the meeting, it still does not guarantee that there will be a positive business impact in the organization or for the attendee.
At Level 4 - Business Results, the measurement focuses on the actual business results achieved by meeting participants as they successfully apply the meeting material or messages. Typical Level 4 measures include output, sales, quality, costs, time and customer satisfaction. Although the meeting may produce a measurable business impact, there is still a concern that the meeting may cost too much.
At Level 5 - Return on Investment, this ultimate level of measurement compares the monetary benefits from the meeting with the fully-loaded meeting costs as expressed in the ROI formula.
All levels of evaluation must be conducted in order to determine the ROI of a meeting or event. The data collected should show a chain of impact occurring through the levels as the skills and knowledge learned (Level 2) are applied on the job (Level 3) to produce business results (Level 4).
Table of contents
- Cover
- Halftitle
- Title
- Copyright
- Contents
- Preface
- Acknowledgments
- Foreword
- 1. The Need for the ROI Methodology in the Meetings and Events Industry
- 2. The ROI Methodology: A Brief Overview
- 3. The Alignment: Defining Needs and Objectives
- 4. Measuring Inputs and Indicators
- 5. Measuring Reaction and Perceived Value
- 6. Measuring Learning and Confidence
-
7. Measuring Application and Implementation
- The Importance of Measuring Application
- Challenges of Measuring Application and Implementation
- Fundamental Issues
- Data Collection with Questionnaires and Surveys
- Data Collection with Interviews
- Data Collection with Focus Groups
- On-the-Job Observation
- The Use of Action Plans and Follow-up Assignments
- The Use of Performance Contracts
- Barriers to Success
- Data Use
- Final Thoughts
-
8. Measuring and Isolating the Impact of Meetings and Events
- Importance of Measuring Business Impact
- Types of Impact Measures
- Specific Measures Linked to Meetings
- Business Performance Data Monitoring
- The Use of Action Plans to Measure Business Impact Data
- The Use of Performance Contracts to Measure Business Impact
- The Use of Questionnaires to Collect Business Data
- Isolate the Effects of the Meeting
- Use of Control Groups
- Use of Trend Line Analysis
- Using Estimates
- Questionnaire or Interview Approach
- Focus Group Approach
- Estimates from Others
- Final Thoughts
- References
-
9. Monetary Benefits, Costs, and ROI
- The Importance of Monetary Benefits and ROI
- Key Steps to Convert Data to Monetary Values
- Standard Monetary Values
- Data Conversion When Standard Values are not Available
- Selecting the Conversion Method
- Monitoring Meeting Costs
- Major Cost Categories
- Cost Accumulation and Estimation
- Calculating the ROI
- Final Thoughts
- References
- 10. Intangible Benefits
-
11. Reporting Results
- Why the Concern About Communicating Results?
- Key Principles of Communicating Results
- The Reasons for Communication
- Planning the Communications
- The Audience for Communications
- Content Development
- Communication Media Selection
- Presenting Information
- Reactions to Communication
- Using Evaluation Data
- Final Thoughts
- References
-
12. Implementing and Sustaining the Evaluation System
- Why the Concern?
- Implementing the Process: Overcoming Resistance
- Assessing the Climate for Measurement
- Developing Roles and Responsibilities
- Establishing Goals and Plans
- Revising or Developing Policies and Guidelines
- Preparing the Team
- Initiating Evaluation Studies
- Preparing the Clients and Management Team
- Removing Obstacles
- Monitoring Progress
- Final Thoughts
- References
- Appendix. How Results-Based Are Your Meetings and Events? Survey for Executives, Clients, and Managers
- Index
Product information
- Title: Return on Investment in Meetings and Events
- Author(s):
- Release date: January 2008
- Publisher(s): Routledge
- ISBN: 9781136368394
You might also like
book
Blockchain Basics: A Non-Technical Introduction in 25 Steps
In 25 concise steps, you will learn the basics of blockchain technology. No mathematical formulas, program …
book
Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow, 3rd Edition
Through a recent series of breakthroughs, deep learning has boosted the entire field of machine learning. …
book
Python for Data Analysis, 3rd Edition
Get the definitive handbook for manipulating, processing, cleaning, and crunching datasets in Python. Updated for Python …
book
Financial Planning & Analysis and Performance Management
Critical insights for savvy financial analysts Financial Planning & Analysis and Performance Management is the essential …