O'Reilly logo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Remote Research

Book Description

Remote studies give you the opportunity to observe users as they behave naturally in their own environment. In Remote Research, you learn how to design and conduct remote research studies using a phone and a laptop.

Table of Contents

  1. Remote Research: Real Users, Real Time, Real Research
  2. Dedication
  3. SPECIAL OFFER: Upgrade this ebook with O’Reilly
  4. How to Use This Book
    1. Who Should Read This Book?
    2. What’s in This Book?
    3. What Comes with This Book?
  5. Frequently Asked Questions
    1. What is remote user research, anyway? Is it anything like focus groups or surveys?
    2. What kinds of remote research are there?
    3. I’m skeptical about remote research. If it’s so great, why haven’t I heard of it?
    4. I’m still skeptical. Can you really get valid behavioral feedback without seeing your participants in person?
    5. I want to cut costs for my user research study. Is using remote methods a good way to do that?
    6. Where can I get people to participate in my remote study?
    7. How on earth can you call this a book about research without way more academic references and doctoral degrees?
  6. Foreword
  7. 1. Why Remote Research?
    1. The Appeal of Lab Research
    2. Is Lab Research Dead?
    3. What’s Remote Research Good For?
      1. Time-Aware Research
      2. Other Benefits of Remote Research
    4. When to Go Remote
    5. Moderated vs. Automated
    6. When to Use Which Remote Method
    7. Chapter Summary
  8. 2. Moderated Research: Setup
    1. Gearing Up: Physical Equipment
    2. Doing a Pilot Test Right Now
    3. Preparing for a Real Study
      1. Screen Sharing
      2. Recording
      3. Taking Notes
      4. Webcams
    4. Drafting the Research Documents
      1. The Remote Facilitator Guide
        1. Presession Setup (1 Minute)
        2. Greeting and Introduction (5 Minutes)
        3. Natural Tasks (15–25 Minutes)
        4. Predetermined Tasks (5–15 Minutes)
        5. Wrap-up and Debrief (3–5 Minutes)
      2. Preparing Observers for Testing
    5. Chapter Summary
  9. 3. Recruiting for Remote Studies
    1. What’s “Live Recruiting”?
    2. Live Recruiting Using Forms and Pop-ups
      1. Implementing the Recruiting Screener
      2. Logistics of Screener Implementation
      3. Web traffic Requirements for Live Recruiting
    3. Designing the Screener
      1. Screener Introduction
      2. Screener Questions
      3. Screener Submission Confirmation
    4. Paying Remote Recruits
    5. Choosing Good Users and Spotting the Fakers
    6. Recruiting Slow? Don’t Sit Around—Fix the Screener
    7. Wait! Read On...
    8. Chapter Summary
  10. 4. Privacy and Consent
    1. Certain Assumptions
    2. Set Up Your Web Site’s Privacy Policy
    3. Basic Participation Consent
    4. Consent to Record
    5. International Consent
      1. Recruiting Services
      2. Hiring a Local Lawyer
      3. Local Research Practitioners
      4. International Consent Example: EU’s “Safe Harbor”
    6. Consent for Minors
      1. Privacy Policy for Minors
      2. Don’t Record Minors
    7. Chapter Summary
  11. 5. Moderating
    1. Introducing the Study
    2. Time-Aware Research and Going Off-Script
    3. Smart Note Taking
    4. Working with Observers
      1. During the Session
      2. After the Session
    5. Quiet, Chatty, Bored, Drunk, and Mean
    6. Ain’t Nothing Wrong with Using the Phone
    7. Wrapping Up
    8. Chapter Summary
  12. 6. Automated Research
    1. The Structure of an Automated Study
    2. Recruiting for Automated Studies
    3. Different Kinds of Automated Research
    4. Task Elicitation
      1. Don’t Lead the Users
      2. Find the Right Level of Task Specificity
      3. Use Both Qualitative and Quantitative Methods
    5. Remote Card Sorting
      1. Open Sorts
      2. Closed Sorts
      3. Moderated or Automated Card Sorts?
    6. Surveys
    7. Other Methods
    8. Where Do I Learn About Tools?
    9. Chapter Summary
  13. 7. Analysis and Reporting
    1. Moderated Analysis
      1. The Technological Ecosystem
      2. Making Highlight Clips
    2. Automated Analysis
      1. Task Elicitation and Analytics
      2. Card Sorting
      3. Surveys
    3. Reporting
      1. Before the Presentation
      2. Presenting Moderated Findings
      3. Presenting Automated Findings
      4. Other Approaches to Presenting Findings
      5. Following Up
    4. Not All Research Is Research
    5. Chapter Summary
  14. 8. Remote Research Tools
    1. Screen Sharing
      1. Adobe Connect
      2. UserVue
      3. GoToMeeting
      4. LiveLook
      5. Other Screen Sharing Services
    2. Recording
      1. Camtasia Studio/Camtasia for Mac
      2. CamStudio
      3. iShowU HD
      4. Other Recording Options
    3. Automated Tools and Services
      1. Task Elicitation and Analytics Tools
      2. Survey Tools
      3. Card Sorting Tools
      4. Other Automated Research Tools
    4. Chapter Summary
  15. 9. New Approaches to User Research
    1. Top Secret (Reverse Screen Sharing and Remote Access)
      1. Method
    2. Mobile Device Research (Smartphones)
    3. One-to-Many Remote Moderating (Video Games)
      1. Method
      2. Equipment Setup
      3. Pros and Cons of Simulated Native Environments
      4. Bringing Game Research Home
    4. Portable Testing (Cars)
      1. Method
      2. Challenges and Logistics
      3. Getting Better All the Time
    5. Staying Current
    6. Chapter Summary
  16. 10. The Challenges of Remote Testing
    1. Legitimacy
    2. Not Seeing the Users’ Faces
    3. Technology Failures
    4. Not as Inexpensive as You’d Think
    5. Organizational Challenges of Web Recruiting
    6. Getting the Right Recruits
    7. Natural User Behavior
    8. Multitasking
    9. Security and Confidentiality
    10. Persistent Negativity
    11. Chapter Summary
  17. A. Conclusion: Don’t Waste Your Life Doing Pointless Research
  18. B. Acknowledgments
  19. C. About the Authors
    1. Nate Bolt
    2. Tony Tulathimutte
  20. Index
  21. SPECIAL OFFER: Upgrade this ebook with O’Reilly
  22. Copyright