Evolving Networking Technologies

11Search Engine Evaluation Methodology

JN Singh¹, Prashant Johri¹, Gaurav Dhuriya¹, Kanta Prasad Sharma²

¹ Galgotias University, Greater Noida, India

² Computer Engineerign and Application , GLA University Mathura, India

Email: [e-mail], [e-mail], [e-mail], [e-mail]

Abstract

In this chapter, we explore the various methodologies and statistical measures that have been used for better evaluation of search engines. It also includes a comparative study of statistical and automatic methods and the study of various factors that affect the search engine evaluation process. The chapter presents a broad discussion about the various forums that have been used and provides various data for better evaluation of search engines. Thereafter, the popular statistical measures that have been used to evaluate the search engines are discussed. The chapter also details the automatic approaches of click-through data and eye tracking, and provides the reasons as to why the automatic approach for page quality-related judgments collection is considered superior to traditional approaches.

Keywords: Search engine, eye tracking, statistical method

11.1 Introduction

Today, it is a monumental process to judge the performance of information retrieval systems. As we know, some information retrieval systems that satisfy our minimum requirements are better than others. However, it is not an easy task to satisfy the needs and and address the problems of ...