Relevance feedback

From Wikipedia, the free encyclopedia

Relevance feedback is a feature of some information retrieval systems. The idea behind relevance feedback is to take the results that are initially returned from a given query and to use information about whether or not those results are relevant to perform a new query. We can usefully distinguish between three types of feedback: explicit feedback, implicit feedback, and blind or "pseudo" feedback.

1 Explicit feedback
2 Implicit feedback
3 Blind feedback
4 Using relevance information
5 Further reading

[edit] Explicit feedback

Explicit feedback is obtained from assessors of relevance indicating the relevance of a document retrieved for a query. This type of feedback is defined as explicit only when the assessors (or other users of a system) know that the feedback provided is interpreted as relevance judgments.

Users may indicate relevance explicitly using a binary or graded relevance system. Binary relevance feedback indicates that a document is either relevant or irrelevant for a given query. Graded relevance feedback indicates the relevance of a document to a query on a scale using numbers, letters, or descriptions (such as "not relevant", somewhat relevant", "relevant", or "very relevant"). Graded relevance may also take the form of a cardinal ordering of documents created by an assessor; that is, the assessor places documents of a result set in order of (usually descending) relevance.

[edit] Implicit feedback

Implicit feedback is inferred from user behavior, such as noting which documents they do and do not select for viewing^{[citation needed]}, the duration of time spent viewing a document^{[citation needed]}, or page browsing or scrolling actions^{[citation needed]}.

The key differences of implicit relevance feedback from that of explicit include^{[citation needed]}:

the user is not assessing relevance for the benefit of the IR system, but only satisfying their own needs and
the user is not necessarily informed that their behavior (selected documents) will be used as relevance feedback

[edit] Blind feedback

Blind or "pseudo" relevance feedback is obtained by assuming that the top k documents in the result set containing n results (usually where k << n) are relevant.

Blind feedback automates the manual part of relevance feedback and has the advantage that assessors are not required.

[edit] Using relevance information

Relevance information is utilized by using the contents of the relevant documents to either adjust the weights of terms in the original query, or by using those contents to add words to the query. Relevance feedback is often implemented using the Rocchio algorithm.