Search results
1 – 7 of 7
This paper presents a set of basic components which constitutes the experimental setting intended for the evaluation of interactive information retrieval (IIR) systems, the aim of…
Abstract
This paper presents a set of basic components which constitutes the experimental setting intended for the evaluation of interactive information retrieval (IIR) systems, the aim of which is to facilitate evaluation of IIR systems in a way which is as close as possible to realistic IR processes. The experimental setting consists of three components: (1) the involvement of potential users as test persons; (2) the application of dynamic and individual information needs; and (3) the use of multidimensional and dynamic relevance judgements. Hidden under the information need component is the essential central sub‐component, the simulated work task situation, the tool that triggers the (simulated) dynamic information needs. This paper also reports on the empirical findings of the metaevaluation of the application of this sub‐component, the purpose of which is to discover whether the application of simulated work task situations to future evaluation of IIR systems can be recommended. Investigations are carried out to determine whether any search behavioural differences exist between test persons‘ treatment of their own real information needs versus simulated information needs. The hypothesis is that if no difference exists one can correctly substitute real information needs with simulated information needs through the application of simulated work task situations. The empirical results of the meta‐evaluation provide positive evidence for the application of simulated work task situations to the evaluation of IIR systems. The results also indicate that tailoring work task situations to the group of test persons is important in motivating them. Furthermore, the results of the evaluation show that different versions of semantic openness of the simulated situations make no difference to the test persons’ search treatment.
Details
Keywords
The concept of information is central to several fields of research and professional practice. So many definitions have been put forward that complete inventory is unachievable…
Abstract
Purpose
The concept of information is central to several fields of research and professional practice. So many definitions have been put forward that complete inventory is unachievable while authors have failed to reach a consensus. In the face of the present impasse, innovative proposals could rouse information theorists to action, but literature surveys tend to emphasize the common traits of definitions. Reviewers are inclined to iron out originality in information models; thus the purpose of this paper is to discover the creativity of authors attempting to define the concept of information and to stimulate the progress of studies in this field.
Design/methodology/approach
Because the present inquiry could be influenced and distorted by personal criteria and opinions, the authors have adopted precise criteria and guidelines. It could be said the present approach approximates a statistical methodology.
Findings
The findings of this paper include (1) The authors found 32 original definitions of information which sometimes current surveys have overlooked. (2) The authors found a relation between information theories and advances in information technology. (3) Overall, the authors found that researchers take account of a wide variety of perspectives yet overlook the notion of information as used by computing practitioners such as electronic engineers and software developers.
Research limitations/implications
The authors comment on some limitations of the procedure that was followed. Results 1 and 3 open up new possibilities for theoretical research in the information domain.
Originality/value
This is an attempt to conduct a bibliographical inquiry driven by objective and scientific criteria; its value lies in the fact that final report has not been influenced by personal choice or arbitrary viewpoints.
Details
Keywords
With the outset of automatic detection of information, misinformation, and disinformation, the purpose of this paper is to examine and discuss various conceptions of information…
Abstract
Purpose
With the outset of automatic detection of information, misinformation, and disinformation, the purpose of this paper is to examine and discuss various conceptions of information, misinformation, and disinformation within philosophy of information.
Design/methodology/approach
The examinations are conducted within a Gricean framework in order to account for the communicative aspects of information, misinformation, and disinformation as well as the detection enterprise.
Findings
While there often is an exclusive focus on truth and falsity as that which distinguish information from misinformation and disinformation, this paper finds that the distinguishing features are actually intention/intentionality and non-misleadingness/misleadingness – with non-misleadingness/misleadingness as the primary feature. Further, the paper rehearses the argument in favor of a true variety of disinformation and extends this argument to include true misinformation.
Originality/value
The findings are novel and pose a challenge to the possibility of automatic detection of misinformation and disinformation. Especially the notions of true disinformation and true misinformation, as varieties of disinformation and misinformation, which force the true/false dichotomy for information vs mis-/disinformation to collapse.
Details