01116nas a2200145   4500000000100000008004100001260001500042100001800057245007500075856004700150300001000197490000700207520074200214022001400956       2004                            d  c2004-04-011 aLiv Langfeldt00aExpert panels evaluating research: decision-making and sources of bias  uhttps://doi.org/10.3152/147154404781776536  a51-620 v133 aThis study consists of in-depth analysis of six international evaluations of Norwegian research. There was little overlapping competence on the panels, a high degree of task division and the composition of an expert panel, the organisation of its work and lack of group interaction, may have been decisive for the conclusions of the evaluations. Moreover, there seems to have been a serious disparity between the processes and resources of the studied evaluations and the demands that ideally should be met when judging scholarly quality. The revealed weaknesses are believed to be inherent to the concept of expert panel evaluation of research as an instrument for national research policy, and not specific for the studied evaluations.  a0958-2029