http://repub.eur.nl/res/aut/434/ List of Publications en http://repub.eur.nl/static-eur/img/logo.png http://repub.eur.nl http://repub.eur.nl/res/pub/40055/ 2013-05-09T00:00:00Z Even though peer process feedback is an often used tool to enhance the effectiveness of collaborative learning environments like PBL, the conditions under which it is best facilitated still need to be investigated. Therefore, this study investigated the effects of individual versus shared reflection and goal setting on students' individual contributions to the group and their academic achievement. In addition, the influence of prior knowledge on the effectiveness of peer feedback was studied. In this pretest-intervention-posttest study 242 first year students were divided into three conditions: condition 1 (individual reflection and goal setting), condition 2 (individual and shared reflection and goal setting), and condition 3 (control group). Results indicated that the quality of individual contributions to the tutorial group did not improve after receiving the peer feedback, nor did it differ between the three conditions. With regard to academic achievement, only males in conditions 1 and 2 showed better academic achievement compared with condition 3. However, there was no difference between both ways of reflection and goal setting with regard to achievement, indicating that both ways are equally effective. Nevertheless, it is still too early to conclude that peer feedback combined with reflection and goal setting is not effective in enhancing students' individual contributions. Students only had a limited number of opportunities to improve their contributions. Therefore, future research should investigate whether an increase in number of tutorial group meetings can enhance the effectiveness of peer feedback. In addition, the effect of quality of reflection and goal setting could be taken into consideration in future research. http://repub.eur.nl/res/pub/39986/ 2013-01-01T00:00:00Z Within Problem-Based Learning successful learning depends on the quality of cognitive, social and motivational contributions students make to the tutorial group. But at the same time, not all students in PBL automatically contribute in a high quality manner, which might impede successful group functioning. This study investigated whether peer process feedback combined with goal setting can be used to improve the quality of students' individual contributions. A mixed-methods explanatory design, in which 74 second-year Health Sciences students participated, combined a pre- and posttest with a focus group. The results indicated that the quality of the contributions only increased for students with a below average score on the pre-test. The qualitative data confirmed that the impact of the feedback could be increased by combining individual reflection by means of goal setting with face-to-face discussion. Another suggestion is to investigate whether midterm peer process feedback is more effective for first year students, because they are still developing their tutorial behavior, as opposed to second year students. http://repub.eur.nl/res/pub/38662/ 2012-09-28T00:00:00Z Although elaboration has been investigated frequently, there is little evidence for the beneficial effect of elaboration in problem-based learning. A controlled experiment tested the effect of elaboration during problem-based discussion on recall. Sixty-seven students observed a video-recorded, problem-based discussion. In one experimental condition, a tutor in the video encouraged participants to elaborate by asking elaborative questions. In a second condition, the tutor asked superficial questions. After the discussion, all participants studied a text with relevant new information. Elaborative questions had no significant effect on recall of idea units from the text, p = .39, η2= .01. High-ability students outperformed low-ability students, p = .04, η2= .07, but this effect did not interact with the experimental treatment, p = .22, η2= .02. Suggestions for further research are presented. http://repub.eur.nl/res/pub/17781/ 2011-03-01T00:00:00Z Seventy students participated in an experiment to measure the effects of either providing explanations or listening during small group discussions on recall of related subject-matter studied after the discussion. They watched a video of a small group discussing a problem. In the first experimental condition, the video was stopped at various points in time, enabling the participants to verbally respond to the discussion. In the second condition, they listened to the same discussion, without contributing. In the control condition, they listened to a discussion that was not related to the subject-matter subsequently studied. After the discussion, all participants studied a text and answered questions that tested their recall of information from this text. No immediate differences in recall were found. One month later, participants who had actively engaged in explaining remembered more from the text. The conclusion appears justified that actively providing explanations during a discussion positively affects long-term memory. http://repub.eur.nl/res/pub/2899/ 1998-05-06T00:00:00Z Student assessment in community settings presents problems for medical teachers, e.g. difficulties in assessing the contribution of individual members to group work, and lack of test standardization due to varying field conditions. The Faculty of Medicine, University of Gezira, Sudan is a community-oriented, community-based medical school which has adopted a comprehensive approach to student assessment in community settings using various methods, including peer assessment, a supervisory checklist, community feedback, reports from students, short essay questions (SEQs) and multiple choice questions (MCQs). Each method focuses on a specific aspect of the objectives of the community-based programme and is weighted in the final grade according to the extent to which objectives were covered. This assessment programme contrasts with the conventional teacher-centred approach, and is continuously monitored and improved using a variety of sources of information. A total of 105 students participated in a study designed to measure the reliability and validity of this approach. The reliability of the methods was tested by computing the alpha coefficient and was found to range between 0.77 and 0.92. This was considered acceptable. The validity of the instruments was examined using confirmatory factor analysis, and their content validity was reviewed. The results show that the comprehensive approach used is fairly valid. It is suggested that the University's approach is successful in solving some of the problems of student assessment in community settings. http://repub.eur.nl/res/pub/2898/ 1998-01-01T00:00:00Z The assessment of students in community settings faces unique difficulties. Since students are usually posted in small groups in different community settings and since the learning (largely) takes place outside the classroom, assessing student performance becomes an intrinsically complex endeavor. In this article, the proposition is made and tested that peers may be used to accurately assess particular aspects of performance, in particular those which need extensive and close observation. Examples are: Effort displayed while working in a community, quality of the interaction with that community, display of leadership, and subject-matter contributions. http://repub.eur.nl/res/pub/2679/ 1997-01-01T00:00:00Z Although clinical clerkships are an important and essential part of any medical training program, medical schools' policy makers seem to exert little control on the educational effectiveness of clerkships. However, educational quality of clerkships may be assured and improved by using information from evaluation. The success of the usefulness of evaluation results is clearly associated with the fulfilment of a number of conditions: willingness to adopt a critical attitude, willingness to analyse the existing situation, opportunities to discuss and carry on a dialogue, availability of a plan of action and continuous collection of evaluative data. This paper describes these conditions and the way in which they were translated in the context of clinical clerkships. http://repub.eur.nl/res/pub/2685/ 1996-09-01T00:00:00Z http://repub.eur.nl/res/pub/2686/ 1996-01-01T00:00:00Z http://repub.eur.nl/res/pub/2687/ 1996-01-01T00:00:00Z http://repub.eur.nl/res/pub/2690/ 1995-01-01T00:00:00Z http://repub.eur.nl/res/pub/2701/ 1994-07-01T00:00:00Z A major assumption of problem-based learning (PBL) is that learning issues, generated by students while discussing a problem, are used as guides for self-directed learning activities. This assumption, though basic to PBL, has never been tested. At the University of Limburg, the Netherlands, two procedures have been developed that reflect the extent to which students are able to identify important learning issues given a particular problem, and whether subsequent, independent, learning corresponds with these learning issues. The focus of the present article will be on the relationship between the two. We have explored to what extent student-generated learning issues are a major factor influencing the nature of students' self-study, or whether other factors may be involved in decisions on what to study and how much time to spend on topics selected. First, the production of learning issues was studied and represented as the percentage of overlap between learning issues raised by students and pre-set faculty objectives for each problem. The second procedure consisted of the administration of a 'Topic Checklist' (TOC) which purports to measure students' actual self-directed learning activities. The TOC consists of a list of topics specifying the intended course content. Students were asked to indicate on a five-point Likert scale how much time they had spent studying each topic and to what degree they had mastered that topic. Third, learning issues and TOC topics were compared directly in a qualitative sense. Comparisons between the procedures revealed that a low proportion of variance of TOC scores could be predicted from the percentage of faculty objectives identified for each problem and the direct match between learning issues and TOC scores. It is concluded that scrutinizing student-generated learning issues and topics covered during self-study may provide information about what content is covered by students in tutorial groups. The discrepancy between the results of the measurements suggests, however, that learning issues produced during group discussion are not the sole source on which students base self-study decisions. Several other factors may be involved, such as tutor guidance, content already covered in previous units, issues raised during sessions with resource persons, and the nature of the learning resources available. Therefore, the relationship between learning issues and content covered during self-study is not as straightforward as is suggested. http://repub.eur.nl/res/pub/2702/ 1994-01-01T00:00:00Z An instrument has been developed to assess tutor performance in problem-based tutorial groups. This tutor evaluation questionnaire consists of 13 statements reflecting the tutor's behaviour. The statements are based on a description of the tasks set for the tutor. This study reports results on the validity and reliability of the instrument. Confirmatory factor analysis showed that a three-factor model fitted the data reasonably well. The three factors are: (1) guiding students through the learning process, (2) content knowledge input, and (3) commitment to the group's learning. Generalizability studies indicated that the rating scales provide reliable information with student responses of existing tutorial group sizes. It is concluded that the tutor evaluation questionnaire is a fairly valid and reliable instrument that can be used in staff development programmes. http://repub.eur.nl/res/pub/2703/ 1994-01-01T00:00:00Z In problem-based learning, the development of self-directed learning skills is encouraged through confronting students with (professional) problems. However, several other elements of a problem-based curriculum, such as general teaching objectives, lectures and tutors, may have an impact on students' actual learning activities. The present study focuses on the extent to which various elements of a problem-based curriculum influence students' decisions on what to study. First, interviews were conducted to obtain qualitative data about what actually takes place when students initiate learning activities during self-study. Based on the findings of these interviews, a questionnaire was developed, consisting of statements describing elements of the learning process and their influence on student learning. Elements included in the questionnaire were: the discussion in the tutorial group, content tested, course objectives, lectures, the tutor and reference literature. The students reported that all these elements may have an impact on decisions on what to study. Moreover, first-year students tend to rely more on the literature cited in the references list and content covered in lectures and tests than students in the other three curriculum years. In general, the influence of these elements showed a decrease over the four curriculum years. The influence of the discussion in the tutorial group, on the contrary, tended to increase over the four curriculum years. These findings suggest that students in a problem-based curriculum become more accomplished self-directed learners over the four curriculum years, even although they are provided with many clues which may play a role in their decisions on what to study. http://repub.eur.nl/res/pub/2704/ 1994-01-01T00:00:00Z http://repub.eur.nl/res/pub/2713/ 1993-12-03T00:00:00Z In order to measure instructional quality, several methods have been proposed in the literature, among them student performance on achievement tests and student ratings of the quality of instruction. Both methods have in common that they tend to ignore course content coverage, although this is an important determinant of instructional quality. In this article a procedure is described which is used to assess students' actual learning activities. This procedure, the Topic Checklist, makes use of student ratings. Reliability, validity, and utility studies were conducted. The results suggest that the Topic Checklist is a reliable and fairly valid procedure to evaluate course content coverage and to detect problem areas in a course, providing feedback useful for carrying out improvements. http://repub.eur.nl/res/pub/2712/ 1993-01-01T00:00:00Z Background. Problem-based learning (PBL) emphasizes active generation of learning issues by students. Both students and reachers, however, tend to worry that not all important knowledge will be acquired. To explore this question, problem effectiveness (i.e., for each problem, the degree of correspondence between student-generated learning issues and preset faculty objectives) was examined in three interdependent studies. Method. The three studies used the same participants: about 120 second-year students and 12 faculty tutors in a six-week course on normal pregnancy, delivery, and child development at the medical school of the University of Limburg in The Netherlands, 1990-91. The participants were randomly assigned to 12 tutorial groups that were each given the same 12 problems; the problems were based on 51 faculty objectives; the tutors were asked to record all learning issues generated by their groups. Study 1 addressed this question: To what degree are faculty objectives reflected by student-generated learning issues? Study 2: To what extent do students miss certain objectives, and are these objectives classifiable? Study 3: Do students generate learning issues not expected by the faculty, and are these issues relevant to course content, and finally, why do students generate these issues? To help answer these questions, the studies employed expert raters and a teacher familiar with the course content. Results. Study 1: For the set of 12 problems, the average overlap between learning issues and faculty objectives was 64.2%, with the percentages for individual problems ranging from 27.7% to 100%. Study 2: Of the 51 objectives, 30 were not identified by at least one tutorial group; these objectives were grouped into three categories; on average, each group failed to identify 7.4 objectives (15%). Study 3: Of 520 learning issues, 32 (6%) were unexpected; 15 of these were judged to be at least fairly relevant to course content; they were grouped into four categories. Conclusions. The students' learning activities covered an average of 64% of the intended course content; in addition, the students generated learning issues not expected by the faculty, and half of these issues were judged relevant to the course content. Thus, PBL seems to permit students to adapt learning activities to their own needs and interests.