Lei, J. van der

Using electronic health care records for drug safety signal detection: A comparative evaluation of statistical methods (Article)

2012-10-01T00:00:00Z

BACKGROUND: Drug safety monitoring relies primarily on spontaneous reporting, but electronic health care record databases offer a possible alternative for the detection of adverse drug reactions (ADRs). OBJECTIVES: To evaluate the relative performance of different statistical methods for detecting drug-adverse event associations in electronic health care record data representing potential ADRs. RESEARCH DESIGN: Data from 7 databases across 3 countries in Europe comprising over 20 million subjects were used to compute the relative risk estimates for drug-event pairs using 10 different methods, including those developed for spontaneous reporting systems, cohort methods such as the longitudinal gamma poisson shrinker, and case-based methods such as case-control. The newly developed method "longitudinal evaluation of observational profiles of adverse events related to drugs" (LEOPARD) was used to remove associations likely caused by protopathic bias. Data from the different databases were combined by pooling of data, and by meta-analysis for random effects. A reference standard of known ADRs and negative controls was created to evaluate the performance of the method. MEASURES: The area under the curve of the receiver operator characteristic curve was calculated for each method, both with and without LEOPARD filtering. RESULTS: The highest area under the curve (0.83) was achieved by the combination of either longitudinal gamma poisson shrinker or case-control with LEOPARD filtering, but the performance between methods differed little. LEOPARD increased the overall performance, but flagged several known ADRs as caused by protopathic bias. CONCLUSIONS: Combinations of methods demonstrate good performance in distinguishing known ADRs from negative controls, and we assume that these could also be used to detect new drug safety signals. Copyright

Validation study of automatically generated codes in colonoscopy using the endoscopic report system Endobase (Article)

2010-09-01T00:00:00Z

Objective. Gastrointestinal endoscopy databases are important for surveillance, epidemiology, quality control and research. A good quality of automatically generated databases to enable drawing justified conclusions based on the data is of key importance. The aim of this study is to validate the correctness of coding of a national automatically generated anonymous endoscopy database. Material and methods. We evaluated a total of 500 colonoscopies performed in five larger hospitals of the TRANS.IT project focusing on endoscopy reporting. Randomly 500 examinations were selected from a total of 5,000 examinations and their generated endoscopic terminology codes as well as complete reports were analysed. Indications for the examination and described findings were scored for correctness and clinical relevance of the coding that would be exported to the anonymous database. Results. Indications were correctly coded in 92% of all examinations (range 76100%) per hospital. Correct coding of findings ranged from 42% to 93% per hospital (mean 77%). Different correct coding proportions were seen varying with the diagnosis, with the highest correct coding rates in polyps, carcinoma and diverticular disease. Incorrect coded examinations were scored for clinical relevance. Overall 11% of the investigated examinations were incorrectly coded with clinical relevance. Conclusions. Accuracy of clinically relevant endoscopy data recorded in the TRANS.IT anonymous central database is high. Further improvement is desirable, which may be achieved by education of individual endoscopists and enhancement of the program.

Repeatability of the Manchester triage system for children (Article)

2010-07-01T00:00:00Z

Objective: The authors aimed to assess the repeatability of the Manchester Triage System (MTS) in children. Methods: All emergency department nurses (n=43) from a general teaching hospital and a university children's hospital in The Netherlands triaged 20 written case scenarios using the Manchester Triage system. Second, at two emergency departments (EDs), real-life simultaneous triage of patients (<16 years) was performed by ED nurses and two research nurses. The written case scenarios and the patients included in the real-life simultaneous triage study were representative of children attending the ED, in age, problem and urgency level. The authors assessed inter-rater agreement using quadratic weighted kappa values. Results: The weighted kappa between the nurses, triaging the case scenarios, was 0.83 (95% CI 0.74 to 0.91). In total, 88% (N=198) of the eligible ED patients were triaged simultaneously, with a weighted κ of 0.65 (95% CI 0.56 to 0.72). Conclusions: The MTS showed good to very good repeatability in paediatric emergency care.

Data mining on electronic health record databases for signal detection in pharmacovigilance: Which events to monitor? (Article)

2009-12-28T00:00:00Z

Purpose: Data mining on electronic health records (EHRs) has emerged as a promising complementary method for post-marketing drug safety surveillance. The EU-ADR project, funded by the European Commission, is developing techniques that allow mining of EHRs for adverse drug events across different countries in Europe. Since mining on all possible events was considered to unduly increase the number of spurious signals, we wanted to create a ranked list of high-priority events. Methods: Scientific literature, medical textbooks, and websites of regulatory agencies were reviewed to create a preliminary list of events that are deemed important in pharmacovigilance. Two teams of pharmacovigilance experts independently rated each event on five criteria: 'trigger for drug withdrawal', 'trigger for black box warning', 'leading to emergency department visit or hospital admission', 'probability of event to be drug-related', and 'likelihood of death'. In case of disagreement, a consensus score was obtained. Ordinal scales between 0 and 3 were used for rating the criteria, and an overall score was computed to rank the events. Results: An initial list comprising 23 adverse events was identified. After rating all the events and calculation of overall scores, a ranked list was established. The top-ranking events were: cutaneous bullous eruptions, acute renal failure, anaphylactic shock, acute myocardial infarction, and rhabdomyolysis. Conclusions: A ranked list of 23 adverse drug events judged as important in pharmacovigilance was created to permit focused data mining. The list will need to be updated periodically as knowledge on drug safety evolves and newissues in drug safety arise. Copyright

An inventory of publications on electronic medical records revisited (Article)

2009-12-01T00:00:00Z

Objectives: In this short review we provide an update of our earlier inventories of publications indexed in MedLine with the MeSH term 'Medical Records Systems, Computerized'. Methods: We retrieved and analyzed all references to English articles published before January 1, 2008, and indexed in PubMed with the MeSH term 'Medical Records Systems, Computerized'. Results: We retrieved a total of 11,924 publications, of which 3937 (33%) appeared in a journal with an impact factor. Since 2002 the number of yearly publications, and the number of journals in which those publications appeared, increased. A cluster analysis revealed three clusters: an organizational issues cluster, a technically oriented cluster and a cluster about order-entry and research. Conclusions: Although our previous inventory in 2003 suggested a constant yearly production of publications on electronic medical records since 1998, the current inventory shows another rise in production since 2002. In addition, many new journals and countries have shown interest during the last five years. In the last 15 years, interest in organizational issues remained fairly constant, order entry and research with systems gained attention, while interest in technical issues relatively decreased.

The impact of electronic memory in the treatment of dyslipidemia (Article)

2009-09-01T00:00:00Z

Manchester triage system in paediatric emergency care: Prospective observational study (Article)

2008-10-01T00:00:00Z

Objective: To validate use of the Manchester triage system in paediatric emergency care. Design: Prospective observational study. Setting: Emergency departments of a university hospital and a teaching hospital in the Netherlands, 2006-7. Participants: 17 600 children (aged <16) visiting an emergency department over 13 months (university hospital) and seven months (teaching hospital). Intervention: Nurses triaged 16 735/17 600 patients (95%) using a computerised Manchester triage system, which calculated urgency levels from the selection of discriminators embedded in flowcharts for presenting problems. Nurses over-ruled the urgency level in 1714 (10%) children who were excluded from analysis. Complete data for the reference standard were unavailable in 1467 (9%) children, leaving 13 554 patients for analysis. Main outcome measures: Urgency according to the Manchester triage system compared with a predefined and independently assessed reference standard for five urgency levels. This reference standard was based on a combination of vital signs at presentation, potentially life threatening conditions, diagnostic resources, therapeutic interventions, and follow-up. Sensitivity, specificity, and likelihood ratios for high urgency (immediate and very urgent) and 95% confidence intervals for subgroups based on age, use of flowcharts, and discriminators. Results: The Manchester urgency level agreed with the reference standard in 4582 of 13 554 (34%) children; 7311 (54%) were over-triaged and 1661 (12%) undertriaged. The likelihood ratio was 3.0 (95% confidence interval 2.8 to 3.2) for high urgency and 0.5 (0.4 to 0.5) for low urgency; though the likelihood ratios were lower for those presenting with a medical problem (2.3 (2.2 to 2.5) v 12.0 (7.8 to 18.0) for trauma) and in younger children (2.4 (1.9 to 2.9) at 0-2 months v 5.4 (4.5 to 6.5) at 8-16 years). Conclusions: The Manchester triage system has moderate validity in paediatric emergency care. It errs on the safe side, with much more over-triage than under-triage compared with an independent reference standard for urgency. Triage of patients with a medical problem or in younger children is particularly difficult.

Prevalence and treatment of hypertensive patients with multiple concomitant cardiovascular risk factors in The Netherlands and Italy (Article)

2008-08-01T00:00:00Z

The Anglo-Scandinavian Cardiac Outcomes Trial-Lipid-Lowering Arm (ASCOT-LLA) trial demonstrated the benefits of combined antihypertensive/ lipid-lowering treatment over antihypertensive treatment alone in hypertensive patients with ≥3 additional cardiovascular (CV) risk factors. We assessed the prevalence and treatment of patients with hypertension and ≥3 additional CV risk factors in The Netherlands and Italy in a retrospective cohort study using the Integrated Primary Care Information (IPCI) database in The Netherlands and the Health Search/ Thales Database (HSD) in Italy. Patients aged ≥16 years, with 1 year of valid database history, diagnosed and/or treated for hypertension (>140/90 mmHg) during 2000-2002 were included in the study. The IPCI and HSD populations consisted of ∼175 000 and ∼325 000 patients, respectively. The prevalence of hypertension increased from 20.3 to 22.3% in the IPCI, and from 19.0 to 21.8% in the HSD during 2000-2002. The prevalence of ≥3 concomitant risk factors among hypertensive patients increased from 31.2 and 31.1% in 2000 to 34.2 and 39.3% in 2002 in the IPCI and HSD, respectively. From 2000 to 2002, among hypertensive patients with ≥3 CV risk factors and no prior symptomatic CV disease (CVD) approximately 54-57% in the IPCI and 80-83% in the HSD received antihypertensive treatment. In these patients, the use of combined antihypertensive and lipid-lowering treatment increased from 14.2 to 17.6% in the IPCI and from 15.5 to 17.4% in the HSD from 2000 to 2002. This study shows that primary prevention of CVD in hypertensive patients in The Netherlands and Italy could be improved.

Randomized Trial of a Clinical Decision Support System: Impact on the Management of Children with Fever without Apparent Source (Article)

2008-01-01T00:00:00Z

Objective: To assess compliance with a clinical decision support system (CDSS) for diagnostic management of children with fever without apparent source and to study the effects of application of the CDSS on time spent in the emergency department (ED) and number of laboratory tests. Design: The CDSS was used by ED nursing staff to register children presenting with fever. The CDSS identified children that met inclusion criteria (1-36 months and fever without apparent source (FWS)) and provided patient-specific diagnostic management advice. Children at high risk for serious bacterial infection were randomized for the 'intervention' (n = 74) or the 'control' (n = 90) group. In the intervention group, the CDSS provided the advice to immediately order laboratory tests and in the control group the ED physician first assessed the children and then decided on ordering laboratory tests. Results: Compliance with registration of febrile children was 50% (683/1,399). Adherence to the advice to order laboratory tests was 82% (61/74). Children in the intervention group had a median (25th-75thpercentile) length of stay at the ED of 138 (104-181) minutes. The median length of stay at the ED in the control group was 123 (83-179) minutes. Laboratory tests were significantly more frequently ordered in the intervention group (82%) than in the control group (44%, p < 0.001, χ2test). Conclusion: Implementation of a CDSS for diagnostic management of young children with fever without apparent source was successful regarding compliance and adherence to CDSS recommendations, but had unexpected effects on patient outcome in terms of ED length of stay and number of laboratory tests. The use of the current CDSS was discontinued.

Electronic alerts versus on-demand decision support to improve dyslipidemia treatment: A cluster randomized controlled trial (Article)

2008-01-01T00:00:00Z

BACKGROUND - Indirect evidence shows that alerting users with clinical decision support systems seems to change behavior more than requiring users to actively initiate the system. However, randomized trials comparing these methods in a clinical setting are lacking. We studied the effect of both alerting and on-demand decision support with respect to screening and treatment of dyslipidemia based on the guidelines of the Dutch College of General Practitioners. METHODS AND RESULTS - In a clustered randomized trial design, 38 Dutch general practices (77 physicians) and 87 886 of their patients (39 433 men 18 to 70 years of age and 48 453 women 18 to 75 years of age) who used the ELIAS electronic health record participated. Each practice was assigned to receive alerts, on-demand support, or no intervention. We measured the percentage of patients screened and treated after 12 months of follow-up. In the alerting group, 65% of the patients requiring screening were screened (relative risk versus control=1.76; 95% confidence interval, 1.41 to 2.20) compared with 35% of patients in the on-demand group (relative risk versus control=1.28; 95% confidence interval, 0.98 to 1.68) and 25% of patients in the control group. In the alerting group, 66% of patients requiring treatment were treated (relative risk versus control=1.40; 95% confidence interval, 1.15 to 1.70) compared with 40% of patients (relative risk versus control=1.19; 95% confidence interval, 0.94 to 1.50) in the on-demand group and 36% of patients in the control group. CONCLUSION - The alerting version of the clinical decision support systems significantly improved screening and treatment performance for dyslipidemia by general practitioners.

Applied information retrieval and multidisciplinary research: New mechanistic hypotheses in Complex Regional Pain Syndrome (Article)

2007-05-04T00:00:00Z

Background: Collaborative efforts of physicians and basic scientists are often necessary in the investigation of complex disorders. Difficulties can arise, however, when large amounts of information need to reviewed. Advanced information retrieval can be beneficial in combining and reviewing data obtained from the various scientific fields. In this paper, a team of investigators with varying backgrounds has applied advanced information retrieval methods, in the form of text mining and entity relationship tools, to review the current literature, with the intention to generate new insights into the molecular mechanisms underlying a complex disorder. As an example of such a disorder the Complex Regional Pain Syndrome (CRPS) was chosen. CRPS is a painful and debilitating syndrome with a complex etiology that is still unraveled for a considerable part, resulting in suboptimal diagnosis and treatment. Results: A text mining based approach combined with a simple network analysis identified Nuclear Factor kappa B (NFκB) as a possible central mediator in both the initiation and progression of CRPS. Conclusion: The result shows the added value of a multidisciplinary approach combined with information retrieval in hypothesis discovery in biomedical research. The new hypothesis, which was derived in silico, provides a framework for further mechanistic studies into the underlying molecular mechanisms of CRPS and requires evaluation in clinical and epidemiological studies.

Of new times, new opportunities, and old problems (Article)

2007-05-01T00:00:00Z

Internet and written respiratory questionnaires yield equivalent results for adolescents (Article)

2007-04-01T00:00:00Z

This study compared results from Internet and written questionnaires about respiratory symptoms in order to find out if both forms of the survey yielded the same answers. One thousand seventy-one students, ages 13 to 17, were asked to complete either an Internet or a written questionnaire. The demographic characteristics of the participants equalled those of the general Dutch adolescent population. Participants were randomly assigned to fill out an electronic or written questionnaire. In addition to eight items from the International Study of Asthma and Allergies in Childhood (ISAAC) questionnaire, two items on doctor visits (medical attention) regarding asthma or allergic disease during the past 12 months were included. The participation rate was 87%. The Internet version of the questionnaire showed fewer missing answers than the written version, but this was not statistically significant. The respiratory items did not show statistically significant score differences between the Internet and written modes of administration, and there was no visible trend for higher respectively lower scores by either mode of questionnaire administration. From these results, we conclude that respiratory questionnaires may be provided to adolescents electronically rather than on paper, since both approaches yielded equal results. To generalize these findings, we recommend repeated studies in other settings.

SYMBIOmatics: Synergies in Medical Informatics and Bioinformatics - Exploring current scientific literature for emerging topics (Article)

2007-03-08T00:00:00Z

Background: The SYMBIOmatics Specific Support Action (SSA) is "an information gathering and dissemination activity" that seeks "to identify synergies between the bioinformatics and the medical informatics" domain to improve collaborative progress between both domains (ref. to http://www.symbiomatics.org). As part of the project experts in both research fields will be identified and approached through a survey. To provide input to the survey, the scientific literature was analysed to extract topics relevant to both medical informatics and bioinformatics. Results: This paper presents results ofa systematic analysis of the scientific literature from medical informatics research and bioinformatics research. In the analysis pairs of words (bigrams) from the leading bioinformatics and medical informatics journals have been used as indication of existing and emerging technologies and topics over the period 2000-2005 ("recent") and 1990-1990 ("past"). We identified emerging topics that were equally important to bioinformatics and medical informatics in recent years such as microarray experiments, ontologies, open source, text mining and support vector machines. Emerging topics that evolved only in bioinformatics were system biology, protein interaction networks and statistical methods for microarray analyses, whereas emerging topics in medical informatics were grid technology and tissue microarrays. Conclusion: We conclude that although both fields have their own specific domains of interest, they share common technological developments that tend to be initiated by new developments in biotechnology and computer science.

Cost consequences of implementing an electronic decision support system for ordering laboratory tests in primary care: Evidence from a controlled prospective study in the Netherlands (Article)

2007-02-01T00:00:00Z

Background: The economic consequences of interventions to promote rational, evidence-based use of laboratory tests by physicians are not yet fully understood. We evaluated the cost consequences of a computer-based, guideline-driven decision-support system (CDSS) for ordering blood tests in primary care. Methods: We installed the CDSS in 118 practices [159 general practitioners (GPs)] throughout The Netherlands and calculated the costs of the intervention in this group. During a period of 6 months before and 6 months after installation of the CDSS, the test-ordering behavior of 87 (109 GPs) of these 118 study practices was studied and the results were compared with those of a nonhistorical control group that did not receive the CDSS. In addition the costs of laboratory requests were calculated for both groups. Results: Total intervention costs, comprising development costs and installation costs, amounted to €79 000 (€670 per practice). Whereas the introduction of the CDSS did not affect the number of order forms submitted to the laboratories, it did reduce the number of blood tests per order form. As a result, the CDSS yielded mean savings on the costs of laboratory requests of €847 per practice per 6 months. Conclusions: This study demonstrates that providing electronic decision support for ordering blood tests in primary care represents an economically promising concept. Savings on laboratory costs are achievable and not offset by disproportionally high intervention costs.

Structured data entry for narrative data in a broad specialty: patient history and physical examination in pediatrics. (Article)

2006-07-13T00:00:00Z

BACKGROUND: Whereas an electronic medical record (EMR) system can partly address the limitations, of paper-based documentation, such as fragmentation of patient data, physical paper records missing and poor legibility, structured data entry (SDE, i.e. data entry based on selection of predefined medical concepts) is essential for uniformity of data, easier reporting, decision support, quality assessment, and patient-oriented clinical research. The aim of this project was to explore whether a previously developed generic (i.e. content independent) SDE application to support the structured documentation of narrative data (called OpenSDE) can be used to model data obtained at history taking and physical examination of a broad specialty. METHODS: OpenSDE was customized for the broad domain of general pediatrics: medical concepts and its descriptors from history taking and physical examination were modeled into a tree structure. RESULTS: An EMR system allowing structured recording (OpenSDE) of pediatric narrative data was developed. Patient history is described by 20 main concepts and physical examination by 11. In total, the thesaurus consists of about 1800 items, used in 8648 nodes in the tree with a maximum depth of 9 levels. Patient history contained 6312 nodes, and physical examination 2336. User-defined entry forms can be composed according to individual needs, without affecting the underlying data representation. The content of the tree can be adjusted easily and sharing records among different disciplines is possible. Data that are relevant in more than one context can be accessed from multiple branches of the tree without duplication or ambiguity of data entry via "shortcuts". CONCLUSION: An expandable EMR system with structured data entry (OpenSDE) for pediatrics was developed, allowing structured documentation of patient history and physical examination. For further evaluation in other environments, the tree structure for general pediatrics is available at the Erasmus MC Web site (in Dutch, translation into English in progress) 1. The generic OpenSDE application is available at the OpenSDE Web site 2.

Non-cardiac QTc-prolonging drugs and the risk of sudden cardiac death. (Article)

2005-10-01T00:00:00Z

AIMS: To assess the association between the use of non-cardiac QTc-prolonging drugs and the risk of sudden cardiac death. METHODS AND RESULTS: A population-based case-control study was performed in the Integrated Primary Care Information (IPCI) project, a longitudinal observational database with complete medical records from more than 500,000 persons. All deaths between 1 January 1995 and 1 September 2003 were reviewed. Sudden cardiac death was classified based on the time between onset of cardiovascular symptoms and death. For each case, up to 10 random controls were matched for age, gender, date of sudden death, and general practice. The exposure of interest was the use of non-cardiac QTc-prolonging drugs. Exposure at the index date was categorized into three mutually exclusive groups of current use, past use, and non-use. The study population comprised 775 cases of sudden cardiac death and 6297 matched controls. Current use of any non-cardiac QTc-prolonging drug was associated with a significantly increased risk of sudden cardiac death (adjusted OR: 2.7; 95% CI: 1.6-4.7). The risk of death was highest in women and in recent starters. CONCLUSION: The use of non-cardiac QTc-prolonging drugs in a general population is associated with an increased risk of sudden cardiac death.

Identification of the four conventional cardiovascular disease risk factors by Dutch general practitioners. (Article)

2005-10-01T00:00:00Z

BACKGROUND: Detecting and managing the four major conventional risk factors, smoking, hypertension, diabetes mellitus, and hypercholesterolemia, is pivotal in the primary and secondary prevention of cardiovascular disease (CVD). OBJECTIVE: To assess the preventive activities of general practitioners (GPs) regarding the four conventional risk factors and the associated measurements for cardiovascular risk factors by GPs in relation to the time of the first clinical presence of CVD. SETTING: Large longitudinal general practice research database (the Integrated Primary Care Information database) in the Netherlands from September 1999 to August 2003. PARTICIPANTS AND METHODS: Patients > 18 year of age with newly diagnosed CVD with a valid history of at least 1 year before and after the first clinical diagnosis of CVD. Details on conventional risk factors and associated measurements for the four cardiovascular risk factors were assessed in relation to the first clinical diagnosis of CVD. RESULTS: In total, 157,716 patients met the study inclusion criteria. Of the 2,594 patients with newly diagnosed CVD, at least one of the four investigated risk factors was observed in 76% of women and 73% of men. In 40% of cases, no risk factor was recorded before the date of the first CVD diagnosis. In 16% of cases, no associated measurements were present before the first CVD diagnosis. CONCLUSION: In daily practice, GPs seem to focus on the secondary prevention of CVD. Intervention strategies that aim to influence GPs' case finding behavior should focus on increasing the awareness of physicians in performing risk factor-associated measurements in patients who are eligible for the primary prevention of CVD. Further research will have to show the feasibility and effectiveness of such intervention strategies.

Annual revaccination against influenza and mortality risk in community-dwelling elderly persons. (Article)

2004-11-03T00:00:00Z

CONTEXT: Although large-scale observational studies have demonstrated the effectiveness of influenza vaccination, no large studies have systematically addressed the clinical benefit of annual revaccinations. OBJECTIVE: To investigate the effect of annual influenza revaccination on mortality in community-dwelling elderly persons. DESIGN, SETTING, AND PARTICIPANTS: A population-based cohort study using the computerized Integrated Primary Care Information (IPCI) database in the Netherlands including community-dwelling individuals aged 65 years or older from 1996 through 2002. For each year, we computed the individual cumulative exposure to influenza vaccination since study start. MAIN OUTCOME MEASURE: Association between the number of consecutive influenza vaccinations and all-cause mortality vs no vaccination after adjusting for age, sex, chronic respiratory and cardiovascular disease, hypertension, diabetes mellitus, renal failure, and cancer. RESULTS: The study population included 26,071 individuals, of whom 3485 died during follow-up. Overall, a first vaccination was associated with a nonsignificant annual reduction of mortality risk of 10% (hazard ratio [HR], 0.90; 95% confidence interval [CI], 0.78-1.03) while revaccination was associated with a reduced mortality risk of 24% (HR, 0.76; 95% CI, 0.70-0.83). Compared with a first vaccination, revaccination was associated with a reduced annual mortality risk of 15% (HR, 0.85; 95% CI, 0.75-0.96). During the epidemic periods this reduction was 28% (HR, 0.72; 95% CI, 0.53-0.96). Similar estimates were obtained for persons with and without chronic comorbidity and those aged 70 years or older at baseline. Overall, influenza vaccination is estimated to prevent 1 death for every 302 vaccinees at a vaccination coverage that varied between 64% and 74%. CONCLUSION: Annual influenza vaccination is associated with a reduction in all-cause mortality risk in a population of community-dwelling elderly persons, particularly in older individuals.

OpenSDE: Row modeling applied to generic structured data entry. (Article)

2004-03-01T00:00:00Z

Clinicians generally record medical narrative data, such as current complaints, physical examination, and progress notes, as free text in paper-based medical records. The medical narrative involves heterogeneous and detailed data that include the description of (multiple) occurrences of medical findings or symptoms that may progress over time. Structured, electronic recording of narrative data would facilitate the use of these data for research. The authors' OpenSDE application supports clinicians with the structured recording of narrative data in both research and care settings. Data entry is enabled using forms that are generated using domain-specific trees of medical concepts. For data storage, the authors have expanded the traditional row modeling methodology with additional columns that allow structured representation of medical narratives including descriptions of findings, multiple occurrences of findings, and the progression of findings over time.

AsthmaCritic: issues in designing a noninquisitive critiquing system for daily practice. (Article)

2003-09-01T00:00:00Z

The noninquisitive critiquing system, AsthmaCritic, uses routinely recorded electronic patient data to select and analyze records of patients with asthma or chronic obstructive pulmonary disease (COPD). The system generates critiquing comments and adds these comments to the patient record. The system was developed by using and expanding an existing generic critiquing system. After a brief overview of the system, this report focuses on the authors' design choices in light of existing literature and the issues that underlie these design choices. Currently, AsthmaCritic is used by primary care physicians and is undergoing clinical evaluation.

Cholgate - a randomized controlled trial comparing the effect of automated and on-demand decision support on the management of cardiovascular disease factors in primary care (Article)

2003-01-01T00:00:00Z

Automated and on-demand decision support systems integrated into an electronic medical record have proven to be an effective implementation strategy for guidelines. Cholgate is a randomized controlled trial comparing the effect of automated and on-demand decision support on the management of cardiovascular disease factors in primary care.

Towards personalized Internet health information: The STEPPS architecture (Article)

2002-12-01T00:00:00Z

Primary objective: STEPPS (STructured Evaluated Personalized Patient Support) proposes a strategy for integration of electronic patient records with Internet health-related content and its consequent use in personalized information retrieval for patient education. The application domain is the post-discharge support of burn patients in the Netherlands. Materials and methods: We developed an electronic patient record interface for structured data collection in burn care. The systems thesaurus was projected to UMLS terms and the corresponding codes were incorporated in our software. A list of topics central to burn patient education was identified and a collection of related Web pages was compiled using meta-search software (Copernic2001Pro®). The HTML pages were filed into catalogues by the Collexis®indexing-matching software, using the UMLS Metathesaurus as indexing vocabulary. Results: The bilingual (English and Dutch) structured data interface is currently used to create a database of retrospective patient data. Each patients profile, i.e. set of characteristics employed to personalize information retrieval, can be automatically extracted. We have assembled a collection of more than 2500 Internet pages containing relevant information for burn patients. When patient data is available, the Collexis®matching engine will accept the patients profile as input and retrieve the most relevant HTML documents available in the catalogues. Discussion: We have addressed some basic issues around the technical feasibility of linking electronic patient record data to online content. Although the functionality of STEPPS is not yet optimal, it contributes to the efforts towards improved relevance of information retrieval. Electronic patient record applications in conjunction with Internet resources can give a significant boost to the availability of tailored health education material. In this context, quality assurance of online health information is an indispensable element.

Compliance of general practitioners with a guideline-based decision support system for ordering blood tests (Article)

2002-01-01T00:00:00Z

BACKGROUND: Guidelines are viewed as a mechanism for disseminating a rapidly increasing body of knowledge. We determined the compliance of Dutch general practitioners with the recommendations for blood test ordering as defined in the guidelines of the Dutch College of General Practitioners. METHODS: We performed an audit of guideline compliance over a 12-month period (March 1996 through February 1997). In an observational study, a guideline-based decision support system for blood test ordering, BloodLink, was integrated with the electronic patient records of 31 general practitioners practicing in 23 practices (16 solo). BloodLink followed the guidelines of the Dutch College of General Practitioners. We determined compliance by comparing the recommendations for test ordering with the test(s) actually ordered. Compliance was expressed as the percentage of order forms that followed the recommendations for test ordering. RESULTS: Of 12 668 orders generated, 9091 (71%) used the decision-support software rather than the paper order forms. Twelve indications accounted for >80% of the 7346 order forms that selected a testing indication in BloodLink. The most frequently used indication for test ordering was "vague complaints" (2209 order forms; 30.1%). Of the 7346 order forms, 39% were compliant. The most frequent type of noncompliance was the addition of tests. Six of the 12 tests most frequently added to the order forms were supported by revisions of guidelines that occurred within 3 years after the intervention period. CONCLUSIONS: In general practice, noncompliance with guidelines is predominantly caused by adding tests. We conclude that noncompliance with a guideline seems to be partly caused by practitioners applying new medical insight before it is incorporated in a revision of that guideline.

Feasibility of AsthmaCritic, a decision-support system for asthma and COPD which generates patient-specific feedback on routinely recorded data in general practice (Article)

2002-01-01T00:00:00Z

BACKGROUND: Introducing decision-support systems as a tool to stimulate the dissemination of clinical guidelines in daily practice has been disappointing. Researchers have argued that integration of such systems with clinical practice is a prerequisite for acceptance. The big question concerns the feasibility of a true integration--if only routinely recorded data are used for such a system, can patient-specific feedback be produced? OBJECTIVE: The aim of this study was to assess the feasibility of generating patient-specific feedback based on routinely recorded data in general practice by AsthmaCritic, a decision-support system for asthma and chronic obstructive pulmonary disease (COPD). METHODS: We built the decision-support system AsthmaCritic and assessed its ability to detect asthma and COPD patient records and generate patient-specific feedback by retrospective analysis of routinely recorded data in 103 713 electronic patient records from primary care practices. We grouped feedback into categories of comments by age group (<12 years and > or =12 years). The main outcome measures were the number and percentage of "triggered" (selected) asthma and COPD patient records, and the number and percentage of records on which AsthmaCritic produced at least one feedback comment during the 1-year study period, by category of comments. RESULTS: AsthmaCritic detected 8784 (8.5%) asthma and COPD patient records. During the study period, AsthmaCritic generated 255 664 feedback comments (mean 3.4 per patient visit). The most frequently generated category of comments in the case of patients aged > or =12 years was "non-compliant prescription" (23.7%), whereas the most frequent category in the case of patients <12 years was "non-compliant route" (31.1%). CONCLUSIONS: This study shows that, using routinely recorded data only, AsthmaCritic is able to detect asthma and COPD patient records for further analysis and to produce patient-specific feedback.

Electronic messaging between primary and secondary care: a four-year case report (Article)

2001-01-01T00:00:00Z

OBJECTIVE: To observe how electronic messaging between a hospital consultant and general practitioners (GPs) in 15 practices about patients suffering from diabetes evolved over a 3-year period after an initial 1-year study. DESIGN: Case report. Electronic messages between a hospital consultant and GPs were counted. The authors determined whether a message sent by the consultant was integrated into the receiving GP's electronic medical record system. After the observation period, the GPs answered a questionnaire. MEASUREMENTS: The number of electronic messages and the percentage of messages integrated into the electronic medical record. RESULTS: The volume of messages was maintained during the 3 years after the original study. In the original study, the percentage of the messages integrated by the GPs increased during the year. After that study, however, seven GPs stopped integrating data from messages. The extent to which received messages were integrated varied widely among practices. CONCLUSION: The authors conclude that extrapolation of the results of the original study would have led to incorrect conclusions. Although the volume of messages remained stable after the original study, GPs changed their method of handling messages. Initially, all GPs used the opportunity to copy data from the messages into their own records. At the end of the observation period (that is, the 3 years after completion of the original study), more than 50 percent of GPs had ceased copying data from the messages into their own records. The majority of GPs, however, wanted to expand the use of electronic messaging.

Effects of electronic communication between the GP and the pharmacist. The quality of medication data on admission and after discharge (Article)

2001-01-01T00:00:00Z

BACKGROUND: When a patient is admitted to a hospital, the need for information about the medications prescribed is an important issue. OBJECTIVES: Our aim was to assess whether electronic communication between the GP and the pharmacist provides better information regarding current medication when a patient is admitted to the hospital than paper-based communication. METHODS: A prospective study was carried out whereby on the day of admission and 10 days after discharge, three different data collectors independently asked the patient, the GP and the pharmacist details of the patient's current medication. Five GPs and a local pharmacy relying on electronic communication, and five GPs and a local pharmacy relying on paper-based communication were studied. RESULTS: A total of 139 patients were included on the first day of their admission, and 116 on the tenth day after discharge. Of the 275 drugs that the patient, the GP and/or the pharmacist reported on admission in the electronic group, 134 (49%) were reported by the patient, the GP and the pharmacist, and 79 (29%) were not reported by the patient. For the paper group, these figures were 340 drugs on admission, of which 107 (31%) were reported by the patient, the GP and the pharmacist, while 130 (38%) were not reported by the patient. CONCLUSIONS: We conclude that electronic communication between the GP and the community pharmacist results in a better agreement between them with respect to the current medication of the patient than paper-based communication. However, electronic communication does not suffice as a solution to obtain reliable information.

Analysis of the practice guidelines of the Dutch College of General Practitioners with respect to the use of blood tests (Article)

1999-01-01T00:00:00Z

OBJECTIVE: To determine the consistency among the practice guidelines of the Dutch College of General Practitioners with respect to the use of blood tests. METHODS: The authors evaluated 64 practice guidelines of the Dutch College of General Practitioners. For each guideline, they analyzed each sentence that contained a reference to a blood test to determine the clinical situation in which the test should be performed (the indication) and to determine the tests that should be performed in that situation (the recommended test). An incomplete recommendation refers to a guideline that mentioned a blood test but did not identify the indication for that test. An inconsistency refers to the situation in which one guideline recommended a certain test for a given indication whereas another guideline mentioned the same indication but did not recommend the same test. RESULTS: Twenty-seven practice guidelines mentioned blood tests. Of these, three explicitly recommended not to request blood tests. Five guidelines contained incomplete recommendations, and the authors encountered two inconsistencies among the guidelines. Twenty-three guidelines mentioned blood tests and allowed the authors to identify indications and recommended tests. CONCLUSION: The identification of indications and recommended tests allows evaluation of consistency among practice guidelines. Although some incomplete recommendations and inconsistencies were discovered, the majority of the guidelines provide clear and unambiguous recommendations for blood-test ordering in primary care.

Simulating an integrated critiquing system (Article)

1998-01-01T00:00:00Z

OBJECTIVE: To investigate factors that determine the feasibility and effectiveness of a critiquing system for asthma/COPD that will be integrated with a general practitioner's (GP's) information system. DESIGN: A simulation study. Four reviewers, playing the role of the computer, generated critiquing comments and requests for additional information on six electronic medical records of patients with asthma/COPD. Three GPs who treated the patients, playing users, assessed the comments and provided missing information when requested. The GPs were asked why requested missing information was unavailable. The reviewers reevaluated their comments after receiving requested missing information. MEASUREMENTS: Descriptions of the number and nature of critiquing comments and requests for missing information. Assessment by the GPs of the critiquing comments in terms of agreement with each comment and judgment of its relevance, both on a five-point scale. Analysis of causes for the (un-)availability of requested missing information. Assessment of the impact of missing information on the generation of critiquing comments. RESULTS: Four reviewers provided 74 critiquing comments on 87 visits in six medical records. Most were about prescriptions (n = 28) and the GPs' workplans (n = 27). The GPs valued comments about diagnostics the most. The correlation between the GPs' agreement and relevance scores was 0.65. However, the GPs' agreements with prescription comments (complete disagreement, 31.3%; disagreement, 20.0%; neutral, 13.8%; agreement, 17.5%; complete agreement, 17.5%) differed from their judgments of these comments' relevance (completely irrelevant, 9.0%; irrelevant, 24.4%; neutral, 24.4%; relevant, 32.1%; completely relevant, 10.3%). The GPs were able to provide answers to 64% of the 90 requests for missing information. Reasons available information had not been recorded were: the GPs had not recorded the information explicitly; they had assumed it to be common knowledge; it was available elsewhere in the record. Reasons information was unavailable were: the decision had been made by another; the GP had not recorded the information. The reviewers left 74% of the comments unchanged after receiving requested missing information. CONCLUSION: Human reviewers can generate comments based on information currently available in electronic medical records of patients with asthma/COPD. The GPs valued comments regarding the diagnostic process the most. Although they judged prescription comments relevant, they often strongly disagreed with them, a discrepancy that poses a challenge for the presentation of critiquing comments for the future critiquing system. Requested additional information that was provided by the GPs led to few changes. Therefore, as system developers faced with the decision to build an integrated, non-inquisitive or an inquisitive critiquing system, the authors choose the former.