Adequacy and quality of immunization data in a comprehensive electronic health record system.
Background and Purpose: Timely, simultaneous and combined vaccination is important to protect children from common infectious diseases. In a large health care delivery system in Western Kenya, we examined the adequacy and quality of data within the electronic health record (EHR) to assess the feasibility of developing a clinical decision support system to improve childhood vaccination uptake and coverage.
Methods: The study evaluated vaccination information collected and stored in an EHR between 2006 and 2012 involving 23,270 children. Encounters for 10,299 children lacked immunization information and were excluded.
Results: Documentation of vaccination coverage and timeliness is rendered in Kaplan–Meier time-to-event plots. Vaccination coverage at the end of one year ranges from 60% to 90% for all vaccines assessed individually that are part of the Kenya Expanded Program on Immunization (KEPI). Timely documentation of vaccination is low, with 52.8 weeks (95% CI: 52.1, 53.5) for measles vaccine and 29.2 weeks (95% CI: 28.5, 29.8) for the Bacillus Calmette–Guérin (BCG) vaccine. Complete vaccine observations were recorded in 16% of the encounters. Combination and simultaneous vaccine administration had high congruence and consistency.
Conclusion: A clinical decision support system that generates reminders to clinicians and caretakers of children would optimize vaccination uptake and improve overall immunization coverage. To achieve this, immunization data in the EHR must be timely, complete and consistent. Assessed vaccination timeliness is low, despite high coverage. Vaccine observations are often incomplete. There is need to improve the data collection process to achieve data quality levels that can adequately support a clinical decision support system.Keywords: Vaccination, Electronic health records, Developing countries, Data quality
Centers for Disease Control and Prevention (US). Ten Great Public Health Achievements--United States, 1900-1999.MMWR Recomm Rep.1999; 48(12): p. 241.
GAVI. GAVI Alliance Progress Report 2010. 2010.
UNICEF. A World Fit for Children. Proceedings of the Millennium Development Goals; Special Session on Children Documents; The Convention on the Rights of the Child Conference; 2002 July; New York, US. New York, US: UNICEF;2002
Wolfson LJ, Gasse F, Lee-Martin SP, Lydon P, Magan A, Tibouti A, Johns B, Hutubessy R, Salama P, Okwo-Bele JM. Estimating the costs of achieving the WHO-UNICEF Global Immunization Vision and Strategy, 2006-2015. B World Health Organ, 2008; 86(1): p. 27-39.
Stevens LA, Palma JP, Pandher KK, Longhurst CA. Immunization registries in the EMR Era. Online J Public Health Inform, 2013; 5(2): p. 211.
Williams F,Boren SA. The role of the electronic medical record (EMR) in care delivery development in developing countries: a systematic review. Inform Prim Care, 2008; 16(2): p. 139-145.
Ndira SP, Rosenberger KD, Wetter T. Assessment of data quality of and staff satisfaction with an electronic health record system in a developing country (Uganda): a qualitative and quantitative comparative study. Methods Inf Med, 2008; 47(6): p. 489-98.
Weiner JP, Fowles JB, Chan KS. New paradigms for measuring clinical performance using electronic health records. Int J Qual Health Care 2012; 24(3): p. 200-5.
Einterz RM, Kimaiyo S, Mengech HN, Khwa-Otsyula BO, Esamai F, Quigley F, Mamlin JJ. Responding to the HIV pandemic: the power of an academic medical partnership. Acad Med, 2007; 82(8): p. 812-8.
Bjerregaard P. [Vaccination of children in Kenya]. Ugeskr Laeger, 1989; 151(48): p. 3221-5.
Tierney WM, Rotich JK, Hannan TJ, Siika AM, Biondich PG, Mamlin BW, Nyandiko WM, Kimaiyo S, Wools-Kaloustian K, Sidle JE, et al. The AMPATH medical record system: creating, implementing, and sustaining an electronic medical record system to support HIV/AIDS care in western Kenya. Stud Health Technol Inform, 2007; 129(Pt 1): p. 372-6.
Mamlin BW, Biondich PG, Wolfe BA, Fraser H, Jazayeri D, Allen C, Miranda J, Tierney WM. Cooking up an open source EMR for developing countries: OpenMRS - a recipe for successful collaboration. AMIA Annu Symp Proc, 2006: p. 529-33.
Batini C, Cappiello C, Francalanci C, Maurino A. Methodologies for data quality assessment and improvement. ACM Comput. Surv., 2009; 41(3): p. 1-52.
Wand Y,Wang RY. Anchoring data quality dimensions in ontological foundations. Commun. ACM, 1996; 39(11): p. 86-95.
Wang RY,Strong DM. Beyond accuracy: what data quality means to data consumers. J. Manage. Inf. Syst., 1996; 12(4): p. 5-33.
Liaw ST, Taggart J, Dennis S, Yeo A. Data quality and fitness for purpose of routinely collected data--a general practice case study from an electronic practice-based research network (ePBRN). AMIA Annu Symp Proc, 2011; 2011: p. 785-94.
Pipino LL, Lee YW, Wang RY. Data quality assessment. Commun. ACM, 2002; 45(4): p. 211-218.
Advisory Committee on Immunization Practices (ACIP). General recommendations on immunization.MMWR: Morbidity & Mortality Weekly Report.2011; 60(2): p. 1-64.
Bland JM,Altman DG. Survival probabilities (the Kaplan-Meier method). BMJ, 1998; 317(7172): p. 1572.
Laubereau B, Hermann M, Schmitt HJ, Weil J, von Kries R. Detection of delayed vaccinations: a new approach to visualize vaccine uptake. Epidemiol Infect, 2002; 128(2): p. 185-92.
Wakounig S, Heinze G, Schemper M. Non-parametric estimation of relative risk in survival and associated tests. Stat Methods Med Res, 2011.
Centers for Disease Control and Prevention (US). Global routine vaccination coverage, 2010.MMWR Recomm Rep.2011; 60: p. 1520-2.
Izugbara C, Ezeh A, Fotso JC. The persistence and challenges of homebirths: perspectives of traditional birth attendants in urban Kenya. Health Policy Plan, 2009; 24(1): p. 36-45.
Niederhauser VP,Markowitz M. Barriers to immunizations: Multiethnic parents of under- and unimmunized children speak. J Am Acad Nurse Pract, 2007; 19(1): p. 15-23.
Gillies A. Assessing and improving the quality of information for health evaluation and promotion. Methods Inf Med, 2000; 39(3): p. 208-12.
von Kries RBOWA. Haemophilus influenzae b-vaccination: the urgency for timely vaccination. European Journal of Pediatrics, 1997; 156(4): p. 282.
Grant CC, Roberts M, Scragg R, Stewart J, Lennon D, Kivell D, Ford R, Menzies R. Delayed immunisation and risk of pertussis in infants: unmatched case-control study. BMJ, 2003; 326(7394): p. 852-3.
The National Vaccine Advisory Committee. The measles epidemic. The problems, barriers, and recommendations. .JAMA Pediatr.1991; 266(11): p. 1547-52.
Dayan GH, Shaw KM, Baughman AL, Orellana LC, Forlenza R, Ellis A, Chaui J, Kaplan S, Strebel P. Assessment of delay in age-appropriate vaccination using survival analysis. Am J Epidemiol, 2006; 163(6): p. 561-70.
Fadnes LT, Nankabirwa V, Sommerfelt H, Tylleskar T, Tumwine JK, Engebretsen IM. Is vaccination coverage a good indicator of age-appropriate vaccination? A prospective study from Uganda. Vaccine, 2011; 29(19): p. 3564-70.
Kalies H, Grote V, Verstraeten T, Hessel L, Schmitt HJ, von Kries R. The use of combination vaccines has improved timeliness of vaccination in children. Pediatr Infect Dis J, 2006; 25(6): p. 507-12.