Research Article - Journal of Child and Adolescent Health (2019) Volume 3, Issue 2
A high rate of false positive newborn screening results in the neonatal intensive care unit
Asghar A1*, Shabanova V2, Mercurio MR3 and Bizzarro MJ3
1Division of Neonatal-Perinatal Medicine, Department of Pediatrics, The University of Texas Southwestern Medical Center, USA
2Department of Epidemiology and Public Health, Yale University School of Medicine, USA
3Division of Neonatal-Perinatal Medicine, Department of Pediatrics, Yale University School of Medicine, USA
- *Corresponding Author:
- Asya Asghar
Division of Neonatal-Perinatal Medicine
Department of Pediatrics
The University of Texas Southwestern Medical Center, USA
Tel: 214-648-3111
E-mail: asya.asghar@utsouthwestern.edu
Accepted on March 15, 2019
Citation: Asghar A, Shabanova V, Mercurio MR, et al. A high rate of false positive newborn screening results in the neonatal intensive care unit. J Child Adolesc Health. 2019;3(1):7-11.
Abstract
Introduction: Newborn screen false positive rates are increased in the preterm infant, low birth weight and very low birth weight infant. The factors contributing to this high false positive rate have not been fully elucidated.
Objective: Determine rate of false positive (FP) newborn screening (NBS) tests in the Yale-New Haven Children’s Hospital neonatal intensive care unit (NICU) and assess the effectiveness of an intervention to decrease this rate.
Methods: Pre-post intervention study of 1,451 admissions to the NICU in 2012 (Period 1) and March 31, 2013 to March 30, 2014 (Period 2). FP rates were assessed in Period 1. Modified NBS collection guidelines were then implemented to withhold total parenteral nutrition 4 hours prior to obtaining sample. Period 2 data were compared to Period 1 using binomial logistic regression.
Results: 77% of all extremely low birth weight (ELBW) infants and 52% of all infants 1000-1499 g BW had at least one FP NBS result in Period 1. There was a trend towards reduction in the rates of FP results in Period 2.
Conclusion: Despite withholding TPN for 4 hours, the high rate of FP NBS results in our NICU did not significantly change.
Keywords
Newborn screening, Phenylketonuria, Neonates, Infants, Biotin.
Introduction
Newborn screening (NBS) programs for treatable disease have long been established in an effort to reduce associated morbidity and mortality with early identification and intervention. Bob Guthrie championed the NBS program through his innovative approach to testing for Phenylketonuria (PKU) using dried blood spots on filter paper [1]. By 1965, 32 states had enacted laws to screen for PKU using Guthrie’s methods [2]. Recognizing the widespread acceptance of Guthrie’s screening methods, James Maxwell, Grover Wilson and Gunner Jungner identified classic screening criteria in their 1968 World Health Organization bulletin [3].
NBS programs were further revolutionized with the introduction of tandem mass spectrometry (MS/MS), which allowed for multiple diseases to be tested [4]. In 2006, the American College of Medical Genetics recommended that expanded newborn screening include 29 inherited diseases [5]. To date, most states have implemented this expanded panel, with some states offering newborn screen testing for 40-50 inherited diseases. Tremendous variation exists between states with regards to the number of mandatory screens and timing of these screens. Expanded screening panels have, in turn, been applied to both healthy term infants as well as the smallest and sickest infants requiring neonatal intensive care.
Prior investigations have consistently reported a higher rate of false positive (FP) NBS results in premature infants (i.e., less than 37 weeks gestation), as compared with full-term infants [6,7]. However, these studies have failed to quantify the magnitude of the difference between FP rates for those 2500 g-3999 g birth weight as compared to the low birth weight (LBW, <2500 g), very low birth weight (VLBW, <1500 g and extremely low birth weight (ELBW, <1000 g) populations. In addition, total parenteral nutrition (TPN), specifically the amino acid component, has been implicated as a major contributor to the high FP NBS rates in the NICU [8-10]. Recent attempts to assess reduction in FP NBS rates by withholding TPN for 3 hours prior to obtaining NBS samples have not been consistent in showing a statistically significant reduction in the FP rates for the ELBW or VLBW population [9,10].
The goals of this study were:
(1) To establish baseline FP rates for the newborn screens in our NICU, particularly for the low birth weight patients.
(2) To identify and implement interventions aimed at reducing FP NBS rates in our NICU.
(3) Assess the effect of implemented interventions on the FP NBS rate.
Methods
Study subjects and protocols
This study was approved by the Yale University Human Investigation Committee. Informed consent was not required. The study was conducted at the Yale-New Haven Children’s Hospital (YNCHC) NICU, which is a 54-bed Level 4 NICU that serves as both an admitting hospital for inborn patients and a regional referral center for infants with complex medical and surgical needs.
Data were collected on all infants admitted to the YNHCH NICU during the following study periods: from January 1, 2012 to December 31, 2012 (Period 1) and March 31, 2013 to March 30, 2014 (Period 2), using the YNHCH electronic medical record and the Connecticut Department of Health Newborn Screening Database (MAVEN), which included all infants screened within the state of Connecticut.
We excluded infants from our analysis if any of the following information was incomplete: final NBS report, results of diagnostic testing performed in response to an abnormal NBS, or documentation of final diagnosis for NBS abnormality. Common reasons for incomplete data included inability to access medical records for infants transferred back to referring facilities and lack of diagnostic testing for infants who expired with abnormal newborn screen results.
The following information was extracted: sex, gestational age (GA), birth weight (BW), timing of newborn screen collection (<24 hours after birth (HAB), 24-72 HAB and >72 HAB), NBS final reports, diagnostic testing results for NBS abnormalities, and documentation of diagnosis for NBS abnormalities. The study investigators tracked each positive result on any NBS sample until its final resolution. Final resolution was accomplished either by repeat NBS collection and result or through confirmatory testing as requested by subspecialty consultation.
The expanded NBS program in the state of Connecticut uses MS/MS, as well as t-cell receptor excision circle assays, to screen for more than 40 disorders during the study period. Each newborn screening sample included the following panels: acylcarnitine (AC) profile, amino acid (AA) profile, biotinidase (Biotin) profile, congenital adrenal hyperplasia (CAH) profile, galactose (GALT) profile, T-cell receptor excision circle (TREC) assay and hemoglobin profile. Blood samples were collected on Guthrie filter papers.
During Period 1, samples were obtained at 24-72 HAB for all infants. Additional samples were obtained at <24 HAB for infants receiving early TPN prior to a blood transfusion or for those at risk for death in the first 24 HAB. No specification was given with regard to a minimum amount of protein intake required or duration of time spent off TPN prior to obtaining the NBS. Subsequent samples were obtained for some patients at the request of the subspecialty consultants based on initial NBS abnormalities.
Based on data collected during Period 1 and in consultation with the state and local newborn screening experts, the screening protocol was modified in Period 2 in an effort to decrease FP results. The modifications were aimed at addressing concerns regarding disproportionately high FP rates for samples obtained at <24 HAB, TPN interference with NBS results, and improper sample collection techniques. The modified protocol called for:
(1) Samples to be obtained at 24-72 HAB for all infants.
(2) Samples obtained at <24 HAB only in the setting of the need for a blood transfusion or for perceived risk of death in the first 24 HAB (i.e., we eliminated the need to obtain a sample on all neonates receiving TPN in the first 24 HAB).
(3) Protein intake for a minimum of 8 hours prior to obtaining the newborn screen (including breast feeding, formula feeding or TPN).
(4) When applicable, withholding TPN for 4 hours prior to obtaining any NBS specimen at 24 HAB or later (fluids with appropriate electrolyte and dextrose concentration ordered during this time).
(5) All samples obtained by heel-stick.
A comprehensive nursing/medical staff educational initiative was also conducted to inform staff of the problem of high FP rates in our preterm population and the rationale behind the initiative, to improve techniques for obtaining samples and to provide an overview of the changes to the NBS guideline. Nurses from the YNHCH NBS committee provided one-on-one review of the guideline/procedure modifications to the nursing staff. A protocol flow diagram was created and placed at each patient bedside. This flow diagram was updated by nursing at the time of NBS collection and remained at the patient bedside until discharge. This education was initiated on January 1, 2013 with full implementation of these changes beginning March 31, 2013 (onset of Period 2).
All samples were sent to the state of Connecticut Department of Public Health Newborn Screening laboratory for processing via United Parcel Service (UPS) or hospital-based courier service.
Statistical analysis
In Period 1, analysis included determination of rates of positive (abnormal) NBS and rates of FP NBS for all admissions to the NICU, stratified by GA and BW categories. Negative newborn screens were considered true negative screens given the inability to obtain information prospectively on all subjects, i.e., 100% sensitivity was assumed. Rates were summarized as percentages. Binary logistic regression was utilized to compare FP newborn screen rates between infants in lower categories of BW and infants of normal BW for the following screens: overall newborn screen for any time after birth, newborn screens at <24 HAB, newborn screens at 24-72 HAB, as well as newborn screens for Biotin, CAH, TSH, GAL, AA, AC and TREC at 24-72 HAB.
Differences in the distribution of gender, GA categories and BW categories were tested between Period 2 and Period 1 using the chi-square test. Binary logistic regression was used to compare false positive NBS rates between study periods, stratified by BW categories.
Results from logistic regression analyses were summarized as odds ratios (OR) with 95% confidence intervals (95% CI).
Statistical significance was considered at alpha=0.05. SPSS version 21 (IBM) was used to conduct all statistical analyses, and Excel (Microsoft) was used to create the figures.
Results
There were 1,829 NBS samples obtained from the 1,581 infants admitted to the YNHCH NICU over the entire study period. Complete documentation of all NBS sample results, confirmatory testing and final diagnosis related to newborn screening abnormalities were available for 1,734 samples (94.8%) in 1,451 infants (91.8%) and were included for analysis. GA ranged from 22 weeks to 42 weeks and BW from 380 g to 5330 g (Table 1).
Category | Period 1 N=724 (%) | Period 2 N=727 (%) | p-value |
---|---|---|---|
Gender | |||
Female | 320 (44) | 307 (42) | 0.449 |
Male | 404 (56) | 420 (58) | -- |
Birth weight, g | |||
<1000 | 51 (7) | 70 (10) | 0.076 |
1000-1499 | 47 (7) | 48 (6) | 0.932 |
1500-2499 | 237 (33) | 227 (31) | 0.537 |
2500-3999 | 336 (46) | 325 (45) | 0.514 |
≥4000 | 53 (7) | 57 (8) | 0.708 |
Gestational age, completed wk | |||
<26 | 28 (4) | 28 (4) | 0.987 |
26-29 | 49 (6) | 62 (8) | 0.208 |
30-32 | 73 (10) | 59 (8) | 0.193 |
33-36 | 221 (31) | 238 (33) | 0.395 |
≥37 | 353 (49) | 340 (47) | 0.498 |
Table 1. Patient demographics.
Period 1
Complete data were available for 724 of the 791 YNHCH NICU admissions (91.5%) with 924 NBS samples included in the analysis. There were 149 (16.1%) abnormal NBS results noted in 112 (15.5%) infants admitted to the YNHCH NICU. Forty-three percent of patients with abnormal NBS results (48 infants) had abnormalities for multiple conditions (eg. AA and TREC profiles). FP results were identified in 141 (94.6%) of abnormal screening results, which corresponds to 105 (93.8%) of the patients with abnormal screening.
True positive results were found in 7 patients. Two of these infants were determined to have CAH. One of these infants was found to have an initial false negative result for CAH, in addition to FP results for the AA and AC. The other infant was found to have FP AA and TREC, in addition to true positive CAH result. The remaining 5 infants were diagnosed with Biotinidase deficiency, Galactosemia, Ornithine Transcarbamylase Deficiency, Short Chain acyl-CoA Dehydrogenase Deficiency carrier and Glutaric Acidemia.
When stratified by birth weight categories, 77% of ELBW infants and 52% of infants with BW 1000 g-1499 g were found to have FP NBS results. FP NBS were also observed in 9%, 5% and 4% respectively for patients 1500 g-2499 g, 2500 g-3999 g and ≥ 4000 g (Figure 1).
Compared to infants with BW 2500-3999g, FP results were more prevalent in the <1000 g and 1000 g-1499 g BW categories for the AA, AC, CAH and TREC profiles (Table 2). Data from Period 1 also revealed that 100% of NBS abnormalities identified at <24 HAB were FP results.
Category | Birth Weight, g | |||
---|---|---|---|---|
<1000 | 1000-1499 | 1500-2499 | ≥ 4000 | |
FP NBS | OR (95% CI) | OR (95% CI) | OR (95% CI) | OR (95% CI) |
NBS (any time) | 57.1* CI 25.6 -127.3 | 21.7* CI 10.3-45.8 | NS | NS |
NBS (< 24 HAB) | NS | NS | NS | NS |
NBS (24-72 HAB) | 50.3* (21.6-117.3) | 20.7* (9.4-45.5) | NS | NS |
AA | 81.5* (25.6-259.1) | 22.6* (6.8-75.9) | NS | NS |
AC | 50.1* (15.6-161.0) | 25.6* (7.7-84.7) | NS | NS |
Biotin | NS | NS | NS | NS |
CAH | 67.9* (8.1-568.8) | 15.0** (1.3-168.9) | NS | NS |
GALT | NS | NS | NS | NS |
TREC | 77.6* (9.4-639.6) | 31.4** (3.4-287.8) | NS | NS |
TSH | NS | NS | NS | NS |
*p <0.001; **p<0.05
AAA: Amino Acid Profile; AC: Acylcarnitine Profile; Biotin: Biotinidase Profile; CAH: Congenital Adrenal Hyperplasia Profile; CI: 95% Confidence Interval; GALT: Galactosemia Profile; HAB: Hours After Birth; NBS: Newborn Screen; NS: Non- Significant; OR: Odds Ratio; TREC: Severe Combined Immunodeficiency Profile;
TSH: Thyroid Profile
Table 2. Period 1 association of false positive newborn screening result with birth weight (reference category 2500 g-3999 g).
Period 2
Complete data were available for 726 of the 790 YNCHC NICU admissions (91.9%). The modified NBS protocol resulted in 802 screens obtained in Period 2 as compared to 924 screens obtained in Period 1. This reduction in the overall number of newborn screens was most pronounced for screens obtained at <24 HAB with only 27 screens obtained in Period 2 compared to 149 screens obtained in Period 1.
When stratified by BW categories, 65% of ELBW infants and 35% of infants with BW 1000 g-1499 g were found to have FP NBS results. While this represented a trend towards lower FP results for the 1000 g-1499 g BW category compared with Period 1, the difference did not achieve statistical significance (p<0.053) (Table 3). FP NBS results were also observed in 15%, 6%, and 7% respectively for patients 1500 g-2499 g, 2500 g-3999 g, and ≥ 4000 g.
Category | Birth Weight, g | ||||
---|---|---|---|---|---|
<1000 | 1000-1499 | 1500-2499 | 2500-3999 | ≥ 4000 | |
FP NBS | |||||
NBS (any time) | p=0.266 | p=0.053 | p=0.085 | p=0.534 | p=0.461 |
NBS (<24 HAB) | p=0.142 | p=1.000 | p=0.001 OR 22.8 CI 3.58- 145 | p=0.935 | p=0.711 |
NBS (24-72 HAB) | p=0.550 | p=0.293 | p=0.078 | p=0.677 | p=0.664 |
AA | p=0.243 | p=0.797 | p=0.253 | p=0.896 | p=0.998 |
AC | p=0.047 OR=0.41 CI 0.17-0.99 | p=0.185 | p=0.181 | p=0.790 | N/A |
Biotin | p=0.998 | N/A | N/A | p=0.995 | N/A |
CAH | p=0.871 | p=0.340 | p=0.149 | p=0.187 | N/A |
GALT | N/A | p=0.998 | p=0.995 | p=0.617 | p=0.998 |
TREC | p=0.748 | p=0.695 | p=0.609 | p=0.305 | p=0.989 |
TSH | N/A | p=0.998 | p=0.959 | p=0.934 | p=0.997 |
AA: Amino Acid Profile; AC: Acylcarnitine Profile; Biotin: Biotinidase Profile; CAH: Congenital Adrenal Hyperplasia Profile; CI: 95% Confidence Interval; GALT: Galactosemia Profile; HAB: Hours After Birth; N/A: Insufficient Data to Assess; NBS: Newborn Screen; OR: Odds Ratio; TREC: Severe Combined Immunodeficiency Profile; TSH: Thyroid Profile
Table 3. Comparison of false positive newborn screening in period 2 to period 1 by birth weight.
A statistically significant reduction in FP results was found only in abnormalities of AC profile in patients <1000 grams (p<0.047). Furthermore, 1500 g-2499 g infants were found to have statistically significant increased rate of FP NBS results at <24 HAB (p<0.001) (Table 3).
Discussion
Our study confirms a very high rate of FP NBS results in LBW infants in the NICU, particularly those weighing <1000 g and 1000 g-1499 g, when compared to infants with BW 2500 g-3999 g. While the VLBW patients comprised fewer than 15% of the yearly NICU admissions, they were responsible for more than 50% of the abnormal newborn screen results, of which >95% are FP. Strikingly, our study found 3 out of every 4 ELBW infants admitted to our NICU during the study period had at least 1 FP NBS result, a finding that did not significantly change despite our interventions. Unlike previous studies which have shown the CAH and TSH profiles to be the primary drivers of the high FP rates in this population [6], we found that the most common abnormalities are those related to the AA, AC, CAH, and TREC profiles.
The impact of this high rate of FP NBS results in our most vulnerable patients is, we believe, significant. Parental anxiety is a common and understandable result of disclosure of initial positive result, despite reassurance that the results are likely spurious. Repeated blood draws cause pain to the patient and follow-up testing takes time and money. All of these factors combine to create the perception that the NBS may be causing more harm than benefit in the smallest and sickest NICU patients. The medical providers are not likely to be immune to a sense of mistrust in the NBS process for these patients, potentially leading to complacency and delay in diagnosis for the rare child who truly has a treatable disease. It is unavoidable human nature that too many false alarms can make us less vigilant in our attention to the valid ones.
We were able to show a statistically significant decrease in the likelihood of having abnormalities related to the AC profile at 24-72 HAB in the ELBW infant with the implementation of our interventions, including withholding TPN for 4 hours prior to obtaining screening samples. While the significant decrease was found only in ELBW infants, this finding supports the idea that components of TPN may affect the AC profile and withholding TPN for a standard period of time prior to obtaining the newborn screen may improve the accuracy of results. However, the appropriate duration to withhold TPN balanced with the potential risks of withholding nutrition remains uncertain [11].
Surprisingly, our investigation revealed a statistically significant increase in the likelihood of FP NBS results in 1500 g-2499 g infants at <24 HAB in Period 2 compared to Period 1, highlighting the challenges of interpreting data in a pre-post intervention study.
Conclusion
Following modifications to the NBS protocol, we were able to reduce the number of NBS samples obtained 1500-2499 g infants at <24 HAB from 43 in Period 1 to 8 in Period 2. The total number of patients with FP results remained essentially unchanged from Period 1 to Period 2, thus accounting for the significant increased likelihood of FP NBS results. Most importantly and in keeping with our pre-intervention data, 100% of the abnormal NBS results obtained at <24HAB were FP in our post-intervention group.
Limitations to our study included the inability to assess the true false negative rate, therefore the assumption of 100% sensitivity, as a consequence of the inability to obtain longterm follow-up information on all patients admitted to the NICU. In addition, the broad categorizations used in the study design (eg., AA and AC) limited the ability to identify particular patterns of analyte abnormalities and their associated diseases (eg., homocystinuria and methylmalonic academia), data that could be critical to inform future interventions. Perhaps most importantly, our study was limited in scope, focused on practice in a single unit in a single state. Despite these limitations, the data presented suggests a significant problem that could have serious consequences, and it is our hope that these findings will foster a national conversation focused on improving NBS in the NICU population.
References
- Levy HL. Historical perspectives: Newborn metabolic screening. Neo Reviews. 2005;6(2):57-60.
- Guthrie R, Susi A. A simple phenylalanine method for detecting phenylketonuria in large populations of newborn infants. Pediatrics. 1963;32(3):338-43.
- Wilson JM, Jungner G. Principles and practice of screening for disease. World Health Organization, Geneva, Switzerland. 1968.
- Naylor EW, Chace DH. Automated tandem mass spectrometry for mass newborn screening for disorders in fatty acid, organic acid, and amino acid metabolism. J Child Neurol. 1999;14(1):4-8.
- Watson MS, Mann MY, Lloyd MA, et al. Newborn screening: Toward a uniform screening panel and system-executive summary. Pediatrics. 2006;117(3):296-307.
- Slaughter JL, Meinzen-Derr J, Rose SR, et al. The effects of gestational age and birth weight on false-positive newborn-screening rates. Pediatrics. 2010;126(5):910-16.
- Clark RH, Kelleher AS, Chace DH, et al. Gestational age and age at sampling influence metabolic profiles in premature infants. Pediatrics. 2014;134(1):37-46.
- Chace DH, De Jesús VR, Lim TH, et al. Detection of TPN contamination of dried blood spots used in newborn and metabolic screening and its impact on quantitative measurement of amino acids. Clinica Chimica Acta. 2011;412(15):1385-90.
- Morris M, Fischer K, Leydiker K, et al. Reduction in newborn screening metabolic false-positive results following a new collection protocol. Genet Med. 2014;16(6):477-83.
- Tim AT, Harmon HM, Nock ML, et al. Stopping parenteral nutrition for 3 hours reduces false positives in newborn screening. J pediatr. 2015;167(2):312-16.
- Trivedi A, Sinn JK. Early versus late administration of amino acids in preterm infants receiving parenteral nutrition. Cochrane Database Systematic Rev. 2013.