Advertisement
Review| Volume 129, P152-161, April 2023

The effectiveness of interventions that support penicillin allergy assessment and delabeling of adult and pediatric patients by nonallergy specialists: a systematic review and meta-analysis

Open AccessPublished:November 26, 2022DOI:https://doi.org/10.1016/j.ijid.2022.11.026

      Highlights

      • Penicillin allergy delabeling by nonallergists is safe.
      • Less intensive methods delabeled a smaller proportion of patients.
      • Once patients were assessed as suitable for testing, rates of delabeling were high.
      • A diverse workforce engaged in delabeling incorrect penicillin allergy records.
      • Penicillin allergy delabeling interventions are described.

      Abstract

      Objectives

      Penicillin allergy records are often incorrect and may result in harm. We aimed to systematically review the effectiveness and safety of nonallergist health care worker delivery of penicillin allergy delabeling.

      Methods

      We searched EMBASE/MEDLINE/CINAHL (Ovid), PsycInfo, Web of Science, and Cochrane CENTRAL from inception to January 21, 2022 and unpublished studies and gray literature. The proportion of patients allergic to penicillin delabeled and harmed was calculated using random-effects models.

      Results

      Overall, 5019 patients were delabeled. Using allergy history alone, 14% (95% confidence interval [CI], 9-21%) of 4350 assessed patients were delabeled without reported harm. Direct drug provocation testing resulted in delabeling in 27% (95% CI, 18-37%) of 4207 assessed patients. Of the 1373 patients tested, 98% were delabeled (95% CI, 97-99%), and nonserious harm was reported in 1% (95% CI, 0-2%). Using skin testing, followed by drug provocation testing, 41% (95% CI, 24-59%) of 2890 assessed patients were delabeled. Of the 1294 tested patients, 95.0% (95% CI, 90-99%) were delabeled, and the reported harm was low (0%; (95% CI 0-1%).

      Conclusion

      Penicillin allergy delabeling by nonallergists is efficacious and safe. The proportion of assessed patients who can be delabeled increases with the complexity of testing method, but substantial numbers can be delabeled without skin testing.

      Keywords

      Introduction

      Approximately 6% of the general population (
      • West RM
      • Smith CJ
      • Pavitt SH
      • Butler CC
      • Howard P
      • Bates C
      • Savic S
      • Wright JM
      • Hewison J
      • Sandoe JAT.
      Warning: allergic to penicillin': association between penicillin allergy status in 2.3 million NHS general practice electronic health records, antibiotic prescribing and health outcomes.
      ) and 15% of hospital inpatients have a record of penicillin allergy (penA;
      • Macy E
      • Contreras R.
      Health care use and serious infection prevalence associated with penicillin “allergy” in hospitalized patients: a cohort study.
      ;
      • Powell N
      • Honeyford K
      • Sandoe J.
      Impact of penicillin allergy records on antibiotic costs and length of hospital stay: a single-centre observational retrospective cohort.
      ;
      • Trubiano JA
      • Smibert O
      • Douglas A
      • Devchand M
      • Lambros B
      • Holmes NE
      • Chua KY
      • Phillips EJ
      • Slavin MA.
      The safety and efficacy of an oral penicillin challenge program in cancer patients: a multicenter pilot study.
      ). Penicillin-based antibiotics are first-line treatment for many infections, but patients with penA labels are usually treated with second-line antibiotics (
      • Powell N
      • Honeyford K
      • Sandoe J.
      Impact of penicillin allergy records on antibiotic costs and length of hospital stay: a single-centre observational retrospective cohort.
      ), which are often more costly, can be less effective in certain clinical circumstances, more toxic, and often have broader spectrum, potentially increasing a patient's risk of future infections with resistant bacteria (
      • Krah NM
      • Jones TW
      • Lake J
      • Hersh AL.
      The impact of antibiotic allergy labels on antibiotic exposure, clinical outcomes, and healthcare costs: a systematic review.
      ). More than 95% of individuals with a penA label can tolerate penicillin (
      • DesBiens M
      • Scalia P
      • Ravikumar S
      • Glick A
      • Newton H
      • Erinne O
      • Riblet N.
      A closer look at penicillin allergy history: systematic review and meta-analysis of tolerance to drug challenge.
      ;
      • Shenoy ES
      • Macy E
      • Rowe T
      • Blumenthal KG
      Evaluation and management of penicillin allergy: a review.
      ).
      The assessment of patients with reported penAs has been the role of allergists, but allergy services are limited (
      • Krishna MT
      • Huissoon AP
      • Li M
      • Richter A
      • Pillay DG
      • Sambanthan D
      • Raman SC
      • Nasser S
      • Misbah SA.
      Enhancing antibiotic stewardship by tackling “spurious” penicillin allergy.
      ). Traditional penA testing requires skin testing (ST) before drug provocation testing, which remains the main testing method in Europe, making penA testing resource intense (
      • Mirakian R
      • Leech SC
      • Krishna MT
      • Richter AG
      • Huber PA
      • Farooque S
      • Khan N
      • Pirmohamed M
      • Clark AT
      • Nasser SM
      Standards of Care Committee of the British Society for Allergy and Clinical Immunology. Management of allergy to penicillins and other beta-lactams.
      ;
      • Romano A
      • Atanaskovic-Markovic M
      • Barbaud A
      • Bircher AJ
      • Brockow K
      • Caubet JC
      • Celik G
      • Cernadas J
      • Chiriac AM
      • Demoly P
      • Garvey LH
      • Mayorga C
      • Nakonechna A
      • Whitaker P
      • Torres MJ.
      Towards a more precise diagnosis of hypersensitivity to beta-lactams - an EAACI position paper.
      ). Direct drug provocation testing (DPT), an oral challenge test, in patients with a low-risk allergy history is less resource intense. Two systematic reviews have confirmed the safety and efficacy of DPT (without previous ST) as a method of delabeling adults, delivered both by allergists and nonallergists (
      • Cooper L
      • Harbour J
      • Sneddon J
      • Seaton RA.
      Safety and efficacy of de-labelling penicillin allergy in adults using direct oral challenge: a systematic review.
      ;
      • DesBiens M
      • Scalia P
      • Ravikumar S
      • Glick A
      • Newton H
      • Erinne O
      • Riblet N.
      A closer look at penicillin allergy history: systematic review and meta-analysis of tolerance to drug challenge.
      ). ST before DPT has also been successfully delivered by nonallergists (
      • Englert E
      • Weeks A.
      Pharmacist-driven penicillin skin testing service for adults prescribed nonpreferred antibiotics in a community hospital.
      ;
      • Wall GC
      • Peters L
      • Leaders CB
      • Wille JA.
      Pharmacist-managed service providing penicillin allergy skin tests.
      ).
      The American Academy of Allergy Asthma and Immunology (

      American Academy of Allergy, Asthma & Immunology. Penicillin allergy testing: AAAAI advocacy priority. https://www.aaaai.org/about-aaaai/advocacy/penicillin-allergy-testing, 2020 (accessed 20 April, 2021).

      ) with the Infectious Diseases Society of America wrote to the Centers for Medicare and Medicaid Services to urge US hospitals to include verification of penA as part of its mandatory antibiotic stewardship programs. The World Health Organization (

      World Health Organization, Regional Office for Europe. Antimicrobial stewardship interventions: a practical guide. https://apps.who.int/iris/bitstream/handle/10665/340709/9789289054980-eng.pdf, 2021 (accessed 02 July 2021).

      ) has since recommended antibiotic delabeling as an effective antimicrobial stewardship strategy. The enablement of the wider health care workforce to delabel eligible patients is required to deliver penA assessment and delabeling at a large scale. Understanding the wider frameworks that enable nonallergists to safely delabel is required, enabling the development of effective interventions that facilitate penA delabeling by nonallergy specialists.
      We systematically reviewed the literature to determine the proportion of patients with a reported penA who were safely delabeled by nonallergy health care workers (HCWs), categorizing the components of interventions using the Effective Practice and Organisation of Care (EPOC) taxonomy of health interventions (

      Effective practice and organisation of care (EPOC 2016). The EPOC taxonomy of health systems interventions. EPOC Resources for review authors. epoc.cochrane.org/epoc-taxonomy, 2016 (accessed 16 May 2022).

      ) and report any measured antimicrobial stewardship and health system impact.

      Methods

      This systematic review and meta-analysis were conducted in accordance with the Joanna Briggs Institute methodology for systematic reviews of effectiveness (
      • Tufanaru C
      • Munn Z
      • Aromataris E
      • Campbell J
      • Hopp L
      Chapter 3. Systematic reviews of effectiveness.
      ) and is reported using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis checklist (
      • Liberati A
      • Altman DG
      • Tetzlaff J
      • Mulrow C
      • Gøtzsche PC
      • Ioannidis JPA
      • Clarke M
      • Devereaux PJ
      • Kleijnen J
      • Moher D.
      The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration.
      ).

      Inclusion/exclusion criteria

      The inclusion criteria are as follows: (i) any patient (adult/child) with a penA record in any health care context, (ii) having undergone penA delabeling (PADL) using any method; and (iii) by nonallergy specialists, defined as a medical professional whose primary specialization is not in allergy or who has not trained in allergy as part of their specialty (
      • Savic LC
      • Khan DA
      • Kopac P
      • Clarke RC
      • Cooke PJ
      • Dewachter P
      • Ebo DG
      • Garcez T
      • Garvey LH
      • Guttormsen AB
      • Hopkins PM
      • Hepner DL
      • Kolawole H
      • Krøigaard M
      • Laguna JJ
      • Marshall SD
      • Mertes PM
      • Platt PR
      • Rose MA
      • Sabato V
      • Sadleir PHM
      • Savic S
      • Takazawa T
      • Voltolini S
      • Volcheck GW.
      Management of a surgical patient with a label of penicillin allergy: narrative review and consensus recommendations.
      ). The penA assessment and delabeling interventions delivered by immunologists or allergy specialists were excluded. All study designs were included, except case reports.

      Search strategy

      The following databases were searched from inception to January 21, 2022 (NP) EMBASE (Ovid), MEDLINE (Ovid), CINAHL (Ovid), PsycInfo, Web of Science, and Cochrane CENTRAL, as was the gray literature. Known experts in the topic were contacted to ensure we have not overlooked relevant literature. The search strategy was reviewed by an experienced information specialist (KO). Only studies published in English were included due to a lack of funding for translation services (Appendix 1).
      Titles and abstracts were screened by two independent reviewers (NP, SA, DK, RO, JS) against the inclusion criteria (RAYYAN software;
      • Ouzzani M
      • Hammady H
      • Fedorowicz Z
      • Elmagarmid A.
      Rayyan-a web and mobile app for systematic reviews.
      ). Full-text citations were assessed against the inclusion criteria by two independent reviewers (NP, RO) using RAYYAN software (
      • Ouzzani M
      • Hammady H
      • Fedorowicz Z
      • Elmagarmid A.
      Rayyan-a web and mobile app for systematic reviews.
      ; Appendix 2 and 3). Disagreements were resolved through discussion.

      Assessment of methodological quality

      Eligible studies were critically appraised by two reviewers (NP, BK) using critical appraisal instruments from the Joanna Briggs Institute (
      • Tufanaru C
      • Munn Z
      • Aromataris E
      • Campbell J
      • Hopp L
      Chapter 3. Systematic reviews of effectiveness.
      ). Authors were contacted to request additional data, where required. Studies were not excluded on the grounds of their risk of bias.

      Data extraction

      Data were extracted by one reviewer (NP), using a purpose-built extraction tool in Excel (

      Microsoft Corporation. Microsoft Excel, 2018.

      ) and included the study design, country, setting, population age, gender, inclusion criteria, exclusion criteria, allergy testing method(s), HCW(s) delivering PADL, components of the PADL interventions, details about education and training, number of assessed patients, number tested, number that experienced unintended harm, and any reported antibiotic stewardship or health care system impact. The extraction of data from seven (10%) studies was validated by a second reviewer. Intervention components were categorized using the EPOC taxonomy of health interventions, enabling the grouping of health system interventions by conceptual or practical similarities (

      Effective practice and organisation of care (EPOC 2016). The EPOC taxonomy of health systems interventions. EPOC Resources for review authors. epoc.cochrane.org/epoc-taxonomy, 2016 (accessed 16 May 2022).

      ). Studies that used a risk stratification protocol for allergy testing were categorized in the “packages of care” subcategory. Complex interventions were categorized into the “care pathways” subcategory (
      • Skivington K
      • Matthews L
      • Simpson SA
      • Craig P
      • Baird J
      • Blazeby JM
      • Boyd KA
      • Craig N
      • French DP
      • McIntosh E
      • Petticrew M
      • Rycroft-Malone J
      • White M
      • Moore L.
      A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance.
      ). Governance arrangements were categorized as “authority and accountability for quality of practice”.

      Definitions

      See Appendix 4 for definitions for delabeling, ST/DPT, direct DPT (DDPT) and direct delabeling on history alone (DDL), successful delabel, and definitions of harm.

      Data analysis

      The population-weighted proportional meta-analysis was conducted on studies with a low/moderate risk of bias to determine the proportion of participants successfully delabeled and the proportion with a positive penA test by the delabel method (DDL, DDPT, and ST/DPT) using the R package meta v 5.2.0 (

      Schwarzer G. meta: general Package for Meta-Analysis. https://cran.r-project.org/web/packages/meta/index.html, 2022 (accessed 14 July 2022).

      ). Statistical heterogeneity was assessed using the chi-square test (threshold P <0.1) and the I2 statistic (I2 values <25%, 25-75%, and >75% were considered to represent low, moderate, and high heterogeneity, respectively). Overall estimates were obtained using random-effects models (
      • Tufanaru C
      • Munn Z
      • Stephenson M
      • Aromataris E.
      Fixed or random effects meta-analysis? Common methodological issues in systematic reviews of effectiveness.
      ). A funnel plot was generated to assess publication bias, with funnel plot asymmetry tested using the Egger test (
      • Egger M
      • Davey Smith GD
      • Schneider M
      • Minder C
      Bias in meta-analysis detected by a simple, graphical test.
      ). We used the studentized residual to identify studies that contributed most to heterogeneity (
      • Viechtbauer W
      • Cheung MW.
      Outlier and influence diagnostics for meta-analysis.
      ). Studies with z absolute values >1.96 (
      • Viechtbauer W
      • Cheung MW.
      Outlier and influence diagnostics for meta-analysis.
      ) were excluded from the analysis to assess their influence on the overall estimates. The remaining data are presented in narrative form.

      Results

      Study inclusion

      In total, 11,545 studies were identified, of which 3411 were excluded due to duplication. The review of titles and abstracts by two authors (DK, NP, SA, RO, JS) led to the retrieval of 191 full papers for screening by two authors (NP, RO, JS, MU, STC); 69 were included in the systematic review (Figure 1). A total of 56 studies were case series (
      • Adkinson Jr, NF
      • Thompson WL
      • Maddrey WC
      • Lichtenstein LM
      Routine use of penicillin skin testing on an inpatient service.
      ;
      • Allen HI
      • Gillespie P
      • Vazquez-Ortiz M
      • Murphy AW
      • Moylett EM.
      A cost-analysis of outpatient paediatric penicillin allergy de-labelling using telemedicine.
      ;
      • Bauer ME
      • MacBrayne C
      • Stein A
      • Searns J
      • Hicks A
      • Sarin T
      • Lin T
      • Duffey H
      • Rannie M
      • Wickstrom K
      • Yang C
      • Bajaj L
      • Carel K.
      A multidisciplinary quality improvement initiative to facilitate penicillin allergy delabeling among hospitalized pediatric patients.
      ;
      • Blackwell W
      • Khan D.
      Penicillin allergy testing by allergy trained pharmacists in hospitalized patients.
      ;
      • Blumenthal KG
      • Li Y
      • Hsu JT
      • Wolfson AR
      • Berkowitz DN
      • Carballo VA
      • Schwartz JM
      • Marquis KA
      • Elshaboury R
      • Gandhi RG
      • Lambl BB
      • Freeley MM
      • Gruszecki A
      • Wickner PG
      • Shenoy ES.
      Outcomes from an inpatient beta-lactam allergy guideline across a large US health system.
      ;
      • Chen JR
      • Tarver SA
      • Alvarez KS
      • Tran T
      • Khan DA.
      A proactive approach to penicillin allergy testing in hospitalized patients.
      ;
      • Devchand M
      • Kirkpatrick CMJ
      • Stevenson W
      • Garrett K
      • Perera D
      • Khumra S
      • Urbancic K
      • Grayson ML
      • Trubiano JA.
      Evaluation of a pharmacist-led penicillin allergy de-labelling ward round: a novel antimicrobial stewardship intervention.
      ;
      • du Plessis T
      • Walls G
      • Jordan A
      • Holland DJ.
      Implementation of a pharmacist-led penicillin allergy de-labelling service in a public hospital.
      ;
      • Englert E
      • Weeks A.
      Pharmacist-driven penicillin skin testing service for adults prescribed nonpreferred antibiotics in a community hospital.
      ;
      • Eischens MR
      • Wolf LM
      • Dumkow LE
      • Anderson AM
      • Jameson AP
      • Brandt KL.
      146 impact of an emergency department antimicrobial stewardship program on the rate of beta-lactam allergy challenge.
      ;
      • Foolad F
      • Berlin S
      • White C
      • Dishner E
      • Jiang Y
      • Taremi M.
      The impact of penicillin skin testing on aztreonam stewardship and cost savings in immunocompromised cancer patients.
      ;
      • Gugkaeva Z
      • Crago JS
      • Yasnogorodsky M.
      Next step in antibiotic stewardship: pharmacist-provided penicillin allergy testing.
      ;
      • Griffith NC
      • Justo JA
      • Winders HR
      • Al-Hasan MN
      • Mediwala KN
      • Bookstaver PB.
      Regulatory approval, implementation, and brief assessment of a pharmacist- and pharmacy trainee-administered penicillin allergy assessment and skin testing program.
      ;
      • Harmon S
      • Richardson T
      • Simons H
      • Monforte S
      • Fanning S
      • Harrington K.
      The clinical and financial impact of a pharmacist-driven penicillin skin testing program on antimicrobial stewardship practices.
      ;
      • Ham Y
      • Sukerman ES
      • Lewis JS
      • Tucker KJ
      • Yu DL
      • Joshi SR.
      Safety and efficacy of direct two-step penicillin challenges with an inpatient pharmacist-driven allergy evaluation.
      ;
      • Harris AD
      • Sauberman L
      • Kabbash L
      • Greineder DK
      • Samore MH.
      Penicillin skin testing: a way to optimize antibiotic utilization.
      ;
      • Harper HM
      • Sanchez M.
      Review of pharmacist driven penicillin allergy assessments and skin testing: a multi-center Case-Series.
      ;
      • Heil EL
      • Bork JT
      • Schmalzle SA
      • Kleinberg M
      • Kewalramani A
      • Gilliam BL
      • Buchwald UK.
      Implementation of an infectious disease fellow-managed penicillin allergy skin testing service.
      ;
      • Jones BM
      • Bland CM.
      Penicillin skin testing as an antimicrobial stewardship initiative.
      ;
      • Jones BM
      • Gamble K
      • Sizemore S
      • Bland CM.
      The impact of pharmacy students performing penicillin allergy reconciliation in a community health system.
      ;
      • Kleris R
      • Sarubbi C
      • Wrenn R
      • Anderson D
      • Lugar PL.
      Inpatient penicillin allergy evaluation program enriches anti-microbial stewardship aims.
      ;
      • Kyi L
      • Heke E
      • McPhee S
      • Ojaimi S
      • Barnes S.
      Direct oral challenge for rapid penicillin de-labelling in acute admitted general medical patients.
      ;
      • Lecerf K
      • Chaparro J
      • Hehmeyer J
      • Hussain C
      • Macias C
      • Vegh M
      • Watson J
      • Stukus D.
      Development of a penicillin allergy electronic decision support pathway for pediatric inpatient admissions.
      ;
      • Leis JA
      • Palmay L
      • Ho G
      • Raybardhan S
      • Gill S
      • Kan T
      • Campbel J
      • Kiss A
      • McCready JB
      • Das P
      • Minnema B
      • Powis JE
      • Walker SAN
      • Ferguson H
      • Wong B
      • Weber E.
      Point-of-care β-lactam allergy skin testing by antimicrobial stewardship programs: a pragmatic multicenter prospective evaluation.
      ;
      • Lin L
      • Nagtegaal JE
      • Buijtels PCAM
      • Jong E
      Antimicrobial stewardship intervention: optimizing antibiotic treatment in hospitalized patients with reported antibiotic allergy.
      ;
      • Livirya S
      • Pithie A
      • Chua I
      • Hamilton N
      • Doogue M
      Isenman H. Oral amoxicillin challenge for low-risk penicillin allergic patients.
      ;
      • Lnumerables F
      • Fischer-Cartlidge E
      Improving antibiotic stewardship through nurse-driven penicillin allergy testing.
      ;
      • Lo SCR
      • Lacaria K
      • Mah A
      • Wong T
      • Mak R.
      An algorithm-based approach to routinely delabel penicillin allergy in pre-hematopoietic stem cell transplant patients with low risk of reaction. In: Proceedings of the Canadian Society of Allergy and Clinical Immunology Annual Scientific Meeting 2019.
      ;
      • Louden NJ
      • Hansen LA
      • Rimal A
      • Norton LE.
      Implementation of a pharmacist-driven penicillin and cephalosporin allergy assessment tool: a pilot evaluation.
      ;
      • Maguire M
      • Hayes BD
      • Fuh L
      • Elshaboury R
      • Gandhi RG
      • Bor S
      • Shenoy ES
      • Wolfson AR
      • Mancini CM
      • Blumenthal KG.
      Beta-lactam antibiotic test doses in the emergency department.
      ;
      • Marwood J
      • Aguirrebarrena G
      • Kerr S
      • Welch SA
      • Rimmer J.
      De-labelling self-reported penicillin allergy within the emergency department through the use of skin tests and oral drug provocation testing.
      ;
      • Mitchell AB
      • Ness RA
      • Bennett JG
      • Bowden JE
      • Elliott WV
      • Gillion AR
      • Pattanaik DN.
      Implementation and impact of a beta-lactam allergy assessment protocol in a veteran population.
      ;
      • Morjaria S
      • Inumerables F
      • Patel D
      • Cohen N
      • Seo S
      • Posthumus S
      • Martin SC
      • Kaltsas A
      • Lee S
      • Boucher N
      • Fischer-Cartlidge E.
      Penicillin allergy testing: an outpatient nurse-driven program for patients with cancer.
      ;
      • Murphy K
      • Scanlan B
      • Coghlan D.
      Does this child really have a penicillin allergy?.
      ;
      • Parker N
      • Choo HF
      • Ghodrat M.
      Implementation of pharmacist-driven penicillin allergy skin testing in a community hospital resulting in a change in scope of practice for pharmacists.
      ;
      • Patel R
      • Saccone N
      • Stock K
      • Utley S
      • Bouknight D.
      Challenging penicillin allergies: pharmacist led program in a community hospital.
      ;
      • Phung M
      • Vo T
      • Murfin B
      • Galbraith K
      • Barnes S
      • Coutsouvelis J.
      P31: Pharmacist-led penicillin allergic risk categorisation in intensive care patients for the purpose of rapid penicillin allergy delabeling (rapid phire) pilot study.
      ;
      • Rahbani P.
      A quality improvement initiative to increase penicillin allergy clarification and decrease aztreonam usage.
      ;
      • Rahbani p
      • Monroe-Duprey L
      Clinical outcome of penicillin skin testing as an antimicrobial stewardship initiative in the pre-surgical clinic in a community hospital.
      ;
      • Rimawi RH
      • Cook PP
      • Gooch M
      • Kabchi B
      • Ashraf MS
      • Rimawi BH
      • Gebregziabher M
      • Siraj DS.
      The impact of penicillin skin testing on clinical practice and antimicrobial stewardship.
      ;
      • Rimawi RH
      • Mazer MA.
      Expanding the pool of healthcare providers to perform penicillin skin testing in the ICU.
      ;
      • Savic L
      • Gurr L
      • Kaura V
      • Toolan J
      • Sandoe JAT
      • Hopkins PM
      • Savic S.
      Penicillin allergy de-labelling ahead of elective surgery: feasibility and barriers.
      ;
      • Sigona NS
      • Steele JM
      • Miller CD.
      Impact of a pharmacist-driven beta-lactam allergy interview on inpatient antimicrobial therapy: a pilot project.
      ;
      • Skibba N
      • Fischer J
      • Loecker B.
      Pilot program of pharmacist managed penicillin allergy skin testing on inpatients at a medical center to determine cost-benefit.
      ;
      • Smibert O
      • Douglas A
      • Devchand M
      • Lambros B
      • Stevenson W
      • Slavin M
      • Trubiano J.
      The safety and efcacy of an oral penicillin rechallenge program in cancer patients: a pilot multicenter study.
      ;
      • Sneddon J
      • Cooper L
      • Ritchie N
      • Steele C
      • Spears M
      • McEwen J
      • Dempsey Z
      • Sutherland R
      • Khatamzas E
      • Seaton RA.
      An algorithm for safe de-labelling of antibiotic allergy in adult hospital in-patients.
      ;
      • Song YC
      • Nelson ZJ
      • Wankum MA
      • Gens KD.
      Effectiveness and feasibility of pharmacist-driven penicillin allergy de-labeling pilot program without skin testing or oral challenges.
      ;
      • Steenvoorden L
      • Bjoernestad EO
      • Kvesetmoen TA
      • Gulsvik AK.
      De-labelling penicillin allergy in acutely hospitalized patients: a pilot study.
      ;
      • Stone CA
      • Stollings JL
      • Lindsell CJ
      • Dear ML
      • Buie RB
      • Rice TW
      • Phillips EJ.
      Risk-stratified management to remove low-risk penicillin allergy labels in the ICU.
      ;
      • Taremi M
      • Artau A
      • Foolad F
      • Berlin S
      • White C
      • Jiang Y
      • Raad I
      • Adachi J.
      Safety, efficacy, and clinical impact of penicillin skin testing in immunocompromised cancer patients.
      ;
      • Torney N
      • Tiberg M.
      Description of a pharmacist-managed penicillin allergy skin testing (PAST) service at a community teaching hospital.
      ,
      • Torney NP
      • Tiberg MD.
      Description of a pharmacist-managed/administered penicillin allergy skin testing service at a community hospital.
      ;
      • Trubiano JA
      • Smibert O
      • Douglas A
      • Devchand M
      • Lambros B
      • Holmes NE
      • Chua KY
      • Phillips EJ
      • Slavin MA.
      The safety and efficacy of an oral penicillin challenge program in cancer patients: a multicenter pilot study.
      ;
      • Wall GC
      • Peters L
      • Leaders CB
      • Wille JA.
      Pharmacist-managed service providing penicillin allergy skin tests.
      ;
      • Wong J
      • Timberlake K
      • Atkinson A
      • Science M.
      269. De-labeling of allergies to b-lactam antibiotics (De-LABeL) program: development and pilot of an inpatient pediatric program.
      ;
      • Wrenn R
      • Sarubbi C
      • Kleris R
      • Drew R
      • Moehring R
      • Lugar P
      • Anderson D.
      Antimicrobial stewarding with a unique pharmacist-managed penicillin skin testing (PST) service.
      ), ten were quasi-experimental studies (
      • Blumenthal KG
      • Shenoy ES
      • Varughese CA
      • Hurwitz S
      • Hooper DC
      • Banerji A.
      Impact of a clinical guideline for prescribing antibiotics to inpatients reporting penicillin or cephalosporin allergy.
      ;
      • Chen JR
      • Tarver SA
      • Alvarez KS
      • Wei W
      • Khan DA.
      Improving aztreonam stewardship and cost through a penicillin allergy testing clinical guideline.
      ;
      • Gaudreau S
      • Bourque G
      • Côté K
      • Nutu C
      • Beauchesne MF
      • Longpré AA
      • Beloin-Jubinville B
      • Legeleux L
      • Blaquière M
      • Martin P
      • Gilbert M.
      Resources assessment for penicillin allergy testing performed by pharmacists at the Patient's bedside.
      ;
      • Jones BM
      • Avramovski N
      • Concepcion AM
      • Crosby J
      • Bland CM.
      Clinical and economic outcomes of penicillin skin testing as an antimicrobial stewardship initiative in a community health system.
      ;
      • Nguyen CT
      • Sahbani O
      • Pisano J
      • Pursell K
      • Pettit NN.
      Impact of a standardized pharmacist-led beta-lactam allergy interview on the quality of allergy documentation.
      ;
      • Ravindran S
      • Beshir M
      • Wang S
      • Bandi S
      • Hanson A
      • O'Driscoll T
      • MC Tobin
      Impact of hospital-wide guideline for antimicrobial stewardship in patients with history of beta-lactam allergy at an academic medical center.
      ;
      • Shannon KT
      • Krop LC.
      Evaluation of the implementation of an allergy assessment tool as an antimicrobial stewardship initiative.
      ;
      • Stein A
      • MacBrayne C
      • Yang C
      • Sarin T
      • Hicks A
      • Searns J
      • Bajaj L
      • Bauer ME
      • Carel K.
      Clinical pathway to increase rates of penicillin allergy de-labeling.
      ;
      • Trubiano JA
      • Thursky K
      • Stewardson AJ
      • Urbancic K
      • Worth LJ
      • Sutherland M
      • Slavin MA
      • Grayson ML
      • Phillips EJ.
      The impact of an integrated antibiotic allergy testing program on antimicrobial stewardship: a multicentre evaluation.
      ;
      • Sacco KA
      • Cochran BP
      • Epps K
      • Parkulo M
      • Gonzalez-Estrada A.
      Inpatient beta-lactam test-dose protocol and antimicrobial stewardship in patients with a history of penicillin allergy.
      ), two were cohort studies (
      • Chua KYL
      • Vogrin S
      • Bury S
      • Douglas A
      • Holmes NE
      • Tan N
      • Brusco NK
      • Hall R
      • Lambros B
      • Lean J
      • Stevenson W
      • Devchand M
      • Garrett K
      • Thursky K
      • Grayson ML
      • Slavin MA
      • Phillips EJ
      • Trubiano JA.
      The penicillin allergy delabeling program: a multicenter whole-of-hospital health services intervention and comparative effectiveness study.
      ;
      • Trubiano JA
      • Vogrin S
      • Copaescu A
      • Nasra M
      • Douglas A
      • Holmes NE
      • Chua KYL.
      Direct oral penicillin challenge for penicillin allergy delabeling as a health services intervention: a multicenter cohort study.
      ), and one was a randomized controlled trial (
      • Vyles D
      • Chiu A
      • Routes J
      • Castells M
      • Phillips EJ
      • Visotcky A
      • Fraser R
      • Pezzin L
      • Brousseau DC.
      Oral amoxicillin challenges in low-risk children during a pediatric emergency department visit.
      ).
      Figure 1
      Figure 1Flow diagram illustrating included and excluded studies.

      Methodological quality

      Of the 56 case series studies, six, 19, and 31 had a high, moderate, and low risk of bias, respectively. The risk of bias assessments are shown in Appendix 5.

      Characteristics of included studies

      The 69 included studies reported on the successful PADL of 5019 patients (adults n = 4314 [
      • Adkinson Jr, NF
      • Thompson WL
      • Maddrey WC
      • Lichtenstein LM
      Routine use of penicillin skin testing on an inpatient service.
      ;
      • Blumenthal KG
      • Shenoy ES
      • Varughese CA
      • Hurwitz S
      • Hooper DC
      • Banerji A.
      Impact of a clinical guideline for prescribing antibiotics to inpatients reporting penicillin or cephalosporin allergy.
      ,
      • Blumenthal KG
      • Li Y
      • Hsu JT
      • Wolfson AR
      • Berkowitz DN
      • Carballo VA
      • Schwartz JM
      • Marquis KA
      • Elshaboury R
      • Gandhi RG
      • Lambl BB
      • Freeley MM
      • Gruszecki A
      • Wickner PG
      • Shenoy ES.
      Outcomes from an inpatient beta-lactam allergy guideline across a large US health system.
      ;
      • Blackwell W
      • Khan D.
      Penicillin allergy testing by allergy trained pharmacists in hospitalized patients.
      ;
      • Chen JR
      • Tarver SA
      • Alvarez KS
      • Tran T
      • Khan DA.
      A proactive approach to penicillin allergy testing in hospitalized patients.
      ,
      • Chen JR
      • Tarver SA
      • Alvarez KS
      • Wei W
      • Khan DA.
      Improving aztreonam stewardship and cost through a penicillin allergy testing clinical guideline.
      ;
      • Chua KYL
      • Vogrin S
      • Bury S
      • Douglas A
      • Holmes NE
      • Tan N
      • Brusco NK
      • Hall R
      • Lambros B
      • Lean J
      • Stevenson W
      • Devchand M
      • Garrett K
      • Thursky K
      • Grayson ML
      • Slavin MA
      • Phillips EJ
      • Trubiano JA.
      The penicillin allergy delabeling program: a multicenter whole-of-hospital health services intervention and comparative effectiveness study.
      ;
      • Devchand M
      • Kirkpatrick CMJ
      • Stevenson W
      • Garrett K
      • Perera D
      • Khumra S
      • Urbancic K
      • Grayson ML
      • Trubiano JA.
      Evaluation of a pharmacist-led penicillin allergy de-labelling ward round: a novel antimicrobial stewardship intervention.
      ;
      • du Plessis T
      • Walls G
      • Jordan A
      • Holland DJ.
      Implementation of a pharmacist-led penicillin allergy de-labelling service in a public hospital.
      ;
      • Englert E
      • Weeks A.
      Pharmacist-driven penicillin skin testing service for adults prescribed nonpreferred antibiotics in a community hospital.
      ;
      • Eischens MR
      • Wolf LM
      • Dumkow LE
      • Anderson AM
      • Jameson AP
      • Brandt KL.
      146 impact of an emergency department antimicrobial stewardship program on the rate of beta-lactam allergy challenge.
      ;
      • Foolad F
      • Berlin S
      • White C
      • Dishner E
      • Jiang Y
      • Taremi M.
      The impact of penicillin skin testing on aztreonam stewardship and cost savings in immunocompromised cancer patients.
      ;
      • Gugkaeva Z
      • Crago JS
      • Yasnogorodsky M.
      Next step in antibiotic stewardship: pharmacist-provided penicillin allergy testing.
      ;
      • Griffith NC
      • Justo JA
      • Winders HR
      • Al-Hasan MN
      • Mediwala KN
      • Bookstaver PB.
      Regulatory approval, implementation, and brief assessment of a pharmacist- and pharmacy trainee-administered penicillin allergy assessment and skin testing program.
      ;
      • Gaudreau S
      • Bourque G
      • Côté K
      • Nutu C
      • Beauchesne MF
      • Longpré AA
      • Beloin-Jubinville B
      • Legeleux L
      • Blaquière M
      • Martin P
      • Gilbert M.
      Resources assessment for penicillin allergy testing performed by pharmacists at the Patient's bedside.
      ;
      • Ham Y
      • Sukerman ES
      • Lewis JS
      • Tucker KJ
      • Yu DL
      • Joshi SR.
      Safety and efficacy of direct two-step penicillin challenges with an inpatient pharmacist-driven allergy evaluation.
      ;
      • Harmon S
      • Richardson T
      • Simons H
      • Monforte S
      • Fanning S
      • Harrington K.
      The clinical and financial impact of a pharmacist-driven penicillin skin testing program on antimicrobial stewardship practices.
      ;
      • Harper HM
      • Sanchez M.
      Review of pharmacist driven penicillin allergy assessments and skin testing: a multi-center Case-Series.
      ;
      • Harris AD
      • Sauberman L
      • Kabbash L
      • Greineder DK
      • Samore MH.
      Penicillin skin testing: a way to optimize antibiotic utilization.
      ;
      • Heil EL
      • Bork JT
      • Schmalzle SA
      • Kleinberg M
      • Kewalramani A
      • Gilliam BL
      • Buchwald UK.
      Implementation of an infectious disease fellow-managed penicillin allergy skin testing service.
      ;
      • Jones BM
      • Bland CM.
      Penicillin skin testing as an antimicrobial stewardship initiative.
      ;
      • Jones BM
      • Avramovski N
      • Concepcion AM
      • Crosby J
      • Bland CM.
      Clinical and economic outcomes of penicillin skin testing as an antimicrobial stewardship initiative in a community health system.
      ;
      • Jones BM
      • Gamble K
      • Sizemore S
      • Bland CM.
      The impact of pharmacy students performing penicillin allergy reconciliation in a community health system.
      ;
      • Kyi L
      • Heke E
      • McPhee S
      • Ojaimi S
      • Barnes S.
      Direct oral challenge for rapid penicillin de-labelling in acute admitted general medical patients.
      ;
      • Leis JA
      • Palmay L
      • Ho G
      • Raybardhan S
      • Gill S
      • Kan T
      • Campbel J
      • Kiss A
      • McCready JB
      • Das P
      • Minnema B
      • Powis JE
      • Walker SAN
      • Ferguson H
      • Wong B
      • Weber E.
      Point-of-care β-lactam allergy skin testing by antimicrobial stewardship programs: a pragmatic multicenter prospective evaluation.
      ;
      • Lin L
      • Nagtegaal JE
      • Buijtels PCAM
      • Jong E
      Antimicrobial stewardship intervention: optimizing antibiotic treatment in hospitalized patients with reported antibiotic allergy.
      ;
      • Livirya S
      • Pithie A
      • Chua I
      • Hamilton N
      • Doogue M
      Isenman H. Oral amoxicillin challenge for low-risk penicillin allergic patients.
      ;
      • Lnumerables F
      • Fischer-Cartlidge E
      Improving antibiotic stewardship through nurse-driven penicillin allergy testing.
      ;
      • Lo SCR
      • Lacaria K
      • Mah A
      • Wong T
      • Mak R.
      An algorithm-based approach to routinely delabel penicillin allergy in pre-hematopoietic stem cell transplant patients with low risk of reaction. In: Proceedings of the Canadian Society of Allergy and Clinical Immunology Annual Scientific Meeting 2019.
      ;
      • Maguire M
      • Hayes BD
      • Fuh L
      • Elshaboury R
      • Gandhi RG
      • Bor S
      • Shenoy ES
      • Wolfson AR
      • Mancini CM
      • Blumenthal KG.
      Beta-lactam antibiotic test doses in the emergency department.
      ;
      • Marwood J
      • Aguirrebarrena G
      • Kerr S
      • Welch SA
      • Rimmer J.
      De-labelling self-reported penicillin allergy within the emergency department through the use of skin tests and oral drug provocation testing.
      ;
      • Mitchell AB
      • Ness RA
      • Bennett JG
      • Bowden JE
      • Elliott WV
      • Gillion AR
      • Pattanaik DN.
      Implementation and impact of a beta-lactam allergy assessment protocol in a veteran population.
      ;
      • Morjaria S
      • Inumerables F
      • Patel D
      • Cohen N
      • Seo S
      • Posthumus S
      • Martin SC
      • Kaltsas A
      • Lee S
      • Boucher N
      • Fischer-Cartlidge E.
      Penicillin allergy testing: an outpatient nurse-driven program for patients with cancer.
      ;
      • Nguyen CT
      • Sahbani O
      • Pisano J
      • Pursell K
      • Pettit NN.
      Impact of a standardized pharmacist-led beta-lactam allergy interview on the quality of allergy documentation.
      ;
      • Patel R
      • Saccone N
      • Stock K
      • Utley S
      • Bouknight D.
      Challenging penicillin allergies: pharmacist led program in a community hospital.
      ;
      • Parker N
      • Choo HF
      • Ghodrat M.
      Implementation of pharmacist-driven penicillin allergy skin testing in a community hospital resulting in a change in scope of practice for pharmacists.
      ;
      • Phung M
      • Vo T
      • Murfin B
      • Galbraith K
      • Barnes S
      • Coutsouvelis J.
      P31: Pharmacist-led penicillin allergic risk categorisation in intensive care patients for the purpose of rapid penicillin allergy delabeling (rapid phire) pilot study.
      ;
      • Rimawi RH
      • Mazer MA.
      Expanding the pool of healthcare providers to perform penicillin skin testing in the ICU.
      ;
      • Sacco KA
      • Cochran BP
      • Epps K
      • Parkulo M
      • Gonzalez-Estrada A.
      Inpatient beta-lactam test-dose protocol and antimicrobial stewardship in patients with a history of penicillin allergy.
      ;
      • Savic L
      • Gurr L
      • Kaura V
      • Toolan J
      • Sandoe JAT
      • Hopkins PM
      • Savic S.
      Penicillin allergy de-labelling ahead of elective surgery: feasibility and barriers.
      ;
      • Shannon KT
      • Krop LC.
      Evaluation of the implementation of an allergy assessment tool as an antimicrobial stewardship initiative.
      ;
      • Sigona NS
      • Steele JM
      • Miller CD.
      Impact of a pharmacist-driven beta-lactam allergy interview on inpatient antimicrobial therapy: a pilot project.
      ;
      • Skibba N
      • Fischer J
      • Loecker B.
      Pilot program of pharmacist managed penicillin allergy skin testing on inpatients at a medical center to determine cost-benefit.
      ;
      • Smibert O
      • Douglas A
      • Devchand M
      • Lambros B
      • Stevenson W
      • Slavin M
      • Trubiano J.
      The safety and efcacy of an oral penicillin rechallenge program in cancer patients: a pilot multicenter study.
      ;
      • Sneddon J
      • Cooper L
      • Ritchie N
      • Steele C
      • Spears M
      • McEwen J
      • Dempsey Z
      • Sutherland R
      • Khatamzas E
      • Seaton RA.
      An algorithm for safe de-labelling of antibiotic allergy in adult hospital in-patients.
      ;
      • Song YC
      • Nelson ZJ
      • Wankum MA
      • Gens KD.
      Effectiveness and feasibility of pharmacist-driven penicillin allergy de-labeling pilot program without skin testing or oral challenges.
      ;
      • Steenvoorden L
      • Bjoernestad EO
      • Kvesetmoen TA
      • Gulsvik AK.
      De-labelling penicillin allergy in acutely hospitalized patients: a pilot study.
      ;
      • Stone CA
      • Stollings JL
      • Lindsell CJ
      • Dear ML
      • Buie RB
      • Rice TW
      • Phillips EJ.
      Risk-stratified management to remove low-risk penicillin allergy labels in the ICU.
      ;
      • Taremi M
      • Artau A
      • Foolad F
      • Berlin S
      • White C
      • Jiang Y
      • Raad I
      • Adachi J.
      Safety, efficacy, and clinical impact of penicillin skin testing in immunocompromised cancer patients.
      ;
      • Torney N
      • Tiberg M.
      Description of a pharmacist-managed penicillin allergy skin testing (PAST) service at a community teaching hospital.
      ,
      • Torney NP
      • Tiberg MD.
      Description of a pharmacist-managed/administered penicillin allergy skin testing service at a community hospital.
      ;
      • Trubiano JA
      • Thursky K
      • Stewardson AJ
      • Urbancic K
      • Worth LJ
      • Sutherland M
      • Slavin MA
      • Grayson ML
      • Phillips EJ.
      The impact of an integrated antibiotic allergy testing program on antimicrobial stewardship: a multicentre evaluation.
      ,
      • Trubiano JA
      • Smibert O
      • Douglas A
      • Devchand M
      • Lambros B
      • Holmes NE
      • Chua KY
      • Phillips EJ
      • Slavin MA.
      The safety and efficacy of an oral penicillin challenge program in cancer patients: a multicenter pilot study.
      ,
      • Trubiano JA
      • Vogrin S
      • Copaescu A
      • Nasra M
      • Douglas A
      • Holmes NE
      • Chua KYL.
      Direct oral penicillin challenge for penicillin allergy delabeling as a health services intervention: a multicenter cohort study.
      ;
      • Wall GC
      • Peters L
      • Leaders CB
      • Wille JA.
      Pharmacist-managed service providing penicillin allergy skin tests.
      ;
      • Wrenn R
      • Sarubbi C
      • Kleris R
      • Drew R
      • Moehring R
      • Lugar P
      • Anderson D.
      Antimicrobial stewarding with a unique pharmacist-managed penicillin skin testing (PST) service.
      ]; children n = 461 [
      • Allen HI
      • Gillespie P
      • Vazquez-Ortiz M
      • Murphy AW
      • Moylett EM.
      A cost-analysis of outpatient paediatric penicillin allergy de-labelling using telemedicine.
      ;
      • Bauer ME
      • MacBrayne C
      • Stein A
      • Searns J
      • Hicks A
      • Sarin T
      • Lin T
      • Duffey H
      • Rannie M
      • Wickstrom K
      • Yang C
      • Bajaj L
      • Carel K.
      A multidisciplinary quality improvement initiative to facilitate penicillin allergy delabeling among hospitalized pediatric patients.
      ;
      • Lecerf K
      • Chaparro J
      • Hehmeyer J
      • Hussain C
      • Macias C
      • Vegh M
      • Watson J
      • Stukus D.
      Development of a penicillin allergy electronic decision support pathway for pediatric inpatient admissions.
      ;
      • Louden NJ
      • Hansen LA
      • Rimal A
      • Norton LE.
      Implementation of a pharmacist-driven penicillin and cephalosporin allergy assessment tool: a pilot evaluation.
      ;
      • Murphy K
      • Scanlan B
      • Coghlan D.
      Does this child really have a penicillin allergy?.
      ;
      • Rahbani p
      • Monroe-Duprey L
      Clinical outcome of penicillin skin testing as an antimicrobial stewardship initiative in the pre-surgical clinic in a community hospital.
      ;
      • Stein A
      • MacBrayne C
      • Yang C
      • Sarin T
      • Hicks A
      • Searns J
      • Bajaj L
      • Bauer ME
      • Carel K.
      Clinical pathway to increase rates of penicillin allergy de-labeling.
      ;
      • Wong J
      • Timberlake K
      • Atkinson A
      • Science M.
      269. De-labeling of allergies to b-lactam antibiotics (De-LABeL) program: development and pilot of an inpatient pediatric program.
      ;
      • Vyles D
      • Chiu A
      • Routes J
      • Castells M
      • Phillips EJ
      • Visotcky A
      • Fraser R
      • Pezzin L
      • Brousseau DC.
      Oral amoxicillin challenges in low-risk children during a pediatric emergency department visit.
      ]; unreported n = 244 [
      • Kleris R
      • Sarubbi C
      • Wrenn R
      • Anderson D
      • Lugar PL.
      Inpatient penicillin allergy evaluation program enriches anti-microbial stewardship aims.
      ;
      • Rahbani P.
      A quality improvement initiative to increase penicillin allergy clarification and decrease aztreonam usage.
      ;
      • Ravindran S
      • Beshir M
      • Wang S
      • Bandi S
      • Hanson A
      • O'Driscoll T
      • MC Tobin
      Impact of hospital-wide guideline for antimicrobial stewardship in patients with history of beta-lactam allergy at an academic medical center.
      ]). The studies were from the United States (n = 48;
      • Adkinson Jr, NF
      • Thompson WL
      • Maddrey WC
      • Lichtenstein LM
      Routine use of penicillin skin testing on an inpatient service.
      ;
      • Bauer ME
      • MacBrayne C
      • Stein A
      • Searns J
      • Hicks A
      • Sarin T
      • Lin T
      • Duffey H
      • Rannie M
      • Wickstrom K
      • Yang C
      • Bajaj L
      • Carel K.
      A multidisciplinary quality improvement initiative to facilitate penicillin allergy delabeling among hospitalized pediatric patients.
      ;
      • Blackwell W
      • Khan D.
      Penicillin allergy testing by allergy trained pharmacists in hospitalized patients.
      ;
      • Blumenthal KG
      • Shenoy ES
      • Varughese CA
      • Hurwitz S
      • Hooper DC
      • Banerji A.
      Impact of a clinical guideline for prescribing antibiotics to inpatients reporting penicillin or cephalosporin allergy.
      ,
      • Blumenthal KG
      • Li Y
      • Hsu JT
      • Wolfson AR
      • Berkowitz DN
      • Carballo VA
      • Schwartz JM
      • Marquis KA
      • Elshaboury R
      • Gandhi RG
      • Lambl BB
      • Freeley MM
      • Gruszecki A
      • Wickner PG
      • Shenoy ES.
      Outcomes from an inpatient beta-lactam allergy guideline across a large US health system.
      ;
      • Chen JR
      • Tarver SA
      • Alvarez KS
      • Tran T
      • Khan DA.
      A proactive approach to penicillin allergy testing in hospitalized patients.
      ,
      • Chen JR
      • Tarver SA
      • Alvarez KS
      • Wei W
      • Khan DA.
      Improving aztreonam stewardship and cost through a penicillin allergy testing clinical guideline.
      ;
      • Eischens MR
      • Wolf LM
      • Dumkow LE
      • Anderson AM
      • Jameson AP
      • Brandt KL.
      146 impact of an emergency department antimicrobial stewardship program on the rate of beta-lactam allergy challenge.
      ;
      • Englert E
      • Weeks A.
      Pharmacist-driven penicillin skin testing service for adults prescribed nonpreferred antibiotics in a community hospital.
      ;
      • Foolad F
      • Berlin S
      • White C
      • Dishner E
      • Jiang Y
      • Taremi M.
      The impact of penicillin skin testing on aztreonam stewardship and cost savings in immunocompromised cancer patients.
      ;
      • Gugkaeva Z
      • Crago JS
      • Yasnogorodsky M.
      Next step in antibiotic stewardship: pharmacist-provided penicillin allergy testing.
      ;
      • Griffith NC
      • Justo JA
      • Winders HR
      • Al-Hasan MN
      • Mediwala KN
      • Bookstaver PB.
      Regulatory approval, implementation, and brief assessment of a pharmacist- and pharmacy trainee-administered penicillin allergy assessment and skin testing program.
      ;
      • Ham Y
      • Sukerman ES
      • Lewis JS
      • Tucker KJ
      • Yu DL
      • Joshi SR.
      Safety and efficacy of direct two-step penicillin challenges with an inpatient pharmacist-driven allergy evaluation.
      ;
      • Harmon S
      • Richardson T
      • Simons H
      • Monforte S
      • Fanning S
      • Harrington K.
      The clinical and financial impact of a pharmacist-driven penicillin skin testing program on antimicrobial stewardship practices.
      ;
      • Harper HM
      • Sanchez M.
      Review of pharmacist driven penicillin allergy assessments and skin testing: a multi-center Case-Series.
      ;
      • Harris AD
      • Sauberman L
      • Kabbash L
      • Greineder DK
      • Samore MH.
      Penicillin skin testing: a way to optimize antibiotic utilization.
      ;
      • Heil EL
      • Bork JT
      • Schmalzle SA
      • Kleinberg M
      • Kewalramani A
      • Gilliam BL
      • Buchwald UK.
      Implementation of an infectious disease fellow-managed penicillin allergy skin testing service.
      ;
      • Jones BM
      • Bland CM.
      Penicillin skin testing as an antimicrobial stewardship initiative.
      ;
      • Jones BM
      • Avramovski N
      • Concepcion AM
      • Crosby J
      • Bland CM.
      Clinical and economic outcomes of penicillin skin testing as an antimicrobial stewardship initiative in a community health system.
      ;
      • Jones BM
      • Gamble K
      • Sizemore S
      • Bland CM.
      The impact of pharmacy students performing penicillin allergy reconciliation in a community health system.
      ;
      • Kleris R
      • Sarubbi C
      • Wrenn R
      • Anderson D
      • Lugar PL.
      Inpatient penicillin allergy evaluation program enriches anti-microbial stewardship aims.
      ;
      • Lecerf K
      • Chaparro J
      • Hehmeyer J
      • Hussain C
      • Macias C
      • Vegh M
      • Watson J
      • Stukus D.
      Development of a penicillin allergy electronic decision support pathway for pediatric inpatient admissions.
      ;
      • Lnumerables F
      • Fischer-Cartlidge E
      Improving antibiotic stewardship through nurse-driven penicillin allergy testing.
      ;
      • Louden NJ
      • Hansen LA
      • Rimal A
      • Norton LE.
      Implementation of a pharmacist-driven penicillin and cephalosporin allergy assessment tool: a pilot evaluation.
      ;
      • Maguire M
      • Hayes BD
      • Fuh L
      • Elshaboury R
      • Gandhi RG
      • Bor S
      • Shenoy ES
      • Wolfson AR
      • Mancini CM
      • Blumenthal KG.
      Beta-lactam antibiotic test doses in the emergency department.
      ;
      • Mitchell AB
      • Ness RA
      • Bennett JG
      • Bowden JE
      • Elliott WV
      • Gillion AR
      • Pattanaik DN.
      Implementation and impact of a beta-lactam allergy assessment protocol in a veteran population.
      ;
      • Morjaria S
      • Inumerables F
      • Patel D
      • Cohen N
      • Seo S
      • Posthumus S
      • Martin SC
      • Kaltsas A
      • Lee S
      • Boucher N
      • Fischer-Cartlidge E.
      Penicillin allergy testing: an outpatient nurse-driven program for patients with cancer.
      ;
      • Nguyen CT
      • Sahbani O
      • Pisano J
      • Pursell K
      • Pettit NN.
      Impact of a standardized pharmacist-led beta-lactam allergy interview on the quality of allergy documentation.
      ;
      • Patel R
      • Saccone N
      • Stock K
      • Utley S
      • Bouknight D.
      Challenging penicillin allergies: pharmacist led program in a community hospital.
      ;
      • Parker N
      • Choo HF
      • Ghodrat M.
      Implementation of pharmacist-driven penicillin allergy skin testing in a community hospital resulting in a change in scope of practice for pharmacists.
      ;
      • Rahbani P.
      A quality improvement initiative to increase penicillin allergy clarification and decrease aztreonam usage.
      ;
      • Rahbani p
      • Monroe-Duprey L
      Clinical outcome of penicillin skin testing as an antimicrobial stewardship initiative in the pre-surgical clinic in a community hospital.
      ;
      • Ravindran S
      • Beshir M
      • Wang S
      • Bandi S
      • Hanson A
      • O'Driscoll T
      • MC Tobin
      Impact of hospital-wide guideline for antimicrobial stewardship in patients with history of beta-lactam allergy at an academic medical center.
      ;
      • Rimawi RH
      • Cook PP
      • Gooch M
      • Kabchi B
      • Ashraf MS
      • Rimawi BH
      • Gebregziabher M
      • Siraj DS.
      The impact of penicillin skin testing on clinical practice and antimicrobial stewardship.
      ;
      • Rimawi RH
      • Mazer MA.
      Expanding the pool of healthcare providers to perform penicillin skin testing in the ICU.
      ;
      • Sacco KA
      • Cochran BP
      • Epps K
      • Parkulo M
      • Gonzalez-Estrada A.
      Inpatient beta-lactam test-dose protocol and antimicrobial stewardship in patients with a history of penicillin allergy.
      ;
      • Shannon KT
      • Krop LC.
      Evaluation of the implementation of an allergy assessment tool as an antimicrobial stewardship initiative.
      ;
      • Sigona NS
      • Steele JM
      • Miller CD.
      Impact of a pharmacist-driven beta-lactam allergy interview on inpatient antimicrobial therapy: a pilot project.
      ;
      • Skibba N
      • Fischer J
      • Loecker B.
      Pilot program of pharmacist managed penicillin allergy skin testing on inpatients at a medical center to determine cost-benefit.
      ;
      • Song YC
      • Nelson ZJ
      • Wankum MA
      • Gens KD.
      Effectiveness and feasibility of pharmacist-driven penicillin allergy de-labeling pilot program without skin testing or oral challenges.
      ;
      • Stein A
      • MacBrayne C
      • Yang C
      • Sarin T
      • Hicks A
      • Searns J
      • Bajaj L
      • Bauer ME
      • Carel K.
      Clinical pathway to increase rates of penicillin allergy de-labeling.
      ;
      • Stone CA
      • Stollings JL
      • Lindsell CJ
      • Dear ML
      • Buie RB
      • Rice TW
      • Phillips EJ.
      Risk-stratified management to remove low-risk penicillin allergy labels in the ICU.
      ;
      • Taremi M
      • Artau A
      • Foolad F
      • Berlin S
      • White C
      • Jiang Y
      • Raad I
      • Adachi J.
      Safety, efficacy, and clinical impact of penicillin skin testing in immunocompromised cancer patients.
      ;
      • Torney N
      • Tiberg M.
      Description of a pharmacist-managed penicillin allergy skin testing (PAST) service at a community teaching hospital.
      ,
      • Torney NP
      • Tiberg MD.
      Description of a pharmacist-managed/administered penicillin allergy skin testing service at a community hospital.
      ;
      • Wall GC
      • Peters L
      • Leaders CB
      • Wille JA.
      Pharmacist-managed service providing penicillin allergy skin tests.
      ;
      • Wrenn R
      • Sarubbi C
      • Kleris R
      • Drew R
      • Moehring R
      • Lugar P
      • Anderson D.
      Antimicrobial stewarding with a unique pharmacist-managed penicillin skin testing (PST) service.
      ;
      • Vyles D
      • Chiu A
      • Routes J
      • Castells M
      • Phillips EJ
      • Visotcky A
      • Fraser R
      • Pezzin L
      • Brousseau DC.
      Oral amoxicillin challenges in low-risk children during a pediatric emergency department visit.
      ), Australia (n = 9;
      • Chua KYL
      • Vogrin S
      • Bury S
      • Douglas A
      • Holmes NE
      • Tan N
      • Brusco NK
      • Hall R
      • Lambros B
      • Lean J
      • Stevenson W
      • Devchand M
      • Garrett K
      • Thursky K
      • Grayson ML
      • Slavin MA
      • Phillips EJ
      • Trubiano JA.
      The penicillin allergy delabeling program: a multicenter whole-of-hospital health services intervention and comparative effectiveness study.
      ;
      • Devchand M
      • Kirkpatrick CMJ
      • Stevenson W
      • Garrett K
      • Perera D
      • Khumra S
      • Urbancic K
      • Grayson ML
      • Trubiano JA.
      Evaluation of a pharmacist-led penicillin allergy de-labelling ward round: a novel antimicrobial stewardship intervention.
      ;
      • Kyi L
      • Heke E
      • McPhee S
      • Ojaimi S
      • Barnes S.
      Direct oral challenge for rapid penicillin de-labelling in acute admitted general medical patients.
      ;
      • Marwood J
      • Aguirrebarrena G
      • Kerr S
      • Welch SA
      • Rimmer J.
      De-labelling self-reported penicillin allergy within the emergency department through the use of skin tests and oral drug provocation testing.
      ;
      • Phung M
      • Vo T
      • Murfin B
      • Galbraith K
      • Barnes S
      • Coutsouvelis J.
      P31: Pharmacist-led penicillin allergic risk categorisation in intensive care patients for the purpose of rapid penicillin allergy delabeling (rapid phire) pilot study.
      ;
      • Smibert O
      • Douglas A
      • Devchand M
      • Lambros B
      • Stevenson W
      • Slavin M
      • Trubiano J.
      The safety and efcacy of an oral penicillin rechallenge program in cancer patients: a pilot multicenter study.
      ;
      • Trubiano JA
      • Thursky K
      • Stewardson AJ
      • Urbancic K
      • Worth LJ
      • Sutherland M
      • Slavin MA
      • Grayson ML
      • Phillips EJ.
      The impact of an integrated antibiotic allergy testing program on antimicrobial stewardship: a multicentre evaluation.
      ,
      • Trubiano JA
      • Smibert O
      • Douglas A
      • Devchand M
      • Lambros B
      • Holmes NE
      • Chua KY
      • Phillips EJ
      • Slavin MA.
      The safety and efficacy of an oral penicillin challenge program in cancer patients: a multicenter pilot study.
      ,
      • Trubiano JA
      • Vogrin S
      • Copaescu A
      • Nasra M
      • Douglas A
      • Holmes NE
      • Chua KYL.
      Direct oral penicillin challenge for penicillin allergy delabeling as a health services intervention: a multicenter cohort study.
      ), Canada (n = 4;
      • Gaudreau S
      • Bourque G
      • Côté K
      • Nutu C
      • Beauchesne MF
      • Longpré AA
      • Beloin-Jubinville B
      • Legeleux L
      • Blaquière M
      • Martin P
      • Gilbert M.
      Resources assessment for penicillin allergy testing performed by pharmacists at the Patient's bedside.
      ;
      • Leis JA
      • Palmay L
      • Ho G
      • Raybardhan S
      • Gill S
      • Kan T
      • Campbel J
      • Kiss A
      • McCready JB
      • Das P
      • Minnema B
      • Powis JE
      • Walker SAN
      • Ferguson H
      • Wong B
      • Weber E.
      Point-of-care β-lactam allergy skin testing by antimicrobial stewardship programs: a pragmatic multicenter prospective evaluation.
      ;
      • Lo SCR
      • Lacaria K
      • Mah A
      • Wong T
      • Mak R.
      An algorithm-based approach to routinely delabel penicillin allergy in pre-hematopoietic stem cell transplant patients with low risk of reaction. In: Proceedings of the Canadian Society of Allergy and Clinical Immunology Annual Scientific Meeting 2019.
      ;
      • Wong J
      • Timberlake K
      • Atkinson A
      • Science M.
      269. De-labeling of allergies to b-lactam antibiotics (De-LABeL) program: development and pilot of an inpatient pediatric program.
      ), Ireland (n = 2;
      • Allen HI
      • Gillespie P
      • Vazquez-Ortiz M
      • Murphy AW
      • Moylett EM.
      A cost-analysis of outpatient paediatric penicillin allergy de-labelling using telemedicine.
      ;
      • Murphy K
      • Scanlan B
      • Coghlan D.
      Does this child really have a penicillin allergy?.
      ), New Zealand (n = 2;
      • du Plessis T
      • Walls G
      • Jordan A
      • Holland DJ.
      Implementation of a pharmacist-led penicillin allergy de-labelling service in a public hospital.
      ;
      • Livirya S
      • Pithie A
      • Chua I
      • Hamilton N
      • Doogue M
      Isenman H. Oral amoxicillin challenge for low-risk penicillin allergic patients.
      ), the UK (n = 2;
      • Savic L
      • Gurr L
      • Kaura V
      • Toolan J
      • Sandoe JAT
      • Hopkins PM
      • Savic S.
      Penicillin allergy de-labelling ahead of elective surgery: feasibility and barriers.
      ;
      • Sneddon J
      • Cooper L
      • Ritchie N
      • Steele C
      • Spears M
      • McEwen J
      • Dempsey Z
      • Sutherland R
      • Khatamzas E
      • Seaton RA.
      An algorithm for safe de-labelling of antibiotic allergy in adult hospital in-patients.
      ), the Netherlands (n = 1;
      • Lin L
      • Nagtegaal JE
      • Buijtels PCAM
      • Jong E
      Antimicrobial stewardship intervention: optimizing antibiotic treatment in hospitalized patients with reported antibiotic allergy.
      ), and Norway (n = 1;
      • Savic L
      • Gurr L
      • Kaura V
      • Toolan J
      • Sandoe JAT
      • Hopkins PM
      • Savic S.
      Penicillin allergy de-labelling ahead of elective surgery: feasibility and barriers.
      ); most were inpatient studies (n = 56; 81.2%;
      • Adkinson Jr, NF
      • Thompson WL
      • Maddrey WC
      • Lichtenstein LM
      Routine use of penicillin skin testing on an inpatient service.
      ;
      • Bauer ME
      • MacBrayne C
      • Stein A
      • Searns J
      • Hicks A
      • Sarin T
      • Lin T
      • Duffey H
      • Rannie M
      • Wickstrom K
      • Yang C
      • Bajaj L
      • Carel K.
      A multidisciplinary quality improvement initiative to facilitate penicillin allergy delabeling among hospitalized pediatric patients.
      ;
      • Blackwell W
      • Khan D.
      Penicillin allergy testing by allergy trained pharmacists in hospitalized patients.
      ;
      • Blumenthal KG
      • Shenoy ES
      • Varughese CA
      • Hurwitz S
      • Hooper DC
      • Banerji A.
      Impact of a clinical guideline for prescribing antibiotics to inpatients reporting penicillin or cephalosporin allergy.
      ,
      • Blumenthal KG
      • Li Y
      • Hsu JT
      • Wolfson AR
      • Berkowitz DN
      • Carballo VA
      • Schwartz JM
      • Marquis KA
      • Elshaboury R
      • Gandhi RG
      • Lambl BB
      • Freeley MM
      • Gruszecki A
      • Wickner PG
      • Shenoy ES.
      Outcomes from an inpatient beta-lactam allergy guideline across a large US health system.
      ;
      • Chen JR
      • Tarver SA
      • Alvarez KS
      • Tran T
      • Khan DA.
      A proactive approach to penicillin allergy testing in hospitalized patients.
      ,
      • Chen JR
      • Tarver SA
      • Alvarez KS
      • Wei W
      • Khan DA.
      Improving aztreonam stewardship and cost through a penicillin allergy testing clinical guideline.
      ;
      • Chua KYL
      • Vogrin S
      • Bury S
      • Douglas A
      • Holmes NE
      • Tan N
      • Brusco NK
      • Hall R
      • Lambros B
      • Lean J
      • Stevenson W
      • Devchand M
      • Garrett K
      • Thursky K
      • Grayson ML
      • Slavin MA
      • Phillips EJ
      • Trubiano JA.
      The penicillin allergy delabeling program: a multicenter whole-of-hospital health services intervention and comparative effectiveness study.
      ;
      • Devchand M
      • Kirkpatrick CMJ
      • Stevenson W
      • Garrett K
      • Perera D
      • Khumra S
      • Urbancic K
      • Grayson ML
      • Trubiano JA.
      Evaluation of a pharmacist-led penicillin allergy de-labelling ward round: a novel antimicrobial stewardship intervention.
      ;
      • du Plessis T
      • Walls G
      • Jordan A
      • Holland DJ.
      Implementation of a pharmacist-led penicillin allergy de-labelling service in a public hospital.
      ;
      • Englert E
      • Weeks A.
      Pharmacist-driven penicillin skin testing service for adults prescribed nonpreferred antibiotics in a community hospital.
      ;
      • Foolad F
      • Berlin S
      • White C
      • Dishner E
      • Jiang Y
      • Taremi M.
      The impact of penicillin skin testing on aztreonam stewardship and cost savings in immunocompromised cancer patients.
      ;
      • Gaudreau S
      • Bourque G
      • Côté K
      • Nutu C
      • Beauchesne MF
      • Longpré AA
      • Beloin-Jubinville B
      • Legeleux L
      • Blaquière M
      • Martin P
      • Gilbert M.
      Resources assessment for penicillin allergy testing performed by pharmacists at the Patient's bedside.
      ;
      • Gugkaeva Z
      • Crago JS
      • Yasnogorodsky M.
      Next step in antibiotic stewardship: pharmacist-provided penicillin allergy testing.
      ;
      • Griffith NC
      • Justo JA
      • Winders HR
      • Al-Hasan MN
      • Mediwala KN
      • Bookstaver PB.
      Regulatory approval, implementation, and brief assessment of a pharmacist- and pharmacy trainee-administered penicillin allergy assessment and skin testing program.
      ;
      • Ham Y
      • Sukerman ES
      • Lewis JS
      • Tucker KJ
      • Yu DL
      • Joshi SR.
      Safety and efficacy of direct two-step penicillin challenges with an inpatient pharmacist-driven allergy evaluation.
      ;
      • Harmon S
      • Richardson T
      • Simons H
      • Monforte S
      • Fanning S
      • Harrington K.
      The clinical and financial impact of a pharmacist-driven penicillin skin testing program on antimicrobial stewardship practices.
      ;
      • Harper HM
      • Sanchez M.
      Review of pharmacist driven penicillin allergy assessments and skin testing: a multi-center Case-Series.
      ;
      • Harris AD
      • Sauberman L
      • Kabbash L
      • Greineder DK
      • Samore MH.
      Penicillin skin testing: a way to optimize antibiotic utilization.
      ;
      • Heil EL
      • Bork JT
      • Schmalzle SA
      • Kleinberg M
      • Kewalramani A
      • Gilliam BL
      • Buchwald UK.
      Implementation of an infectious disease fellow-managed penicillin allergy skin testing service.
      ;
      • Jones BM
      • Bland CM.
      Penicillin skin testing as an antimicrobial stewardship initiative.
      ;
      • Jones BM
      • Avramovski N
      • Concepcion AM
      • Crosby J
      • Bland CM.
      Clinical and economic outcomes of penicillin skin testing as an antimicrobial stewardship initiative in a community health system.
      ;
      • Jones BM
      • Gamble K
      • Sizemore S
      • Bland CM.
      The impact of pharmacy students performing penicillin allergy reconciliation in a community health system.
      ;
      • Kleris R
      • Sarubbi C
      • Wrenn R
      • Anderson D
      • Lugar PL.
      Inpatient penicillin allergy evaluation program enriches anti-microbial stewardship aims.
      ;
      • Kyi L
      • Heke E
      • McPhee S
      • Ojaimi S
      • Barnes S.
      Direct oral challenge for rapid penicillin de-labelling in acute admitted general medical patients.
      ;
      • Lecerf K
      • Chaparro J
      • Hehmeyer J
      • Hussain C
      • Macias C
      • Vegh M
      • Watson J
      • Stukus D.
      Development of a penicillin allergy electronic decision support pathway for pediatric inpatient admissions.
      ;
      • Leis JA
      • Palmay L
      • Ho G
      • Raybardhan S
      • Gill S
      • Kan T
      • Campbel J
      • Kiss A
      • McCready JB
      • Das P
      • Minnema B
      • Powis JE
      • Walker SAN
      • Ferguson H
      • Wong B
      • Weber E.
      Point-of-care β-lactam allergy skin testing by antimicrobial stewardship programs: a pragmatic multicenter prospective evaluation.
      ;
      • Lin L
      • Nagtegaal JE
      • Buijtels PCAM
      • Jong E
      Antimicrobial stewardship intervention: optimizing antibiotic treatment in hospitalized patients with reported antibiotic allergy.
      ;
      • Livirya S
      • Pithie A
      • Chua I
      • Hamilton N
      • Doogue M
      Isenman H. Oral amoxicillin challenge for low-risk penicillin allergic patients.
      ;
      • Louden NJ
      • Hansen LA
      • Rimal A
      • Norton LE.
      Implementation of a pharmacist-driven penicillin and cephalosporin allergy assessment tool: a pilot evaluation.
      ;
      • Mitchell AB
      • Ness RA
      • Bennett JG
      • Bowden JE
      • Elliott WV
      • Gillion AR
      • Pattanaik DN.
      Implementation and impact of a beta-lactam allergy assessment protocol in a veteran population.
      ;
      • Nguyen CT
      • Sahbani O
      • Pisano J
      • Pursell K
      • Pettit NN.
      Impact of a standardized pharmacist-led beta-lactam allergy interview on the quality of allergy documentation.
      ;
      • Patel R
      • Saccone N
      • Stock K
      • Utley S
      • Bouknight D.
      Challenging penicillin allergies: pharmacist led program in a community hospital.
      ;
      • Parker N
      • Choo HF
      • Ghodrat M.
      Implementation of pharmacist-driven penicillin allergy skin testing in a community hospital resulting in a change in scope of practice for pharmacists.
      ;
      • Phung M
      • Vo T
      • Murfin B
      • Galbraith K
      • Barnes S
      • Coutsouvelis J.
      P31: Pharmacist-led penicillin allergic risk categorisation in intensive care patients for the purpose of rapid penicillin allergy delabeling (rapid phire) pilot study.
      ;
      • Ravindran S
      • Beshir M
      • Wang S
      • Bandi S
      • Hanson A
      • O'Driscoll T
      • MC Tobin
      Impact of hospital-wide guideline for antimicrobial stewardship in patients with history of beta-lactam allergy at an academic medical center.
      ;
      • Rahbani P.
      A quality improvement initiative to increase penicillin allergy clarification and decrease aztreonam usage.
      ;
      • Rimawi RH
      • Cook PP
      • Gooch M
      • Kabchi B
      • Ashraf MS
      • Rimawi BH
      • Gebregziabher M
      • Siraj DS.
      The impact of penicillin skin testing on clinical practice and antimicrobial stewardship.
      ;
      • Rimawi RH
      • Mazer MA.
      Expanding the pool of healthcare providers to perform penicillin skin testing in the ICU.
      ;
      • Sacco KA
      • Cochran BP
      • Epps K
      • Parkulo M
      • Gonzalez-Estrada A.
      Inpatient beta-lactam test-dose protocol and antimicrobial stewardship in patients with a history of penicillin allergy.
      ;
      • Shannon KT
      • Krop LC.
      Evaluation of the implementation of an allergy assessment tool as an antimicrobial stewardship initiative.
      ;
      • Sigona NS
      • Steele JM
      • Miller CD.
      Impact of a pharmacist-driven beta-lactam allergy interview on inpatient antimicrobial therapy: a pilot project.
      ;
      • Skibba N
      • Fischer J
      • Loecker B.
      Pilot program of pharmacist managed penicillin allergy skin testing on inpatients at a medical center to determine cost-benefit.
      ;
      • Smibert O
      • Douglas A
      • Devchand M
      • Lambros B
      • Stevenson W
      • Slavin M
      • Trubiano J.
      The safety and efcacy of an oral penicillin rechallenge program in cancer patients: a pilot multicenter study.
      ;
      • Song YC
      • Nelson ZJ
      • Wankum MA
      • Gens KD.
      Effectiveness and feasibility of pharmacist-driven penicillin allergy de-labeling pilot program without skin testing or oral challenges.
      ;
      • Steenvoorden L
      • Bjoernestad EO
      • Kvesetmoen TA
      • Gulsvik AK.
      De-labelling penicillin allergy in acutely hospitalized patients: a pilot study.
      ;
      • Stein A
      • MacBrayne C
      • Yang C
      • Sarin T
      • Hicks A
      • Searns J
      • Bajaj L
      • Bauer ME
      • Carel K.
      Clinical pathway to increase rates of penicillin allergy de-labeling.
      ;
      • Stone CA
      • Stollings JL
      • Lindsell CJ
      • Dear ML
      • Buie RB
      • Rice TW
      • Phillips EJ.
      Risk-stratified management to remove low-risk penicillin allergy labels in the ICU.
      ;
      • Taremi M
      • Artau A
      • Foolad F
      • Berlin S
      • White C
      • Jiang Y
      • Raad I
      • Adachi J.
      Safety, efficacy, and clinical impact of penicillin skin testing in immunocompromised cancer patients.
      ;
      • Torney N
      • Tiberg M.
      Description of a pharmacist-managed penicillin allergy skin testing (PAST) service at a community teaching hospital.
      ,
      • Torney NP
      • Tiberg MD.
      Description of a pharmacist-managed/administered penicillin allergy skin testing service at a community hospital.
      ;
      • Trubiano JA
      • Thursky K
      • Stewardson AJ
      • Urbancic K
      • Worth LJ
      • Sutherland M
      • Slavin MA
      • Grayson ML
      • Phillips EJ.
      The impact of an integrated antibiotic allergy testing program on antimicrobial stewardship: a multicentre evaluation.
      ,
      • Trubiano JA
      • Vogrin S
      • Copaescu A
      • Nasra M
      • Douglas A
      • Holmes NE
      • Chua KYL.
      Direct oral penicillin challenge for penicillin allergy delabeling as a health services intervention: a multicenter cohort study.
      ;
      • Wall GC
      • Peters L
      • Leaders CB
      • Wille JA.
      Pharmacist-managed service providing penicillin allergy skin tests.
      ;
      • Wrenn R
      • Sarubbi C
      • Kleris R
      • Drew R
      • Moehring R
      • Lugar P
      • Anderson D.
      Antimicrobial stewarding with a unique pharmacist-managed penicillin skin testing (PST) service.
      ;
      • Wong J
      • Timberlake K
      • Atkinson A
      • Science M.
      269. De-labeling of allergies to b-lactam antibiotics (De-LABeL) program: development and pilot of an inpatient pediatric program.
      ), four in the emergency department only (
      • Eischens MR
      • Wolf LM
      • Dumkow LE
      • Anderson AM
      • Jameson AP
      • Brandt KL.
      146 impact of an emergency department antimicrobial stewardship program on the rate of beta-lactam allergy challenge.
      ;
      • Marwood J
      • Aguirrebarrena G
      • Kerr S
      • Welch SA
      • Rimmer J.
      De-labelling self-reported penicillin allergy within the emergency department through the use of skin tests and oral drug provocation testing.
      ;
      • Maguire M
      • Hayes BD
      • Fuh L
      • Elshaboury R
      • Gandhi RG
      • Bor S
      • Shenoy ES
      • Wolfson AR
      • Mancini CM
      • Blumenthal KG.
      Beta-lactam antibiotic test doses in the emergency department.
      ;
      • Vyles D
      • Chiu A
      • Routes J
      • Castells M
      • Phillips EJ
      • Visotcky A
      • Fraser R
      • Pezzin L
      • Brousseau DC.
      Oral amoxicillin challenges in low-risk children during a pediatric emergency department visit.
      ), four in the outpatient setting (
      • Allen HI
      • Gillespie P
      • Vazquez-Ortiz M
      • Murphy AW
      • Moylett EM.
      A cost-analysis of outpatient paediatric penicillin allergy de-labelling using telemedicine.
      ;
      • Lo SCR
      • Lacaria K
      • Mah A
      • Wong T
      • Mak R.
      An algorithm-based approach to routinely delabel penicillin allergy in pre-hematopoietic stem cell transplant patients with low risk of reaction. In: Proceedings of the Canadian Society of Allergy and Clinical Immunology Annual Scientific Meeting 2019.
      ;
      • Rahbani p
      • Monroe-Duprey L
      Clinical outcome of penicillin skin testing as an antimicrobial stewardship initiative in the pre-surgical clinic in a community hospital.
      ;
      • Morjaria S
      • Inumerables F
      • Patel D
      • Cohen N
      • Seo S
      • Posthumus S
      • Martin SC
      • Kaltsas A
      • Lee S
      • Boucher N
      • Fischer-Cartlidge E.
      Penicillin allergy testing: an outpatient nurse-driven program for patients with cancer.
      ), three conducted in both the inpatient and the outpatient setting (
      • Lnumerables F
      • Fischer-Cartlidge E
      Improving antibiotic stewardship through nurse-driven penicillin allergy testing.
      ;
      • Murphy K
      • Scanlan B
      • Coghlan D.
      Does this child really have a penicillin allergy?.
      ,
      • Trubiano JA
      • Smibert O
      • Douglas A
      • Devchand M
      • Lambros B
      • Holmes NE
      • Chua KY
      • Phillips EJ
      • Slavin MA.
      The safety and efficacy of an oral penicillin challenge program in cancer patients: a multicenter pilot study.
      ), one inpatient and peri-op (
      • Sneddon J
      • Cooper L
      • Ritchie N
      • Steele C
      • Spears M
      • McEwen J
      • Dempsey Z
      • Sutherland R
      • Khatamzas E
      • Seaton RA.
      An algorithm for safe de-labelling of antibiotic allergy in adult hospital in-patients.
      ), and one perioperation only (
      • Savic L
      • Gurr L
      • Kaura V
      • Toolan J
      • Sandoe JAT
      • Hopkins PM
      • Savic S.
      Penicillin allergy de-labelling ahead of elective surgery: feasibility and barriers.
      ). The clinical settings included general/internal medicine (n = 23;
      • Adkinson Jr, NF
      • Thompson WL
      • Maddrey WC
      • Lichtenstein LM
      Routine use of penicillin skin testing on an inpatient service.
      ;
      • Blumenthal KG
      • Shenoy ES
      • Varughese CA
      • Hurwitz S
      • Hooper DC
      • Banerji A.
      Impact of a clinical guideline for prescribing antibiotics to inpatients reporting penicillin or cephalosporin allergy.
      ,
      • Blumenthal KG
      • Li Y
      • Hsu JT
      • Wolfson AR
      • Berkowitz DN
      • Carballo VA
      • Schwartz JM
      • Marquis KA
      • Elshaboury R
      • Gandhi RG
      • Lambl BB
      • Freeley MM
      • Gruszecki A
      • Wickner PG
      • Shenoy ES.
      Outcomes from an inpatient beta-lactam allergy guideline across a large US health system.
      ;
      • Chen JR
      • Tarver SA
      • Alvarez KS
      • Tran T
      • Khan DA.
      A proactive approach to penicillin allergy testing in hospitalized patients.
      ,
      • Chen JR
      • Tarver SA
      • Alvarez KS
      • Wei W
      • Khan DA.
      Improving aztreonam stewardship and cost through a penicillin allergy testing clinical guideline.
      ;
      • Chua KYL
      • Vogrin S
      • Bury S
      • Douglas A
      • Holmes NE
      • Tan N
      • Brusco NK
      • Hall R
      • Lambros B
      • Lean J
      • Stevenson W
      • Devchand M
      • Garrett K
      • Thursky K
      • Grayson ML
      • Slavin MA
      • Phillips EJ
      • Trubiano JA.
      The penicillin allergy delabeling program: a multicenter whole-of-hospital health services intervention and comparative effectiveness study.
      ;
      • Englert E
      • Weeks A.
      Pharmacist-driven penicillin skin testing service for adults prescribed nonpreferred antibiotics in a community hospital.
      ;
      • Harmon S
      • Richardson T
      • Simons H
      • Monforte S
      • Fanning S
      • Harrington K.
      The clinical and financial impact of a pharmacist-driven penicillin skin testing program on antimicrobial stewardship practices.
      ;
      • Heil EL
      • Bork JT
      • Schmalzle SA
      • Kleinberg M
      • Kewalramani A
      • Gilliam BL
      • Buchwald UK.
      Implementation of an infectious disease fellow-managed penicillin allergy skin testing service.
      ;
      • Kyi L
      • Heke E
      • McPhee S
      • Ojaimi S
      • Barnes S.
      Direct oral challenge for rapid penicillin de-labelling in acute admitted general medical patients.
      ;
      • Leis JA
      • Palmay L
      • Ho G
      • Raybardhan S
      • Gill S
      • Kan T
      • Campbel J
      • Kiss A
      • McCready JB
      • Das P
      • Minnema B
      • Powis JE
      • Walker SAN
      • Ferguson H
      • Wong B
      • Weber E.
      Point-of-care β-lactam allergy skin testing by antimicrobial stewardship programs: a pragmatic multicenter prospective evaluation.
      ;
      • Livirya S
      • Pithie A
      • Chua I
      • Hamilton N
      • Doogue M
      Isenman H. Oral amoxicillin challenge for low-risk penicillin allergic patients.
      ;
      • Louden NJ
      • Hansen LA
      • Rimal A
      • Norton LE.
      Implementation of a pharmacist-driven penicillin and cephalosporin allergy assessment tool: a pilot evaluation.
      ;
      • Mitchell AB
      • Ness RA
      • Bennett JG
      • Bowden JE
      • Elliott WV
      • Gillion AR
      • Pattanaik DN.
      Implementation and impact of a beta-lactam allergy assessment protocol in a veteran population.
      ;
      • Nguyen CT
      • Sahbani O
      • Pisano J
      • Pursell K
      • Pettit NN.
      Impact of a standardized pharmacist-led beta-lactam allergy interview on the quality of allergy documentation.
      ;
      • Parker N
      • Choo HF
      • Ghodrat M.
      Implementation of pharmacist-driven penicillin allergy skin testing in a community hospital resulting in a change in scope of practice for pharmacists.
      ;
      • Rimawi RH
      • Cook PP
      • Gooch M
      • Kabchi B
      • Ashraf MS
      • Rimawi BH
      • Gebregziabher M
      • Siraj DS.
      The impact of penicillin skin testing on clinical practice and antimicrobial stewardship.
      ;
      • Sacco KA
      • Cochran BP
      • Epps K
      • Parkulo M
      • Gonzalez-Estrada A.
      Inpatient beta-lactam test-dose protocol and antimicrobial stewardship in patients with a history of penicillin allergy.
      ;
      • Sneddon J
      • Cooper L
      • Ritchie N
      • Steele C
      • Spears M
      • McEwen J
      • Dempsey Z
      • Sutherland R
      • Khatamzas E
      • Seaton RA.
      An algorithm for safe de-labelling of antibiotic allergy in adult hospital in-patients.
      ;
      • Song YC
      • Nelson ZJ
      • Wankum MA
      • Gens KD.
      Effectiveness and feasibility of pharmacist-driven penicillin allergy de-labeling pilot program without skin testing or oral challenges.
      ;
      • Steenvoorden L
      • Bjoernestad EO
      • Kvesetmoen TA
      • Gulsvik AK.
      De-labelling penicillin allergy in acutely hospitalized patients: a pilot study.
      ;
      • Torney NP
      • Tiberg MD.
      Description of a pharmacist-managed/administered penicillin allergy skin testing service at a community hospital.
      ;
      • Trubiano JA
      • Vogrin S
      • Copaescu A
      • Nasra M
      • Douglas A
      • Holmes NE
      • Chua KYL.
      Direct oral penicillin challenge for penicillin allergy delabeling as a health services intervention: a multicenter cohort study.
      ), intensive care (n = 12;
      • Blumenthal KG
      • Li Y
      • Hsu JT
      • Wolfson AR
      • Berkowitz DN
      • Carballo VA
      • Schwartz JM
      • Marquis KA
      • Elshaboury R
      • Gandhi RG
      • Lambl BB
      • Freeley MM
      • Gruszecki A
      • Wickner PG
      • Shenoy ES.
      Outcomes from an inpatient beta-lactam allergy guideline across a large US health system.
      ;
      • Chen JR
      • Tarver SA
      • Alvarez KS
      • Wei W
      • Khan DA.
      Improving aztreonam stewardship and cost through a penicillin allergy testing clinical guideline.
      ;
      • Heil EL
      • Bork JT
      • Schmalzle SA
      • Kleinberg M
      • Kewalramani A
      • Gilliam BL
      • Buchwald UK.
      Implementation of an infectious disease fellow-managed penicillin allergy skin testing service.
      ;
      • Jones BM
      • Avramovski N
      • Concepcion AM
      • Crosby J
      • Bland CM.
      Clinical and economic outcomes of penicillin skin testing as an antimicrobial stewardship initiative in a community health system.
      ;
      • Leis JA
      • Palmay L
      • Ho G
      • Raybardhan S
      • Gill S
      • Kan T
      • Campbel J
      • Kiss A
      • McCready JB
      • Das P
      • Minnema B
      • Powis JE
      • Walker SAN
      • Ferguson H
      • Wong B
      • Weber E.
      Point-of-care β-lactam allergy skin testing by antimicrobial stewardship programs: a pragmatic multicenter prospective evaluation.
      ;
      • Louden NJ
      • Hansen LA
      • Rimal A
      • Norton LE.
      Implementation of a pharmacist-driven penicillin and cephalosporin allergy assessment tool: a pilot evaluation.
      ;
      • Phung M
      • Vo T
      • Murfin B
      • Galbraith K
      • Barnes S
      • Coutsouvelis J.
      P31: Pharmacist-led penicillin allergic risk categorisation in intensive care patients for the purpose of rapid penicillin allergy delabeling (rapid phire) pilot study.
      ;
      • Rimawi RH
      • Cook PP
      • Gooch M
      • Kabchi B
      • Ashraf MS
      • Rimawi BH
      • Gebregziabher M
      • Siraj DS.
      The impact of penicillin skin testing on clinical practice and antimicrobial stewardship.
      ;
      • Rimawi RH
      • Mazer MA.
      Expanding the pool of healthcare providers to perform penicillin skin testing in the ICU.
      ;
      • Stone CA
      • Stollings JL
      • Lindsell CJ
      • Dear ML
      • Buie RB
      • Rice TW
      • Phillips EJ.
      Risk-stratified management to remove low-risk penicillin allergy labels in the ICU.
      ;
      • Torney NP
      • Tiberg MD.
      Description of a pharmacist-managed/administered penicillin allergy skin testing service at a community hospital.
      ;
      • Trubiano JA
      • Vogrin S
      • Copaescu A
      • Nasra M
      • Douglas A
      • Holmes NE
      • Chua KYL.
      Direct oral penicillin challenge for penicillin allergy delabeling as a health services intervention: a multicenter cohort study.
      ), surgery/general surgery (n = 10;
      • Blumenthal KG
      • Shenoy ES
      • Varughese CA
      • Hurwitz S
      • Hooper DC
      • Banerji A.
      Impact of a clinical guideline for prescribing antibiotics to inpatients reporting penicillin or cephalosporin allergy.
      ,
      • Blumenthal KG
      • Li Y
      • Hsu JT
      • Wolfson AR
      • Berkowitz DN
      • Carballo VA
      • Schwartz JM
      • Marquis KA
      • Elshaboury R
      • Gandhi RG
      • Lambl BB
      • Freeley MM
      • Gruszecki A
      • Wickner PG
      • Shenoy ES.
      Outcomes from an inpatient beta-lactam allergy guideline across a large US health system.
      ;
      • Chen JR
      • Tarver SA
      • Alvarez KS
      • Tran T
      • Khan DA.
      A proactive approach to penicillin allergy testing in hospitalized patients.
      ,
      • Chen JR
      • Tarver SA
      • Alvarez KS
      • Wei W
      • Khan DA.
      Improving aztreonam stewardship and cost through a penicillin allergy testing clinical guideline.
      ;
      • Chua KYL
      • Vogrin S
      • Bury S
      • Douglas A
      • Holmes NE
      • Tan N
      • Brusco NK
      • Hall R
      • Lambros B
      • Lean J
      • Stevenson W
      • Devchand M
      • Garrett K
      • Thursky K
      • Grayson ML
      • Slavin MA
      • Phillips EJ
      • Trubiano JA.
      The penicillin allergy delabeling program: a multicenter whole-of-hospital health services intervention and comparative effectiveness study.
      ;
      • Heil EL
      • Bork JT
      • Schmalzle SA
      • Kleinberg M
      • Kewalramani A
      • Gilliam BL
      • Buchwald UK.
      Implementation of an infectious disease fellow-managed penicillin allergy skin testing service.
      ;
      • Jones BM
      • Avramovski N
      • Concepcion AM
      • Crosby J
      • Bland CM.
      Clinical and economic outcomes of penicillin skin testing as an antimicrobial stewardship initiative in a community health system.
      ;
      • Rimawi RH
      • Cook PP
      • Gooch M
      • Kabchi B
      • Ashraf MS
      • Rimawi BH
      • Gebregziabher M
      • Siraj DS.
      The impact of penicillin skin testing on clinical practice and antimicrobial stewardship.
      ;
      • Song YC
      • Nelson ZJ
      • Wankum MA
      • Gens KD.
      Effectiveness and feasibility of pharmacist-driven penicillin allergy de-labeling pilot program without skin testing or oral challenges.
      ;
      • Trubiano JA
      • Vogrin S
      • Copaescu A
      • Nasra M
      • Douglas A
      • Holmes NE
      • Chua KYL.
      Direct oral penicillin challenge for penicillin allergy delabeling as a health services intervention: a multicenter cohort study.
      ), oncology (n = 11;
      • Blumenthal KG
      • Shenoy ES
      • Varughese CA
      • Hurwitz S
      • Hooper DC
      • Banerji A.
      Impact of a clinical guideline for prescribing antibiotics to inpatients reporting penicillin or cephalosporin allergy.
      ,
      • Blumenthal KG
      • Li Y
      • Hsu JT
      • Wolfson AR
      • Berkowitz DN
      • Carballo VA
      • Schwartz JM
      • Marquis KA
      • Elshaboury R
      • Gandhi RG
      • Lambl BB
      • Freeley MM
      • Gruszecki A
      • Wickner PG
      • Shenoy ES.
      Outcomes from an inpatient beta-lactam allergy guideline across a large US health system.
      ;
      • Chua KYL
      • Vogrin S
      • Bury S
      • Douglas A
      • Holmes NE
      • Tan N
      • Brusco NK
      • Hall R
      • Lambros B
      • Lean J
      • Stevenson W
      • Devchand M
      • Garrett K
      • Thursky K
      • Grayson ML
      • Slavin MA
      • Phillips EJ
      • Trubiano JA.
      The penicillin allergy delabeling program: a multicenter whole-of-hospital health services intervention and comparative effectiveness study.
      ;
      • Foolad F
      • Berlin S
      • White C
      • Dishner E
      • Jiang Y
      • Taremi M.
      The impact of penicillin skin testing on aztreonam stewardship and cost savings in immunocompromised cancer patients.
      ;
      • Jones BM
      • Avramovski N
      • Concepcion AM
      • Crosby J
      • Bland CM.
      Clinical and economic outcomes of penicillin skin testing as an antimicrobial stewardship initiative in a community health system.
      ;
      • Morjaria S
      • Inumerables F
      • Patel D
      • Cohen N
      • Seo S
      • Posthumus S
      • Martin SC
      • Kaltsas A
      • Lee S
      • Boucher N
      • Fischer-Cartlidge E.
      Penicillin allergy testing: an outpatient nurse-driven program for patients with cancer.
      ;
      • Smibert O
      • Douglas A
      • Devchand M
      • Lambros B
      • Stevenson W
      • Slavin M
      • Trubiano J.
      The safety and efcacy of an oral penicillin rechallenge program in cancer patients: a pilot multicenter study.
      ;
      • Taremi M
      • Artau A
      • Foolad F
      • Berlin S
      • White C
      • Jiang Y
      • Raad I
      • Adachi J.
      Safety, efficacy, and clinical impact of penicillin skin testing in immunocompromised cancer patients.
      ;
      • Trubiano JA
      • Thursky K
      • Stewardson AJ
      • Urbancic K
      • Worth LJ
      • Sutherland M
      • Slavin MA
      • Grayson ML
      • Phillips EJ.
      The impact of an integrated antibiotic allergy testing program on antimicrobial stewardship: a multicentre evaluation.
      ,
      • Trubiano JA
      • Smibert O
      • Douglas A
      • Devchand M
      • Lambros B
      • Holmes NE
      • Chua KY
      • Phillips EJ
      • Slavin MA.
      The safety and efficacy of an oral penicillin challenge program in cancer patients: a multicenter pilot study.
      ,
      • Trubiano JA
      • Vogrin S
      • Copaescu A
      • Nasra M
      • Douglas A
      • Holmes NE
      • Chua KYL.
      Direct oral penicillin challenge for penicillin allergy delabeling as a health services intervention: a multicenter cohort study.
      ), hematology (n = 9;
      • Foolad F
      • Berlin S
      • White C
      • Dishner E
      • Jiang Y
      • Taremi M.
      The impact of penicillin skin testing on aztreonam stewardship and cost savings in immunocompromised cancer patients.
      ;
      • Lnumerables F
      • Fischer-Cartlidge E
      Improving antibiotic stewardship through nurse-driven penicillin allergy testing.
      ;
      • Lo SCR
      • Lacaria K
      • Mah A
      • Wong T
      • Mak R.
      An algorithm-based approach to routinely delabel penicillin allergy in pre-hematopoietic stem cell transplant patients with low risk of reaction. In: Proceedings of the Canadian Society of Allergy and Clinical Immunology Annual Scientific Meeting 2019.
      ;
      • Morjaria S
      • Inumerables F
      • Patel D
      • Cohen N
      • Seo S
      • Posthumus S
      • Martin SC
      • Kaltsas A
      • Lee S
      • Boucher N
      • Fischer-Cartlidge E.
      Penicillin allergy testing: an outpatient nurse-driven program for patients with cancer.
      ;
      • Smibert O
      • Douglas A
      • Devchand M
      • Lambros B
      • Stevenson W
      • Slavin M
      • Trubiano J.
      The safety and efcacy of an oral penicillin rechallenge program in cancer patients: a pilot multicenter study.
      ,
      • Taremi M
      • Artau A
      • Foolad F
      • Berlin S
      • White C
      • Jiang Y
      • Raad I
      • Adachi J.
      Safety, efficacy, and clinical impact of penicillin skin testing in immunocompromised cancer patients.