Impact of ICD-10-CM Transition on Selected Cardiovascular-Related Events in the Sentinel System

Similar documents
ICD-10-CM and the DPH Implementation Strategy

COMPARISON OF FIXED & VARIABLE RATES (25 YEARS) CHARTERED BANK ADMINISTERED INTEREST RATES - PRIME BUSINESS*

Progress Report on the Design and Planning of an Infrastructure Improvement Project for the Sunnyside TIF District (Phase II)

Provider ICD 10 Compliant Release A S K E S I S W E B I N A R F E B R U A R Y 1 9,

ICD 10 Transition: What You Don t Already Know and How to Prepare for It!

PUBLIC AGENDA STREET ACTIVITY STEERING COMMITTEE

Utility Debt Securitization Authority 2013 T/TE Billed Revenues Tracking Report

Algorithm to Define. Outcome

MEMORANDUM. City Constituents. Leilani Schwarcz, Vision Zero Surveillance Epidemiologist, SFDPH

ICD 10 CM 2018 SNAPSHOT CODING CARD DERMATOLOGY

Transition to Use of ICD-10-CM Coding for Birth Defects, Part 1

ICD-10 Primer: Are You Ready?

Bluetongue Disease (BT)

2018 HR & PAYROLL Deadlines

MAR DASHBOARD MAR. Compliant % Breakdown Mar % Late % On-time MAR APR MAY JUN JUL AUG SEP OCT NOV DEC

Introduction to ICD-10-CM. Improving the Financial Health of the Practices we Serve.

DEC DASHBOARD. Positive Response Compliance DEC. Compliant Tickets : On-Time Performance Analysis. December % Late.

JAN DASHBOARD. Positive Response Compliance JAN. Compliant Tickets : On-Time Performance Analysis. January % Late.

Key statistics from the National Cardiac Arrest Audit 2016/17

Wisconsin 511 Traveler Information Annual Usage Summary January 3, Wisconsin 511 Phone Usage ( )

Implementing ICD-10-CM Preparing for the Conversion

Mr. Joseph J. Lhota Chairman Metropolitan Transportation Authority 2 Broadway New York, NY Re: Train On-Time Performance Report 2017-F-8

September 2017 MLS Statistical Report. Residential Inventory

ICD-10-CM IN VERSION 10

Liberals with steady 10 point lead on Conservatives

July 2015 Sept Cork City Pedestrian Counter Report

How to Avoid an Office Meltdown: Find Out the Facts about ICD-10-CM. Chapter 1 Chapter 2 Chapter 3 Chapter 4 Chapter 5 Appendix

JULY 2013 RIDERSHIP REPORT MTA METRO-NORTH RAILROAD EXECUTIVE SUMMARY

May 2018 FY Key Performance Report

Little Athletics NSW. 2018/2019 Season. Age Group Information Handbook / 1

May 2018 MLS Statistical Report

KC Scout Kansas City s Bi-State Transportation Management Center

95 Express Annual Operations Report: Fiscal Year

WHAT IS NEW IN ICD 10 CM 2017

Manufacturers Continue Capacity Expansion as Technology Orders Grow

SAS Quality Scorecard August 2011

VEHICLE / PEDESTRIAN COLLISIONS

MALL CROSSING STUDY. Testing the Effectiveness Of the 4th Street East Crossing. For: City of Charlottesville Neighborhood Development Services

Bicycle Crashes. Number of Bike Crashes. Total Bike Crashes. are down 21% and severe bike crashes down 8% since 2013 (5 years).

AHFoZ Conference September 2014 ICD 10 Codes - Shane Perumal

PROPOSED EP BOWLS CALENDAR; January 2019 Version 2 Approved 22 November 2018

Danish gambling market statistics Third quarter, 2017

Bilateral leg cramps icd 10

Manufacturers continue capacity expansion as technology orders grow

Hard Shoulder Running is a valuable tool July 14, Dean H. Gustafson, PE, PTOE State Operations Engineer VDOT Operations Division

Site Description: Tower Site

SEASONAL PRICES for TENNESSEE FEEDER CATTLE and COWS

A review of 2015 fatal collision statistics as of 31 December 2015

EVects of seasonal change in rugby league on the incidence of injury

Danish gambling market statistics First quarter 2017

Assessment of Guide Reporting & Preliminary Results of Lion Monitoring

Nasdaq Dubai AED TRADING HOLIDAYS AND SETTLEMENT CALENDAR 2018 For Equities Outsourced to the DFM (T+2)

STAFF REPORT ACTION REQUIRED. Public Works and Infrastructure Committee. General Manager, Transportation Services

September 2018 FY Key Performance Report

Recent Events in the Market for Canadian Snow Crab

Data-Driven Justice Case Studies

Cargo Theft IN ASIA 2013 SUPPLY CHAIN INTELLIGENCE CENTER:

FEASIBILITY STUDY DANBURY BRANCH ELECTRIFICATION PROJECT

Bird strikes Swedish Airspace

For Information Only. Pedestrian Collisions (2011 to 2015) Resolution. Presented: Monday, Apr 18, Report Date Tuesday, Apr 05, 2016

SWISS reports stable load factors

Liquefied Natural Gas: Current Trends and Future Directions

Icd 10 code for rectus femoris tear

Albeni Falls Dam Downstream Water Temperature Study Interim Results

August 2018 Las Vegas Strip Gaming Revenue Analysis

Abel Tasman Birdsong Trust Trapping Report March 2017

KC Scout Kansas City s Bi-State Transportation Management Center

Foreign overnights in the Nordic countries 2015

Start Preparing NOW for ICD- 10 Coding. July 27, 2011

NASDAQ DUBAI TRADING HOLIDAYS AND SETTLEMENT CALENDAR 2018 For Equities Outsourced to the DFM (T+2)

Icd 10 for lower extremity neuropathy

Environmental Health & Safety

b Number issued 200,000 (marked with * in the attached appendix) Exercise price is as set out in the appendix

Zoning for a Healthy Baltimore

1 PEW RESEARCH CENTER

How customer behaviour is changing

English for Academic Purpose - 20 weeks. ATMC CDU Fed Uni USC. Available Intakes. Orientation Date. English for Academic Purpose - 15 weeks

January 2019 FY Key Performance Report

10 Mar-7 Club Spring Partners Net BB Tournament 1. ABCD Scramble TBD TBD. 2-Person Teams (scores not postable )

Greater Manchester Police Hate Crime and Hate Incident Data 01/04/14 to 31/03/15

JUNIOR RANKING SYSTEM (NJRS)

SEMDAC MSC support and surveillance in Chile s EEZ, Desventuradas Islands and Easter Island. Laura Fontan Bouzas Fisheries Analyst, OceanMind

NCC Cable System Order

World Leading Traffic Analysis

Performance Measures Year End 2015

Preston s Edmond Market Report

3. EXCEL FORMULAS & TABLES

Invasive Bacterial Disease Surveillance Report Emerging Infections Program Minnesota Department of Health

Lake Taneycomo Fisheries Management. Shane Bush : Fisheries Management Biologist

Real Estate and Economic Outlook

Wind Resource Assessment for CHEFORNAK, ALASKA

WIM #36 MN 36 MP 15.0 LAKE ELMO APRIL 2014 MONTHLY REPORT

Analysis of 2015 Trail Usage Patterns along the Great Allegheny Passage

Analysis of the Red Light Camera Program in Garden Grove, CA By Jay Beeber, Executive Director, Safer Streets L.A., Member ITE

County of Orange Resources and Development Management Department Harbors, Beaches and Parks. Strategic Plan. HBP Strategic Plan Workshop 1.

REVENUE & RIDERSHIP REPORT SEPTEMBER 2018

Icd 10 code for metastatic disease

Table of Contents Diagnosis ICD9 to ICD10 GEM Report... 1 Diagnosis Form... 5 Helpful Hints on Correcting Issues... 8 Disclaimer...

Order No. 55/18 CENTRA GAS MANITOBA INC.: PRIMARY GAS RATE APPLICATION, EFFECTIVE MAY 1, April 26, 2018

2015 Winnebago System Walleye Report

Transcription:

Impact of ICD-10-CM Transition on Selected Cardiovascular-Related Events in the Sentinel System Tiffany Siu Woodworth, MPH, Catherine A. Panozzo, PhD, Emily C. Welch, MPH, Ting-Ying Jane Huang, PhD, BSPharm, Qoua L. Her, PharmD, MSc, Catherine Rogers, MPH, Max Ehrmann, MPH, Talia Menzin, Nicole Haug, MPH, Katherine Freitas, Sengwee Darren Toh, ScD Harvard Pilgrim Health Care Institute, Boston, MA, USA 1

Disclosures This work was supported by the FDA through the Department of Health and Human Services (HHS) Contract Number HHSF223200910006I and Task Order HHSF22301012T The views expressed are the authors and not necessarily those of the Food and Drug Administration, or the Department of Health and Human Services 2

Transitioning to ICD-10-CM in the U.S. 1979 ~14,000 codes 3 to 5 digits Category Etiology, Anatomical Site, Manifestation Oct 1, 2015 1 st digit 2 nd digit ~69,000 codes 3 rd digit 4 th digit 5 th digit 3 to 7 digits, with allowing for increased specificity Category Etiology, Anatomical Site, Severity Extension today 1 st digit 2 nd digit 3 rd digit 4 th digit 5 th digit 6 th digit 7 th digit http://www.roadto10.org/icd-10-basics 3

Objective To characterize the impact of the ICD-10-CM transition on the identification selected Health Outcomes of Interest (HOIs) Assess feasibility of using validated algorithms from international studies Assess the feasibility of using algorithms defined through mapping techniques 4

Approach to defining conditions Four definitions used to identify each condition ICD-9-CM algorithm from medical literature or previous Sentinel work ICD-10-CM algorithm derived from international validation studies ICD-10-CM Simple Forward Mapping (SFM) conversion using General Equivalence Mappings (GEMs)* ICD-10-CM Forward-Backward Mapping (FBM) conversion using GEMs* Selected health conditions Acute myocardial infarction (AMI), ischemic stroke, angioedema *Fung et al, egems 2016;4(1):Article 4 5

Example: Algorithms from literature Ischemic stroke algorithm (total 119 ICD-10 codes): Any of the following ICD-10 codes in the principal position on an inpatient hospital claim: I63.* (cerebral infarction) H34.1* (retinal artery occlusion) Derived algorithm based on literature review Two international studies validated similar algorithm including inpatient and other settings Kokotailo (Canada) Kokotailo, R. A., and M. D. Hill. "Coding of Stroke and Stroke Risk Factors Using International Classification of Diseases, Revisions 9 and 10." Stroke 36.8 (2005): 1776-781 Tolonen (Finland) H, Tolonen, Salomaa V, Torppa J, Sivenius J, Immonen-Räihä P, and Lehtonen A. "The Validation of the Finnish Hospital Discharge Register and Causes of Death Register Data on Stroke Diagnoses." Eur J Cardiovasc Prev Rehabil. 2007 Jun 14(3): 380-5 6

ICD-9-CM Example: Simple-forward mapping Ischemic Stroke algorithm* (total 12 codes): Utilize GEMs forward mapping files SFM: Translation using ICD-9-CM to ICD-10-CM dictionary 433.01 I63.22 433.11 433.21 433.31 433.81 I63.139 I63.239 I63.019 I63.119 I63.219 I63.59 433.91 I63.20 ICD-10-CM *partial ischemic stroke algorithm 7

ICD-9-CM Example: Forward-backward mapping Ischemic Stroke algorithm* (total 91 codes): Utilize both forward mapping and backward mapping files FBM: Translation using ICD-10 to ICD-9 dictionary + SFM codes 433.01 433.11 433.21 I63.22 I63.02 I63.031 I63.032 I63.033 I63.039 I63.139 I63.239 I63.011 I63.012 I63.013 I63.019 I63.119 I63.219 ICD-10-CM *partial ischemic stroke algorithm 8

Analysis specifications Leveraged publicly available Sentinel tools For each outcome algorithm: Detect trends: incidence over time Coding-era comparison: incidence Indicates study period Indicates washout period only 9

Summary of results 11 health plans participating in Sentinel Mix of national and regional health insurers, integrated delivery systems At a minimum, included data through March 31, 2016 Data included: Analysis type Members Member-years Trend analysis: October 1, 2010 August 31, 2016 Coding-era analysis: October 1, 2014 March 31, 2015 October 1, 2015 March 31, 2016 131 million 319 million 57 million 13 million 10

Oct-10 Dec-10 Feb-11 Apr-11 Jun-11 Aug-11 Oct-11 Dec-11 Feb-12 Apr-12 Jun-12 Aug-12 Oct-12 Dec-12 Feb-13 Apr-13 Jun-13 Aug-13 Oct-13 Dec-13 Feb-14 Apr-14 Jun-14 Aug-14 Oct-14 Dec-14 Feb-15 Apr-15 Jun-15 Aug-15 Oct-15 Dec-15 Feb-16 Apr-16 Jun-16 Aug-16 Incidence/1K Eligible Members AMI: trend analysis Incidence per 1,000 Eligible Members of Acute Myocardial Infarction (AMI) between October 2010- August 2016, by Outcome Definition 0.12 0.10 0.08 0.06 0.04 0.02 0.00 ICD-9-CM codes from an Algorithm, 183 day washout ICD-10-CM codes from an Algorithm, 183 day washout ICD-10-CM codes from SFM, 183 day washout ICD-10-CM codes from FBM, 183 day washout 11

Incidence/1000 eligible members AMI: coding-era analysis Incidence of various AMI definitions per 1000 eligible members using a 90 day washout, Jan-Mar 2015 vs. Jan-Mar 2016 0.350 0.325 Definition ICD-9-CM Code Count ICD-10-CM Code Count Algorithm* 20 12 SFM 20 6 FBM 20 14 0.300 0.275 Each algorithm identified ~16.5K events 0.250 0.225 0.200 ICD-9-CM (literature) 0.288 (0.284, 0.293) ICD-10-CM (literature) 0.292 (0.288, 0.297) ICD-10-CM (SFM) 0.285 (0.281, 0.290) ICD-10-CM (FBM) 0.292 (0.288, 0.297) ICD-10-CM codes identified by the three approaches all included the most frequently used codes *Cutrona et al 2013 12

Oct-10 Dec-10 Feb-11 Apr-11 Jun-11 Aug-11 Oct-11 Dec-11 Feb-12 Apr-12 Jun-12 Aug-12 Oct-12 Dec-12 Feb-13 Apr-13 Jun-13 Aug-13 Oct-13 Dec-13 Feb-14 Apr-14 Jun-14 Aug-14 Oct-14 Dec-14 Feb-15 Apr-15 Jun-15 Aug-15 Oct-15 Dec-15 Feb-16 Apr-16 Jun-16 Aug-16 Incidence/1K Eligible Members Ischemic stroke: trend analysis Incidence per 1,000 Eligible Members of Ischemic Stroke between October 2010- August 2016, by Outcome Definition 0.08 0.07 0.06 0.05 0.04 0.03 ICD-9-CM codes from an Algorithm, 183 day washout ICD-10-CM codes from an Algorithm, 183 day washout ICD-10-CM codes from SFM, 183 day washout 0.02 SFM 0.01 0.00 13

Incidence/1000 Eligible Members Ischemic stroke: coding-era analysis Incidence of various AMI definitions per 1000 eligible members using a 90 day washout, Jan-Mar 2015 vs. Jan-Mar 2016 0.250 Definition ICD-9-CM Code Count ICD-10-CM Code Count Algorithm* 10 119 SFM 10 12 0.200 FBM 10 91 Most common code: 0.150 0.100 ICD-9-CM (literature) 0.191 (0.188, 0.195) ICD-10-CM (literature) 0.193 (0.189, 0.196) ICD-10-CM (SFM) 0.014 (0.013, 0.015) ICD-10-CM (FBM) 0.190 (0.186, 0.193) I63.9: cerebral infarction unspecified Not included in SFM (800 events) Included in Algorithm & FBM: (11K events) 0.050 0.000 14

Oct-10 Dec-10 Feb-11 Apr-11 Jun-11 Aug-11 Oct-11 Dec-11 Feb-12 Apr-12 Jun-12 Aug-12 Oct-12 Dec-12 Feb-13 Apr-13 Jun-13 Aug-13 Oct-13 Dec-13 Feb-14 Apr-14 Jun-14 Aug-14 Oct-14 Dec-14 Feb-15 Apr-15 Jun-15 Aug-15 Oct-15 Dec-15 Feb-16 Apr-16 Jun-16 Aug-16 Incidence/1K Eligible Members Angioedema: trend analysis Incidence per 1,000 Eligible Members of Angioedema between October 2010- August 2016, by Outcome Definition 0.14 0.12 0.10 0.08 0.06 0.04 ICD-9-CM codes from an Algorithm, 183 day washout ICD-10-CM codes from an Algorithm, 183 day washout ICD-10-CM codes from SFM and FBM, 183 day washout 0.02 0.00 15

Incidence/1000 eligible members Angioedema: coding-era analysis Incidence of various angioedema definitions per 1000 eligible members using a 90 day washout, Jan-Mar 2015 vs. Jan-Mar 2016 0.350 0.325 0.300 0.275 Definition ICD-9-CM Code Count ICD-10-CM Code Count Algorithm* 1 1 Washout 1 3 SFM 1 1 FBM 1 1 One ICD-9-CM code (19K events) 995.1: Angioneurotic edema not elsewhere classified 0.250 0.225 0.200 ICD-9-CM (literature) 0.338 (0.333, 0.343) ICD-10-CM (literature) 0.256 (0.252, 0.260) ICD-10-CM (SFM) 0.261 (0.257, 0.266) ICD-10-CM (FBM) 0.261 (0.257, 0.266) Three ICD-10-CM codes (15K events) T78.3XXA: Angioneurotic edema, initial encounter T78.3XXD: Angioneurotic edema, subsequent encounter T78.3XXS: Angioneurotic edema, sequela *Toh S et al, Johnsen SP et al, Gupta R et al 16

Other findings Algorithms that included commonly reported diagnosis codes generally performed similarly In general, FBM performed better than SFM Rates consistent in both eras across 11 diverse, participating health plans 17

Strengths and limitations Strengths: Variety and size of the Sentinel distributed database Reproducibility Limitations: Analysis only includes selected HOIs Coding practices may change over time Investigation focused on conditions as outcomes 18

Recommendations Continue to monitor trends as ICD-10-CM data accumulate Assess trend analysis for inferential analyses within cohorts Consider sensitivity analyses for outcome definitions Forward-backward mapping may be reasonable substitute Internationally validated algorithms should be tested Clinical expertise should be leveraged If possible, chart validation is ideal 19

Acknowledgements Co-authors Catherine Panozzo, Emily Welch, Jane Huang, Qoua Her, Catherine Rogers, Max Ehrmann, Talia Menzin, Nicole Haug, Katherine Freitas, Darren Toh Sentinel Applied Surveillance Core University of Iowa: Ryan Carnahan, Elizabeth Chrischilles University of Pennsylvania: Sean Hennessy, Charles Leonard Many thanks are due to the Data Partners who provided data used in this analysis 20

Thank you! 21

Extra Slides 22

ICD-10-CM vs. ICD-9-CM http://www.roadto10.org/icd-10-basics 23

ICD-10-CM Example 1 of >300 ICD-10-CM codes for gout Note: In contrast, only 15 ICD-9-CM codes for gout (e.g., 274.02) Example courtesy of Kevin Haynes, HealthCore http://www.roadto10.org/icd-10-basics 24

How do GEMs work? http://bok.ahima.org/doc?oid=106975#.v6kvbvkrldc 25

Defining clinical concepts with ICD-10-CM Published algorithms International studies, includes other ICD-10 variants (e.g., ICD-10-CA vs ICD-10-CM) ICD-9-CM ICD-10-CM translations using General Equivalence Mappings (GEMs) Simple forward mapping (SFM) Forward-backward mapping (FBM) Fung et al, egems 2016;4(1):Article 4 26

Summary of results Outcome definition Acute myocardial infarction Number of incident events Number of eligible members Number of member-years Incidence per 1,000 eligible members (95% CI) Incidence per 1,000 member-years ICD-9-CM algorithm 16,629 57,668,750 13,555,553 0.288 (0.284, 0.293) 1.227 (1.208, 1.245) ICD-10-CM algorithm 16,780 57,453,227 13,778,048 0.292 (0.288, 0.297) 1.218 (1.2, 1.236) ICD-10-CM SFM 16,391 57,453,627 13,778,265 0.285 (0.281, 0.290) 1.190 (1.172, 1.208) ICD-10-CM FBM 16,781 57,452,861 13,777,818 0.292 (0.288, 0.297) 1.218 (1.2, 1.237) Angioedema ICD-9-CM algorithm 19,486 57,677,701 13,565,531 0.338 (0.333, 0.343) 1.436 (1.416, 1.457) ICD-10-CM algorithm 14,719 57,464,145 13,789,293 0.256 (0.252, 0.260) 1.067 (1.05, 1.085) ICD-10-CM SFM 15,020 57,465,350 13,790,286 0.261 (0.257, 0.266) 1.089 (1.072, 1.107) ICD-10-CM FBM 15,020 57,465,350 13,790,286 0.261 (0.257, 0.266) 1.089 (1.072, 1.107) Ischemic stroke ICD-9-CM algorithm 11,011 57,634,007 13,535,439 0.191 (0.188, 0.195) 0.813 (0.798, 0.829) ICD-10-CM algorithm 11,058 57,430,577 13,763,591 0.193 (0.189, 0.196) 0.803 (0.789, 0.819) ICD-10-CM SFM 791 57,447,546 13,777,259 0.014 (0.013, 0.015) 0.057 (0.054, 0.062) ICD-10-CM FBM 10,898 57,421,718 13,758,294 0.190 (0.186, 0.193) 0.792 (0.777, 0.807) 27

Selected results: AMI (2) Incidence of various AMI definitions per 1000 eligible members using a 90 day washout, Jan-Mar 2015 vs. Jan-Mar 2016 Outcome definition ICD-9-CM algorithm from literature ICD-10-CM algorithm from literature Number of incident events Number of eligible members Number of memberyears Incidence per 1,000 eligible members (95% CI) 16,629 57,668,750 13,555,553 0.288 (0.284, 0.293) 16,780 57,453,227 13,778,048 0.292 (0.288, 0.297) ICD-10-CM SFM 16,391 57,453,627 13,778,265 0.285 (0.281, 0.290) ICD-10-CM FBM 16,781 57,452,861 13,777,818 0.292 (0.288, 0.297) 28

Selected results: angioedema (2) Incidence of various angioedema definitions per 1000 eligible members using a 90 day washout, Jan-Mar 2015 vs. Jan-Mar 2016 Outcome definition ICD-9-CM algorithm from literature ICD-10-CM algorithm from literature Number of incident events Number of eligible members Number of memberyears Incidence per 1,000 eligible members (95% CI) 19,486 57,677,701 13,565,531 0.338 (0.333, 0.343) 14,719 57,464,145 13,789,293 0.256 (0.252, 0.260) ICD-10-CM SFM 15,020 57,465,350 13,790,286 0.261 (0.257, 0.266) ICD-10-CM FBM 15,020 57,465,350 13,790,286 0.261 (0.257, 0.266) 29

Selected results: ischemic stroke findings * I63.9, cerebral infarction unspecified, NOT captured by the SFM definition This code represented 24-38% of the ischemic stroke codes submitted by data partners The Algorithm (n=119 codes) and FBM (n=91 codes) identified I63.9 as well as many additional codes *Andrade et al, Tirschwell et al, Kokotailo et al, Tolonen et al 30

Selected results: ischemic stroke (2) Incidence of various ischemic stroke definitions per 1000 eligible members using a 90 day washout, Jan-Mar 2015 vs. Jan-Mar 2016 Outcome definition ICD-9-CM algorithm from literature ICD-10-CM algorithm from literature Number of incident events Number of eligible members Number of memberyears Incidence per 1,000 eligible members (95% CI) 11,011 57,634,007 13,535,439 0.191 (0.188, 0.195) 11,058 57,430,577 13,763,591 0.193 (0.189, 0.196) ICD-10-CM SFM 791 57,447,546 13,777,259 0.014 (0.013, 0.015) ICD-10-CM FBM 10,898 57,421,718 13,758,294 0.190 (0.186, 0.193) 31

Selected results: angioedema findings One ICD-9-CM code 995.1: Angioneurotic edema not elsewhere classified Three ICD-10-CM codes T78.3XXA: Angioneurotic edema, initial encounter T78.3XXD: Angioneurotic edema, subsequent encounter T78.3XXS: Angioneurotic edema, sequela * Lower incidence in ICD-10-CM era vs. ICD-9-CM era currently unexplained *Toh S et al, Johnsen SP et al, Gupta R et al 32

Hypertension results Checking Expectations 1. Is the prevalence steady across the ICD-9 and ICD-10 eras? Yes 2. Is there a sharp decrease of ICD-9-CM and sharp increase of ICD-10-CM codes in October 2015? Yes 3. Are there differences between how the ICD-10-CM definitions performed? No 33

Number of Incident Diagnoses /1K Eligible Members Oct-10 Dec-10 Feb-11 Apr-11 Jun-11 Aug-11 Oct-11 Dec-11 Feb-12 Apr-12 Jun-12 Aug-12 Oct-12 Dec-12 Feb-13 Apr-13 Jun-13 Aug-13 Oct-13 Dec-13 Feb-14 Apr-14 Jun-14 Aug-14 Oct-14 Dec-14 Feb-15 Apr-15 Jun-15 Aug-15 Oct-15 Dec-15 Feb-16 Apr-16 Jun-16 Aug-16 60.00 Hypertension results Incidence per 1,000 Eligible Members of Hypertension Definition, October 2010- August 2016 50.00 40.00 30.00 20.00 10.00 0.00 Month - Year ICD-9-CM codes from an Algorithm, 0 day washout ICD-10-CM codes from an Algorithm, 0 day washout ICD-9-CM codes from SFM and FBM, 0 day washout ICD-10-CM codes from SFM, 0 day washout Checking Expectations 1. Is the prevalence steady across the ICD-9 and ICD-10 eras? Yes 2. Is there a sharp decrease of ICD-9-CM and sharp increase of ICD-10-CM codes in October 2015? Yes 3. Are there differences between how the ICD-10-CM definitions performed? No 34

Condition #1: hypertension findings Definition * ICD-9-CM Code Count ICD-10-CM Code Count Algorithm 45 19 SFM 33 12 FBM 33 18 I10, essential primary hypertension, included in all three ICD- 10-CM definitions This code represented 83-95% of the hypertension codes submitted by data partners May explain the similar performance of the three definitions *Based on Quan H et al 35

Selected results: AMI findings Definition ICD-9-CM Code Count ICD-10-CM Code Count Algorithm* 20 12 SFM 20 6 FBM 20 14 ICD-10-CM codes identified by the three approaches all included the most frequently used codes Thus, SFM (n=6 codes) performed as well as the Algorithm (n=12 codes) and FBM (n=14 codes) *Cutrona et al 2013 36

Condition #2: diabetes results FBM SFM Algorithm 37

Oct-10 Dec-10 Feb-11 Apr-11 Jun-11 Aug-11 Oct-11 Dec-11 Feb-12 Apr-12 Jun-12 Aug-12 Oct-12 Dec-12 Feb-13 Apr-13 Jun-13 Aug-13 Oct-13 Dec-13 Feb-14 Apr-14 Jun-14 Aug-14 Oct-14 Dec-14 Feb-15 Apr-15 Jun-15 Aug-15 Oct-15 Dec-15 Feb-16 Apr-16 Jun-16 Aug-16 Number of Incident Diagnoses /1K Eligible Members Condition #2: diabetes results 35.00 Incidence per 1,000 Eligible Members of Diabetes Definition, October 2010- August 2016 FBM 30.00 25.00 20.00 15.00 SFM 10.00 5.00 Algorithm 0.00 Month - Year ICD-9-CM codes from Algorithm, SFM, and FBM, 0 day washout ICD-10-CM codes from SFM, 0 day washout ICD-10-CM codes from FBM, 0 day washout ICD-10-CM codes from an Algorithm, 0 day washout ICD-10-CM codes from SFM with cluster logic, 0 day washout 38

Condition #2: diabetes findings Definition ICD-9-CM Code Count ICD-10-CM Code Count Algorithm 51 25 SFM, no clusters 51 51 SFM, clusters 51 51 FBM 51 254 SFM and FBM performed similarly even though FBM identified 5x as many codes (254 vs. 51) Many of the additional codes pulled by FBM were highly specific, 7-digit codes that may not be used in practice E.g., E10.37X1, Type I DM with diabetic macular edema, resolved following treatment, right eye Only two clusters which may explain the minimal impact of adding them E.g., E11.65 AND E11.21, Type II DM with hyperglycemia AND Type II DM with diabetic nephropathy 39

Condition #5: syncope results 40

Oct-10 Dec-10 Feb-11 Apr-11 Jun-11 Aug-11 Oct-11 Dec-11 Feb-12 Apr-12 Jun-12 Aug-12 Oct-12 Dec-12 Feb-13 Apr-13 Jun-13 Aug-13 Oct-13 Dec-13 Feb-14 Apr-14 Jun-14 Aug-14 Oct-14 Dec-14 Feb-15 Apr-15 Jun-15 Aug-15 Oct-15 Dec-15 Feb-16 Apr-16 Jun-16 Aug-16 Number of Diagnoses per 1,000 Eligible Members Condition #5: syncope results 1.60 Incidence per 1,000 Eligible Members by Syncope Definition, 183-Day Washout 1.40 1.20 1.00 0.80 0.60 0.40 0.20 0.00 Month - Year ICD-9-CM codes from Algorithm, SFM, and FBM, 183 day washout ICD-10-CM codes from Algorithm, SFM, and FBM, 183 day washout 41

Condition #5: syncope results Incidence of sycope definitions per 1000 eligible members using a 90 day washout, Jan- Mar 2015 vs. Jan-Mar 2016 Outcome definition 2015 ICD-9-CM codes from Algorithm, SFM, and FBM, 90 day washout 2016 ICD-9-CM codes from Algorithm, SFM, and FBM, 90 day washout Number of incident events Number of eligible members Number of memberyears Incidence per 1,000 eligible members (95% CI) 115,757 31,209,998 7,350,651 3.71 124,805 31,955,722 7,612,506 3.91 2010 2014 2015 2016 ICD version used to define Scenario Oct (Nov-10 to Sep- 14) Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr Washout (d) Incidence with respect to Event 3 90 9 9 4 90 10 10 42

Condition #5: syncope findings One ICD-9-CM code 780.2: syncope and collapse One ICD-10-CM code R55: syncope and collapse Definition ICD-9-CM Code Count ICD-10-CM Code Count Algorithm* 1 1 SFM 1 1 FBM 1 1 Despite a one-to-one mapping and identical clinical concepts, the incidence in the ICD-10 era was higher than the ICD era Higher incidence in ICD-10 era vs. ICD-9 era currently unexplained *Jette et al 2010 43

Condition #6: drug overdose results 44

Oct-10 Dec-10 Feb-11 Apr-11 Jun-11 Aug-11 Oct-11 Dec-11 Feb-12 Apr-12 Jun-12 Aug-12 Oct-12 Dec-12 Feb-13 Apr-13 Jun-13 Aug-13 Oct-13 Dec-13 Feb-14 Apr-14 Jun-14 Aug-14 Oct-14 Dec-14 Feb-15 Apr-15 Jun-15 Aug-15 Oct-15 Dec-15 Feb-16 Apr-16 Jun-16 Aug-16 Number of Diagnoses per 1,000 Eligible Members Condition #6: drug overdose results 0.80 Incidence per 1,000 Eligible Members by Drug Overdose Definition, 183- Day Washout 0.70 0.60 0.50 0.40 0.30 0.20 0.10 0.00 Month - Year ICD-9-CM codes from SFM, 183 day washout ICD-10-CM codes from SFM, 183 day washout ICD-9-CM codes from FBM, 183 day washout ICD-10-CM codes from FBM, 183 day washout 45

Condition #6: drug overdose results Incidence of various drug overdose definitions per 1000 eligible members using a 90 day washout, Jan- Mar 2015 vs. Jan-Mar 2016 Outcome definition 2015 ICD-9-CM codes from SFM and FBM, 90 day washout 2016 ICD-9-CM codes from SFM, 90 day washout ICD-9-CM codes from FBM, 90 day washout Number of incident events Number of eligible members Number of memberyears Incidence per 1,000 eligible members (95% CI) 29,200 31,225,534 7,373,366.00 0.94 28,175 31,974,813 7,638,328.71 0.88 35,778 31,974,169 7,636,432.09 1.12 46

Condition #6: drug overdose findings Definition ICD-9-CM Code Count ICD-10-CM Code Count SFM 459 1214 FBM 459 1301 Same seasonal pattern of drug overdose replicated in ICD-10 era Currently uncertain why seasonality exists Month-year incidence similar between eras, despite >2-fold increase in the number of ICD-10-CM codes used in the SFM and FBM definitions All ICD-10-CM codes had 7-digits 47

Condition #6: drug overdose sample codes 48