Top Banner
Interpreting MBQIP Hospital Data Reports for Quality Improvement __________________________________________________________________________ Updated March 2018 This project is supported by the Health Resources and Services Administration (HRSA) of the U.S. Department of Health and Human Services (HHS) under grant number U1RRH29052, Rural Quality Improvement Technical Assistance Cooperative Agreement, $500,000 (0% financed with nongovernmental sources). This information or content and conclusions are those of the author and should not be construed as the official position or policy of, nor should any endorsements be inferred by HRSA, HHS, or the U.S. Government
21

Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Sep 26, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

__________________________________________________________________________

Updated March 2018

This project is supported by the Health Resources and Services Administration (HRSA) of the U.S. Department of Health and Human

Services (HHS) under grant number U1RRH29052, Rural Quality Improvement Technical Assistance Cooperative Agreement, $500,000

(0% financed with nongovernmental sources). This information or content and conclusions are those of the author and should not be

construed as the official position or policy of, nor should any endorsements be inferred by HRSA, HHS, or the U.S. Government

Page 2: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 2

Table of Contents

Table of Contents .................................................................................................................................................... 2

Overview ................................................................................................................................................................. 3

About MBQIP ..................................................................................................................................................... 3

Purpose of this Guide .......................................................................................................................................... 3

Using MBQIP Patient Safety and Inpatient/Outpatient Care Quality Reports ....................................................... 4

N/A, D/E, 0 Patients on Patient Safety and Inpatient/Outpatient Care Quality Reports .................................... 4

Using Comparison Data for Patient Safety and Inpatient/Outpatient Measures ................................................ 5

Interpreting Reports to Support Improvement .................................................................................................... 5

Using MBQIP Patient Engagement Quality Reports .............................................................................................. 6

Using Comparison Data for HCAHPS Measures ............................................................................................... 7

Interpreting Reports to Support Improvement .................................................................................................... 7

Using MBQIP Care Transitions Quality Reports for Emergency Department Transfer Communication (EDTC) 8

Using Comparison Data for the EDTC Measure ................................................................................................ 8

Interpreting Reports to Support Improvement .................................................................................................... 9

Additional Resources .............................................................................................................................................. 9

CAHMPAS (Critical Access Hospital Measurement and Performance Assessment System) ........................... 9

Emergency Department Transfer Communication Measure Resources ............................................................. 9

MBQIP Measures Fact Sheets ............................................................................................................................ 9

MBQIP Reporting Guide .................................................................................................................................. 10

Quality Improvement Implementation Guide and Toolkit for Critical Access Hospitals ................................ 10

Appendix A – Sample MBQIP Hospital Data Reports ......................................................................................... 11

Appendix B – Glossary ......................................................................................................................................... 20

Page 3: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 3

Overview

About MBQIP

The Medicare Beneficiary Quality Improvement Project (MBQIP) is a quality improvement activity under the

Federal Office of Rural Health Policy’s (FORHP) Medicare Rural Hospital Flexibility (Flex) grant program.

Implemented in 2011, the goal of MBQIP is to improve the quality of care provided in critical access

hospitals (CAHs) by increasing voluntary quality data reporting by CAHs and then driving quality

improvement activities based on the data.

MBQIP provides an opportunity for individual hospitals to look at their own data, compare their results against

other CAHs and partner with other hospitals around quality improvement initiatives to improve outcomes and

provide the highest quality care to each and every one of their patients. Demonstrating value by providing cost

efficient, quality care is the future of health care reimbursement. MBQIP takes a proactive approach to ensure

CAHs are well-prepared to meet future quality requirements.

Purpose of this Guide

This guide is intended to help CAH staff use MBQIP Hospital Data Reports to support quality improvement

efforts and improve patient care. The guide includes:

Examples of how to interpret MBQIP Hospital Data Reports with a focus on improvement. The

examples within the text reference notated sample MBQIP Hospital Data Reports (which can be found

in Appendix A). Hyperlinks within the text and the sample reports allow the reader to toggle back and

forth on the screen. Some may find it helpful to print the sample reports for review purposes.

A glossary of key words with definitions and external links, if applicable. Throughout the document key

words are hyperlinked so the reader is able to click on the word and go directly to the glossary.

This guide focuses on interpretation and use of the MBQIP Hospital Data Reports. For information

regarding best practices on MBQIP measures and quality improvement strategies, see the Quality

Improvement Implementation Guide and Toolkit for Critical Access Hospitals

Measures included in the MBQIP Data Interpretation Guide

This guide focuses on how to make use of data for measures reported for MBQIP as part of the fiscal year (FY)

2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality

measures, this guide will be updated on a routine basis to align with changes made to MBQIP.

MBQIP Hospital Data Reports, which include state and national CAH comparisons, are distributed to CAHs

approximately quarterly. Contact your state Flex Coordinator if you are unsure who is receiving these reports at

your hospital. Contact information for your state Flex Coordinator can be on the State Flex Profile page of the

TASC website. There are three separate MBQIP Hospital Data Reports:

Patient Safety and Inpatient/Outpatient Care Quality Report

Care Transitions (EDTC) Quality Report

Patient Experience (HCAHPS) Quality Report

Page 4: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 4

Using MBQIP Patient Safety and Inpatient/Outpatient Care Quality Reports

The MBQIP Patient Safety and Inpatient/Outpatient Care Quality Reports include data from CMS Hospital

Compare measures that are relevant for CAHs under the MBQIP domains of patient safety and outpatient care.

The reports include data from all CAHs that have signed a MBQIP Memorandum of Understanding (MOU) and

have submitted data. Thus, the reports include data from CAHs that have not agreed to publicly report on

Hospital Compare, in addition to data from CAHs that don’t have enough cases to be publically reported on

Hospital Compare, providing a more complete picture of performance across CAHs nationally.

N/A, D/E, 0 Patients on Patient Safety and Inpatient/Outpatient Care Quality Reports The following are brief explanations and examples of why an MBQIP Patient Safety and Inpatient/Outpatient

Care Quality Report might show not available (N/A), zero (0) patients, or data excluded (D/E) for some

measures.

N/A can mean two different things:

Data was not submitted/reported by the CAH.

Data was submitted but was rejected/not accepted into the Quality Improvement Organization (QIO)

Clinical Warehouse.

Examples – N/A

A CAH did not enter a zero into the Population and Sampling grid for a given measure set and did not

submit/report any cases to QualityNet. (See the MBQIP Reporting Guide for more details on Population and

Sampling.)

A CAH may have submitted data to the QIO Clinical Warehouse, but the file could have had technical

issues or a case was missing data in some of the abstraction fields. The case(s) would be rejected from the

warehouse. CAHs are strongly encouraged to run a case status summary report each quarter after

submission (and before the deadline) to ensure cases have been accepted into the warehouse. Instructions

can be found here: https://www.ruralcenter.org/tasc/resources/get-your-data-accepted-qualitynet-warehouse

A CAH may have entered a number greater than zero into the Population and Sampling grid, but did not

submit/report any cases to QualityNet.

Zero (0) means that a CAH entered a zero into the Population and Sampling grid, indicating that it had no

eligible patients in a measure set population for the reporting quarter, and the CAH did not submit/report

anything further to QualityNet.

Example – 0 Patients

A CAH entered a zero into the Population and Sampling grid for a particular measure set. The CAH did not

submit/report anything further to QualityNet (because there were no eligible cases to submit). Because the CAH

entered a zero into the Population and Sampling grid to indicate that no cases were eligible, the CAH is

considered reporting, and a 0 is shown on the Patient Safety and Outpatient Report.

Data excluded (D/E) means that the CAH submitted eligible cases to QualityNet. Data was considered

submitted and accepted to the QIO Clinical Warehouse; however, case(s) were excluded from a particular

measure.

Page 5: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 5

Examples – D/E

A CAH submits eligible cases in the population for a measure set, but the cases do not meet the inclusion

criteria for a specific measure. One way this might happen is: A CAH submits one outpatient acute

myocardial infarction (AMI) care case and the case is accepted into the QIO Clinical Warehouse. However,

since the patient was not given fibrinolytic therapy, the case does not meet the criteria for inclusion in OP-1

(median time to fibrinolytic therapy) and OP-2 (fibrinolytic therapy received within 20 minutes of ED

arrival). The OP-1 and OP-2 measures are excluded for this case, and, if no other AMI care cases are

submitted, the report would indicate D/E for the OP-1 and OP-2 measures.

Using Comparison Data for Patient Safety and Inpatient/Outpatient Measures MBQIP Patient Safety and Inpatient/Outpatient Care Quality Reports include state and national comparison

data for all reporting CAHs. The measures on these reports are process-based quality measures, which evaluate

implementation of clinically proven best practices of care. Hospitals should strive to provide these best practices

in clinical care to every patient, 100 percent of the time.

State and national comparison data are averages. In your reports, averages of the state and national median

measures (OP-1, OP-3b, etc.) are medians of those hospital-level medians for CAHs in the state, and in the

nation. To calculate such an average for a given measure, the medians of all hospitals reporting that measure

would be arranged smallest to largest, and the middle median would be displayed on the report. Averages of the

state and national percentage measures (OP-2, OP-4, etc.) are averages in the more usual sense of the term. To

calculate the state and national averages for a given measure, the sum of all numerators for that measure is

divided by the sum of all denominators.(state and national median measures are medians of the median, while

state and national percentage measures are averages in the usual use of the term).

Although it can be helpful to understand your comparison to those norms, averages represent the middle ground

for performance and everyone should strive to achieve at least the 90th percentile for each measure. For quality

improvement purposes, such data benchmarks, are more useful than average comparison data. (Note:

Benchmarks for the top 10 percent by state and for the nation are included in your MBQIP Patient Safety and

Outpatient reports, but your state Flex Coordinator may be able to provide additional state specific information)

Interpreting Reports to Support Improvement Examples of how to interpret the data for use in quality improvement efforts are listed below. Each example is

hyperlinked to the corresponding example in the sample reports found in Appendix A.

Example A: Lack of Consistent Process

Reports that show a measure routinely at low performance indicate that there is not a consistent process for

completion and documentation of that best practice of care. Hospitals in this situation are encouraged to

develop and implement standardized processes to ensure evidence-based care is being provided and

documented.

Example B: Process May Need Adjustment

Reports that show a measure routinely at high performance, but not at 100 percent indicate processes for

best practices are in place, but there is opportunity to ensure they are consistently followed. In this situation,

a hospital may want to consider reviewing records for the patient stays that did not meet the measure. They

can help the hospital to understand why those individual patients did not receive the evidence-based best

Page 6: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 6

practice. This can help identify opportunities to improve processes and documentation, or may identify the

need for staff education or reminders to follow the processes and procedures in place.

Example C: Understanding Variation

Reports that indicate a wide variation on timing measures should be reviewed to understand the cause(s) of

that variation. In Example C, the percentage of patients receiving aspirin at arrival varies from 75% to

100%. Some things to consider:

The state and national averages for receiving aspirin at arrival are 96% and 95% respectively, so the

values of 75% in the first quarter of 2017 (abbreviated as 1Q17) and 93% in 2Q17 appear to be a bit

low.

In this situation, the transfer cases could be reviewed for a better understanding of what type of variation

caused the percentage receiving aspirin at arrival to be so low, and identify if there are opportunities to

improve the process. There are two causes of variation:

o If the variation is common cause, such as the time to run and interpret test results, that may

indicate an opportunity to improve the testing process.

o If the variation is special cause, due to an unusual case or situation that impacted the results, it is

important to understand that cause; however, rather than changing processes, it may lead to the

need for development of a back-up plan.

Example D: Variation Outside of a Set Limit

This example illustrates a common cause variation in the measure across the quarters of data on the

report. For this measure, median time to electrocardiogram (ECG) has specific clinical recommendations

attached – that the ECG should be completed within 10 minutes of arrival. A median time of 10 minutes

indicates that half of the patients received their ECG more than 10 minutes after arrival to the

emergency department (ED), which is outside the set guidelines for this process of care. A review of

cases and workflow is warranted to identify opportunities to improve time to ECG and ensure excellent

care for all patients.

Example E: Considerations for Timing Measures

To identify areas of improvement for timing measures (such as ED-1, or OP-18), look at your own hospital’s

variation to understand opportunities. In Example X, the median time from ED arrival to ED departure for

admitted ED patients is steadily increasing. This hospital might want to look into any possible reasons for that

increase in time. In addition to looking at variation each quarter within the hospital, it can also be helpful to

compare against the median and 90th percentiles for both the state and the nation to identify areas of

improvement and identify benchmarking targets. In this case the hospital has a consistently larger median time

than both the state and national averages, suggesting that the hospital might want to look at opportunities for

decreasing that time.

Using MBQIP Patient Engagement Quality Reports

MBQIP Patient Engagement Quality Reports summarize Hospital Consumer Assessment of Healthcare

Providers and Systems (HCAHPS) survey data reported by hospitals, which provides hospitals the opportunity

to understand care provided from the patient’s point of view. In addition to four screening and seven

demographic questions, the survey includes 21 questions that ask patients for their feedback on a variety of

aspects related to their experience as an inpatient in the hospital. The 21 substantive questions are broken into

seven composite areas, two individual topic areas and two global topic areas. The full survey is available on the

HCAHPS survey website. It is not expected that hospitals will perform at 100 percent on any individual

measure because, unlike process measures, data from the HCAHPS is based on patient perception.

Page 7: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 7

Using Comparison Data for HCAHPS Measures

There is typically more variation in this type of survey data than in process measures. Therefore, you

should look for trends that indicate consistent decline or improvement over time.

Looking at comparison data on the MBQIP Patient Engagement Quality Reports can help provide a

better understanding of how your hospital compares to other like facilities in your state and nationally. If

benchmark data from top performers is available (such as the top 10 percent), that can be helpful in

setting targets for improvement goals, particularly if your hospital is already above the state and national

averages. If your hospital is below the state or national average in an area, that also indicates an

improvement opportunity.

Note: State and national rates in the MBQIP Patient Engagement Quality Reports represent

all hospitals in the state and nation, not just CAHs.

Not all hospitals will be given an HCAHPS Star Rating. Hospitals must have 100 completed surveys in a

rolling four quarter period to have an HCAHPS Star Rating calculated. Hospitals that generally have

near 100 completed surveys in such a time period may have no Star Rating for some time periods that

dip slightly below 100 completed surveys.

HCAHPS data are presented as a rolling four quarters (see the sample MBQIP Patient Engagement

Quality Report in Appendix A) and each report represents the most recent rolling four quarters available,

so it will take time to see improvements/changes in the data. To look at HCAHPS performance over

time, you can compare MBQIP Patient Engagement Quality Reports from different time periods. If

quarterly reports are available from the survey vendor (or through the internal processes if a vendor is

not used) those reports may be more useful for evaluating changes resulting from specific initiatives or

efforts that have been launched. Always use caution when interpreting data from individual quarters, as

the number of surveys completed in any individual quarter may be small.

Interpreting Reports to Support Improvement Examples of how to interpret the data for use in quality improvement efforts are listed below. Each example is

hyperlinked to the corresponding example in the sample report found in Appendix A.

Note: There are two pages in the sample MBQIP Patient Engagement Quality Report: hospital specific data on

the first page and average comparison data on the second page. Each example references both sets of data. The

hyperlink in each example will take you to the first page of the report.

Example F: Opportunity for Improvement

In this example of the HCAHPS composite scores for Composites 1 through 5:

The hospital’s percent “Always” response rate is consistently lower than the state and national CAH

averages for all of these composite indicators as shown on page two of the report.

The hospital could revisit earlier HCAHPS reports to see if any similar trends in these composite scores

are noticeable.

Example G: Translate to the Number of Patients

For many, talking about percentages of responses on a survey can be difficult to translate into impact on

individual patients. One strategy in using HCAHPS data to help staff understand the need for

improvement is to translate the percentages into numbers of actual patients. In the example circled, 70

Page 8: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 8

percent of respondents indicated that their pain was always well-controlled. 70 percent translates to 203

individual patients that always felt their pain was well-controlled. Consider taking this example one step

further and calculate the number of patients who did not answer “Always.” Subtract 203 from 290 to

learn that 87 patients did not answer that they always felt their pain was well-controlled. Considering the

number of patients may help make a more compelling appeal to staff to improve communication and/or

processes in this area.

Calculating the Number of Patients

By using information provided on the report we can compute how many patients answered a question in a

certain way. In this case, we want to know how many patients answered “Always” to the questions making up

the pain management composite. We know that 70 percent of patients said “Always”; this is represented as 70

divided by 100. We also know that 290 people completed the survey (as listed at the top of the report). So we

are solving for X where 70 divided by 100 equals X divided by 290.

70

100=

X

290

70 ∗ 290

100= 203 Patients

We find that, in this example, 70 percent is equal to 203 patients. To calculate the number of patients who did

not answer “Always” to the pain management composite, subtract 203 from 290: 290 – 203 = 87 patients.)

Note: Survey respondents can opt out of answering questions on the HCAHPS. If using a HCAHPS vendor,

CAHs can also identify the exact number of patients with specific responses by looking for that additional

information in their vendor reports.

Using MBQIP Care Transitions Quality Reports for Emergency Department Transfer Communication (EDTC) A fundamental role of CAHs in the health care safety net for rural communities is stabilization and transfer of

patients in emergency situations. The Emergency Department Transfer Communication (EDTC) measure allows

CAHs to evaluate and demonstrate the effectiveness of that important role.

The EDTC measure evaluates the process of transfer communication through documentation of key information

(data elements) and the timeliness in which that information is communicated to the next setting of care.

Using Comparison Data for the EDTC Measure Similar to the other reports, MBQIP Care Transitions Quality Reports for Emergency Department Transfer

Communication (EDTC) also include state and national comparison data for all reporting CAHs. State and

national comparison data are averages. Although it can be helpful to understand your comparison to those

norms, averages represent the middle ground for performance. Strive to achieve at least the 90th percentile for

each measure. For quality improvement purposes, such data benchmarks are more useful than average

comparison data. (Note: Benchmarks for the top 10 percent by state and for the nation are included in your

EDTC reports, but your state Flex Coordinator may be able to provide additional state specific information)

Although the EDTC measure has been utilized sporadically across the country for over 10 years, inclusion of

the measures in MBQIP is the first systematic nationwide implementation of the EDTC measure. Since this

Page 9: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 9

measure is newer to most CAHs compared to HCAHPS and OP measures, state and national averages are likely

to increase consistently over the first few quarters of data collection as CAHs across the country update

documentation and processes.

Interpreting Reports to Support Improvement Examples of how to interpret the data for use in quality improvement efforts are listed below. Each example is

hyperlinked to the corresponding example in the MBQIP Care Transitions Quality Report for Emergency

Department Transfer Communication (EDTC) found in Appendix A.

Example H: Opportunity for Improvement

EDTC sub-measure 2 (Patient Information) is low-performing among the EDTC categories for this hospital,

with a range of percentages for each quarter and an aggregate performance for the year of 77 percent. It is

also lower than the state and national averages (90 percent and 94 percent respectively) and 90th percentiles

(both at 100 percent). Therefore, it may be a target for improvement efforts such as updating documentation

fields and processes to help ensure the data is captured and communicated. Depending on the tool a CAH is

using to collect the data, they may also be able to see results at the data element level, which can be even

more useful in targeting areas for improvement. For example, the data elements for EDTC sub-measure 2

(Patient Information) include: patient name, patient address, patient age, patient gender, patient contact

information, and patient insurance information. If results are available at the data element level it may help

target improvement opportunities for documentation and/or processes to address specific information that is

most commonly missing.

Example I: Documentation or Process?

EDTC sub-measure 7 (Procedures and Tests) also has room for improvement, with an aggregate

performance for the year at 79 percent. Although the hospital’s rate is closer to the state and national

average for this sub-measure (88 percent and 95 percent respectively), it may still represent a good

opportunity for improvement. The hospital may need to evaluate whether the lower score in this area is a

result of failure to document or an issue with the process. CAHs participating in an eight-state pilot on this

measure found that one common area for improvement was to ensure documentation of a plan for how tests

results would be communicated to the next setting of care if they were not available at the time of transfer.

Additional Resources

CAHMPAS (Critical Access Hospital Measurement and Performance Assessment System) Online data query tool from the Flex Monitoring Team which can be used to compare and visualize CAH

performance on financial, quality, and community-benefit measures between groups of hospitals defined by

users. Authorized users are state flex programs and CAH administrators. Contact

[email protected] for login credentials.

Emergency Department Transfer Communication Measure Resources Data specifications manual, Excel-based data collection tool, recorded trainings, quality improvement toolkit

MBQIP Measures Fact Sheets One-measure-per-page-overview of the data collection and reporting processes for the required MBQIP

measures.

Page 10: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 10

MBQIP Reporting Guide This guide is intended to help Flex Coordinators, critical access hospital staff and others involved with MBQIP

understand the measure reporting process. For each reporting channel, information is included on how to

register for the site, which measures are reported to the site and how to submit those measures to the site.

Quality Improvement Implementation Guide and Toolkit for Critical Access Hospitals Offers strategies and resources to help critical access hospital (CAH) staff organize and support efforts to

implement best practices for quality improvement. It includes:

A quality improvement implementation model for small, rural hospital settings

A 10-step guide to leading quality improvement efforts

Summaries of key national quality initiatives that align with MBQIP priorities

Best practices for improvement for current MBQIP measures

Simple, Excel-based tool to assist CAHs with tracking and displaying real time data for MBQIP and

other quality and patient safety measures to support internal improvement efforts

CAH quality prioritization tool

Page 11: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 11

Appendix A – Sample MBQIP Hospital Data Reports

Example A: Lack of Consistent Process

Page 12: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 12

Example B: Process May Need Adjustment

Page 13: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 13

Example C: Understanding Variation

Page 14: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 14

Example D: Variation outside of a set limit

Page 15: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 15

Example E: Considerations for timing measures

Page 16: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 16

D/E (Data Excluded)

0

N/A (Not Available)

General Information for State and National data:

The Average Time/Overall Rate and 90th percentile calculations in these reports are based on the number of

CAHs submitting with eligible cases.

However, note that the number of CAHs with MBQIP MOU submitting data includes those that have

submitted data but have zero (0) eligible cases to report.

Page 17: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 17

Example F:

Opportunity for Improvement

General Information:

Data is presented over

rolling four quarters.

General Information:

The data publicly reported on Hospital Compare

includes percentage of “Always”, “Yes”, “Yes

Definitely” and “9” or “10” ratings depending on the

type of question for the most recent rolling four

quarters. These are known as the top box scores.

Page 18: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 18

Example G: Translate to Number of Patients

How do you calculate how many patients are

70% of completed surveys?

70 = X

100 (completed surveys)

Multiply and divide to solve for X:

70*290/100= 203 patients

Page 19: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 19

General Information:

This column shows the aggregate of data for

all four quarters of data on the report. The

total number of records represents all cases

reviewed in those four quarters. Example H:

Opportunity for Improvement

Example I:

Documentation or Process?

General Information:

The All EDTC measure is the percentage of cases that have every data

element from every sub-measure (a total of 27 data elements). Thus,

this indicator will never be higher than the lowest of the sub-measures.

General Information for State and National data:

The Average Current Quarter and 90th percentile calculations in

these reports are based on the number of CAHs submitting with

eligible cases.

However, note that the number of CAHs with MBQIP MOU

submitting data includes those that have submitted data but have

zero (0) eligible cases to report.

Page 20: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 20

Appendix B – Glossary

This glossary includes a list of commonly used terms and their explanations as they apply to the

Medicare Beneficiary Quality Improvement Project (MBQIP) and quality data reporting.

Accepted: Individual case(s) submitted and accepted into the QIO Clinical Warehouse.

Aggregate: Sum; total combined.

Average: State and national averages are calculated by adding up all the numerators and

denominators of every reporting critical access hospital then dividing to get the percentage.

CART: The Centers for Medicare & Medicaid Services (CMS) Abstraction & Reporting Tool; a

free tool that hospitals can utilize to collect and submit the chart abstracted inpatient and outpatient

Hospital Compare measures.

CMS Measure Specifications Manuals: Manuals created by the Centers for Medicare &

Medicaid Services (CMS) to provide definitions for a uniform set of quality measures to be

implemented in hospital settings. The inpatient and outpatient manuals can be found on the

QualityNet website.

Common cause variation: Arises from factors inherent in the process; ‘usual’ differences in a

standard process, but can be an opportunity for improvement if a reduction in variation is desired.

Composite: A composite measure combines more than one item in order to measure a concept that

is too complex to be measured with one item. In reference to Hospital Consumer Assessment of

Healthcare Providers and Systems (HCAHPS), a composite measure is a grouping of related

questions.

Denominator: The bottom term in a fraction; the total number of parts created from the whole.

Excluded: Individual case(s) accepted into the QIO Clinical Warehouse that did not meet the

criteria to be included in a specific quality indicator; not included in the denominator.

Failed: Individual case(s) accepted into the QIO Clinical Warehouse that met the criteria to be

included in a specific quality indicator, but did meet the measure criteria; included in the

denominator, but not in the numerator.

Hospital Compare: A website developed by the Centers for Medicare & Medicaid Services

(CMS) that compiles information about hospitals and their reported quality measures and allows

consumers to compare hospitals to assist in making a decision about where to seek care. For more

information visit the Hospital Compare website.

Included: Individual case(s) accepted into the QIO Clinical Warehouse and met the criteria to be

included in specific quality indicator; included in the denominator.

Median: The middle number in a set of values; half the numbers are less and half the numbers are

greater.

Numerator: The top term in a fraction; how many parts of the whole being considered.

Passed: Individual case(s) accepted into the QIO Clinical Warehouse, met the criteria to be

included in a specific quality indicator and met the measure criteria; included in the denominator

and the numerator.

Page 21: Interpreting MBQIP Hospital Data Reports for Quality ......2017 Flex grant cycle, which ends August 31, 2017. Recognizing the evolving nature of health care quality measures, this

Interpreting MBQIP Hospital Data Reports for Quality Improvement

Rural Quality Improvement Technical Assistance, www.stratishealth.org 21

QIO Clinical Warehouse: The Quality Improvement Organization (QIO) Clinical Warehouse is

the national data repository for health care quality data. Hospitals participating in the Centers for

Medicare & Medicaid Services (CMS) quality improvement initiatives must submit specified data

in the prescribed format to the QIO Clinical Warehouse via the QualityNet website.

QualityNet: Established by the Centers for Medicare & Medicaid Services (CMS), QualityNet

provides health care quality improvement news, resources and data reporting tools and applications

used by health care providers and others. QualityNet is the only CMS-approved website for secure

communications and health care quality data exchange between: quality improvement

organizations (QIOs), hospitals, physician offices, nursing homes, data vendors and end stage renal

disease (ESRD) networks and facilities. For more information visit the QualityNet website.

Rejected: Individual case(s) submitted, but for some reason not accepted into the QIO Clinical

Warehouse.

Rolling quarters: Inclusion of a certain number of the most recent quarters.

Special cause variation: Arises from factors outside the process; outside the ordinary; requires a

need to understand what happened, but not typically the focus of improvement. May lead to

planning for specific circumstances.

Submit: Transmission of data via the secure QualityNet website. Hospitals may transmit data

themselves if using the CART tool for data collection or have a vendor transmit the data on their

behalf if they are using a vendor supported data collection process. For more information visit the

Data Submission webpage of the QualityNet website.

Top box: The most positive answer choice; in reference to the Hospital Consumer Assessment of

Healthcare Providers and Systems (HCAHPS) this means the answers: “Always” for those

questions with options always, usually, sometimes or never; “Yes” for those questions with the

options yes or no; “Yes Definitely” for those with the options yes definitely, yes somewhat or no;

and “9” or “10” for those with the options of a number 0 through 10.