Top Banner
The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise Desk Audit Bureau NESTOA - 2019 September 10, 2019
20

The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Aug 30, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

The Ins and Outs of Using Data in Audit Operations

Joseph Carzo, Director, Audit Division

Kristin Dence, Director, Income Franchise Desk Audit Bureau

NESTOA - 2019

September 10, 2019

Page 2: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Overview

Data and audit operations• Volumes and results• Desk audit and field audit• Selection• Management• Adjustments

Page 3: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Audit Division

Bureau Staff Number of Audits Collections*($000)

Income/Franchise Field 372 4,480 1,212,209

Transaction Field 446 5,539 552,058

Income/Franchise Desk 296 614,830 1,011,254

Transaction Desk 143 33,703 109,449

* FY’19

Page 4: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Audit Division

Bureau Staff Number of Audits Collections*($000)

Income/Franchise Field 372 4,480 1,212,209

Transaction Field 446 5,539 552,058

Income/Franchise Desk 296 614,830 1,011,254

Transaction Desk 143 33,703 109,449

* FY’19

Page 5: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Audit selection

Case Identification and Selection System (CISS)• Business rules• Predictive models

Page 6: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Predictive models

Earned Income Tax Credit/Dependent Care Credit model • Used in CISS rules to select prior to refund being issued• Detects questionable returns and assigns a score• Looks at many factors:

− Type of income− Dependents− Dependent relationships− Preparer information− Past filings− Audit history

Page 7: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Predictive models

Aggregate model • Uses cluster analysis and over 60 metrics to detect unusual or

hidden patterns compared to all other clusters• Generates weekly reports for the Fraud Analysis and Selection

Team (FAST) and the Identity Verification Unit (IVU)• FAST and IVU detect schemes quickly and prevent loss• Results are used to refine reports and business rules

Page 8: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Inventory management

Peak processing planning• Risk• Staff hours• Projected response rates• Completion time

Page 9: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Inventory management

Peak processing monitoring• Letters sent• Responses received• Aging

Page 10: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Inventory management

Planning for next year• Evaluate audit results• Edit business rules• Refine predictive model scoring• Legislative changes

Page 11: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Audit Division

Bureau Staff Number of Audits Collections*($000)

Income/Franchise Field 372 4,480 1,212,209

Transaction Field 446 5,539 552,058

Income/Franchise Desk 296 614,830 1,011,254

Transaction Desk 143 33,703 109,449

* FY’19

Page 12: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Audit Division

Bureau Staff Number of Audits Collections*($000)

Income/Franchise Field 372 4,480 1,212,209

Transaction Field 446 5,539 552,058

Income/Franchise Desk 296 614,830 1,011,254

Transaction Desk 143 33,703 109,449

* FY’19

Page 13: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Audit selection

Selection criteria applied to processed returns• Reviewed manually by experienced staff• Recommendations reviewed by managers• Cases created and assigned• Candidates not selected available for further

screening

Page 14: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Return on resourcesC

olle

ctio

ns

Time/Resources

Page 15: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Return on resourcesC

olle

ctio

ns

Time/Resources

Page 16: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Return on resourcesC

olle

ctio

ns

Time/Resources

Page 17: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Understanding results

Applying analytics to improve selection• Resources committed to achieve results• Repeating successes, not mistakes• Identifying compliance is a good thing

Page 18: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Operational data

Applying analytics to improve performance• Optimal interactions

− Field time / Block scheduling− Elevation− Agreeing to disagree

• Balancing staff

Page 19: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Work in progress§ Refining candidate scoring§ Concluding lower-value audits§ Impact on other Divisions§ Impact on taxpayers

• Certainty• Consistency/Fairness

Page 20: The Ins and Outs of Using Data in Audit Operations...The Ins and Outs of Using Data in Audit Operations Joseph Carzo, Director, Audit Division Kristin Dence, Director, Income Franchise

Efficiency ● Integrity ● Fairness