Top Banner
Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International Conference on Establishment Surveys June 20, 2007 Montréal, Québec, Canada
20

Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Mar 27, 2015

Download

Documents

Sara Pope
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Response Rates and Response Patterns among New Businesses:

Results from the Kauffman Firm Survey (KFS)

Response Rates and Response Patterns among New Businesses:

Results from the Kauffman Firm Survey (KFS)

Zhanyun ZhaoFrank Potter

Yuhong Zheng

Third International Conference on Establishment SurveysJune 20, 2007

Montréal, Québec, Canada

Zhanyun ZhaoFrank Potter

Yuhong Zheng

Third International Conference on Establishment SurveysJune 20, 2007

Montréal, Québec, Canada

Page 2: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

OverviewOverview

KFS Background

Sample Design

Non-Response Status

Summary

KFS Background

Sample Design

Non-Response Status

Summary

Page 3: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Kauffman Firm SurveyKauffman Firm Survey

Longitudinal survey of new firmsStudy dynamics and sustainability of new

firms

Sponsored by Ewing Marion Kauffman Foundationhttp://www.kauffman.org/

Dun & Bradstreet as the sampling frame

Longitudinal survey of new firmsStudy dynamics and sustainability of new

firms

Sponsored by Ewing Marion Kauffman Foundationhttp://www.kauffman.org/

Dun & Bradstreet as the sampling frame

Page 4: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Kauffman Firm Survey (Cont.)Kauffman Firm Survey (Cont.)

Pilot study (new firms founded in 2003)

Main study (new firms founded in 2004)

Baseline survey (5000 firms & weighting)

First follow up (4000 firms)

Second follow up (expect 3500 firms)

Pilot study (new firms founded in 2003)

Main study (new firms founded in 2004)

Baseline survey (5000 firms & weighting)

First follow up (4000 firms)

Second follow up (expect 3500 firms)

Page 5: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Sample DesignSample Design

Stratified random sample

Strata

High tech industries (3 levels)

Woman-owned indicator

Over sampling for high tech firms

Stratified random sample

Strata

High tech industries (3 levels)

Woman-owned indicator

Over sampling for high tech firms

Page 6: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

High Tech FirmsHigh Tech Firms

BLS definition based on D&B employment

Used SIC rather than NAICS

Three categories

High Tech

Medium Tech

Non Tech

BLS definition based on D&B employment

Used SIC rather than NAICS

Three categories

High Tech

Medium Tech

Non Tech

Page 7: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Woman Owned FirmsWoman Owned Firms

Woman owned indicator composite

D&B Indicator

CEO’s gender / prefix

Final indicator results

Tested in the pilot study

Added 20% using CEO’s gender

Woman owned indicator composite

D&B Indicator

CEO’s gender / prefix

Final indicator results

Tested in the pilot study

Added 20% using CEO’s gender

Page 8: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Sample Frame Sample Frame

High Tech

Woman Owned

June Frame

Deceased in Nov

New in Nov

Total All

Total Alive

Total 188,292 13,439 62,990 251,282 237,843

High Yes 361 21 166 527 506

No 2,232 123 1,110 3,342 3,219

Med Yes 4,332 153 1,215 5,547 5,394

No 18,212 773 5,902 24,114 23,341

Non Yes 32,016 2,177 9,951 41,967 39,790

No 131,139 10,192 44,646 175,785 165,593

Page 9: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Sample Selection and ReleaseSample Selection and Release

Stratified by technology (SIC) and woman owned

Sequential selection

Implicit strata: employee count, zip code

Nov sample allocation based on

June and Nov sample are balanced Reach Target 5,000 completes

Released in waves

Stratified by technology (SIC) and woman owned

Sequential selection

Implicit strata: employee count, zip code

Nov sample allocation based on

June and Nov sample are balanced Reach Target 5,000 completes

Released in waves

Page 10: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Total SampleTotal Sample

High Tech

Woman Owned

June Sample

June Percent

Nov Sample

NovPercent

Total Sample

Total 23,942 12.7 8,527 13.5 32,469

High Yes 361 100 166 100 527

No 2,232 100 1,110 100 3,342

Med Yes 1,029 23.8 237 19.5 1,266

No 4,740 26.0 1,568 26.6 6,308

Non Yes 2,090 6.5 670 6.7 2,760

No 13,490 10.3 4,776 10.7 18,266

Page 11: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Non-response AdjustmentNon-response Adjustment

CHAID and Propensity Score Independently within technology group Location model / Response model Key characteristics:

High tech Woman owned Census division MSA Industry Legal status

CHAID and Propensity Score Independently within technology group Location model / Response model Key characteristics:

High tech Woman owned Census division MSA Industry Legal status

Page 12: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Response RatesResponse Rates

Overall weighted rates

Percentage located: 90.7

Percentage complete/located: 54.2

Percentage complete: 49.1

Response patterns on key characteristics …

Overall weighted rates

Percentage located: 90.7

Percentage complete/located: 54.2

Percentage complete: 49.1

Response patterns on key characteristics …

Page 13: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Stratification FactorsStratification Factors

Stratification factors

0

10

20

30

40

50

60

70

80

90

100

High tech Mediumtech

Non tech Womanowned

Man owned

Located

Comp/Loc

Complete

Stratification factors

0

10

20

30

40

50

60

70

80

90

100

High tech Mediumtech

Non tech Womanowned

Man owned

Located

Comp/Loc

Complete

Page 14: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Sampling StrataSampling Strata

Sampling Strata

0

10

20

30

40

50

60

70

80

90

100

High tech,womanowned

High tech,man owned

Mediumtech, woman

owned

Mediumtech, man

owned

Non tech,womanowned

Non tech,man owned

Located

Comp/Loc

Complete

Sampling Strata

0

10

20

30

40

50

60

70

80

90

100

High tech,womanowned

High tech,man owned

Mediumtech, woman

owned

Mediumtech, man

owned

Non tech,womanowned

Non tech,man owned

Located

Comp/Loc

Complete

Page 15: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Geographic Region and Metropolitan Status

Geographic Region and Metropolitan Status

Geography

0

10

20

30

40

50

60

70

80

90

100

Midwest Northeast South West MSA Non MSA

Located

Comp/Loc

Complete

Geography

0

10

20

30

40

50

60

70

80

90

100

Midwest Northeast South West MSA Non MSA

Located

Comp/Loc

Complete

Page 16: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

IndustryIndustry

Industry

0102030405060708090

100

Located

Comp/Loc

Complete

Industry

0102030405060708090

100

Located

Comp/Loc

Complete

Page 17: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Legal StatusLegal Status

Legal Status

0

10

20

30

40

50

60

70

80

90

100

Unknown Corporation Partnership Proprietorship

Located

Comp/Loc

Complete

Legal Status

0

10

20

30

40

50

60

70

80

90

100

Unknown Corporation Partnership Proprietorship

Located

Comp/Loc

Complete

Page 18: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

Item Non-responseItem Non-response

Focus on business financial data

Total assets, equity, debt, profit etc.

Include both main and subsequent question

The subsequent question could have actual value or category

High item response rate

Main Q.Sub. Q.

Mean 98.9% 95.6%Median 99.1% 96.7%

Focus on business financial data

Total assets, equity, debt, profit etc.

Include both main and subsequent question

The subsequent question could have actual value or category

High item response rate

Main Q.Sub. Q.

Mean 98.9% 95.6%Median 99.1% 96.7%

Page 19: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

SummarySummary

Stratified design to get precise understanding of newly formed firms, especially high tech

Higher response rates are: Medium tech & woman owned Manufacturing Midwest, non-MSA Sole proprietorship

Lower response rates are: Low tech & not woman owned Construction Northeast, MSA Partnership

High item response rates in key questions

Stratified design to get precise understanding of newly formed firms, especially high tech

Higher response rates are: Medium tech & woman owned Manufacturing Midwest, non-MSA Sole proprietorship

Lower response rates are: Low tech & not woman owned Construction Northeast, MSA Partnership

High item response rates in key questions

Page 20: Response Rates and Response Patterns among New Businesses: Results from the Kauffman Firm Survey (KFS) Zhanyun Zhao Frank Potter Yuhong Zheng Third International.

ThanksThanks

Questions and paper requests:

[email protected]

MPR website

http://mathematica-mpr.com

Questions and paper requests:

[email protected]

MPR website

http://mathematica-mpr.com