WS 1B Surveying Participants: Lessons from Viva Calle San Jose

Surveying Participants: Lessons from Viva CalleSJ

2016 International Open Street Summit

Asha Weinstein Agrawal, PhD

August 18, 2016

Mineta Transportation Institute

Presentation outline

1. About the survey project

2. Sampling considerations

3. Questionnaire design considerations

4. Where to learn more

Photo by 8-80 Cities

Survey project partners

1. My co-author: Hilary Nixon, PhD

2. Mineta Transportation Institute

3. City of San Jose, Parks & Recreation

4. Silicon Valley Bicycle Coalition

Our survey – a few details

• Short! (1 page with 12 questions)

• Self-complete

• Available in three languages

• Surveyors were stationed at 6 key locations

• 618 people returned usable surveys

Presentation outline

1. About our survey project

2. Sampling considerations

3. Questionnaire design considerations

4. Where to learn more

Sampling Options

Sampling approach

Advantages Disadvantages

Census Accurately reflects all participants

Impossible!

Random sample

Results can be generalized to all participants

Impossible!

Intercept at key locations

Easy to administerResults may approximate a random sample

Can’t generalize with full confidence

Presentation outline

1. About our survey project

2. Sampling considerations

3. Questionnaire design considerations

4. Where to learn more

Questionnaire design

1. What topics to include? Ask:

– How would I use the results?

– Is there another (better) way to get this information?

2. How many questions can I include? Ask:

– What is my desired response rate?

– What is my budget and desired # of responses?

Questionnaire design, cont.

3. How to word each question? Ask:

– Would a distracted 6th grader understand it?

– What are all the ways this question could be interpreted?

– How accurately can people answer?

– Will people tell the truth?

– How can I simplify even more (grammar & vocab)?

Sample question: outreach

How did you learn about today’s Viva CalleSJevent? (Check all that apply)

□ Radio

□ Newspaper

□ Flyer/poster

□ E-newsletter or email blast

□ Facebook, Twitter, or other social media

□ Other (please specify)___________

2015 results: outreach

Source of information% of

respondents

Facebook, Twitter, or other social media 29

Other 23

Word of mouth (volunteered) 21

Flyer/poster 21

Newspaper 12

E-newsletter or email blast 12

Radio 5

No response 1

Note: Respondents could select multiple options.

REVISED outreach question

How did you learn about today’s Viva CalleSJ event? (Check all that apply)

□ Radio

□ Newspaper

□ Flyer/poster

□ E-newsletter or email blast

□ Facebook, Twitter, or other social media

□ Word of mouth (friend, co-worker, etc.)

□ Other (please specify)___________

Sample question: money spent

How much money are you likely to spend at Viva CalleSJ?

□ Nothing

□ $1 to $10

□ $11 or more

2015 results: estimated $ spent

Amount spent% of

respondents

$11 or more 53

$1 to $10 35

Nothing 10

No response 3

Draft NEW spending question

How much money have you spent at Viva CalleSJtoday, in each category?

$______Food/drink from food trucks

$______SJMADE Marketplace at Arena Green

$______Food/drink from restaurant along route

$______Stores along the route

$______Other

□ I have not spent any money at all

Comparing the two questions

1. How much money are you likely to spend at Viva CalleSJ?

2. How much money have you spent at Viva CalleSJ today in each category?

Mineta Transportation Institute

Want to learn more?

• Report at transweb.sjsu.edu/project/1430.html

• Email: [email protected]