Web-Based Survey Techniques (2006) / Chapter Skim
Currently Skimming:
Appendix C - Tabulations for Synthesis Survey
Appendix C - Tabulations for Synthesis Survey
Pages 63-104
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 63... ...
63 APPENDIX C Tabulations for Synthesis Survey Screener Section Type of organization Frequency Percent Public transit agency 24 68.6 Consultancy 4 11.4 University 2 5.7 Metropolitan planning organization 3 8.6 Other 2 5.7 Total 35 100 Other types of organizations Frequency Percent Federal government 1 50 Transportation department city government 1 50 Total 2 100 General Survey Inventory Section Frequency of conducting customer research studies More than 4 times per year 2 to 4 times per year Count % Count % Origin–destination surveys 3 8.60 4 11.40 Customer satisfaction surveys 4 11.40 7 20.00 Mode choice surveys 2 5.70 3 8.60 Planning surveys 5 14.30 7 20.00 Other, please specify 5 31.30 2 12.50 Frequency of conducting customer research studies (continued) Once per year Less than once per year, but more than every 5 years Count % Count % Origin–destination surveys 4 11.40 6 17.10 Customer satisfaction surveys 5 14.30 11 31.40 Mode choice surveys 3 8.60 9 25.70 Planning surveys 11 31.40 4 11.40 Other, please specify 1 6.30 1 6.30
|
From page 64... ...
Don't know Total Count % Count % Origin–destination surveys 35 100.00 Customer satisfaction surveys 1 2.90 35 100.00 Mode choice surveys 1 2.90 35 100.00 Planning surveys 35 100.00 Other, please specify 3 18.80 16 100.00 Other types of surveys Frequency Percent Employers, employees, product tests, marketing, etc. 1 10.0 Household travel surveys, transit on-board surveys 1 10.0 Interactive map studies 1 10.0 Marketing evaluation 1 10.0 New technology 1 10.0 Policy and issue analysis 1 10.0 Station evaluation, special issues, new offers/programs related to fares, metrocard, etc., panel survey, safety/security issues, communication materials copy testing, etc.
|
From page 65... ...
Bus 11 68.8 Subway/rapid rail 2 12.5 Commuter rail Light rail 1 6.3 Auto 1 6.3 No mode issues in survey 1 6.3 Recruitment not based on mode 2 12.5 Recruited riders/users for OD survey Other, please specify 2 12.5 Other modes recruited Frequency Percent Airline 1 50 All modes 1 50 Total 2 100 Questions in OD survey about modes Count Column (%) Bus 13 81.3 Subway/rapid rail 2 12.5 Commuter rail 2 12.5 Light rail 1 6.3 Auto 4 25 No mode issues in survey 1 6.3 Recruitment not based on mode Questions in OD survey about modes Other, please specify 1 6.3 Questions about other modes Frequency Percent All modes 1 100
|
From page 66... ...
2 12.5 Convenience sampling (anyone who would participate) 1 6.3 Other sampling method 1 6.3 Total 16 100 Other sampling method Frequency Percent No sampling 1 100 Type of incentives Frequency Percent No incentives 12 75 Incentive for each respondent 3 18.8 Other incentives 1 6.3 Total 16 100 Incentive for each respondent Frequency Percent $2 in advance letter and $5 per person with diary 1 33.3 Free ride 1 33.3 Promotional item 1 33.3 Total 3 100
|
From page 67... ...
1 20.0 Multiply recruitment rate by final completion rate to get total response rate. See documentation at: http://nhts.ornl.gov/2001/usersguide/chapter_4.pdf 1 20.0 Nonresponders not counted 1 20.0 Total 5 100
|
From page 68... ...
68 Survey data set was clean Frequency Percent Agree 7 43.8 Neutral 7 43.8 Disagree 2 12.5 Total 16 100 Respondents completed nearly every question of survey Frequency Percent Strongly agree 2 12.5 Agree 7 43.8 Neutral 6 37.5 Disagree 1 6.3 Total 16 100 Weighted data for most recent OD survey Count Column (%) Did not weight data 6 46.2 Weighted based on ridership/traffic 6 46.2 Weighted based on demographics 1 7.7 Weighted data for most recent OD survey Weighted based on other factors Other factors Frequency Percent Ridership, by route, direction, time of day, day of week 1 100 Total 1 100 Success of survey Frequency Percent Very successful 4 25 Successful 11 68.8 Neither successful nor unsuccessful 1 6.3 Total 16 100 Types of problems/issues Frequency Percent Technical problems: The text overlapped for some browsers 1 1 Total 1 100
|
From page 69... ...
1 50.0 Total 2 100 Results of OD survey presented to Count Column (%) General public 5 31.3 Customers 1 6.3 Constituents 3 18.8 Internal clients/management 14 87.5 External clients 6 37.5 Faculty/staff/students 2 12.5 Other, please specify 1 6.3 Results of OD survey presented to Research results were not presented
|
From page 70... ...
Bus 9 64.3 Subway/rapid rail 1 7.1 Commuter rail 3 21.4 Light rail Auto 1 7.1 No mode issues in survey Recruitment not based on mode 2 14.3 Recruited riders/users for CS survey Other, please specify 1 7.1 Other modes recruited Frequency Percent Paratransit 1 100 Questions in CS survey about modes Count Column (%) Bus 15 75 Subway/rapid rail 3 15 Commuter rail 2 10 Light rail 2 10 Auto 4 20 No mode issues in survey 1 5 Recruitment not based on mode Questions in CS survey about modes Other, please specify 1 5 Questions about other modes Frequency Percent Paratransit vehicles 1 100 Sampling method Frequency Percent No sampling, total population surveyed 1 6.3 Random sampling 9 56.3 Convenience sampling (anyone who would participate)
|
From page 71... ...
71 Type of incentives Frequency Percent No incentives 11 68.8 Lottery conducted with prizes 3 18.8 Incentive for each respondent 1 6.3 Other incentives 1 6.3 Total 16 100 Lottery prizes Frequency Percent Digital music player 1 33.3 Free 30-day pass 1 33.3 Monthly pass 1 33.3 Total 3 100 Incentive for each respondent Frequency Percent Promotional item 1 100 Other incentives Frequency Percent A pen 1 100 Effectiveness of incentives Frequency Percent Do not know 5 100 Administered most recent CS survey Count Column (%) Telephone 8 50 Paper 9 56.3 Computer-based, but not on Internet Online web survey Personal 2 12.5 Administered most recent CS survey Other, please specify Response rate percentage Frequency Percent 9 56.3 14 1 6.3 30 1 6.3 40 1 6.3 50 1 6.3 55 1 6.3 75 1 6.3 90 1 6.3 Total 16 100 Don't know/not applicable
|
From page 72... ...
1 25.0 Total 4 100 Survey data set was clean Frequency Percent Strongly agree 3 18.8 Agree 9 56.3 Neutral 3 18.8 Disagree 1 6.3 Total 16 100 Respondents completed nearly every question of survey Frequency Percent Strongly agree 6 37.5 Agree 9 56.3 Neutral 1 6.3 Total 16 100 Weighted data for most recent CS survey Count Column (%) Did not weight data 10 62.5 Weighted based on ridership/traffic 6 37.5 Weighted based on demographics Weighted data for most recent CS survey Weighted based on other factors Success of survey Frequency Percent Very successful 8 50 Successful 6 37.5 Somewhat unsuccessful 2 12.5 Total 16 100
|
From page 73... ...
external to internal trips Results of CS survey presented to Count Column (%) General public 8 50 Customers 4 25 Constituents 3 18.8 Internal clients/management 15 93.8 External clients 2 12.5 Faculty/staff/students 2 12.5 Other, please specify Results of CS survey presented to Research results were not presented
|
From page 74... ...
Bus 10 55.6 Subway/rapid rail 5 27.8 Commuter rail 5 27.8 Light rail 1 5.6 Auto 7 38.9 No mode issues in survey 1 5.6 Recruitment not based on mode 3 16.7 Recruited riders/users for MC survey Other, please specify 3 16.7 Other modes recruited Frequency Percent Airline 1 33.3 Carpool, vanpool, telecommute, bike, walk 1 33.3 Household survey 1 33.3 Total 3 100 Questions in MC survey about modes Count Column (%) Bus 17 85 Subway/rapid rail 11 55 Commuter rail 2 10 Light rail 5 25 Auto 4 20 No mode issues in survey 1 5 Recruitment not based on mode Questions in MC survey about modes Other, please specify 2 10 Questions about other modes Frequency Percent Airline 1 50 Commuter bus 1 50 Total 2 100 Recruited respondents for MC survey Count Column (%)
|
From page 75... ...
3 14.3 Convenience sampling (anyone who would participate) 5 23.8 Other sampling method 2 9.5 Total 21 100 Other sampling method Frequency Percent A two-stage sampling approach was used for the on-board survey 1 50 We have not done a mode choice survey in years.
|
From page 76... ...
Telephone 7 35 Paper 8 40 Computer-based, but not on Internet 2 10 Online web survey 6 30 Personal 4 20 Administered most recent MC survey Other, please specify 1 5 Other method administered survey Frequency Percent We have not done such a survey in years. 1 100 Response rate percentage Frequency Percent 10 47.6 10 Don't know/not applicable 1 4.8 19 1 4.8 33 2 9.5 34 1 4.8 35 1 4.8 41 1 4.8 60 3 14.3 65 1 4.8 Total 21 100
|
From page 77... ...
Survey data set was clean Frequency Percent Strongly agree 4 19 Agree 9 42.9 Neutral 5 23.8 Disagree 3 14.3 Total 21 100 Respondents completed nearly every question of survey Frequency Percent Strongly agree 4 19 Agree 11 52.4 Neutral 3 14.3 Disagree 3 14.3 Total 21 100 Weighted data for most recent MC survey Frequency Percent Did not weight data 10 47.6 Weighted based on ridership/traffic 5 23.8 Weighted based on demographics 4 19 Weighted data for most recent MC survey Weighted based on other factors 2 9.5 Other factors Frequency Percent The weighting and expansion process was conducted at the day-time-route level -- each survey was weighted and expanded based on the day of the week (i.e., weekday or weekend) , time-of-day (a.m.
|
From page 78... ...
1 16.6 Total 6 100 How research from MC survey was used Count Column (%) Update origin–destination trip tables 8 38.1 Define traveler markets by geography 4 19 Determine trip purpose 8 38.1 Determine trip frequency 5 23.8 Determine distribution of station/stops used 4 19 Determine distribution time-of-day facilities/system used 5 23.8 How research from MC survey was used Generate demographic profile of travelers 6 28.6 Other purposes Frequency Percent Evaluate effectiveness of Transportation Demand Management programs, identify new markets for services 1 16.6 Evaluate TravelSmart Policy 1 16.6 Legislative information 1 16.6 Measure attitudes 1 16.6 We have not done such a survey in years.
|
From page 79... ...
Recruited riders/users for PS survey Count Column (%) Bus 16 76.2 Subway/rapid rail 5 23.8 Commuter rail 3 14.3 Light rail 1 4.8 Auto 5 23.8 No mode issues in survey 1 4.8 Recruitment not based on mode 3 14.3 Recruited riders/users for PS survey Other, please specify 1 4.8 Other modes recruited Frequency Percent Vanpool and paratransit 1 100 Questions in PS survey about modes Count Column (%)
|
From page 80... ...
3 12.5 Convenience sampling (anyone who would participate) 7 29.2 Other sampling method 2 8.3 Total 24 100 Other sampling method Frequency Percent Geographic 1 50 Random selection of bus runs, segmented by route 1 50 Total 2 100 Type of incentives Frequency Percent No incentives 19 79.2 Lottery conducted with prizes 4 16.7 Incentive for each respondent 1 4.2 Total 24 100 Lottery prizes Frequency Percent Airline tickets 1 25 Free monthly pass 1 25 Free transit rides 1 25 Trip to Hawaii, watches, fare tickets 1 25 Total 4 100
|
From page 81... ...
81 Incentive for each respondent Frequency Percent A small amount of cash with an introductory mailing notifying person that they would be contacted by phone for survey 1 100 Effectiveness of incentives Frequency Percent Increased response rate 1–25% 2 40 Increased response rate 25–50% 1 20 Don't know 2 40 Total 5 100 Administered most recent PS survey Count Column (%) Telephone 11 45.8 Paper 16 66.7 Computer-based, but not on Internet 2 8.3 Online web survey 5 20.8 Personal 9 37.5 Administered most recent PS survey Other, please specify Response rate percentage Frequency Percent 12 50 10 Don't know/not applicable 1 4.2 15 1 4.2 20 1 4.2 30.4 1 4.2 35 1 4.2 37 1 4.2 40 1 4.2 42 1 4.2 50 1 4.2 58 1 4.2 74 1 4.2 75 1 4.2 Total 24 100
|
From page 82... ...
Survey data set was clean Frequency Percent Strongly agree 5 20.8 Agree 11 45.8 Neutral 6 25 Disagree 2 8.3 Total 24 100 Respondents completed nearly every question of survey Frequency Percent Strongly agree 5 20.8 Agree 13 54.2 Neutral 5 20.8 Disagree 1 4.2 Total 24 100 Weighted data for most recent PS survey Count Column (%) Did not weight data 14 58.3 Weighted based on ridership/traffic 6 25 Weighted based on demographics 2 8.3 Weighted data for most recent PS survey Weighted based on other factors 2 8.3 Other factors Frequency Percent Household Travel Survey utilizes both weighting and expansion factors to (1)
|
From page 83... ...
The paper survey is our basic planning survey. The goal of this survey was to achieve a statistically projectable sample at each of our stations 1 10.0 To cover all target audiences 1 10.0 To get a bigger sample 1 10.0 To increase response rates 1 10.0 We included commuter rail users and non- users.
|
From page 84... ...
1 4.2 Parking demand estimation 1 4.2 Plan new service 1 4.2 Plan route revisions 1 4.2 Planning projects 1 4.2 Provide information to local government for potential commercial development 1 4.2 Provided an evaluation of home interview surveys for an external client 1 4.2 Route planning 1 4.2 Route planning 1 4.2 Service changes, location of amenities, marketing 1 4.2 Service evaluation and planning 1 4.2 Service planning 1 4.2 The basic planning survey is the reference source for evaluating the impact of regional and station level improvements and possible changes in service. 1 4.2 The objective of the household travel survey is to collect information on work and non-work travel behavior.
|
From page 85... ...
Recruited riders/users for OS survey Count Column (%) Bus 6 35.3 Subway/rapid rail 6 35.3 Commuter rail 4 23.5 Light rail 2 11.8 Auto 4 23.5 No mode issues in survey Recruitment not based on mode 5 29.4 Recruited riders/users for OS survey Other, please specify Questions in OS survey about modes Count Column (%)
|
From page 86... ...
3 17.6 Convenience sampling (anyone who would participate) 3 17.6 Other sampling method 1 5.9 Total 17 100 Other sampling method Frequency Percent A static link was at the top of the web page for interested visitors to click on if they wanted to participate.
|
From page 87... ...
1 14.3 Completed questionnaires divided by potential respondents 1 14.3 Response rate was calculated based on distributed paper surveys and collected onboard paper surveys. For personal interviews, based on number of people on the bus and number of people actually interviewed.
|
From page 88... ...
88 Survey data set was clean Frequency Percent Strongly agree 6 35.3 Agree 9 52.9 Neutral 2 11.8 Total 17 100 Respondents completed nearly every question of survey Frequency Percent Strongly agree 7 41.2 Agree 10 58.8 Total 17 100 Weighted data for most recent OS survey Count Column (%) Did not weight data 11 64.7 Weighted based on ridership/traffic 5 29.4 Weighted based on demographics 2 11.8 Weighted data for most recent OS survey Weighted based on other factors Success of survey Frequency Percent Very successful 7 41.2 Successful 9 52.9 Neither successful nor unsuccessful 1 5.9 Total 17 100 Reason for administering survey with more than one method Frequency Percent Same answer as previous question 1 25.0 The paper-based survey is a tightly controlled, stratified sample based on a random selection of cars on a sample of trains.
|
From page 89... ...
General public 4 23.5 Customers 4 23.5 Constituents 5 29.4 Internal clients/management 16 94.1 External clients 4 23.5 Faculty/staff/students 2 11.8 Other, please specify 1 5.9 Results of OS survey presented to Research results were not presented
|
From page 90... ...
Web-Based Survey Specifics Primary reason for not conducting web-based surveys Frequency Percent Ability to get a broad sample 1 4.2 Biased against customers who have no access to Internet 1 4.2 Captive market of user onboard the vehicle; agency wanted data on users. 1 4.2 1 4.2 I do not like self-selected samples.
|
From page 91... ...
Therefore, we have the opportunity to e-mail them a survey, but we need to create the questionnaire online, something we have not done yet. 1 4.2 1 4.2 Total 24 100 Other reason for not conducting web-based surveys Frequency Percent It would build-in response biases, based upon accessibility to the Internet.
|
From page 92... ...
This works well because it is used by employers with employees who have web access, it simplifies data entry and process and allows for immediate results. Primary reason for conducting web-based surveys Frequency Percent Ability to present complicated subject matter, question design, and graphics 1 9.1 1 9.1 Cost 1 9.1 Ease of access to downtown workforce 1 9.1 Efficiency 1 9.1 High-quality database/complete answers 1 9.1 They are a convenient means of collecting information.
|
From page 93... ...
Cannot tell who is not represented from survey data. 1 14.3 Fairly low response rates compared with other modes 1 14.3 May not represent a cross section of our ridership 1 14.3 Not tangible 1 14.3 Survey takes a lot of time; lots of technical glitches 1 14.3 You cannot calculate statistical precision from nonrandom samples.
|
From page 94... ...
1 9.1 Make certain to incorporate with other methods, complementary methods to get greater response. 1 9.1 None 1 9.1 None to offer 1 9.1 Total 11 100 Other advice offered to transit organizations considering web-based surveys Frequency Percent Check out the latest web survey services.
|
From page 95... ...
1 9.1 1 9.1 To gather a large sample 1 9.1 1 9.1 1 9.1 Total 11 100 Other objective of web survey Frequency Percent Stated preference sensitivity factors 1 50.0 Test messaging 1 50.0 Total 2 100 How web survey was designed Frequency Percent Designed in-house using web page layout software 2 18.2 Designed with an online survey development tool 3 27.3 Contracted out to a consulting or web development firm 6 54.5 Total 11 100 How and where web survey was hosted Frequency Percent Hosted on your own organization's computers 3 27.3 Hosted by a consulting or web development firm 5 45.5 Hosted by a survey provider 3 27.3 Total 11 100 Evaluate features of a cross-agency regional fare card To gain a greater understanding of what it takes to get people to ride the express buses from Pennsylvania and western New Jersey to Newark and NYC
|
From page 96... ...
Neither similar nor different Different Count Percent Count Percent Question ordering 3 27.30 Question wording 3 27.30 Page format 3 27.30 2 18.20 Use of skip patterns 3 27.30 1 9.10 Other comparison of web questionnaire to other versions 2 50.00 How survey questionnaire differs from other web versions (continued) Very different Total Count Percent Count Percent Question ordering 11 100.00 Question wording 11 100.00 Page format 11 100.00 Use of skip patterns 11 100.00 Other comparison of web questionnaire to other versions 1 25.00 4 100.00
|
From page 97... ...
97 Other comparison of web questionnaire to other versions Frequency Percent Internal error checking 1 25.0 Not applicable; the survey was only web-based 1 25.0 There were no other questionnaires 1 25.0 Void 1 25.0 Total 4 100 Days in field Frequency Percent Do not know 3 27.3 7 1 9.1 21 1 9.1 30 1 9.1 35 1 9.1 45 1 9.1 60 1 9.1 90 2 18.2 Total 11 100 Number of recruits Frequency Percent Do not know 9 81.8 1,000 1 9.1 No sample 1 9.1 Total 11 100 Number of completes Frequency Percent Don't know 3 27.3 20 1 9.1 210 1 9.1 250 1 9.1 501 1 9.1 1,000 1 9.1 2,809 1 9.1 4,000 1 9.1 10,460 1 9.1 Total 11 100 Number of incompletes Frequency Percent Do not know 8 72.7 0 2 18.2 5 1 9.1 Total 11 100
|
From page 98... ...
98 Web-based percentage of completes Frequency Percent Don't know 2 18.2 5 1 9.1 10 1 9.1 80 1 9.1 90 1 9.1 100 5 45.5 Total 11 100 Support provided to web respondents Count Column (%) Toll-free telephone number 2 20 E-mail support 3 30 Link with FAQs Links with context-specific help on web page 1 10 Other, please specify None of above 5 50 Survey design plan followed to conduct research Frequency Percent In-house expertise 5 45.5 Survey design software instructions 1 9.1 Other, please specify 1 9.1 Did not follow a survey design plan 1 9.1 Do not know 3 27.3 Total 11 100 Other survey design plan Frequency Percent E-mails sent by individual agencies to their own lists of customers 1 100 Collect geographical information in web survey Frequency Percent Yes, data coded by latitude and longitude 7 63.6 Yes, data coded by zip code 4 36.4 Total 11 100 Have used online geocoding in any web surveys conducted Frequency Percent No 11 100
|
From page 99... ...
or sender authentication Tools to identify common phrases used in spam 1 9.1 Other, please specify 3 27.3 Don't know 3 27.3 Ways to ensure e-mail invitations not considered spam Nothing 3 27.3 Other methods used to ensure e-mail not considered spam Frequency Percent Did not solicit via e-mail, and if I checked this off earlier, I was wrong. 1 33.3 Did not use e-mail invitations 1 33.3 Use e-mail from transit agencies to existing customers 1 33.3 Total 3 100 Reminded respondents to take survey Frequency Percent Yes 4 36.4 No 7 63.6 Total 11 100 Number of times reminded respondents Frequency Percent 1 2 50 2 1 25 3 1 25 Total 4 100 Types of reminders used for web survey Count Column (%)
|
From page 100... ...
Hosting costs 8 72.7 Recruitment costs 4 36.4 Incentive costs 3 27.3 Types of costs associated with web survey Other, please specify 3 27.3 Other costs associated with web survey Frequency Percent Programming 1 33.3 Staff costs 1 33.3 Survey was part of overall study 1 33.3 Total 3 100
|
From page 101... ...
101 Most important Best Practice for conducting web-based research Frequency Percent Careful selection of representative sample for population/market being surveyed 1 9.1 Clearly identify sender and purpose of the e-mail invitations 1 9.1 Develop a willing database of respondents with interest in transit 1 9.1 Do not use e-mail or the web to recruit 1 9.1 Keep it simple; if it is too long and too detailed, you'll lose your respondents. 1 9.1 Make sure sources are reliable, reputable 1 9.1 Make survey consistent with other methods 1 9.1 None 1 9.1 Sample size large enough to support inferences 1 9.1 Thorough testing of the survey tool 1 9.1 Understanding and accounting for all of the sampling biases 1 9.1 Total 11 100 Second most important Best Practice for conducting web-based research Frequency Percent Budget enough time and resources.
|
From page 102... ...
Frequency Percent Allowing a respondent to save a long survey and return to it later, or print it out to be filled out 1 9.1 Approach it with creativity and a sense of humor 1 9.1 Convenient access for target audience 1 9.1 Do not force responses 1 9.1 Do not know 1 9.1 Don't spend 90% gathering 1 9.1 Logical progression of screens/questions 1 9.1 Make sure survey is not too long or repetitive as this will reduce data quality. 1 9.1 None 1 9.1 Remind people 1 9.1 Yes 1 9.1 Total 11 100 Information about current web-based research Frequency Percent It was not a panel survey so much as it was a longitudinal telephone survey 1 33.3 1 33.3 We didn't do a panel study, and if I indicated this earlier, I was wrong.
|
From page 103... ...
11 31.40 13 37.10 Rate organization: Promotes customer research 9 26.50 16 47.10 Rate organization: Promotes communication of research results to customers 5 14.30 8 22.90
|
From page 104... ...
7 20.00 3 8.60 Rate organization: Promotes customer research 5 14.70 3 8.80 Rate organization: Promotes communication of research results to customers 14 40.00 5 14.30 Rate organization: Promotes web-based customer research 3 8.60 35 100.00 Rate organization: Promotes web/Internet initiatives (other than web-based customer research) 1 2.90 35 100.00 Rate organization: Promotes customer research 1 2.90 34 100.00 Rate organization: Promotes communication of research results to customers 3 8.60 35 100.00 Involved with web-based surveys that affected transit research Frequency Percent Yes 10 28.6 No 25 71.4 Total 35 100 Description of research Frequency Percent No answer 8 80 1 10 1 10 Total 10 100
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.