DRAFT Faculty, Survey Nonresponse, and Organizational Citizenship Behavior: A Population Profiling Study Kiernan R. Mathews Harvard University Paper/Poster presented at the annual meeting of the Association for the Study of Higher Education November 22, 2014 Abstract: This study introduces an organizational citizenship behavior (OCB) framework and the population profiling method to explore survey nonresponse among college faculty. Four OCB subscales are measured and compared among survey respondents, passive nonrespondents, and active nonrespondents under an analytical approach including chi-square, linear regression, and MANOVA.
20
Embed
Faculty, Survey Nonresponse, and Organizational ...scholar.harvard.edu/files/kmathews/files/ashe2014_kiernanmathews...DRAFT FACULTY, SURVEY NONRESPONSE, AND ORGANIZATIONAL CITIZENSHIP
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
DRAFT
Faculty, Survey Nonresponse, and Organizational Citizenship Behavior: A Population Profiling Study
Kiernan R. Mathews Harvard University
Paper/Poster presented at the annual meeting
of the Association for the Study of Higher Education
November 22, 2014 Abstract: This study introduces an organizational citizenship behavior (OCB) framework and the population profiling method to explore survey nonresponse among college faculty. Four OCB subscales are measured and compared among survey respondents, passive nonrespondents, and active nonrespondents under an analytical approach including chi-square, linear regression, and MANOVA.
DRAFTFACULTY, SURVEY NONRESPONSE,
AND ORGANIZATIONAL CITIZENSHIP BEHAVIOR: A POPULATION PROFILING STUDY
College and university leaders have come to rely increasingly on surveys of students,
staff, and faculty to inform accreditation, compliance, accountability, and improvements to
Note: NR = Nonrespondents. Effect size is Cohen’s d.
† p<.10, *p<.05, **p<.01.
Faculty, Survey Nonresponse, and O
rganizational Citizenship B
ehavior 13
DRAFT
Faculty, Survey Nonresponse, and Organizational Citizenship Behavior 14
FIGURES
Figure 1. Central tendency and spread of the canonically derived OCB supervariable (z-score)
for respondents, passive nonrespondents, and active nonrespondents.
DRAFT
Faculty, Survey Nonresponse, and Organizational Citizenship Behavior 15
Figure 2. Central tendency and spread of four OCB subscale estimates (z-scores) for
respondents, passive nonrespondents, and active nonrespondents.
DRAFT
Faculty, Survey Nonresponse, and Organizational Citizenship Behavior 16
REFERENCES
Barge, S. & Gehlbach, H. (2012). Using the theory of satisficing to evaluate the quality of survey data. Research in Higher Education, 53(2), 182-200.
Barr, C., Spitzmüller, C., & Stuebing, K. (2008). Too stressed out to participate? Examining the
relation between stressors and survey response behavior. Journal of Occupational Health Psychology, 13(3), 232-243.
Blackburn, R. T. & Lawrence, J. H. (1995). Faculty at work: Motivation, expectation,
satisfaction. Baltimore: Johns Hopkins University Press. Bradburn, N. M. (1978). Respondent burden. Paper presented at the American Statistical
Association, Proceedings of the Survey Research Methods Section. Brennan, M. & Hoek, J. (1992). The behavior of respondents, nonrespondents, and refusers
across mail surveys. Public Opinion Quarterly 56(4), 530-535. Brüggen, E. & Dholakia, U. M. (2010). Determinants of participation and response effort in web
panel surveys. Journal of Interactive Marketing 24(3), 239–250. Cote, L. S., Frinnell, R. E., & Tompkins, L. D. (1986). Increasing response rates to mail surveys:
the impact of adherence to Dillman-like procedures and techniques. Review of Higher Education, 9(2), 229-242.
Couper, M. & Groves, R. (1996). Social environmental impacts on survey cooperation. Quality
and Quantity, 30(2), 173-188. de Leeuw, E. & de Heer, W. (2002). Trends in household survey nonresponse: a longitudinal and
international comparison. In R.M. Groves, D.A. Dillman, J.L. Eltinge & R.J.A. Little (Eds.), Survey nonresponse, 41-54. New York: Wiley.
Dooley, L. M. & Lindner, J. R. (2003). The handling of nonresponse error. Human Resource
Development Quarterly, 14(1), 99-110. Finkelstein, M. J., Seal, R. K., & Schuster, J. H. (1998). The new academic generation: A
profession in transformation. Baltimore: Johns Hopkins University Press. Goyder, J. (1986). Surveys on surveys: Limitations and potentialities. Public Opinion Quarterly,
50(1), 27-41. Grosset, J. M. (1995). The biasing effects of bad addresses on information gathered by mail
surveys. Journal of Applied Research in the Community College, 2(2), 179-191.
DRAFT
Faculty, Survey Nonresponse, and Organizational Citizenship Behavior 17
Hoffman, B. J., Blair, C. A., Meriac, J. P., & Woehr, D. J. (2007). Expanding the criterion domain? A quantitative review of the OCB literature. Journal of Applied Psychology, 92(2), 555-566.
Huberty, C. J. & Petoskey, M. D. (2000). Multivariate analysis of variance and covariance. In H.
Tinsley and S. Brown (Eds.) Handbook of applied multivariate statistics and mathematical modeling. New York: Academic Press.
Hurtado, S., Eagan, M. K., Pryor, J. H., Whang, H., & Tran, S. (2012). Undergraduate teaching
faculty: The 2010–2011 HERI Faculty Survey. Los Angeles: Higher Education Research Institute, UCLA.
Ilies, R., Fulmer, I. S., Spitzmüller, M., & Johnson, M. (2009). Personality and citizenship
behavior: The mediating role of job satisfaction. Journal of Applied Psychology, 94(4), 945-959.
Jones, J. (1996). The effects of non-response on statistical inference. Journal of Health and
Social Policy, 8, 49-62. Kim, J., Gershenson, C., Glaser, P., & Smith, T. W. (2011). The polls: trends in surveys on
surveys. Public Opinion Quarterly, 75(1), 165-191. LePine, J. A., Erez, A., & Johnson, D. E. (2002). The nature and dimensionality of
organizational citizenship behavior: A critical review and meta-analysis. Journal of Applied Psychology, 87, 52–65.
Lindner, J. R., Murphy, T. H., & Briers, G. H. (2001). Handling nonresponse in social science
research. Journal of Agricultural Education, 42 (4), 43-53. Menachemi, N. (2011). Assessing response bias in a web survey at a university faculty.
Evaluation & Research in Education, 24(1), 5-15. Meyers, L. S., Gamst, G., & Guarino, A. (2006). Applied multivariate research: Design and
interpretation. Thousand Oaks, CA: Sage Publishers. O’Meara, K., Terosky, A. L., & Neumann, A. (2008). Faculty careers and work lives: A
professional growth perspective. San Francisco: Jossey-Bass. Organ D.W. (1988). Organizational citizenship behavior: The good soldier syndrome.
Lexington, MA: Lexington Books. Peterson, M. W., Einarson, M. K., Augustine, C. H., & Vaughan, D. S. (1999). Institutional
support for student assessment: Methodology and results of a national survey. Stanford, CA: National Center for Postsecondary Improvement.
DRAFT
Faculty, Survey Nonresponse, and Organizational Citizenship Behavior 18
Peytcheva, E. & Groves, R.M. (2009). Using variation in response rates of demographic subgroups as evidence of nonresponse bias in survey estimates. Journal of Official Statistics 25(2), 193-201.
Podsakoff, P. M., MacKenzie, S. B., & Moorman, R. H. (1990). Transformational leader
behaviors and their effects on followers’ trust in leader, satisfaction, and organizational citizenship behaviors. Leadership Quarterly, l(2), 107-142.
Podsakoff, P. M., MacKenzie, S. B., Paine, J. B., & Bachrach, D. G. (2000). Organizational
citizenship behaviors: A critical review of the theoretical and empirical literature and suggestions for future research. Journal of Management, 26, 513-563.
Porter, S. R. & Umbach, P. (2006). Student survey response rates across institutions: Why do
they vary? Research in Higher Education, 47(2), 229-247. Porter, S. R. & Whitcomb, M. E. (2005). Non-response in student surveys: the role of
demographics, engagement, and personality. Research in Higher Education, 46(2), 127-152.
Rogelberg, S. G. & Luong, A. (1998). Nonresponse to mailed surveys: A review and guide.
Current Directions in Psychological Science, 7(2), 60-65. Rogelberg, S. G., Luong, A., Sederburg, M. E., & Cristol, D. S. (2000). Employee attitude
surveys: Examining the attitudes of noncompliant employees. Journal of Applied Psychology, 85(2), 284-293.
Rogelberg, S. G., Conway, J. M., Sederburg, M. E., Spitzmüller, C., Aziz, S., & Knight, W. E.
(2003). Profiling active and passive nonrespondents to an organizational survey. Journal of Applied Psychology, 88(6), 1104-1114.
Rogelberg, S. G., Spitzmüller, C., Little, I., & Reeve, C. L. (2006). Understanding response
behavior to an online special topics organizational satisfaction survey. Personnel Psychology, 59(4), 903-923.
Rogelberg, S. G. & Stanton, J. M. (2007). Introduction: understanding and dealing with
organizational survey nonresponse. Organizational Research Methods, 10(2), 195-209. Schiltz, M. E. (1988). Professional standards for survey research. Research in Higher Education,
28(1), 67-75. Schuster, J. H. & Finkelstein, M. J. (2006). The American faculty: The restructuring of academic
work and careers. Baltimore: Johns Hopkins University Press. Snover, L., Terkla, D. G., Kim, H., Decarie, L., Brittingham, B. (2010, June) NEASC
Commission on Higher Education Requirements for Documentation of Assessment of Student Learning and Student Success in the Accreditation Process: Four Case Studies. In
DRAFT
Faculty, Survey Nonresponse, and Organizational Citizenship Behavior 19
J. Carpenter-Hubin (Chair), Charting Our Future in Higher Education. 50th Annual Forum of the Association for Institutional Research (AIR), Chicago, IL.
Sosdian, C. P. & Sharp, L. M. (1980). Nonresponse in mail surveys: Access failure or respondent
resistance. Public Opinion Quarterly, 44, 396-402. Spitzmüller, C., Glenn, D. M., Barr, C. D., Rogelberg, S. G., & Daniel, P. (2006). “If you treat
me right, I reciprocate”: Examining the role of exchange in organizational survey response. Journal of Organizational Behavior, 27(1), 19-35.
Spitzmüller, C., Glenn, D. M., Sutton, M. M., Barr, C. D., & Rogelberg, S. G. (2007). Survey
nonrespondents as bad soldiers: Examining the relationship between organizational citizenship and survey response behavior. International Journal of Selection & Assessment, 15(4), 449-459.
Taris, T. W. & Schreurs, P. J. G. (2007). How may nonresponse affect findings in organizational
surveys? The tendency-to-the-positive effect. International Journal of Stress Management, 14(3), 249-259.
Werner, S., Praxedes, M., & Kim, H. G. (2007). The reporting of nonresponse analyses in survey
research. Organizational Research Methods, 10(2), 287-295. Williams, L.I. & Anderson, S.E. (1991). Job-satisfaction and organizational commitment as
predictors of organizational citizenship and in-role behaviors. Journal of Management 17(3), 601-617.
Youssefnia, D. (2001). Examining organizational survey response through an organizational
citizenship framework. (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses (275927939).