Gender Genre and CPR Theory

Imag

e: ©

flic

kr/s

rqpi

x C

C B

Y 2.

0

GENDER/GENRE: GENDER DIFFERENCES IN PROFESSIONAL WRITING(?)

Brian N. Larson January 26, 2015

www.Rhetoricked.com @Rhetoricked

Housekeeping

•  Communications: See slide footer . . . – www.Rhetoricked.com (these slides + some

additional) – Twitter: @Rhetoricked –  [email protected]

•  Research supported by: –  Graduate Research Partnership Program fellowship (U

of M CLA), 2012 –  James I. Brown Summer Research Fellowship, 2014


Your visitor •  Brian N. Larson •  Ph.D. candidate:

Rhetoric and S&TC •  University of Minnesota •  Practicing attorney

–  14 years –  Focus on Internet, including

copyrights, trademarks, privacy, and media law


My disciplinary profile exemplifies “mixed methods”

Teaching experience •  Technical and

professional comm’n •  Science, technology,

and law •  Argumentative writing •  First-year comp •  Legal writing (law

students)

Research •  Inquiry focused on

production of texts in professional and technical contexts

•  Mixed methods, including quantitative, qualitative, hermeneutic


Today’s topic: Do women and men write differently?

•  The answer: It depends. •  Before: Stylistic differences common in

studies – Often not clear how gender was ascribed – Texts in mixed genres (or no genres) – No common sense of goals or stakes among

writers •  Now: Some differences, but not the old

patterns. Why?


I chose texts written late in the first year of law training

•  Law students at most law schools must write a brief or memorandum as their final writing project in legal writing at end of “1L” year

•  Usually in the form of a motion to dismiss or motion for summary judgment

•  In response to a hypothetical case set by the teacher or legal writing program


Gendered authors did not write genred texts differently

•  How should we assess difference? – Stylistic characteristics (though other

possibilities exist) •  What is a genred text? Writer

perceives . . . – Conventional forms and shared social

objectives – Social stakes associated with conformity

•  What is a gendered author?


This study used an ad hoc gender research construct

•  When I talk about my own data, I’ll refer to – Gender F authors/writers: “Female,”

“Feminine”, “Fem,” “F” – Gender M authors/writers: “Male,” “Masculine,”

“M” •  These categories may or may not

correspond to other researchers’ –  {woman, female, feminine} –  {man, male, masculine}


This study examined stylistic features (variables)

•  For now, those of Argamon et al. 2003 •  Relative frequencies of

–  429 “function words” (Argamon used 405) –  45 parts of speech from the Penn Treebank

tagset (Argamon used 76 BNC POS tags) –  100 common part-of-speech bigrams –  500 common POS trigrams – Other features, including varieties of pronouns

and contractions


I calculated mean relative frequencies

•  For each feature – Mean relative frequency (SD) for Gender F

authors – Mean relative frequency (SD) for Gender M

authors – Statistical significance assessed with Mann-

Whitney U test (expressed as p-value) •  A priori threshold for significance: 0.05


I compared results to Argamon et al. 2003

•  Used 500 published texts from BNC •  Mean 34,000 words (‘tokens’) per text •  Statistical analysis showed

correspondence to Biber’s (1995) “informational/involved” dimension


Biber’s informational/involved dimension figured in earlier studies

•  Biber (1995) labeled this a dimension of register variation after doing cluster analyses on frequencies to identify co-varying features as “dimensions”

•  Consistent with popular conceptions and works such as Tannen (1990 [2001]) that characterize women as “affiliative” and men as “informative”


Argamon: Features males used more vs. present study


Argamon: Features females used more v. present study


And the pronouns


The take-away?

•  Statistics: The non-significant differences should probably be regarded as non-significant –  In that case, M-informational/F-involved is not

confirmed in this study •  If the non-significant differences are taken

as suggestive – Evidence for M-informational/F-involved is still

mixed, especially in pronouns and present-tense verbs


Cognitive pragmatic rhetorical (CPR) theory

•  Grounded in relevance theory, a cognitive theory of linguistic pragmatics (Sperber & Wilson, 1995)

•  Enhanced with relevance philosophy of Alfred Schutz (1973, 1964, 1966)

•  HT to Straßheim (2010), who bridged them •  My own additions from rhetoric, cognitive

science, cognitive linguistics, and psycholinguistics


CPR: The stage is set for production

•  Writer and reader have “cognitive environments,” presently accessible –  Assumptions (“representations” or beliefs about

the world) –  Emotions –  Goals

•  In RT terms, the writer’s cognitive environment is “manifest” to her

•  Her meta-representations about reader’s CE are “mutually manifest”


CPR: Writer’s process

•  Writer seeks to modify reader’s CE – Making some assumptions, emotions, or goals

manifest, or more manifest than others •  Relevance: Writer balances

– Effort: Attention, invention, conscious stylistic choices (heuresis and lexis).

– Effect: Writer’s goals, modifications she seeks in reader’s CE

– Default: Habitual choice will always be easiest to “find”


CPR: Reader’s process

•  Reader seeks to achieve his goals – To be educated, delighted, or moved

•  Relevance: Reader balances – Effort: Attention, heuristic comprehension

where stimuli are expected, “search costs” where stimuli are unexpected

– Effect: Advancing reader’s goals •  The most accessible interpretation is the

best one (though not always correct)


Explaining my findings with CPR theory

•  If children are acculturated to writing in certain genres and on certain topics in their youths depending on gender . . .

•  . . . they may unconsciously habituate to certain stylistic choices

•  . . . and may vary their habitual stylistic choices later with great effort –  Diminished relevance in most studies makes this

unlikely –  Communicative production will likely be habitual


Confronted with high-stakes social situation and conventional genre . . .

•  The effect side of the relevance ratio gets much more weight –  Increase in relevance makes variation from

habit likely – Students here exhibited that


CPR explains genre stability and dynamism generally

•  Varying from genre conventions imposes processing costs on the reader

•  Sometimes, writer can seek to achieve her own goals only by breaking conventions

•  But she has to “sell” it to the reader – Alter the reader’s CE to perceive the

communication as having greater potential effects and therefore . . .

–  . . . being worthy of greater processing effort


Question and answer and Thank You!

•  Communications: – www.Rhetoricked.com (these slides + many

bonus slides) – Twitter: @Rhetoricked –  [email protected]

•  Research supported by: –  Graduate Research Partnership Program fellowship (U

of M CLA), 2012 –  James I. Brown Summer Research Fellowship, 2014


BONUS SLIDES

•  These slides contain additional information that may be valuable for context for this talk

•  At the end are my works cited


Many researchers have asked

•  Do men and women communicate differently?

•  Much work inspired by Robin Lakoff (1975) •  Scholarly and popular works by Deborah

Tannen (e.g. 1990[2001]) and others •  Much of this research in oral/face-to-face

communication


Writing: Process and product

•  In writing studies, we can (roughly) divide process and product – Do men and women produce writing using

different processes? –  Is the writing they produce distinguishable

based on author gender?


Previous studies: Process research

•  Focus on interpersonal communications in mixed-gender contexts – Lay, 1989 (Schuster); Rehling, 1996; Raign

& Sims, 1993; Ton & Klecun, 2004; Wolfe & Alexander, 2005; Brown & Burnett, 2006; Wolfe & Powell, 2006, 2009.


Previous studies: Product research

•  In technical and professional communication – Sterkel, 1988 (20 stylistic chars) – Smeltzer & Werbel, 1986 (16 stylistic and

evaluative measures) – Tebeaux, 1990 (quality of responses) – Allen, 1994 (markers of authoritativeness)

•  Manual methods, small samples


Gender in computer-mediated communication (CMC)

•  CMC popular for NLP studies –  Data are readily available –  Data are voluminous

•  Examples –  Herring & Paolillo, 2006 (blog posts, stat analysis) –  Yan & Yan, 2006 (blog posts, MLA analysis) –  Argamon et al., 2007 (blog posts, MLA analysis) –  Rao et al., 2010 (Twitter, MLA analysis) –  Burger et al., 2011 (Twitter, MLA analysis)


Rationale: Why is the question important?

•  Lend support to one or more theories of gender –  ‘Two cultures’ (Maltz & Borker, 1982) –  ‘Standpoint’ (Barker & Zifcak, 1999) –  ‘Performative’ (Butler 1993, 1999, 2004) – Others

•  Sorting out methodological problems, particularly use of gender as a variable


Study design goals

•  Research questions –  Did Gender F and Gender M writers in a disciplinary

genre in which they are being trained use lexical and quasi-syntactic stylistic features with relative frequencies that varied with their genders?

–  If so, did the differences appear in interpretable patterns?

•  Examine a corpus of texts –  All of the same genre –  Where we can be confident of single authorship –  Where author gender is self-identified


Data collection

•  Major writing project at end of first year of law school – Students address hypothetical problem

(writing in same ‘genre’) – Students not allowed to collaborate – Plagiarism difficult (but still possible)

•  Students self-identified gender* •  193 texts (mean word tokens = 3764) *This study IRB-approved (UMN Study #1202E10685)


Gender construct in my study

•  Gender construct: “A loosely and culturally defined set of social behaviors that are expected to make it possible to distinguish persons of the two most common sexes from each other.”

•  Susceptible to application of gender label – Gender F (corresponding to Sex F): “female,”

“feminine,” “woman” – Gender M (corresponding to Sex M): “male,”

“masculine,” “man”


Gender ascription in my study

•  Series of “demographic” questions in survey

•  “Gender:” followed by open box allowing free-form response

•  Problem?


Proliferation of labels Response

Number of participants

Not answered 4 Cis Male 1

F 5 Fem 1

Female 95 female 3

M 3 Male 84

Masculine 1 Grand Total 197


My job: Make an argument

•  That these responses can be classed together as Gender M –  Cis Male –  M –  Male –  Masculine

•  And these as Gender F –  F –  Fem –  F/female


Text genre: Memorandum regarding motion to dismiss

•  Written to hypothetical court •  Supporting or opposing a motion before

the court •  High-level organization is formulaic


r

•  t


Memorandum Sections

•  Caption** •  Introduction/summary* •  Facts •  Legal standard of review* •  Argument •  Conclusion •  Signature block**

* Not always present. **I did not analyze (content is highly formulaic)


NLP methods allow larger corpora to be analyzed

•  Natural language processing (NLP) •  Allows processing of large quantities of

text data •  Study that attracted my attention

– Koppel, Argamon & Shimoni, 2002 (machine-learning algorithms)

– Argamon et al., 2003 (statistical analysis) –  I’ll focus on Argamon et al. in this talk


What are ‘Part-of-speech’ tags? ‘Bigrams & trigrams’?

•  First, ‘tokenize’ each sentence (automated): –  ‘My aunt’s pen is on the table.’


POS tags were assigned and tallied

•  Purple words are function words

•  Tag the parts of speech (automated) •  Then calculate relative frequency of

function words and POS tags (automated)


POS bigrams and trigrams were assigned and tallied

•  A bigram or trigram is a 2- or 3-token ‘window’ on the sentence. –  Automated calculation


Other stylistic features were tallied

•  First-person pronouns (total) –  Singular: I, me, my, mine, myself. –  Plural: We, us, our, ours, ourselves.

•  Second-person pronouns: You, your, yours, yourself. •  Third-person pronouns (total)

–  Singular (total) •  Feminine: She, her, hers, herself. •  Masculine: He, him, his, himself.

–  Plural: They, them, their, theirs, themselves. •  Contractions: Including all instances of n’t, ’ld, ’ve, etc. •  All relative frequencies calculated (automated)


Situating the findings within gender & language theories

•  Findings weakly support or contradict – Two sociolinguistic cultures view (Maltz &

Borker 1982; Tannen 1990 [2001]) –  Intersectionality/performativity views (Barker &

Zifcak 1999; Butler; many others) •  Some gendered linguistic habits appeared

to resist retraining and conscious efforts to conform to register conventions . . .

•  . . . others were apparently overcome.


Are “gender” and “genre” the same?

•  Gender –  < Old French gen(d)re (French genre) = Spanish

and Portuguese genero, Italian genere, < Latin gener- stem form of genus race, kind

•  Genre –  < French genre kind: see gender n. –  ”a. Kind, sort, class; also, genus as opposed to

species”

¡  Oxford English Dictionary (n.d.). "gender, n.". Retrieved from http://www.oed.com/viewdictionaryentry/Entry/77468


Works cited Allen, J. (1994). Women and authority in business/technical communication scholarship: An analysis of writing... Technical Communication Quarterly, 3(3), 271. Argamon, S., Koppel, M., Fine, J., & Shimoni, A. R. (2003). Gender, genre, and writing style in formal written texts. Text, 23(3), 321–346. Argamon, S., Koppel, M., Pennebaker, J. W., & Schler, J. (2007). Mining the Blogosphere: Age, gender and the varieties of self-expression. First Monday, 12(9). Retrieved from http://firstmonday.org/issues/issue12_9/argamon/index.html Armstrong, C. L., & McAdams, M. J. (2009). Blogs of information: How gender cues and individual motivations influence perceptions of credibility. Journal of Computer-Mediated Communication, 14(3), 435–456. Barker, R. T., & Zifcak, L. (1999). Communication and gender in workplace 2000: creating a contextually-based integrated paradigm. Journal of Technical Writing & Communication, 29(4), 335. Biber, D. (1995). Dimensions of register variation  : a cross-linguistic comparison. Cambridge  ;;New York: Cambridge University Press. Bird, S., Klein, E., & Loper, E. (2009). Natural Language Processing with Python (1st ed.). O’Reilly Media. Brown, S. M., & Burnett, R. E. (2006). Women hardly talk. Really! Communication practices of women in undergraduate engineering classes (pp. T3F1–T3F9). Presented at the 9th International Conference on Engineering Education, San Juan, Puerto Rico: International Network for Engineering Education & Research. Retrieved from http://ineer.org/Events/ICEE2006/papers/3219.pdf Burger, J., Henderson, J., Kim, G., & Zarrella, G. (2011). Discriminating gender on Twitter. Bedford, MA: MITRE Corporation. Retrieved from http://www.mitre.org/work/tech_papers/2011/11_0170/

Butler, J. (1993). Bodies that matter: on the discursive limits of“ sex.” New York: Routledge. Butler, J. (1999). Gender trouble. New York: Routledge. Butler, J. (2004). Undoing gender. New York: Routledge. Cunningham, H., Maynard, Diana, Bontcheva, K., Tablan, V., Aswani, N., Roberts, I., … Peters, W. (2012, December 28). Developing Language Processing Components with GATE Version 7 (a User Guide). GATE: General Architecture for Text Engineering. Retrieved January 1, 2013, from http://gate.ac.uk/sale/tao/split.html Cunningham, H., Tablan, V., Roberts, A., & Bontcheva, K. (2013). Getting More Out of Biomedical Documents with GATE’s Full Lifecycle Open Source Text Analytics. PLoS Computational Biology, 9(2), e1002854. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009). The WEKA Data Mining Software: An Update. SIGKDD Explorations, 11(1), 10–18. Herring, S. C., & Paolillo, J. C. (2006). Gender and genre variation in weblogs. Journal of Sociolinguistics, 10(4), 439–459. Koppel, M., Argamon, S., & Shimoni, A. R. (2002). Automatically categorizing written texts by author gender. Literary and Linguistic Computing, 17(4), 401 –412. Lakoff, R. T. (1975/2004). Language and Woman’s Place: Text and Commentaries. (M. Bucholtz, Ed.) (Revised and expanded ed.). New York: Oxford University Press.


Works cited Lay, M. M. (1989). Interpersonal conflict in collaborative writing: What we can learn from gender studies. Journal of Business and Technical Communication, 3(2), 5–28. Maltz, D. N., & Borker, R. (1982). A cultural approach to male-female miscommunication. In J. J. Gumperz (Ed.), Language and social identity (pp. 196–216). Cambridge U.K.: Cambridge University Press. Pakhomov, S. V., Hanson, P. L., Bjornsen, S. S., & Smith, S. A. (2008). Automatic classification of foot examination findings using clinical notes and machine learning. Journal of the American Medical Informatics Association, 15, 198–202. Raign, K. R., & Sims, B. R. (1993). Gender, persuasion techniques, and collaboration. Technical Communication Quarterly, 2(1), 89–104. Rao, D., Yarowsky, D., Shreevats, A., & Gupta, M. (2010). Classifying latent user attributes in Twitter. In Proceedings of the 2nd international workshop on Search and mining user-generated contents (pp. 37–44). Toronto, ON, Canada: ACM. Rehling, L. (1996). Writing together: Gender’s effect on collaboration. Journal of Technical Writing and Communication, 26(2), 163–176. Smeltzer, L. R., & Werbel, J. D. (1986). Gender differences in managerial communication: Fact or folk-linguistics? Journal of Business Communication, 23(2), 41–50. Sperber, D., & Wilson, D. (1995). Relevance: Communication and Cognition (2nd ed.). Wiley-Blackwell. Sterkel, K. S. (1988). The relationship between gender and writing style in business communications. Journal of Business Communication, 25(4), 17–38. Tannen, D. (2001). You Just Don’t Understand: Women and Men in Conversation. William Morrow Paperbacks. Tebeaux, E. (1990). Toward an understanding of gender differences in written business communications: A suggested perspective for future research. Journal of Business and Technical Communication, 4(1), 25–43.

Tong, A., & Klecun, E. (2004). Toward accommodating gender differences in multimedia communication. Professional Communication, IEEE Transactions on, 47(2), 118–129. Wolfe, J., & Alexander, K. P. (2005). The computer expert in mixed-gendered collaborative writing groups. Journal of Business and Technical Communication, 19(2), 135–170. Wolfe, J., & Powell, B. (2006). Gender and expressions of dissatisfaction: A study of complaining in mixed-gendered student work groups. Women & Language, 29(2), 13–20. Wolfe, J., & Powell, E. (2009). Biases in interpersonal communication: How engineering students perceive gender typical speech acts in teamwork. Journal of Engineering Education, 98(1), 5–16. Yan, X., & Yan, L. (2006). Gender classification of weblog authors. In AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs (pp. 228–230).