Journal Article
Machine Learning

Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach

H. Andrew Schwartz(University of Pennsylvania), Johannes C. Eichstaedt(University of Pennsylvania), Margaret L. Kern(University of Pennsylvania), Lukasz Dziurzynski(University of Pennsylvania), Stephanie M. Ramones(University of Pennsylvania), Megha Agrawal(University of Pennsylvania), Achal Shah(University of Pennsylvania), Michał Kosiński(University of Cambridge), David Stillwell(University of Cambridge), Martin E. P. Seligman(University of Pennsylvania), Lyle Ungar(University of Pennsylvania)
September 25, 2013PLoS ONE1,751 citations

1.8k

Citations

125

Influential Citations

PLoS ONE

Venue

2013

Year

Abstract

We analyzed 700 million words, phrases, and topic instances collected from the Facebook messages of 75,000 volunteers, who also took standard personality tests, and found striking variations in language with personality, gender, and age. In our open-vocabulary technique, the data itself drives a comprehensive exploration of language that distinguishes people, finding connections that are not captured with traditional closed-vocabulary word-category analyses. Our analyses shed new light on psychosocial processes yielding results that are face valid (e.g., subjects living in high elevations talk about the mountains), tie in with other research (e.g., neurotic people disproportionately use the phrase 'sick of' and the word 'depressed'), suggest new hypotheses (e.g., an active life implies emotional stability), and give detailed insights (males use the possessive 'my' when mentioning their 'wife' or 'girlfriend' more often than females use 'my' with 'husband' or 'boyfriend'). To date, this represents the largest study, by an order of magnitude, of language and personality.

Analysis

Why This Paper Matters

This 2013 study by Schwartz et al. is a landmark in computational social science, demonstrating that the language people use on social media can reliably predict their personality, gender, and age. By analyzing an unprecedented 700 million words from 75,000 Facebook users, the authors moved beyond small-scale lab studies to a large-scale, ecologically valid analysis of natural language. The open-vocabulary approach—letting the data reveal linguistic patterns rather than imposing predefined categories—was a methodological breakthrough that has since become standard in psycholinguistic and NLP research.

The paper's findings have practical implications for personalized marketing, mental health screening, and user modeling. For AI practitioners, it showed that simple word and phrase frequencies can capture complex psychological constructs, paving the way for modern personality-aware AI systems. The study also highlighted the importance of big data in understanding human behavior, setting a precedent for later work on sentiment, emotion, and demographic inference from text.

Technical Contributions

  • Open-vocabulary analysis: Instead of using closed word-category lists (like LIWC), the authors extracted all words, phrases (n-grams), and latent topics from the data, allowing discovery of unexpected linguistic markers.
  • Large-scale data collection: 75,000 participants with both Facebook messages and standard personality test scores (Big Five), enabling robust statistical analysis.
  • Correlation and regression: Used linear regression to associate language features with personality traits, controlling for age and gender.
  • Visualization of linguistic profiles: Created word clouds and correlation tables to show how specific words and phrases vary with traits (e.g., neuroticism linked to 'depressed', extraversion to 'party').

Results

  • Neurotic individuals disproportionately used words like 'depressed', 'sick of', and 'lonely'.
  • Extraverts used words like 'party', 'awesome', and 'love'.
  • Males more often used possessive 'my' with 'wife' or 'girlfriend' than females used 'my' with 'husband' or 'boyfriend'.
  • Age-related language shifts: younger users used more slang and emoticons; older users used more formal language and references to family.
  • The open-vocabulary approach outperformed closed-vocabulary methods in predicting personality traits, explaining up to 10% of variance in some traits.

Significance

This paper fundamentally changed how researchers study personality and language, shifting from small-scale experiments to large-scale observational studies. It demonstrated that machine learning and natural language processing can extract meaningful psychological signals from noisy social media text. The open-vocabulary methodology has been widely adopted in computational social science, marketing analytics, and AI-driven mental health tools. For AI practitioners, the paper underscores the value of data-driven feature engineering and the importance of large, diverse datasets for training robust models. It also raised ethical considerations about privacy and inference of sensitive traits from public text, a topic that remains highly relevant today.