Validating Large Language Models as Computational Instruments for Social Science Research

Classical traditional surveys

Beloved standard tool of the social sciences

Often considered the gold standard, “ground truth” (especially when working with large representative samples of a population)

But, classical survey methodologies increasingly suffer from problems

First line of the 2024 Book “Polling at a Crossroads: Rethinking Modern Survey Research”: Survey research is in a state of crisis

Last example: US presidential elections 2024

Biggest issue is non-response

Alternatives?

Britain’s mood, measured weekly

One example of an easily accessible, representative survey (UK) in the affective domain