Submission 375
Introducing TTAMRE: Reporting Standards for the Use of LLMs in Political Science
Panel.7-S-4
Presented by: Javier Osorio
The AI revolution is reshaping the way scholars in political science, like many other disciplines, conduct their research. However, the surge in the use of Large Language Models (LLMs) lacks a systematic and transparent way of reporting the various methodological decisions associated with the use of LLMs. To address this paper introduces the TTAMRE (Text, Tasks, Annotations, Models, Results, and Environment) standards for reporting the use of LLMs in Political Science. Following a lifecycle approach in the use of LLMs and adopting the best practices in computer science, the TTAMRE reporting standards seek to promote full transparency about the technical specifications, model choices, and performance results at different stages of the research process. To assist researchers in following the TTAMRE reporting guidelines, this paper introduces a Graphical User Interface (GUI) that generates a standardized technical summary.