09:20 - 11:00
Room: Meeting Room 2.1
Chair/s:
Ju Yeon Park
Erik Chi - Comparing Designs and Diagnostics in Time and Space
Shanna Pearson-Merkowitz - Listening to Public Housing Residents: Lessons from Collecting Surveys to Inform Redevelopment and Management Decisions
Adam Glynn - Estimating Bounds on Selection Bias with Outcomes Measured on the Selected
Thomas Plümper, Eric Neumayer - Tweaking Empirical Results of Causal Analyses: The Case of Regression Discontinuity Designs
Ju Yeon Park - From Reddit to Congressional Hearings: Measuring Representation at the Argument-level
Submission 210
From Reddit to Congressional Hearings: Measuring Representation at the Argument-Level
Panel.1-S-5
Presented by: Ju Yeon Park
Ju Yeon Park 1, Arman Irani 2, Kevin Esterling 2, Michalis Faloutsos 2
1 The Ohio State University
2 UC Riverside
In representative democracy, it is crucial to include the perspectives of those governed in policy making. To analyze representation, research often links public policy preferences with legislators' stances through surveys and votes. However, the scholarship lacks effective methods to assess whether substantive policy ideas of the public gain lawmakers' attention. This study combines Reddit discussions on policy issues with U.S. House of Representatives' hearing transcripts from 2005 to 2022 to develop an innovative LLM-driven argument detection and stance classification framework called WIBA (``What is Being Argued''). By applying WIBA, we construct the new measurements of representation by identifying similar arguments made in both Reddit and hearings and show how the pattern of representation varies across policy issues (partisan vs. non-partisan), legislators, and Reddit communities. Our proposed approach makes both substantive and methodological contributions by introducing a new approach to conceptualize and measure representation at the argument level that is more nuanced and granular than any of the existing methods to measure this concept, providing a deeper understanding of representation.