How Replicable Is Computational Communication Science? A Systematic Field-Level Analysis

Computational Communication Science (CCS) has rapidly expanded over the past decade, yet questions of reproducibility and replicability remain pressing. This study provides a systematic, field-level assessment of CCS research published in leading communication journals between 2010 and 2021. Using a semi-automated literature review and manual content analysis, we coded 476 studies for method- and data-related characteristics, and open-science practices (e.g. data and code sharing). Our findings reveal that media content and self-reported data dominate the field but present challenges for replicability due to platform restrictions and contextual dependencies. Open-science practices remain limited: fewer than 10% of studies shared data or code, though both have increased over time. These results highlight structural and cultural barriers to replicability in CCS while suggesting that growing adoption of open science norms offers a promising route to enhance transparency.

Knöpfle, P., Haim, M., & Breuer, J. (6/2026). How Replicable Is Computational Communication Science? A Systematic Field-Level Analysis. Presented at the 76th Annual Conference of the International Communication Association, Cape Town. (content_copy)