Directional replicability: When is the factor of 2 necessary?

Biostatistical seminar with Vera Djordjilovic, Associate Professor in Statistics at the Department of Economics, University of Venice, Italy.

Abstract

Directional replicability addresses the question of whether an effect studied across \(n\) independent studies is present with the same direction in at least \(r\) of them, for \(r \geq 2\) (Bogomolov and Heller, 2023). When the expected direction of the effect is not specified in advance, the state of the art recommends assessing replicability separately using one-sided p-values for both directions (left and right), and then doubling the smaller of the two resulting p-values to account for multiple testing (Owen, 2009). In this work, we examine whether this multiplicative correction is always necessary, and under what conditions it can be safely omitted.

Published June 26, 2025 9:46 PM - Last modified Oct. 20, 2025 2:50 PM