Evaluating Scientific Confidence in the Concordance of in Vitro and in Vivo Protective Points of Departure

To fulfil the promise of reducing reliance on mammalian in vivo laboratory animal studies, new approach methods (NAMs) need to provide a confident basis for regulatory decision-making. However, previous attempts to develop in vitro NAMs-based points of departure (PODs) have yielded mixed results, with PODs from U.S. EPA's ToxCast, for instance, appearing more conservative (protective) but poorly correlated with traditional in vivo studies. Here, we aimed to address this discordance by reducing the heterogeneity of in vivo PODs, accounting for species differences, and enhancing the biological relevance of in vitro PODs. However, we only found improved in vitro-to-in vivo concordance when combining the use of Bayesian model averaging-based benchmark dose modeling for in vivo PODs, allometric scaling for interspecies adjustments, and human-relevant in vitro assays with multiple induced pluripotent stem cell-derived models. Moreover, the available sample size was only 15 chemicals, and the resulting level of concordance was only fair, with correlation coefficients <0.5 and prediction intervals spanning several orders of magnitude. Overall, while this study suggests several ways to enhance concordance and thereby increase scientific confidence in vitro NAMs-based PODs, it also highlights challenges in their predictive accuracy and precision for use in regulatory decision making.