ECLAIR: A Causally-Grounded AI Framework for Scientific Discovery in Empirical Software Engineering | AMiner
ECLAIR: A Causally-Grounded AI Framework for Scientific Discovery in Empirical Software Engineering
Alejandro Velasco,Daniel Rodriguez-Cardenas,Dipin Khati,David N. Palacio,Denys Poshyvanyk
arXiv · (2026)
William & Mary
被引用0|浏览2
摘要
The scientific method has long guided empirical research in Software Engineering (SE), but the complexity of modern software systems often hinders its systematic application. This paper introduces _ECLAIR_, a causally grounded AI framework that integrates Large Language Models (_LLMs_) into every stage of the scientific process, from hypothesis generation to analysis and interpretation. _ECLAIR_ treats _LLMs_ as active **scientific agents** operating under the principles of causal inference, within a human-in-the-loop design that safeguards against the risks of unsound automated reasoning. We demonstrate the framework through a case study examining how prompt design influences code generation accuracy in two _LLMs_. Results show that, for both models, instruction-style, longer few-shot, and signature-augmented prompts yield small negative causal effects on accuracy, illustrating how causal reasoning provides a principled foundation for explaining _why_ software phenomena occur. This study presents the first causally grounded structured methodology for embedding _LLMs_ within the scientific method in SE, designed around the epistemological demands of empirical SE research, establishing a basis for rigorous AI-assisted research.