Marywood University is a private Catholic university in Scranton, Pennsylvania. Established in 1915 by the Sisters, Servants of the Immaculate Heart of Mary, Marywood currently enrolls more than 2,800 students in a variety of undergraduate, graduate, and doctoral programs. The university has a national arboretum with more than 100 types of trees and shrubs.
From the late years of Belgian colonialism to the turbulent early 1990s, the Institut Medical Evangelique (IME) was the largest and most famous interdenominational Protestant hospital in the Democratic Republic of Congo. Its growth in the 1960s and 1970s shows how assumptions about the decline of health care in the DRC after colonialism did not correspond with the evolution of hospitals. The number of missionary physicians and other staff expanded as well until the late 1970s, as mission boards became less supportive of IME. The hospital also struggled to recruit and keep Congolese doctors until the late 1980s, in part because the scarcity of Congolese doctors created financial opportunities. Once political instability led missionaries to largely withdraw after 1991, Congolese doctors and administrators took full control over the hospital.
This study presents the development of the PsyCogMetrics AI Lab (psycogmetrics.ai), an integrated, cloud-based platform that operationalizes psychometric and cognitive-science methodologies for Large Language Model (LLM) evaluation. Framed as a three-cycle Action Design Science study, the Relevance Cycle identifies key limitations in current evaluation methods and unfulfilled stakeholder needs. The Rigor Cycle draws on kernel theories such as Popperian falsifiability, Classical Test Theory, and Cognitive Load Theory to derive deductive design objectives. The Design Cycle operationalizes these objectives through nested Build-Intervene-Evaluate loops. The study contributes a novel IT artifact, a validated design for LLM evaluation, benefiting research at the intersection of AI, psychology, cognitive science, and the social and behavioral sciences.
