BackgroundPoor sleep hygiene persists in college students today, despite its heavy implications on adolescent development and academic performance. Although sleep patterns in undergraduates have been broadly investigated, no study has exclusively assessed the sleep patterns of premedical undergraduate students. A gap also exists in the knowledge of how students perceive their sleep patterns compared to their actual sleep patterns. ObjectiveThis study aims to address 2 research questions: What are the sleep patterns of premedical undergraduate students? Would the proposed study protocol be feasible to examine the perception of sleep quality and promote sleep behavioral changes in premedical undergraduate students? MethodsAn anonymous survey was conducted with premedical students in the Medical Science Baccalaureate program at an R1: doctoral university in the Midwest United States to investigate their sleep habits and understand their demographics. The survey consisted of both Pittsburg Sleep Quality Index (PSQI) questionnaire items (1-9) and participant demographic questions. To examine the proposed protocol feasibility, we recruited 5 students from the survey pool for addressing the perception of sleep quality and changes. These participants followed a 2-week protocol wearing Fitbit Inspire 2 watches and underwent preassessments, midassessments, and postassessments. Participants completed daily reflections and semistructured interviews along with PSQI questionnaires during assessments. ResultsAccording to 103 survey responses, premedical students slept an average of 7.1 hours per night. Only a quarter (26/103) of the participants experienced good sleep quality (PSQI<5), although there was no significant difference (P=.11) in the proportions of good (PSQI<5) versus poor sleepers (PSQI≥5) across cohorts. When students perceived no problem at all in their sleep quality, 50% (14/28) of them actually had poor sleep quality. Among the larger proportion of students who perceived sleep quality as only a slight problem, 26% (11/43) of them presented poor sleep quality. High stress levels were associated with poor sleep quality. This study reveals Fitbit as a beneficial tool in raising sleep awareness. Participants highlighted Fitbit elements that aid in comprehension such as being able to visualize their sleep stage breakdown and receive an overview of their sleep pattern by simply looking at their Fitbit sleep scores. In terms of protocol evaluation, participants believed that assessments were conducted within the expected duration, and they did not have a strong opinion about the frequency of survey administration. However, Fitbit was found to provide notable variation daily, leading to missing data. Moreover, the Fitbit app’s feature description was vague and could lead to confusion. ConclusionsPoor sleep quality experienced by unaware premedical students points to a need for raising sleep awareness and developing effective interventions. Future work should refine our study protocol based on lessons learned and health behavior theories and use Fitbit as an informatics solution to promote healthy sleep behaviors.

Interactive data visualization can be a viable way to discover patterns in patient-generated health data and enable health behavior changes. However, very few studies have investigated the design and usability of such data visualization. The present study aimed to (1) explore user experiences with sleep data visualizations in the Fitbit app, and (2) focus on end users' perspectives to identify areas of improvement and potential solutions. The study recruited eighteen pre-medicine college students, who wore Fitbit watches for a two-week sleep data collection period and participated in an exit semi-structured interview to share their experience. A focus group was conducted subsequently to ideate potential solutions. The qualitative analysis identified six pain points (PPs) from the interview data using affinity mapping. Four design solutions were proposed by the focus group to address these PPs and illustrated by a set of mock-ups. The study findings informed four design considerations: (1) usability, (2) transparency and explainability, (3) understandability and actionability, and (4) individualized benchmarking. Further research is needed to examine the design guidelines and best practices of sleep data visualization, to create well-designed visualizations for the general population that enables health behavior changes.

Background Predicting 30-day hospital readmissions is crucial for improving patient outcomes, optimizing resource allocation, and achieving financial savings. Existing studies reporting the development of machine learning (ML) models predictive of neurosurgical readmissions do not report factors related to clinical implementation. Objectives Train individual predictive models with good performance (area under the receiver operating characteristic curve or AUROC > 0.8), identify potential interventions through semi-structured interviews, and demonstrate estimated clinical and financial impact of these models. Methods Electronic health records were utilized with five ML methodologies: gradient boosting, decision tree, random forest, ridge logistic regression, and linear support vector machine. Variables of interest were determined by domain experts and literature. The dataset was split divided 80% for training and validation and 20% for testing randomly. Clinical workflow analysis was conducted using semi-structured interviews to identify possible intervention points. Calibrated agent-based models (ABMs), based on a previous study with interventions, were applied to simulate reductions of the 30-day readmission rate and financial costs. Results The dataset covered 12,334 neurosurgical intensive care unit (NSICU) admissions (11,029 patients); 1,903 spine surgery admissions (1,641 patients), and 2,208 traumatic brain injury (TBI) admissions (2,185 patients), with readmission rate of 13.13, 13.93, and 23.73%, respectively. The random forest model for NSICU achieved best performance with an AUROC score of 0.89, capturing potential patients effectively. Six interventions were identified through 12 semi-structured interviews targeting preoperative, inpatient stay, discharge phases, and follow-up phases. Calibrated ABMs simulated median readmission reduction rates and resulted in 13.13 to 10.12% (NSICU), 13.90 to 10.98% (spine surgery), and 23.64 to 21.20% (TBI). Approximately $1,300,614.28 in saving resulted from potential interventions. Conclusion This study reports the successful development and simulation of an ML-based approach for predicting and reducing 30-day hospital readmissions in neurosurgery. The intervention shows feasibility in improving patient outcomes and reducing financial losses.

Pre-medical students face the challenge of managing rigorous academic and extracurricular demands, which can lead to burnout. Effective tracking and visualization of their activities are crucial in keeping records of student progress. This study aimed to develop and evaluate a user-friendly dashboard tailored for pre-medical student data management. Semi-structured interviews with nine medical sciences baccalaureate program (MSBP) faculty members identified major issues in current data management practices, including standardization and tracking. Using affinity diagramming and Miroboard, five key themes emerged, guiding the creation of an initial dashboard prototype. After iterative critiques and revisions, the final design received positive feedback from the MSBP committee. Limitations include a small sample size and a lack of formal usability testing. Future work will focus on addressing implementation challenges and refining the design based on user feedback.

Poor sleep hygiene persists in college students today, despite its heavy implications on adolescent development and academic performance. Although sleep patterns in undergraduates have been broadly investigated, no study has exclusively assessed the sleep patterns of premedical undergraduate students. A gap also exists in the knowledge of how students perceive their sleep patterns compared to their actual sleep patterns. This study aims to address 2 research questions: What are the sleep patterns of premedical undergraduate students? Would the proposed study protocol be feasible to examine the perception of sleep quality and promote sleep behavioral changes in premedical undergraduate students? An anonymous survey was conducted with premedical students in the Medical Science Baccalaureate program at an R1: doctoral university in the Midwest United States to investigate their sleep habits and understand their demographics. The survey consisted of both Pittsburg Sleep Quality Index (PSQI) questionnaire items (1-9) and participant demographic questions. To examine the proposed protocol feasibility, we recruited 5 students from the survey pool for addressing the perception of sleep quality and changes. These participants followed a 2-week protocol wearing Fitbit Inspire 2 watches and underwent preassessments, midassessments, and postassessments. Participants completed daily reflections and semistructured interviews along with PSQI questionnaires during assessments. According to 103 survey responses, premedical students slept an average of 7.1 hours per night. Only a quarter (26/103) of the participants experienced good sleep quality (PSQI<5), although there was no significant difference (P=.11) in the proportions of good (PSQI<5) versus poor sleepers (PSQI≥5) across cohorts. When students perceived no problem at all in their sleep quality, 50% (14/28) of them actually had poor sleep quality. Among the larger proportion of students who perceived sleep quality as only a slight problem, 26% (11/43) of them presented poor sleep quality. High stress levels were associated with poor sleep quality. This study reveals Fitbit as a beneficial tool in raising sleep awareness. Participants highlighted Fitbit elements that aid in comprehension such as being able to visualize their sleep stage breakdown and receive an overview of their sleep pattern by simply looking at their Fitbit sleep scores. In terms of protocol evaluation, participants believed that assessments were conducted within the expected duration, and they did not have a strong opinion about the frequency of survey administration. However, Fitbit was found to provide notable variation daily, leading to missing data. Moreover, the Fitbit app’s feature description was vague and could lead to confusion. Poor sleep quality experienced by unaware premedical students points to a need for raising sleep awareness and developing effective interventions. Future work should refine our study protocol based on lessons learned and health behavior theories and use Fitbit as an informatics solution to promote healthy sleep behaviors.

OBJECTIVES:Clinical Competency Committee (CCC) members employ varied approaches to the review process. This makes the design of a competency assessment dashboard that fits the needs of all members difficult. This work details a user-centered evaluation of a dashboard currently utilized by the Internal Medicine Clinical Competency Committee (IM CCC) at the University of Cincinnati College of Medicine and generated design recommendations. METHODS:Eleven members of the IM CCC participated in semistructured interviews with the research team. These interviews were recorded and transcribed for analysis. The three design research methods used in this study included process mapping (workflow diagrams), affinity diagramming, and a ranking experiment. RESULTS:Through affinity diagramming, the research team identified and organized opportunities for improvement about the current system expressed by study participants. These areas include a time-consuming preprocessing step, lack of integration of data from multiple sources, and different workflows for each step in the review process. Finally, the research team categorized nine dashboard components based on rankings provided by the participants. CONCLUSION:We successfully conducted user-centered evaluation of an IM CCC dashboard and generated four recommendations. Programs should integrate quantitative and qualitative feedback, create multiple views to display these data based on user roles, work with designers to create a usable, interpretable dashboard, and develop a strong informatics pipeline to manage the system. To our knowledge, this type of user-centered evaluation has rarely been attempted in the medical education domain. Therefore, this study provides best practices for other residency programs to evaluate current competency assessment tools and to develop new ones.