BACKGROUND:Cancer registries require accurate and efficient documentation of malignancies, yet current manual methods are time-consuming and error-prone. OBJECTIVES:This study evaluates the effectiveness of large language models (LLMs) in classifying malignancies and detecting tumor types from pathology reports. METHODS:Using a synthetic dataset of 227 reports, the performance of four LLMs and a score-based algorithm was compared against expert-labeled gold standards. RESULTS:The LLMs, particularly GPT-4o and Llama3.3, demonstrated high sensitivity and specificity in both malignancy detection and tumor classification, significantly outperforming traditional algorithms. CONCLUSION:LLMs enhance the accuracy and efficiency of cancer data classification and hold promise for improving public health monitoring and clinical decision-making.
OBJECTIVE:In this synopsis, the editors of the Clinical Information Systems (CIS) section of the IMIA Yearbook of Medical Informatics overview recent research and propose a selection of best papers published in 2023 in the CIS field. METHODS:The CIS section editors utilize a systematic approach to collect relevant articles and determine the best papers for the section. Last year, they refined the query to include the topic of telemedicine. Through a multi-stage systematic selection process, the editors reduced the initial pool to 15 candidate papers. Each of these papers underwent at least six independent reviews, culminating in a selection meeting with the IMIA Yearbook editorial board, where the three best papers for the CIS section were chosen. RESULTS:The query was carried out in January 2024 retrieving 4,784 unique papers from PubMed and Web of Science, spanning 1,401 journals. The top journals included "Telemedicine Journal and e-Health" and "Journal of Medical Internet Research". Publications predominantly originated from the United States and United Kingdom. Significant contributions included advancements in predictive analytics, such as scalable models for diagnosis prediction and patient readmission, integration of digital twin technology, and improvements in data interoperability and security. The analysis underscores the continued focus on leveraging electronic health record data and the importance of patient-centered technologies in CIS. CONCLUSIONS:These findings highlight the ongoing evolution and potential of CIS technologies in enhancing patient care, emphasizing the importance of integrating innovative solutions and patient-centered approaches in the field.
BACKGROUND:Large Language Models (LLMs) offer promising applications in oncology pathology report classification, improving efficiency, accuracy, and automation. However, the use of real patient data is restricted due to legal and ethical concerns, necessitating privacy-compliant alternatives. OBJECTIVES:This study aimed to develop a synthetic oncology pathology dataset to serve as a benchmark for LLM evaluation, enabling reproducible and privacy-preserving AI research. METHODS:A total of 227 synthetic pathology reports were generated using Microsoft Copilot, ChatGPT Plus, and Perplexity Pro to ensure structural and linguistic diversity. The dataset included cases of prostate (n=75), lung (n=78), and breast (n=74) cancer, evenly distributed between malignant (n=113) and benign (n=114) findings. Reports were reviewed and classified by three independent cancer registrars using a consensus-based validation process. RESULTS & CONCLUSION:The dataset provides a structured, clinically relevant benchmark for evaluating LLM performance in pathology text classification. It enables AI model assessment without compromising data privacy, paving the way for scalable and ethical AI-driven oncology documentation.
Background: The COVID-19 pandemic strained healthcare systems, with Tyrol, Austria, as an early hotspot due to Alpine tourism. Variants like Alpha, Delta, and Omicron influenced infection and hospitalization trends. Objectives: To assess how different variants affected hospital occupancy, sick leave, and infection rates in Tyrol. Methods: Daily data on infections, hospital occupancy, and variants from 2020–2022 were analyzed using statistical trend assessments. Results: Sick leave peaked at 38,542 days in early 2022 during the Omicron wave. Hospital occupancy rose significantly during Alpha and Omicron surges, despite milder disease severity for Omicron. Preventive measures temporarily reduced absenteeism. Conclusion: Highly transmissible variants caused significant healthcare strain despite lower severity. Adaptable crisis management strategies are essential for mitigating future pandemic impacts.
The Covid-19 pandemic spurred an unprecedented shift towards digitalization, prompting a surge in telehealth practices. This paper explores the impact of the pandemic on telemedicine through a comprehensive analysis of scientific publications. Utilizing a bibliometric approach, the study examines trends in telemedicine research before and after the onset of Covid-19. The systematic search in PubMed yielded 8,454 pre-Covid-19 publications (2016–2019) and 16,633 post-Covid-19 publications (2020–2023). A total of 21,989 distinct keywords were extracted. Co-occurrence maps reveal evolving thematic clusters, with “mhealth” and “ehealth” dominating pre-Covid-19, while “Covid-19” emerges as a top keyword post-pandemic. The Top-10 keywords shift post-Covid-19, reflecting dynamic research priorities. The bibliometric approach illuminates a heightened exploration of telehealth solutions post-pandemic, emphasizing the enduring impact of the crisis on academic discourse. Changes in key terms and shifts in key term ranking indicate dynamic research priorities and a broader consideration of multidimensional healthcare challenges. Acknowledging study limitations, the analysis offers a high-level perspective, focusing on authors’ keywords. Despite challenges, the study provides a systematic overview, revealing the emergence of new telemedicine application domains and the need for further in-depth analyses. Future research directions may explore the ecological impact of telemedicine applications and other intriguing aspects, contributing to a comprehensive understanding of telemedicine’s scholarly trajectory.
This study scrutinizes free AI tools tailored for supporting literature review and analysis in academic research, emphasizing their response to direct inquiries. Through a targeted keyword search, we cataloged relevant AI tools and evaluated their output variation and source validity. Our results reveal a spectrum of response qualities, with some tools integrating non-academic sources and others depending on outdated information. Notably, most tools showed a lack of transparency in source selection. Our study highlights two key limitations: the exclusion of commercial AI tools and the focus solely on tools that accept direct research queries. This raises questions about the potential capabilities of paid tools and the efficacy of combining various AI tools for enhanced research outcomes. Future research should explore the integration of diverse AI tools, assess the impact of commercial tools, and investigate the algorithms behind response variability. This study contributes to a better understanding of AI’s role in academic research, emphasizing the importance of careful selection and critical evaluation of these tools in academic endeavors.
BACKGROUND:The integration of Information Technology (IT) into private medical practice is crucial in modern healthcare. Physicians managing office-related IT without proper knowledge risk operational inefficiencies and security. OBJECTIVES:This study determines the relevance of specific IT topics in medical practice and identifies the training needs of physicians for enhancing IT competencies in healthcare. METHODS:In March 2023 a cross-sectional online survey was conducted with physicians comprising nine IT-related topics in Tyrol, Austria. RESULTS:The survey results highlighted a strong perceived relevance and high demand for IT education among physicians working in their medical practice, especially in areas of core medical IT and security. The majority of responses indicated high relevance (76.7%) and high demand (69.7%) for IT topics in medical practice. CONCLUSION:The findings underscore a significant need for targeted IT training and support in medical practices, particularly in areas related to the medical practice and security. Addressing these needs could lead to improved healthcare delivery and better management of technological resources in the healthcare sector.
The increasing volume of unstructured textual data in healthcare, particularly in nursing care reports, presents both challenges and opportunities for enhancing patient care and operational efficiency. This study explores the application of Latent Dirichlet Allocation (LDA) topic modeling to analyze free-text nursing narratives from inpatient stays in three different clinics, aiming to uncover the latent thematic structures within. Utilizing the R programming environment and the visualization tool LDAvis, we identified three main themes: "Patient Well-being," "Patient Mobility and Care Activities," and "Treatment and Pain Management," the latter combining two closely related but initially distinct topics due to their overlapping content. Our findings demonstrate the potential of LDA topic modeling in extracting meaningful insights from nursing narratives, which could inform patient care strategies and healthcare practices. However, the study also highlights significant challenges associated with the method, including the sensitivity to parameter settings, the lack of updates for key software packages, and concerns about reproducibility. These issues highlight the need for meticulous parameter validation and the exploration of alternative text analysis methodologies for future research. By addressing these methodological challenges and emphasizing the importance of comparative method analysis, this study contributes to the advancement of text analytics in healthcare. It opens avenues for further research aimed at developing more robust, efficient, and accessible tools for analyzing free-text data, thereby enhancing the ability of healthcare professionals to use unstructured data to improve decision making and patient outcomes.
Secondary use of clinical health data implies a prior integration of mostly heterogenous and multidimensional data sets. A clinical data warehouse addresses the technological and organizational framework conditions required for this, by making any data available for analysis. However, users of a data warehouse often do not have a comprehensive overview of all available data and only know about their own data in their own systems - a situation which is also referred to as 'data siloed state'. This problem can be addressed and ultimately solved by implementation of a data catalog. Its core function is a search engine, which allows for searching the metadata collected from different data sources and thereby accessing all data there is. With this in mind, we conducted an explorative online market survey followed by vendor comparison as a pre-requisite for system selection of a data catalog. Assessment of vendor performance was based on seven predetermined and weighted selection criteria. Although three vendors achieved the highest score, results were lying closely together. Detailed investigations and test installations are needed for further narrowing down the selection process.
OBJECTIVE:In this synopsis, the editors of the Clinical Information Systems (CIS) section of the IMIA Yearbook of Medical Informatics overview recent research and propose a selection of best papers published in 2022 in the CIS field.METHODS:The editors follow a systematic approach to gather relevant articles and select the best papers for the section. This year, they updated the query to incorporate the topic of telemedicine and removed search terms related to geographic information systems. The revised query resulted in a larger number of identified papers, necessitating the appointment of a third section editor to handle the increased workload. The editors narrowed the initial pool of articles to 15 candidate papers through a multi-stage selection process. At least seven independent reviews were collected for each candidate paper, and a selection meeting with the IMIA Yearbook editorial board led to the final selection of the best papers for the CIS section.RESULTS:The query was carried out in mid-January 2023 and retrieved a deduplicated result set of 5,206 articles from 1,500 journals. This year, 15 papers were nominated as candidates, and four were finally selected as the best papers in the CIS section.Including telemedicine in the query resulted in a substantial increase in the number of papers found. The analysis highlights the growing convergence between clinical information systems and telemedicine, with mobile health (mHealth) technologies and data science applications gaining prominence. The selected candidate papers emphasize the practical impact of research efforts, focusing on patient-centric outcomes and benefits, including intelligent mobile health monitoring systems and AI-assisted decision-making in healthcare.CONCLUSIONS:Looking ahead, the field of CIS is expected to continue evolving, driven by advances in telemedicine, mHealth technologies, data science, and AI integration, leading to more efficient, patient-oriented, and intelligent healthcare systems and overall improvement of global healthcare outcomes.
Social presence is a key element in collaborative/cooperative learning. In online learning environments, it is challenging to measure the current state of social presence. This work aims to identify measures of social presence.We manually coded 3546 students' postings (n = 49 students). We selected measures from social network analysis and indices derived from log data as potential indicators. We conducted an exploratory path analysis to define which indicators appropriately describe social presence.The size of the individual egocentric student's network (path coefficient = - 0.56**) and constraint (path coefficient = - 0.51**), as well as the number of forums in which students were active (path coefficient = 0.49**) and the number of solved learning activities (path coefficient = - 0.59**) were indicators of the level of social presence.We were able to identify four indicators for social presence in online-based courses readily available within routine data from learning management systems. We will focus now on how social presence in an ongoing course develops.
The Clinical Information Systems (CIS) section of the IMIA Yearbook of Medical Informatics systematically screens about 2,500 publications from more than 1,000 journals annually to find the best CIS publications. The editors of the CIS section have noticed a trend toward patient-centered care supported by AI and machine learning and increased research in cross-institutional data sharing, particularly in telemedicine. As a result, they adjusted their search query to include the MeSH term "telemedicine." As a preliminary step and to get a sense of the historical development of telemedicine research activity, they performed a bibliometric analysis of all previously published papers in PubMed indexed with the tag "Telemedicine" as MeSH Major Topic. They retrieved 29,289 publications from 1976 to 2022 and used their titles and abstracts to create a bibliometric network that visualizes the most relevant terms, their frequency and relationship to each other, and the chronological sequence of their publication. The development over time also shows a clear move toward patient-centeredness. Interestingly, the term "Covid," which has only recently come into use, takes on a central role in the network.
The Community of Inquiry (CoI) Framework describes success factors for collaborative online-based learning. The CoI Survey is a validated instrument to measure these factors from the perspective of course participants. Until now, no validated translation of this Survey to German was available. The aim of this work was to translate the original English Survey to German and to validate the translated Survey instrument. After a systematic translation process, we validated the German translation in two higher education settings in two countries (entire data set of n=433 Surveys). By conducting item analysis, reliability analysis, exploratory factor analysis, and confirmatory factor analysis, we were able to confirm the reliability and validity of the German CoI Survey. Only one item (CP6) shows cross-loadings on two factors, a finding that was already discussed for the original CoI Survey. To conclude, the validated German version of the CoI Survey is now available.
Data-driven decision-making in health care is becoming increasingly important in daily clinical use. A data warehouse, storing all the clinically relevant information in a highly structured way, is a primary basis for achieving this goal. We are developing a clinical data warehouse where more than 20 years of clinical data can be persisted, and newly generated data from different sources can be integrated. A back room was created to store all hospital information system data in a PostgreSQL database. Due to the enormous number of diverse forms in the hospital information system, a broker service was developed that integrates the individual data sources into the data warehouse as soon as they are released for storage. The front room represents the interface from the infrastructure to the targeted analysis. Database query and visualization tools or business intelligence tools can display and analyze processed and interleaved data. In all areas of business and medicine, structured and quality-adjusted data is of major importance. With the help of a clinical data warehouse system, it is possible to perform patient-centered analyses and thus realize optimal therapy. Furthermore, it is possible to provide staff and management with dashboards for control purposes.
Population Medicine considers the following types of articles:• Research Papers -reports of data from original research or secondary dataset analyses.• Review Papers -comprehensive, authoritative, reviews within the journal's scope.These include both systematic reviews and narrative reviews.• Short Reports -brief reports of data from original research.• Policy Case Studies -brief articles on policy development at a regional or national level.• Study Protocols -articles describing a research protocol of a study.• Methodology Papers -papers that present different methodological approaches that can be used to investigate problems in a relevant scientific field and to encourage innovation.• Methodology Papers -papers that present different methodological approaches that can be used to investigate problems in a relevant scientific field and to encourage innovation.
BACKGROUND:Dashboards provide a good retrospective view of the development of the disease. Yet, current COVID-related dashboards typically lack the capability to predict future trends. However, this is important for health policy makers and health care providers in order to adopt meaningful containment strategies.OBJECTIVES:The aim of this paper is to present the Surviral dashboard, which allows the effective monitoring of infectious disease dynamics.METHODS:The presented dashboard comprises a wide range of information, including retrospective and prognostic data based on an agent-based simulation framework. It served as the basis for informed decision-making and planning of disease control strategies within the federal state of Tyrol.RESULTS:By visualizing the information in an understandable format, the dashboard provided a comprehensive overview of the COVID-19 situation in Tyrol and allowed for the identification of trends and patterns.CONCLUSION:The presented dashboard is a valuable tool for managing pandemics such as COVID-19. It provides a convenient and efficient way to monitor the spread of a disease and identify potential areas for intervention.
Background: Process mining is a promising field of data analytics that is yet to be applied broadly in healthcare. It can streamline the care process, leading to a higher quality of care, increased patient safety and lower costs. Objectives: To get deeper insights into the emergence and detectability of delirium in a gerontopsychiatric setting. Methods: We use process mining to create process models from routinely collected, anonymised nursing data from two gerontopsychiatric wards. We analyse these models to get a longitudinal view of the care processes. Results: The process models comprise all activities during patients' stays but are too extensive and challenging to interpret due to the wide variation in care paths. Although the models give insight into frequent paths and activities, they are insufficient to explain the emergence of delirium meaningfully. No apparent difference between stays with or without delirium could be detected. Conclusion: Conducting process mining on routinely collected data is easy, but the interpretation of the results was a challenge. We identified four limitations associated with using this data and gave recommendations on adapting it for further analysis.
BACKGROUND:Even if English is the leading language for international communication, it is essential to keep in mind that research runs at the local level by local teams generally communicating in their local/national language, especially in Europe among European projects.OBJECTIVE:Therefore, the European Federation for Medical Informatics - Working Group on Health Informatics for Inter-regional Cooperation" has one objective: To develop a multilingual ontology focusing on Health Informatics and Digital Health as a collaboration tool that improves international and, in particular, European collaborations.RESULTS:We have developed the Medical Informatics and Digital Health Multilingual Ontology (MIMO). Hosted on the Health Terminology/Ontology Portal (HeTOP), MIMO contains around 1,000 concepts, 460 MeSH Descriptors, 220 MeSH Concepts, and more than 300 newly created concepts. MIMO is continuously updated to comprise as recent as possible concepts and their translations in more than 30 languages. Moreover, the MIMO's development team constantly improves MIMO content and supporting information. Thus, during workshop discussions and one-on-one exchanges, the MIMO team has collected domain experts' opinions about the community's interests and suggestions for future enhancements. Moreover, MIMO will be integrated to support the annotation and categorization of research products into the HosmartAI European project involving more than 20 countries around Europe and worldwide.CONCLUSION:MIMO is hosted by HeTOP (Health Terminology/Ontology Portal), which integrates 100 terminologies and ontologies in 55 languages. MIMO is freely available online. MIMO is portable to other knowledge platforms as part of MIMO's main aims to facilitate communication between medical librarians, translators, and researchers as well as to support students' self-learning.
Objectives: In this synopsis, we give an overview of recent research and propose a selection of best papers published in 2021 in the field of Clinical Information Systems (CIS). Method: As CIS section editors, we annually apply a systematic process to retrieve articles for the IMIA Yearbook of Medical Informatics. For eight years now, we use the same query to find relevant publications in the CIS field. Each year we retrieve more than 2,400 papers which we categorize in a multi-pass review to distill a preselection of up to 15 candidate papers. External reviewers and yearbook editors then assess the selected candidate papers. Based on the review results, the IMIA Yearbook editorial board chooses up to four best publications for the section at a selection meeting. To get a comprehensive overview of the content of the retrieved articles, we use text mining and term co-occurrence mapping techniques. Results: We carried out the query in mid-January 2022 and retrieved a deduplicated result set of 2,688 articles from 1,062 different journals. This year, we nominated ten papers as candidates and finally selected two of them as the best papers in the CIS section. As in the previous years, the content analysis of the articles revealed the broad spectrum of topics covered by CIS research, but - on the other side – no real innovations or new upcoming research trends. However, the significant impact of COVID-19 on CIS research was observable also this year. Conclusions: The trends in CIS research, as seen in recent years, continue to be observable. The content analysis revealed nothing really new in the CIS domain. What was very visible was the impact of the COVID-19 pandemic, which still effects our lives and also CIS.
Elske Ammenwerth合作论文数Health Informatics and the Institute for Health Information Systems at42