Foraminifera are shell-bearing microorganisms that are commonly found in marine deposits on the seabed. They are important indicators in many analyses, are used in climate change research, monitoring marine environments, evolutionary studies, and are also frequently used in the oil and gas industry. Although some research has focused on automating the classification of foraminifera images, few have addressed the uncertainty in these classifications. Although foraminifera classification is not a safety-critical task, estimating uncertainty is crucial to avoid misclassifications that could overlook rare and ecologically significant species that are informative indicators of the environment in which they lived. Uncertainty estimation in deep learning has gained significant attention and many methods have been developed. However, evaluating the performance of these methods in practical settings remains a challenge. To create a benchmark for uncertainty estimation in the classification of foraminifera, we administered a multiple choice questionnaire containing classification tasks to four senior geologists. By analyzing their responses, we generated human-derived uncertainty estimates for a test set of 260 images of foraminifera and sediment grains. These uncertainty estimates served as a baseline for comparison when training neural networks in classification. We then trained multiple deep neural networks using a range of uncertainty quantification methods to classify and state the uncertainty about the classifications. The results of the deep learning uncertainty quantification methods were then analyzed and compared with the human benchmark, to see how the methods performed individually and how the methods aligned with humans. Our results show that human-level performance can be achieved with deep learning and that test-time data augmentation and ensembling can help improve both uncertainty estimation and classification performance. Our results also show that human uncertainty estimates are helpful indicators for detecting classification errors and that deep learning-based uncertainty estimates can improve calibration and classification accuracy.
The ICT+ project:” Transforming ocean surveying by the power of DL and statistical methods” hosted by UiT The Artic University of Norway, aims at employing machine learning techniques in improving and streamlining methods currently used in ocean surveying by private sector partners to the project, MultiConsult and Argeo. The tasks include detection and identification of µm (e.g. foraminifera, microplastics) to m (e.g. boulders, shipwrecks) sized objects and elements at and in the seabed in data that presently is processed manually by skilled workers, but ideally could be wholly or partially processed using an automated approach.Here we present preliminary work and results related to application of the YOLO (You Only Look Once) algorithms in detection and identification of meio fauna (foraminifera) in - and macro (mollusc) fauna at the seabed. Both proxies are used in evaluation of the environmental state of the seabed. YOLO is a real-time object detection deep learning algorithm that efficiently identifies and locates objects in images or videos in a single pass through the neural network.Presently the year on year growth or shrinkage of protected mollusc banks in northern Norwegian fjords is manually evaluated via video observation in seabed video sequences annually captured via remotely operated vehicles. The preliminary results suggest that upon moderate training the YOLO algorithm can identify presence/absence of mollusc bank formations in set video sequences, thus supporting and eventually minimizing the task of inspecting the video footage manually. Foraminifera are abundant marine meiofauna living in the water column or at and in the seabed. Foraminifera are utilized in research into both modern and past marine environments as they have high turnover rates and individual shells have high preservation potential. Foraminiferal shells are accumulated in the sediments and after sample processing, they subsequently can be manually detected and identified via microscope. This work is very labour-intensive and demands skilled expertise but suffers from errors by and bias of the individual expert.Preliminary results show that a YOLO network, trained on ca 4100 individuals (20 subgroups; benthic calcareous foraminifera (n=19), Planktic foraminifera (n=1)) in 346 images have model performances of up to 0.96 mAP (mean average precision) when trained, validated and tested on the training set. These promising results will be tested on real world samples. This testing is complicated by real world samples containing many more foraminiferal species/groups that were not trained upon, overlapping or closely set specimens and presence of non-foraminiferal material (e.g. sediment grains, other meio-fauna or –flora, etc.). Thus, additional training with focus on set complicating aspects will likely be necessary and most recent result will be presented.
Microfossils are important in climate analysis and in exploration of subsea energy resources. The abundance and distribution of species found in sediment cores provide valuable information, but the analysis is difficult and time consuming as it is based on manual work by human experts. It is also a challenge to have enough labelled data to train a standard deep learning classifier on microfossil images. We propose an efficient pipeline for processing and grouping fossils by species from microscope slides using self-supervised learning. First we show how to efficiently extract crops from whole slide images by adapting previously trained object detection algorithms. Second, we provide a comparison of a range of contrastive self-supervised learning methods to classify and identify microfossil from very few labels. We obtain excellent results with convolutional neural networks and vision transformers fine-tuned by self-supervision.
Well-annotated datasets are fundamental for developing robust artificial intelligence models, particularly in medical fields. Many existing skin lesion datasets have limitations in image diversity (including only clinical or dermoscopic images) or metadata, which hinder their utility for mimicking real-world clinical practice. The purpose of the MCR-SL dataset is to introduce a new, meticulously curated dataset that addresses these limitations. The MCR-SL dataset was collected from 60 subjects at the University Hospital of North Norway and comprises 779 clinical images and 1352 dermoscopic images of 240 unique lesions. The lesion types included are nevus, seborrheic keratosis, basal cell carcinoma, actinic keratosis, atypical nevus, melanoma, squamous cell carcinoma, angioma, and dermatofibroma. Labels were established by combining the consensus of a panel of four dermatologists with histopathology reports for the 29 excised lesions, with the latter serving as the gold standard. The resulting dataset provides a comprehensive resource with clinical and dermoscopic images and rich clinical context, ensuring a high level of clinical relevance, surpassing many existing resources in that matter. The MCR-SL dataset provides a holistic and reliable foundation for validating artificial intelligence models, enabling a more nuanced and clinically relevant approach to automated skin lesion diagnosis that mirrors real-world clinical practice.
Artifacts in dermoscopic images---such as rulers, gel bubbles, or ink stains---can compromise automated skin lesion analysis and reduce diagnostic reliability. Despite their clinical relevance, prior research has primarily targeted the removal or impact assessment of single artifact types, without addressing their automatic detection or co-occurrence modeling.In this work, we introduce the first deep learning framework for multi-label artifact detection in dermoscopy, leveraging the Classification Transformer (C-Tran) to model dependencies between co-occurring labels through attention mechanisms. To address class imbalance and overconfident predictions, we propose the Class-Adaptive Focal loss with Confidence penalty (CAFC), which adaptively weights underrepresented classes and penalizes miscalibrated outputs. On the ISIC-2019 dataset, the model trained with CAFC surpasses both Binary Cross-Entropy and Focal losses, yielding the highest overall F1-score (0.87) and recall (0.91). The proposed framework also generalizes effectively to the external PH2 dataset, achieving an overall F1-score of 0.86 and a recall of 0.91, confirming robustness across domains and imaging distribution shifts. Additionally, the approach provides attention-based interpretability, revealing the spatial regions associated with each artifact type and enhancing transparency. Beyond its strong performance, the proposed approach establishes a foundation for future artifact-aware systems that could assist in image quality control, preprocessing, and bias auditing within clinical diagnostic pipelines.
Microfossil classification is an important discipline in subsurface exploration, for both oil & gas and Carbon Capture and Storage (CCS). The abundance and distribution of species found in sedimentary rocks provide valuable information about the age and depositional environment. However, the analysis is difficult and time-consuming, as it is based on manual work by human experts. Attempts to automate this process face two key challenges: (1) the input data are very large - our dataset is projected to grow to 3 billion microfossils, and (2) there are not enough labeled data to use the standard procedure of training a deep learning classifier. We propose an efficient pipeline for processing and grouping fossils by genus, or even species, from microscope slides using self-supervised learning. First we show how to efficiently extract crops from whole slide images by adapting previously trained object detection algorithms. Second, we provide a comparison of a range of self-supervised learning methods to classify and identify microfossils from very few labels. We obtain excellent results with both convolutional neural networks and vision transformers fine-tuned by self-supervision. Our approach is fast and computationally light, providing a handy tool for geologists working with microfossils.
Fibromyalgia is a chronic disease that affects a considerable fraction of the global population, primarily women. Physical activity is often recommended as a tool to manage the symptoms. In this study, we tried to replicate a positive result of pain reduction through physical activity. After collecting pain and physical activity data from seven women with fibromyalgia, one patient experienced a considerable reduction in pain intensity. According to the patient, the improvement was related to physical activity. Our study was conducted to investigate the replicability of this result through personalized activity recommendations. Out of the other six patients, three experienced a reduction in pain. The remaining three patients did not experience any pain relief. Our results show that two of these were not able to follow the activity recommendations. These results indicate that physical activity may have a positive effect on chronic pain patients. To estimate how effective physical activity can be for this patient group, an intervention with longer follow-ups and larger sample sizes needs to be performed in the future.
Patients with type 1 diabetes must continually decide how much insulin to inject before each meal to maintain blood glucose levels within a healthy range. Recent research has worked on a solution for this burden, showing the potential of reinforcement learning as an emerging approach for the task of controlling blood glucose levels. In this paper, we test and evaluate several deep Q-learning algorithms for automated and personalized blood glucose regulation in an in silico type 1 diabetes patient with the goal of estimating and delivering proper insulin doses. The proposed algorithms are model-free approaches with no prior information about the patient. We used the Hovorka model with meal variation and carbohydrate counting errors to simulate the patient included in this work. Our experiments compare different deep Q-learning extensions showing promising results controlling blood glucose levels, with some of the proposed algorithms outperforming standard baseline treatment.
Objective To apply deep learning to a data set of dental panoramic radiographs to detect the mental foramen for automatic assessment of the mandibular cortical width. Methods Data from the seventh survey of the Tromsø Study (Tromsø7) were used. The data set contained 5197 randomly chosen dental panoramic radiographs. Four pretrained object detectors were tested. We randomly chose 80% of the data for training and 20% for testing. Models were trained using GeForce RTX 2080 Ti with 11 GB GPU memory (NVIDIA Corporation, Santa Clara, CA, USA). Python programming language version 3.7 was used for analysis. Results The EfficientDet-D0 model showed the highest average precision of 0.30. When the threshold to regard a prediction as correct (intersection over union) was set to 0.5, the average precision was 0.79. The RetinaNet model achieved the lowest average precision of 0.23, and the precision was 0.64 when the intersection over union was set to 0.5. The procedure to estimate mandibular cortical width showed acceptable results. Of 100 random images, the algorithm produced an output 93 times, 20 of which were not visually satisfactory. Conclusions EfficientDet-D0 effectively detected the mental foramen. Methods for estimating bone quality are important in radiology and require further development.
This paper proposes a robust control design method using reinforcement learning for controlling partially-unknown dynamical systems under uncertain conditions. The method extends the optimal reinforcement learning algorithm with a new learning technique based on the robust control theory. By learning from the data, the algorithm proposes actions that guarantee the stability of the closed-loop system within the uncertainties estimated also from the data. Control policies are calculated by solving a set of linear matrix inequalities. The controller was evaluated using simulations on a blood glucose model for patients with Type 1 diabetes. Simulation results show that the proposed methodology is capable of safely regulating the blood glucose within a healthy level under the influence of measurement and process noises. The controller has also significantly reduced the post-meal fluctuation of the blood glucose. A comparison between the proposed algorithm and the existing optimal reinforcement learning algorithm shows the improved robustness of the closed-loop system using our method.
Bayesian approaches to Neural Architecture Search (NAS) offer several benefits when compared to typical grid-search methods. Marginalization of a joint posterior distribution of network parameters as well as network architecture specification allows for a principled analysis of predictive and model uncertainty. In this paper, we propose a method of applying Reversible Jump Markov Chain Monte Carlo (RJMCMC) as inference over a distribution of neural network depths. We refer to these models as Reversible Jump Bayesian Neural Networks (RJBNN), and show that a tenable acceptance probability for across-dimension proposals can be achieved through the use of a composite sampler featuring the Hamiltonian Monte Carlo (HMC) based No U-Turn Sampler (NUTS) algorithm. We compare the results of an RJBNN model with standard Bayesian Neural Networks (BNN) of comparable architecture sizes on a regression task for the Boston Housing dataset.
There is a large proliferation of complex data-driven artificial intelligence (AI) applications in many aspects of our daily lives, but their implementation in healthcare is still limited. This scoping review takes a theoretical approach to examine the barriers and facilitators based on empirical data from existing implementations. We searched the major databases of relevant scientific publications for articles related to AI in clinical settings, published between 2015 and 2021. Based on the theoretical constructs of the Consolidated Framework for Implementation Research (CFIR), we used a deductive, followed by an inductive, approach to extract facilitators and barriers. After screening 2784 studies, 19 studies were included in this review. Most of the cited facilitators were related to engagement with and management of the implementation process, while the most cited barriers dealt with the intervention’s generalizability and interoperability with existing systems, as well as the inner settings’ data quality and availability. We noted per-study imbalances related to the reporting of the theoretic domains. Our findings suggest a greater need for implementation science expertise in AI implementation projects, to improve both the implementation process and the quality of scientific reporting.
Foraminifera are single-celled marine organisms that construct shells that remain as fossils in the marine sediments. Classifying and counting these fossils are important in paleo-oceanographic and -climatological research. However, the identification and counting process has been performed manually since the 1800s and is laborious and time-consuming. In this work, we present a deep learning-based instance segmentation model for classifying, detecting, and segmenting microscopic foraminifera. Our model is based on the Mask R-CNN architecture, using model weight parameters that have learned on the COCO detection dataset. We use a fine-tuning approach to adapt the parameters on a novel object detection dataset of more than 7000 microscopic foraminifera and sediment grains. The model achieves a (COCO-style) average precision of 0.78 on the classification and detection task, and 0.80 on the segmentation task. When the model is evaluated without challenging sediment grain images, the average precision for both tasks increases to 0.84 and 0.86, respectively. Prediction results are analyzed both quantitatively and qualitatively and discussed. Based on our findings we propose several directions for future work and conclude that our proposed model is an important step towards automating the identification and counting of microscopic foraminifera.
Electronic health records (EHR) contain a lot of valuable information about individual patients and the whole population. Besides structured data, unstructured data in EHRs can provide extra, valuable information but the analytics processes are complex, time-consuming, and often require excessive manual effort. Among unstructured data, clinical text and images are the two most popular and important sources of information. Advanced statistical algorithms in natural language processing, machine learning, deep learning, and radiomics have increasingly been used for analyzing clinical text and images. Although there exist many challenges that have not been fully addressed, which can hinder the use of unstructured data, there are clear opportunities for well-designed diagnosis and decision support tools that efficiently incorporate both structured and unstructured data for extracting useful information and provide better outcomes. However, access to clinical data is still very restricted due to data sensitivity and ethical issues. Data quality is also an important challenge in which methods for improving data completeness, conformity and plausibility are needed. Further, generalizing and explaining the result of machine learning models are important problems for healthcare, and these are open challenges. A possible solution to improve data quality and accessibility of unstructured data is developing machine learning methods that can generate clinically relevant synthetic data, and accelerating further research on privacy preserving techniques such as deidentification and pseudonymization of clinical text. This article is categorized under: Applications of Computational Statistics > Health and Medical Data/Informatics
This paper shows new contributions in the detection of skin cancer, where we present the use of a customized hyperspectral system that captures images in the spectral range from 450 to 950 nm. By choosing a 7 × 7 sub-image of each channel in the hyperspectral image (HSI) and then taking the mean and standard deviation of these sub-images, we were able to make fits of the resulting curves. These fitted curves had certain characteristics, which then served as a basis of classification. The most distinct fit was for the melanoma pigmented skin lesions (PSLs), which is also the most aggressive malignant cancer. Furthermore, we were able to classify the other PSLs in malignant and benign classes. This gives us a rather complete classification method for PSLs with a novel perspective of the classification procedure by exploiting the variability of each channel in the HSI.
Given the high prevalence and associated cost of chronic pain, it has a significant impact on individuals and society. Improvements in the treatment and management of chronic pain may increase patients’ quality of life and reduce societal costs. In this paper, we evaluate state-of-the-art machine learning approaches in chronic pain research. A literature search was conducted using the PubMed, IEEE Xplore, and the Association of Computing Machinery (ACM) Digital Library databases. Relevant studies were identified by screening titles and abstracts for keywords related to chronic pain and machine learning, followed by analysing full texts. Two hundred and eighty-seven publications were identified in the literature search. In total, fifty-three papers on chronic pain research and machine learning were reviewed. The review showed that while many studies have emphasised machine learning-based classification for the diagnosis of chronic pain, far less attention has been paid to the treatment and management of chronic pain. More research is needed on machine learning approaches to the treatment, rehabilitation, and self-management of chronic pain. As with other chronic conditions, patient involvement and self-management are crucial. In order to achieve this, patients with chronic pain need digital tools that can help them make decisions about their own treatment and care.
Given an object of interest that evolves in time, one often wants to detect possible changes in its properties. The first changes may be small and occur in different scales and it may be crucial to detect them as early as possible. Examples include identification of potentially malignant changes in skin moles or the gradual onset of food quality deterioration. Statistical scale-space methodologies can be very useful in such situations since exploring the measurements in multiple resolutions can help identify even subtle changes. We extend a recently proposed scale-space methodology to a technique that successfully detects such small changes and at the same time keeps false alarms at a very low level. The potential of the novel methodology is first demonstrated with hyperspectral skin mole data artificially distorted to include a very small change. Our real data application considers hyperspectral images used for food quality detection. In these experiments the performance of the proposed method is either superior or on par with a standard approach such as principal component analysis.
Multi-instance (MI) learning is a branch of machine learning, where each object (bag) consists of multiple feature vectors (instances)—for example, an image consisting of multiple patches and their corresponding feature vectors. In MI classification, each bag in the training set has a class label, but the instances are unlabeled. The instances are most commonly regarded as a set of points in a multi-dimensional space. Alternatively, instances are viewed as realizations of random vectors with corresponding probability distribution, where the bag is the distribution, not the realizations. By introducing the probability distribution space to bag-level classification problems, dissimilarities between probability distributions (divergences) can be applied. The bag-to-bag Kullback–Leibler information is asymptotically the best classifier, but the typical sparseness of MI training sets is an obstacle. We introduce bag-to-class divergence to MI learning, emphasizing the hierarchical nature of the random vectors that makes bags from the same class different. We propose two properties for bag-to-class divergences, and an additional property for sparse training sets, and propose a dissimilarity measure that fulfils them. Its performance is demonstrated on synthetic and real data. The probability distribution space is valid for MI learning, both for the theoretical analysis and applications.
In recent years, hyperspectral imaging (HSI) has been shown as a promising imaging modality to assist pathologists in the diagnosis of histological samples. In this work, we present the use of HSI for discriminating between normal and tumor breast cancer cells. Our customized HSI system includes a hyperspectral (HS) push-broom camera, which is attached to a standard microscope, and home-made software system for the control of image acquisition. Our HS microscopic system works in the visible and near-infrared (VNIR) spectral range (400 - 1000 nm). Using this system, 112 HS images were captured from histologic samples of human patients using 20× magnification. Cell-level annotations were made by an expert pathologist in digitized slides and were then registered with the HS images. A deep learning neural network was developed for the HS image classification, which consists of nine 2D convolutional layers. Different experiments were designed to split the data into training, validation and testing sets. In all experiments, the training and the testing set correspond to independent patients. The results show an area under the curve (AUCs) of more than 0.89 for all the experiments. The combination of HSI and deep learning techniques can provide a useful tool to aid pathologists in the automatic detection of cancer cells on digitized pathologic images.