AIMS:To create and validate a weakly supervised artificial intelligence (AI) model for detection of abnormal colorectal histology, including dysplasia and cancer, and prioritise biopsies according to clinical significance (severity of diagnosis). MATERIALS AND METHODS:Triagnexia Colorectal, a weakly supervised deep learning model, was developed for the classification of colorectal samples from haematoxylin and eosin (H&E)-stained whole slide images. The model was trained on 24 983 digitised images and assessed by multiple pathologists in a simulated digital pathology environment. The AI application was implemented as part of a point and click graphical user interface to streamline decision-making. Pathologists assessed the accuracy of the AI tool, its value, ease of use and integration into the digital pathology workflow. RESULTS:Validation of the model was conducted on two cohorts: the first, on 100 single-slide cases, achieved micro-average model specificity of 0.984, micro-average model sensitivity of 0.949 and micro-average model F1 score of 0.949 across all classes. A secondary multi-institutional validation cohort, of 101 single-slide cases, achieved micro-average model specificity of 0.978, micro-average model sensitivity of 0.931 and micro-average model F1 score of 0.931 across all classes. Pathologists reflected their positive impressions on the overall accuracy of the AI in detecting colorectal pathology abnormalities. CONCLUSIONS:We have developed a high-performing colorectal biopsy AI triage model that can be integrated into a routine digital pathology workflow to assist pathologists in prioritising cases and identifying cases with dysplasia/cancer versus non-neoplastic biopsies.
Estimating the quality of machine translation systems has been an ongoing challenge for researchers in this field. Many previous attempts at using round-trip translation as a measure of quality have failed, and there is much disagreement as to whether it can be a viable method of quality estimation. In this paper, we revisit round-trip translation, proposing a system which aims to solve the previous pitfalls found with the approach. Our method makes use of recent advances in language representation learning to more accurately gauge the similarity between the original and round-trip translated sentences. Experiments show that while our approach does not reach the performance of current state of the art methods, it may still be an effective approach for some language pairs.
Digital pathology platforms with integrated artificial intelligence have the potential to increase the efficiency of the nonclinical pathologist's workflow through screening and prioritizing slides with lesions and highlighting areas with specific lesions for review. Herein, we describe the comparison of various single- and multi-magnification convolutional neural network (CNN) architectures to accelerate the detection of lesions in tissues. Different models were evaluated for defining performance characteristics and efficiency in accurately identifying lesions in 5 key rat organs (liver, kidney, heart, lung, and brain). Cohorts for liver and kidney were collected from TG-GATEs open-source repository, and heart, lung, and brain from internally selected R&D studies. Annotations were performed, and models were trained on each of the available lesion classes in the available organs. Various class-consolidation approaches were evaluated from generalized lesion detection to individual lesion detections. The relationship between the amount of annotated lesions and the precision/accuracy of model performance is elucidated. The utility of multi-magnification CNN implementations in specific tissue subtypes is also demonstrated. The use of these CNN-based models offers users the ability to apply generalized lesion detection to whole-slide images, with the potential to generate novel quantitative data that would not be possible with conventional image analysis techniques.
In Tg-rasH2 carcinogenicity mouse models, a positive control group is treated with a carcinogen such as urethane or N-nitroso-N-methylurea to test study validity based on the presence of the expected proliferative lesions in the transgenic mice. We hypothesized that artificial intelligence–based deep learning (DL) could provide decision support for the toxicologic pathologist by screening for the proliferative changes, verifying the expected pattern for the positive control groups. Whole slide images (WSIs) of the lungs, thymus, and stomach from positive control groups were used for supervised training of a convolutional neural network (CNN). A single pathologist annotated WSIs of normal and abnormal tissue regions for training the CNN-based supervised classifier using INHAND criteria. The algorithm was evaluated using a subset of tissue regions that were not used for training and then additional tissues were evaluated blindly by 2 independent pathologists. A binary output (proliferative classes present or not) from the pathologists was compared to that of the CNN classifier. The CNN model grouped proliferative lesion positive and negative animals at high concordance with the pathologists. This process simulated a workflow for review of these studies, whereby a DL algorithm could provide decision support for the pathologists in a nonclinical study.