Complex in vitro models (CIVMs) offer the potential to increase the clinical relevance of preclinical efficacy and toxicity assessments and reduce the reliance on animals in drug development. The European Society of Toxicologic Pathology (ESTP) and Society for Toxicologic Pathology (STP) are collaborating to highlight the role of pathologists in the development and use of CIVM. Pathologists are trained in comparative animal medicine which enhances their understanding of mechanisms of human and animal diseases, thus allowing them to bridge between animal models and humans. This skill set is important for CIVM development, validation, and data interpretation. Ideally, diverse teams of scientists, including engineers, biologists, pathologists, and others, should collaboratively develop and characterize novel CIVM, and collectively assess their precise use cases (context of use). Implementing a morphological CIVM evaluation should be essential in this process. This requires robust histological technique workflows, image analysis techniques, and needs correlation with translational biomarkers. In this review, we demonstrate how such tissue technologies and analytics support the development and use of CIVM for drug efficacy and safety evaluations. We encourage the scientific community to explore similar options for their projects and to engage with health authorities on the use of CIVM in benefit-risk assessment.
We describe a roadmap for a fully digital artificial intelligence (AI)-augmented nonclinical pathology laboratory across three continents. Underpinning the design are Good Laboratory Practice (GLP)-validated laboratory information management systems (LIMS), whole slide-scanners (WSS), image management systems (IMS), and a digital microscope intended for use by the nonclinical pathologist. Digital diagnostics are supported by tools that include AI-based virtual staining and deep learning-based decision support. Implemented during the COVID-19 pandemic, the initial digitized workflow largely mitigated disruption of pivotal nonclinical studies required to support pharmaceutical clinical testing. We believe that this digital transformation of our nonclinical pathology laboratories will promote efficiency and innovation in the future and enhance the quality and speed of drug development decision making.
Histopathologic evaluation and peer review using digital whole-slide images (WSIs) is a relatively new medium for assessing nonclinical toxicology studies in Good Laboratory Practice (GLP) environments. To better understand the present and future use of digital pathology in nonclinical toxicology studies, the Society of Toxicologic Pathology (STP) formed a working group to survey STP members with the goal of creating recommendations for implementation. The survey was administered in December 2019, immediately before the COVID-19 pandemic, and the results suggested that the use of digital histopathology for routine GLP histopathology assessment was not widespread. Subsequently, in follow-up correspondence during the pandemic, many responding institutions either began investigating or adopting digital WSI systems to reduce employee exposure to COVID-19. Therefore, the working group presents the survey results as a pre-pandemic baseline data set. Recommendations for use of WSI systems in GLP environments will be the subject of a separate publication.
The Society of Toxicologic Pathology's Scientific and Regulatory Policy Committee formed a working group to consider the present and future use of digital pathology in toxicologic pathology in general and specifically its use in primary evaluation and peer review in Good Laboratory Practice (GLP) environments. Digital histopathology systems can save costs by reducing travel, enhancing organizational flexibility, decreasing slide handling, improving collaboration, increasing access to historical images, and improving quality and efficiency through integration with laboratory information management systems. However, the resources to implement and operate a digital pathology system can be significant. Given the magnitude and risks involved in the decision to adopt digital histopathology, this working group used pertinent previously published survey results and its members' expertise to create a Points-to-Consider article to assist organizations with building and implementing digital pathology workflows. With the aim of providing a comprehensive perspective, the current publication summarizes aspects of digital whole-slide imaging relevant to nonclinical histopathology evaluations, and then presents points to consider applicable to both primary digital histopathology evaluation and digital peer review in GLP toxicology studies. The Supplemental Appendices provide additional tabulated resources.
Short-term (26 weeks) Tg.rasH2 mouse carcinogenicity studies have been conducted as an alternative model to the conventional 2-year mouse carcinogenicity studies, using urethane as a positive control material. In these studies, urethane was used at a dose of 1,000 mg/kg/dose, administered intraperitoneally on days 1, 3, and 5. Urethane consistently produces lung adenomas and carcinomas and hemangiosarcomas of the spleen, proving validity of the assay. We conducted 3 pilot studies at 3 different sites of Charles River Laboratories using a lower dose of urethane (500 mg/kg/dose), administered on days 1, 3, and 5, followed by a 12-week observation period. Our results demonstrate that a lower dose can be used successfully with fewer number of animals per sex to prove the validity of the assay. However, based on our cumulative experience with this model, we propose to eliminate positive control dose groups in future Tg.rasH2 carcinogenicity studies.
The 2019 manuscript by the Special Interest Group on Digital Pathology and Image Analysis of the Society of Toxicologic pathology suggested that a synergism between artificial intelligence (AI) and machine learning (ML) technologies and digital toxicologic pathology would improve the daily workflow and future impact of toxicologic pathologists globally. Now 2 years later, the authors of this review consider whether, in their opinion, there is any evidence that supports that thesis. Specifically, we consider the opportunities and challenges for applying ML (the study of computer algorithms that are able to learn from example data and extrapolate the learned information to unseen data) algorithms in toxicologic pathology and how regulatory bodies are navigating this rapidly evolving field. Although we see similarities with the "Last Mile" metaphor, the weight of evidence suggests that toxicologic pathologists should approach ML with an equal dose of skepticism and enthusiasm. There are increasing opportunities for impact in our field that leave the authors cautiously excited and optimistic. Toxicologic pathologists have the opportunity to critically evaluate ML applications with a "call-to-arms" mentality. Why should we be late adopters? There is ample evidence to encourage engagement, growth, and leadership in this field.
In Tg-rasH2 carcinogenicity mouse models, a positive control group is treated with a carcinogen such as urethane or N-nitroso-N-methylurea to test study validity based on the presence of the expected proliferative lesions in the transgenic mice. We hypothesized that artificial intelligence–based deep learning (DL) could provide decision support for the toxicologic pathologist by screening for the proliferative changes, verifying the expected pattern for the positive control groups. Whole slide images (WSIs) of the lungs, thymus, and stomach from positive control groups were used for supervised training of a convolutional neural network (CNN). A single pathologist annotated WSIs of normal and abnormal tissue regions for training the CNN-based supervised classifier using INHAND criteria. The algorithm was evaluated using a subset of tissue regions that were not used for training and then additional tissues were evaluated blindly by 2 independent pathologists. A binary output (proliferative classes present or not) from the pathologists was compared to that of the CNN classifier. The CNN model grouped proliferative lesion positive and negative animals at high concordance with the pathologists. This process simulated a workflow for review of these studies, whereby a DL algorithm could provide decision support for the pathologists in a nonclinical study.
Digital tissue image analysis is a computational method for analyzing whole-slide images and extracting large, complex, and quantitative data sets. However, as with any analysis method, the quality of generated results is dependent on a well-designed quality control system for the entire digital pathology workflow. Such system requires clear procedural controls, appropriate user training, and involvement of specialists to oversee key steps of the workflow. The toxicologic pathologist is responsible for reporting data obtained by digital image analysis and therefore needs to ensure that it is correct. To accomplish that, they must understand the main parameters of the quality control system and should play an integral part in its conception and implementation. This manuscript describes the most common digital tissue image analysis end points and potential sources of analysis errors. In addition, it outlines recommended approaches for ensuring quality and correctness of results for both classical and machine-learning based image analysis solutions, as adapted from a recently proposed Food and Drug Administration regulatory framework for modifications to artificial intelligence/machine learning-based software as a medical device. These approaches are beneficial for any type of toxicopathologic study which uses the described end points and can be adjusted based on the intended use of the image analysis solution.
Toxicologic pathology is transitioning from analog to digital methods. This transition seems inevitable due to a host of ongoing social and medical technological forces. Of these, artificial intelligence (AI) and in particular machine learning (ML) are globally disruptive, rapidly growing sectors of technology whose impact on the long-established field of histopathology is quickly being realized. The development of increasing numbers of algorithms, peering ever deeper into the histopathological space, has demonstrated to the scientific community that AI pathology platforms are now poised to truly impact the future of precision and personalized medicine. However, as with all great technological advances, there are implementation and adoption challenges. This review aims to define common and relevant AI and ML terminology, describe data generation and interpretation, outline current and potential future business cases, discuss validation and regulatory hurdles, and most importantly, propose how overcoming the challenges of this burgeoning technology may shape toxicologic pathology for years to come, enabling pathologists to contribute even more effectively to answering scientific questions and solving global health issues. [Box: see text]
The choroid plexus (CP) produces cerebrospinal fluid and has epithelial, interstitial, and vascular compartments. The CP is a potential site of toxicity, and recognizing the normal microanatomy in different animal models is important for the pathologist. In preclinical studies with beagle dog and New Zealand white rabbits, we observed variable numbers of adipocytes in the CP interstitium of control and xenobiotic-treated animals. The adipocytes were unilocular and consistent morphologically with white adipose tissue. There was a striking variability in the number of adipocytes; however, the presence of adipocytes was not associated with other microscopic findings that would suggest a pathologic process. The morphology of adipocytes was reminiscent of what is observed normally in the interstitium of other tissues like skeletal muscle, bone marrow, and the subcutis. Therefore, we propose that the interstitial adipocytes not be recorded as a finding in preclinical studies unless the adipocytes are altered spontaneously (ie, lipoma) or after xenobiotic treatment.
We read with interest the article “Interstitial adipocytes in the Beagle dog and New Zealand White rabbit choroid plexus” in the recent issue of Toxicologic Pathology. The authors present an unusual histologic observation in the choroid plexus of the Beagle dog and New Zealand White rabbit involving variable numbers of round, clear, vacuolated cells. They concluded, based on the morphology of the cells, that these cells were adipocytes. Unfortunately, no special staining, such as Oil Red O or Sudan Black B, was done to definitively show that these cells were indeed adipocytes. A recent article published in the Journal of Veterinary Diagnostic Investigation and presented as a case by the Joint Pathology Center demonstrated cells with very similar morphology in the eyelid of a horse, but special staining techniques revealed these cells to be a clear cell variant of squamous cell carcinoma. Therefore, we need to be careful not to assume everything that looks like an adipocyte, especially when it is located in an unusual location, is an adipocyte. We encourage authors to perform special stains to definitively identify cells with this morphology as adipocytes. Submitted by,
Microphysiological systems (MPS), commonly known as organs-on-chips, are a rapidly advancing technology that promises to impact many areas of medical and toxicological pathology. In this minireview, the history of MPS and its potential utility in safety assessment are described with the toxicologic pathologist in mind. Several MPS development focus areas are defined, and recent progress in the area is highlighted. MPS will likely become an important tool for the toxicologic pathologist as part of our role in the safety assessment process within the pharmaceutical, biotechnology, medical device, and cosmetic and agrichemical industries.
CONTEXT.—:Duchenne muscular dystrophy is a rare, progressive, and fatal neuromuscular disease caused by dystrophin protein loss. Common investigational treatment approaches aim at increasing dystrophin expression in diseased muscle. Some clinical trials include assessments of novel dystrophin production as a surrogate biomarker of efficacy, which may predict a clinical benefit from treatment.OBJECTIVES.—:To establish an immunofluorescent scanning and digital image analysis workflow that provides an objective approach for staining intensity assessment of the immunofluorescence dystrophin labeling and determination of the percentage of biomarker-positive fibers in muscle cryosections.DESIGN.—:Optimal and repeatable digital image capture was achieved by a rigorously qualified fluorescent scanning process. After scanning qualification, the MuscleMap (Flagship Biosciences, Westminster, Colorado) algorithm was validated by comparing high-power microscopic field total and dystrophin-positive fiber counts obtained by trained pathologists to data derived by MuscleMap. Next, the algorithm was tested on whole-slide images of immunofluorescent-labeled muscle sections from Duchenne muscular dystrophy, Becker muscular dystrophy, and control patients.RESULTS.—:When used under the guidance of a trained pathologist, the digital image analysis tool met predefined validation criteria and demonstrated functional and statistical equivalence with manual assessment. This work is the first, to our knowledge, to qualify and validate immunofluorescent scanning and digital tissue image-analysis workflow, respectively, with the rigor required to support the clinical trial environments.CONCLUSIONS.—:MuscleMap enables analysis of all fibers within an entire muscle biopsy section and provides data on a fiber-by-fiber basis. This will allow future clinical trials to objectively investigate myofibers' dystrophin expression at a greater level of consistency and detail.
Context.— Novel therapeutics often target complex cellular mechanisms. Increasingly, quantitative methods like digital tissue image analysis (tIA) are required to evaluate correspondingly complex biomarkers to elucidate subtle phenotypes that can inform treatment decisions with these targeted therapies. These tIA systems need a gold standard, or reference method, to establish analytical validity. Conventional, subjective histopathologic scores assigned by an experienced pathologist are the gold standard in anatomic pathology and are an attractive reference method. The pathologist's score can establish the ground truth to assess a tIA solution's analytical performance. The paradox of this validation strategy, however, is that tIA is often used to assist pathologists to score complex biomarkers because it is more objective and reproducible than manual evaluation alone by overcoming known biases in a human's visual evaluation of tissue, and because it can generate endpoints that cannot be generated by a human observer. Objective.— To discuss common visual and cognitive traps known in traditional pathology-based scoring paradigms that may impact characterization of tIA-assisted scoring accuracy, sensitivity, and specificity. Data Sources.— This manuscript reviews the current literature from the past decades available for traditional subjective pathology scoring paradigms and known cognitive and visual traps relevant to these scoring paradigms. Conclusions.— Awareness of the gold standard paradox is necessary when using traditional pathologist scores to analytically validate a tIA tool because image analysis is used specifically to overcome known sources of bias in visual assessment of tissue sections.