Background Machine learning (ML) has emerged as a vital asset for researchers to analyze and extract valuable information from complex datasets. However, developing an effective and robust ML pipeline can present a real challenge, demanding considerable time and effort, thereby impeding research progress. Existing tools in this landscape require a profound understanding of ML principles and programming skills. Furthermore, users are required to engage in the comprehensive configuration of their ML pipeline to obtain optimal performance.Results To address these challenges, we have developed a novel tool called Machine Learning Made Easy (MLme) that streamlines the use of ML in research, specifically focusing on classification problems at present. By integrating 4 essential functionalities-namely, Data Exploration, AutoML, CustomML, and Visualization-MLme fulfills the diverse requirements of researchers while eliminating the need for extensive coding efforts. To demonstrate the applicability of MLme, we conducted rigorous testing on 6 distinct datasets, each presenting unique characteristics and challenges. Our results consistently showed promising performance across different datasets, reaffirming the versatility and effectiveness of the tool. Additionally, by utilizing MLme's feature selection functionality, we successfully identified significant markers for CD8+ naive (BACH2), CD16+ (CD16), and CD14+ (VCAN) cell populations.Conclusion MLme serves as a valuable resource for leveraging ML to facilitate insightful data analysis and enhance research outcomes, while alleviating concerns related to complex coding scripts. The source code and a detailed tutorial for MLme are available at https://github.com/FunctionalUrology/MLme.
Focal Cortical Dysplasia (FCD) is a frequent cause of drug-resistant focal epilepsy in children and young adults. The international FCD classifications of 2011 and 2022 have identified several clinico-pathological subtypes, either occurring isolated, i.e., FCD ILAE Type 1 or 2, or in association with a principal cortical lesion, i.e., FCD Type 3. Here, we addressed the DNA methylation signature of a previously described new subtype of FCD 3D occurring in the occipital lobe of very young children and microscopically defined by neuronal cell loss in cortical layer 4. We studied the DNA methylation profile using 850 K BeadChip arrays in a retrospective cohort of 104 patients with FCD 1 A, 2 A, 2B, 3D, TLE without FCD, and 16 postmortem specimens without neurological disorders as controls, operated in China or Germany. DNA was extracted from formalin-fixed paraffin-embedded tissue blocks with microscopically confirmed lesions, and DNA methylation profiles were bioinformatically analyzed with a recently developed deep learning algorithm. Our results revealed a distinct position of FCD 3D in the DNA methylation map of common FCD subtypes, also different from non-FCD epilepsy surgery controls or non-epileptic postmortem controls. Within the FCD 3D cohort, the DNA methylation signature separated three histopathology subtypes, i.e., glial scarring around porencephalic cysts, loss of layer 4, and Rasmussen encephalitis. Differential methylation in FCD 3D with loss of layer 4 mapped explicitly to biological pathways related to neurodegeneration, biogenesis of the extracellular matrix (ECM) components, axon guidance, and regulation of the actin cytoskeleton. Our data suggest that DNA methylation signatures in cortical malformations are not only of diagnostic value but also phenotypically relevant, providing the molecular underpinnings of structural and histopathological features associated with epilepsy. Further studies will be necessary to confirm these results and clarify their functional relevance and epileptogenic potential in these difficult-to-treat children.
The generation of effector CD8+ T cells (TEFF) requires activation of naive CD8+ T cells (TN) by dendritic cells (DCs) within lymphoid tissue. To date, it remains elusive how the duration of TN-DC interactions and integration of activation signals are controlled in vivo. Here, we report that lymphoid stroma-secreted ligands for CCR7 constrained interaction duration by gradually inducing CD8+ T cell release from DCs. At late time points of interactions, CCR7 ligands repositioned the F-actin-promoting factor DOCK2 away from the DC interface to enable CD8+ T cell detachment, proliferation onset and acquisition of cytotoxicity. Lack of CCR7 signaling, as during ex vivo activation or in chronically inflamed lymphoid tissue, caused sustained T cell-DC interactions, and generated dysfunctional TEFF with high expression of inhibitory receptors, impaired antimicrobial activity, and poor recall responses. In sum, our findings uncover that lymphoid stromal chemokines act as built-in "disruptors" of T cell-DC interactions for long-term preservation of TEFF functionality. ### Competing Interest Statement The authors have declared no competing interest.
BACKGROUND:Assessing the performance of machine learning (ML) models requires careful consideration of the evaluation metrics used. It is often necessary to utilize multiple metrics to gain a comprehensive understanding of a trained model's performance, as each metric focuses on a specific aspect. However, comparing the scores of these individual metrics for each model to determine the best-performing model can be time-consuming and susceptible to subjective user preferences, potentially introducing bias. RESULTS:We propose the Machine Learning Cumulative Performance Score (MLcps), a novel evaluation metric for classification problems. MLcps integrates several precomputed evaluation metrics into a unified score, enabling a comprehensive assessment of the trained model's strengths and weaknesses. We tested MLcps on 4 publicly available datasets, and the results demonstrate that MLcps provides a holistic evaluation of the model's robustness, ensuring a thorough understanding of its overall performance. CONCLUSIONS:By utilizing MLcps, researchers and practitioners no longer need to individually examine and compare multiple metrics to identify the best-performing models. Instead, they can rely on a single MLcps value to assess the overall performance of their ML models. This streamlined evaluation process saves valuable time and effort, enhancing the efficiency of model evaluation. MLcps is available as a Python package at https://pypi.org/project/MLcps/.
BACKGROUND:In recent years, 3-dimensional (3D) spheroid models have become increasingly popular in scientific research as they provide a more physiologically relevant microenvironment that mimics in vivo conditions. The use of 3D spheroid assays has proven to be advantageous as it offers a better understanding of the cellular behavior, drug efficacy, and toxicity as compared to traditional 2-dimensional cell culture methods. However, the use of 3D spheroid assays is impeded by the absence of automated and user-friendly tools for spheroid image analysis, which adversely affects the reproducibility and throughput of these assays. RESULTS:To address these issues, we have developed a fully automated, web-based tool called SpheroScan, which uses the deep learning framework called Mask Regions with Convolutional Neural Networks (R-CNN) for image detection and segmentation. To develop a deep learning model that could be applied to spheroid images from a range of experimental conditions, we trained the model using spheroid images captured using IncuCyte Live-Cell Analysis System and a conventional microscope. Performance evaluation of the trained model using validation and test datasets shows promising results. CONCLUSION:SpheroScan allows for easy analysis of large numbers of images and provides interactive visualization features for a more in-depth understanding of the data. Our tool represents a significant advancement in the analysis of spheroid images and will facilitate the widespread adoption of 3D spheroid models in scientific research. The source code and a detailed tutorial for SpheroScan are available at https://github.com/FunctionalUrology/SpheroScan.
ABSTRACTMotivationA performance metric is a tool to measure the correctness of a trained Machine Learning (ML) model. Numerous performance metrics have been developed for classification problems making it overwhelming to select the appropriate one since each of them represents a particular aspect of the model. Furthermore, selection of a performance metric becomes harder for problems with imbalanced and/or small datasets. Therefore, in clinical studies where datasets are frequently imbalanced and, in situations when the prevalence of a disease is low or the collection of patient samples is difficult, deciding on a suitable metric for performance evaluation of an ML model becomes quite challenging. The most common approach to address this problem is measuring multiple metrics and compare them to identify the best-performing ML model. However, comparison of multiple metrics is laborious and prone to user preference bias. Furthermore, evaluation metrics are also required by ML model optimization techniques such as hyperparameter tuning, where we train many models, each with different parameters, and compare their performances to identify the best-performing parameters. In such situations, it becomes almost impossible to assess different models by comparing multiple metrics.ResultsHere, we propose a new metric called Machine Learning Cumulative Performance Score (MLcps) as a Python package for classification problems. MLcps combines multiple pre-computed performance metrics into one metric that conserves the essence of all pre-computed metrics for a particular model. We tested MLcps on 4 different publicly available biological datasets and the results reveal that it provides a comprehensive picture of overall model robustness.AvailabilityMLcps is available athttps://pypi.org/project/MLcps/and cases of use are available athttps://mybinder.org/v2/gh/FunctionalUrology/MLcps.git/main.Supplementary informationSupplementary data are available at Bioinformatics online.