Accurate prediction of MHC-peptide binding affinity remains a challenge for immunotherapeutic development. Existing methods struggle to jointly model functional semantics of polymorphic residues, evolutionary conservation constraints, and structural dynamic. We propose the Contrast learning-based Multi-feature Heterogeneous Subgraph model (CMHS) with sequence and structural representation. For sequence representation, we introduce LoRA fine-tuning to obtain the MHC-exclusive sequence representation from ESM2, then jointly BLOSUM50 to capture long-range functional dependencies and evolutionarily conserved residues. For structural representation, we use the biophysics-guided heterogeneous graph network. Constructing an MHC-peptide graph with a novel trainable Gaussian noise layer guided by crystallographic B-factors to dynamically simulate electron density uncertainty, coupled with a three-stage message-passing framework with subgraph aggregation, subgraph extraction and heterogeneous. Finally, to align sequence and graph representation spaces, we use contrastive learning to obtain a more comprehensive representation and to enhance the ability of model prediction. Evaluations on 16 HLA allele benchmarks show average SRCC improvements of 8.7 % , with improvements of average AUC of 7.6 % . This work establishes a new paradigm for predicting hypervariable immune interactions. The corresponding code can be founded in github.
Ancient murals represent invaluable heritage, providing deep insights into historic culture. However, these murals are increasingly at risk due to long-term degradation caused by oxidation and inadequate protection, and other factors, resulting in damages such as peeling and mold. Furthermore, the challenge posed by low-light conditions during image capture exacerbates the analyses and the restoration process, making it difficult to effectively identify and repair defects. To tackle these pressing challenges and facilitate efficient batch restoration at archeological sites, we propose a two-stage restoration model named MER. First, our model employs an innovative illumination enhancement module to improve the lighting of low-light mural images. Second, an automatic defect detection strategy, combined with a multi-receptive field approach, is utilized to systematically restore the identified defects. Comprehensive evaluations demonstrate that our MER model significantly enhances the visual quality of the restored images and achieves superior performance on relevant metrics compared to existing methods. Our works highlight the importance of addressing both lighting issues and defect detection in ancient mural restoration. Furthermore, we have launched a website dedicated to the restoration of ancient mural paintings, utilizing the proposed model. Code is available at https://gitee.com/bbfan2024/MER.git .
IntroductionBecause Alzheimer’s disease (AD) has significant heterogeneity in encephalatrophy and clinical manifestations, AD research faces two critical challenges: eliminating the impact of natural aging and extracting valuable clinical data for patients with AD.MethodsThis study attempted to address these challenges by developing a novel machine-learning model called tensorized contrastive principal component analysis (T-cPCA). The objectives of this study were to predict AD progression and identify clinical subtypes while minimizing the influence of natural aging.ResultsWe leveraged a clinical variable space of 872 features, including almost all AD clinical examinations, which is the most comprehensive AD feature description in current research. T-cPCA yielded the highest accuracy in predicting AD progression by effectively minimizing the confounding effects of natural aging.DiscussionThe representative features and pathogenic circuits of the four primary AD clinical subtypes were discovered. Confirmed by clinical doctors in Tangdu Hospital, the plaques (18F-AV45) distribution of typical patients in the four clinical subtypes are consistent with representative brain regions found in four AD subtypes, which further offers novel insights into the underlying mechanisms of AD pathogenesis.
General graph neural networks (GNNs) implement convolution operations on graphs based on polynomial spectral filters. Existing filters with high-order polynomial approximations can detect more structural information when reaching high-order neighborhoods but produce indistinguishable representations of nodes, which indicates their inefficiency of processing information in high-order neighborhoods, resulting in performance degradation. In this article, we theoretically identify the feasibility of avoiding this problem and attribute it to overfitting polynomial coefficients. To cope with it, the coefficients are restricted in two steps, dimensionality reduction of the coefficients' domain and sequential assignment of the forgetting factor. We transform the optimization of coefficients to the tuning of a hyperparameter and propose a flexible spectral-domain graph filter, which significantly reduces the memory demand and the adverse impacts on message transmission under large receptive fields. Utilizing our filter, the performance of GNNs is improved significantly in large receptive fields and the receptive fields of GNNs are multiplied as well. Meanwhile, the superiority of applying a high-order approximation is verified across various datasets, notably in strongly hyperbolic datasets. Codes are publicly available at: https://github.com/cengzeyuan/TNNLS-FFKSF.
SUMMARY:Estimating genome size using k-mer frequencies, which plays a fundamental role in designing genome sequencing and analysis projects, has remained challenging for polyploid species, i.e., ploidy p > 2. To address this, we introduce "findGSEP," which is designed based on iterative curve fitting of k-mer frequencies. Precisely, it first disentangles up to p normal distributions by analyzing k-mer frequencies in whole genome sequencing of the focal species. Second, it computes the sizes of genomic regions related to 1∼p (homologous) chromosome(s) using each respective curve fitting, from which it infers the full polyploid and average haploid genome size. "findGSEP" can handle any level of ploidy p, and infer more accurate genome size than other well-known tools, as shown by tests using simulated and real genomic sequencing data of various species including octoploids. AVAILABILITY AND IMPLEMENTATION:"findGSEP" was implemented as a web server, which is freely available at http://146.56.237.198:3838/findGSEP/. Also, "findGSEP" was implemented as an R package for parallel processing of multiple samples. Source code and tutorial on its installation and usage is available at https://github.com/sperfu/findGSEP.
Real-time Direct Normal Irradiance (DNI) prediction is crucial for reliable and economic operation of Concentrated photothermal Solar Power (CSP) system in arid desert areas. However, the stochastic characteristics of short-term multidimensional meteorological time series make intra-hour DNI prediction a challenging task. In this study, we have proposed a deep learning model called TLD, which is combined with topological features captured by Topology Data Analysis (TDA) and temporal features captured by LSTM to address this challenge. Experimental results demonstrated that TLD outperformed the five latest models (Ridge, RF, C_GRU, BiLSTM, and GBRT) on seven solar radiation datasets in arid desert areas. Further analysis revealed that the proportion of cloudy days is a key factor affecting the model's performance. To enhance the forecast ability of TLD, we developed a physics-informed hybrid model named TLDP based on TLD and a smart persistence model, which fully combines the DNI prediction ability of TLD under cloudy conditions and that of the smart persistence model under sunny conditions. Experimental results of eight datasets collected from real-world solar photothermal power stations indicated that TLDP outperformed existing models, which may lay a foundation for more economical and stable operation of CSP plants in arid desert areas.
Non-coding RNAs (ncRNAs) are a class of RNA molecules that lack the ability to encode proteins in human cells, but play crucial roles in various biological process. Understanding the interactions between different ncRNAs and their impact on diseases can significantly contribute to diagnosis, prevention, and treatment of diseases. However, predicting tertiary interactions between ncRNAs and diseases based on structural information in multiple scales remains a challenging task. To address this challenge, we propose a method called BertNDA, aiming to predict potential relationships between miRNAs, lncRNAs, and diseases. The framework identifies the local information through connectionless subgraph, which aggregate neighbor nodes' feature. And global information is extracted by leveraging Laplace transform of graph structures and WL (Weisfeiler-Lehman) absolute role coding. Additionally, an EMLP (Element-wise MLP) structure is designed to fuse pairwise global information. The transformer-encoder is employed as the backbone of our approach, followed by a prediction-layer to output the final correlation score. Extensive experiments demonstrate that BertNDA outperforms state-of-the-art methods in prediction assignment and exhibits significant potential for various biological applications. Moreover, we develop an online prediction platform that incorporates the prediction model, providing users with an intuitive and interactive experience. Overall, our model offers an efficient, accurate, and comprehensive tool for predicting tertiary associations between ncRNAs and diseases.
With the rapid development of the Internet, readers tend to share their views and emotions about news events. Predicting these emotions provides a vital role in social media applications (e.g., sentiment retrieval, opinion summary, and election prediction). However, news articles usually consist of objective texts that lack emotion words, making emotion prediction challenging. From prior studies, we know that comments that come directly from readers are full of emotions. Therefore, in this article, we propose a deep learning framework that first merges article and comment information to predict readers' emotions. At the same time, in the prediction process, we design a pseudo comment representation for unpublished news articles by the comments of published news. In addition, a better model is required to encode articles that contain implicit emotions. To solve this problem, we propose a block emotion attention network (BEAN) to encode news articles better. It includes an emotion attention mechanism and a hierarchical structure to capture emotion words and generate structural information during encoding. Experiments performed on three public datasets show that BEAN achieves the state-of-the-art average Pearson (AP) and accuracy (Acc@1). Moreover, results on four self-collected datasets show that both the introduction of emotional comments and BEAN in our framework improve the ability to predict readers' emotions.
Recent studies have demonstrated the significant role that circRNA plays in the progression of human diseases. Identifying circRNA-disease associations (CDA) in an efficient manner can offer crucial insights into disease diagnosis. While traditional biological experiments can be time-consuming and labor-intensive, computational methods have emerged as a viable alternative in recent years. However, these methods are often limited by data sparsity and their inability to explore high-order information. In this paper, we introduce a novel method named Knowledge Graph Encoder from Transformer for predicting CDA (KGETCDA). Specifically, KGETCDA first integrates more than 10 databases to construct a large heterogeneous non-coding RNA dataset, which contains multiple relationships between circRNA, miRNA, lncRNA and disease. Then, a biological knowledge graph is created based on this dataset and Transformer-based knowledge representation learning and attentive propagation layers are applied to obtain high-quality embeddings with accurately captured high-order interaction information. Finally, multilayer perceptron is utilized to predict the matching scores of CDA based on their embeddings. Our empirical results demonstrate that KGETCDA significantly outperforms other state-of-the-art models. To enhance user experience, we have developed an interactive web-based platform named HNRBase that allows users to visualize, download data and make predictions using KGETCDA with ease. The code and datasets are publicly available at https://github.com/jinyangwu/KGETCDA.
As a crucial issue in renewable energy, accurate prediction of direct normal solar irradiance (DNI) is essential for the stable operation of concentrated solar power (CSP) stations, especially for those in arid desert areas. In this study, in order to fully explore the laws of climate change and assess the solar resources in arid desert areas, we have proposed a mixed multi-pattern regression model (MMP) for short-term DNI prediction using prior knowledge provided by the clear-sky solar irradiance (CSI) model and time series patterns of key meteorological factors mined using PR-DTW on different time scales. The contrastive experimental results demonstrated that MMP can outperform existing DNI prediction models in terms of three recognized statistical metrics. To address the challenge of limited data in arid desert areas, we presented the T-MMP model involving combined transfer learning and MMP. The experimental results demonstrated that T-MMP outperformed MMP in DNI prediction by exploiting the significant correlation between meteorological time series patterns in similar areas for data augmentation. Our study provided a valuable prediction model for accurate DNI prediction in arid desert areas, facilitating the economical and stable operation of CSP plants.
Long non-coding RNAs (LncRNAs) serve a vital role in regulating gene expressions and other biological processes. Differentiation of lncRNAs from protein-coding transcripts helps researchers dig into the mechanism of lncRNA formation and its downstream regulations related to various diseases. Previous works have been proposed to identify lncRNAs, including traditional bio-sequencing and machine learning approaches. Considering the tedious work of biological characteristic-based feature extraction procedures and inevitable artifacts during bio-sequencing processes, those lncRNA detection methods are not always satisfactory. Hence, in this work, we presented lncDLSM, a deep learning-based framework differentiating lncRNA from other protein-coding transcripts without dependencies on prior biological knowledge. lncDLSM is a helpful tool for identifying lncRNAs compared with other biological feature-based machine learning methods and can be applied to other species by transfer learning achieving satisfactory results. Further experiments showed that different species display distinct boundaries among distributions corresponding to the homology and the specificity among species, respectively.
Financial news summarization (FNS) has been an attractive research problem in recent years, which aims to generate a shorter highlight of the news article while preserving key factual aspects, emotions, and opinions, providing significant assistance in stock trading and investment decision-making. However, FNS faces two challenges compared to the common domain. Firstly, financial news involves professional qualitative and quantitative information and salient content always scatters across long-range interactions. Secondly, financial news contains latent causal relationships, where historical information in the early generated sequence can significantly affect the subsequent decoding process. To address these difficulties, we propose an enhanced Seq2Seq model named TLGA, where the hierarchical Transformer-BiLSTM encoder can capture long-range interactions and sequential semantics while the Graph Attention-based decoder can fully utilize the historical information of decoded tokens and capture key causal relations. Moreover, we propose history-enhanced attention to concentrate on salient input content based on history semantics, guiding our decoder to generate the summary around the corresponding contents. It is also the first attempt to reuse history information of previously generated summary sequences in FNS using the idea of the Graph Attention Mechanism. Additionally, we construct the LCFNS dataset with 430,820 news-summary pairs for the lack of large-scale high-quality datasets in FNS. Experimental results on two financial datasets and two benchmark datasets indicate that our model outperforms other baselines.
Accumulating evidence indicates more and more circular RNAs (i.e. circRNAs) have played a vital role in regulating gene expression and are related to diseases through different biological procedures. Predicting circRNA-disease associations helps to conjecture possible disease related circRNA and facilitate human disease diagnosis and downstream treatment. Nevertheless, little effort was made to uncover the interaction between various diseases and circRNAs. In our work, human circRNA-disease association network is first generated using known miRNA-circRNA interactions and disease related miRNA (microRNA) information. Then we further integrated this information to compute similarity scores between human diseases and circRNAs. Here, we proposed one deep ensemble model called DeepInteract, which first used two stacked auto-encoders to explore hidden features utilizing similarity information, and adopted a 3-layer neuron network to predict the final association. Our method is capable of capturing more complex non-linear features comparing to other approaches. Our results indicate the proposed method is superior to other previous competitors. Many prediction results have been validated by some biological experiments using our model.
BACKGROUND:The zone adjacent to a transcription start site (TSS), namely, the promoter, is primarily involved in the process of DNA transcription initiation and regulation. As a result, proper promoter identification is critical for further understanding the mechanism of the networks controlling genomic regulation. A number of methodologies for the identification of promoters have been proposed. Nonetheless, due to the great heterogeneity existing in promoters, the results of these procedures are still unsatisfactory. In order to establish additional discriminative characteristics and properly recognize promoters, we developed the hybrid model for promoter identification (HMPI), a hybrid deep learning model that can characterize both the native sequences of promoters and the morphological outline of promoters at the same time. We developed the HMPI to combine a method called the PSFN (promoter sequence features network), which characterizes native promoter sequences and deduces sequence features, with a technique referred to as the DSPN (deep structural profiles network), which is specially structured to model the promoters in terms of their structural profile and to deduce their structural attributes.RESULTS:The HMPI was applied to human, plant and Escherichia coli K-12 strain datasets, and the findings showed that the HMPI was successful at extracting the features of the promoter while greatly enhancing the promoter identification performance. In addition, after the improvements of synthetic sampling, transfer learning and label smoothing regularization, the improved HMPI models achieved good results in identifying subtypes of promoters on prokaryotic promoter datasets.CONCLUSIONS:The results showed that the HMPI was successful at extracting the features of promoters while greatly enhancing the performance of identifying promoters on both eukaryotic and prokaryotic datasets, and the improved HMPI models are good at identifying subtypes of promoters on prokaryotic promoter datasets. The HMPI is additionally adaptable to different biological functional sequences, allowing for the addition of new features or models.
Programmable Logic Controller (PLC) is widely used in various fields and is an essential practical training for college engineering education. However, traditional PLC platform suffers from black box effect and low portability. In this study, a non-wrapped PLC laboratory kit is designed and tested for automatic control education. The laboratory kit is composed of PLC, man-machine interface, input and output elements, which are much more portable and flexible than elements of traditional PLC platform. The input elements mainly include buttons, encoder, temperature sensor, weight sensor and proximity switches, and the output elements are mainly indicator lights, lead screw slides driven by stepper motors, three-phase motor controlled by frequency converter, and electric heater controlled by solid-state relays, and servo motor. The basic practice projects, controlling practice projects, and innovative practice projects developed on the base of the laboratory kit can promote students’ practical ability and meet the teaching requirements of automatic control education. Moreover, the application of the laboratory kit could improve students’ wiring operation ability (overcoming black box effect that traditional PLC training brings), cultivate students’ design and problem-solving ability. The designed laboratory kit is intended for third-year students at Xi’an Jiaotong University.
In the era of data technology, data growth is occurring at an unprecedented scale. Business data and information are among the most valuable assets. Massive data analysis now drives nearly every aspect of society and can facilitate informed decision-making by businesses. Fully automated data flow detection of anomalies plays a crucial role in maintaining data service stability and preventing malicious attacks. This paper presents an extensible and generic real-time monitoring system framework (EGRTMS) for large-scale time-series data. EGRTMS employs a prediction module and an anomaly detection module within an anomaly filtering layer for the accurate identification of anomalies. Moreover, the alarm module and anomaly handling module within an anomaly trace processing layer enables the system to respond swiftly to the detected threats. Our solution does not rely on the labelling of anomalies; instead, a predictor module with a deep learning attention-based mechanism learns the normal behaviour of the data, and an anomaly handling module determines the dynamic alarm-threshold by utilizing a sliding window. The results of this study demonstrate that our framework significantly outperforms other anomaly detection systems on most real and synthetic datasets.
With the rapid development of social media, sentiment classification of financial microblogs has been a research hotpot. Online financial microblogs contain a wealth of information on market and usually express emotions or opinions. However, microblogs contain so much noise that it is difficult to make sentiment classification correctly. In this paper, we propose a two-stage model to improve the performance of sentiment classification through automatic text summarization techniques. The automatic text summarization model built on encoder-decoder model as well as attention mechanism can compress the original text and obtain the informative words, which can filter the noise in microblogs and capture significant semantics. Then we build the sentiment classifier based on hierarchical attention network. To make full use of sentiment semantics, we fuse every original blog and its generated summary to train our classifier. We establish two datasets based on Sina Weibo, one is for training the summarization model, another is for sentiment classification. Experimental results indicate that our model outperforms the other baselines on real datasets.
The promoter is a region located near the transcription start site (TSS) and responsible for the initiation and regulation of DNA transcription. Hence, accurate identification of promoters is essential for further building and understanding the mechanism of genetic regulatory networks. Numerous approaches for eukaryotic promoter identification were proposed. Nevertheless, the performances of these approaches are still unsatisfactory due to the variety nature of promoters. To extract more discriminative features and accurately identify eukaryotic promoters, here, we develop an effective hybrid deep learning model HDLMepi, which is able to characterize the original promoter sequences and the structural profiles of promoters simultaneously. We integrate the method we name PromoterClCce which characterizes the original promoter sequences and extracts sequence features, with an approach DSPN, which we design to model the structural profile of promoters and extract structure features, in HDLMepi for precisely eukaryotic promoter identification. We apply HDLMepi on both human and plants datasets and the experimental results demonstrate it is effective in promoter features extraction and can improve the performance of promoter identification significantly. HDLMepi is also open to add new features or new models and can be applied to other biology functional sequences.
The design and optimization of Concentrated Solar Power-Photovoltaic (CSP-PV) hybrid system is a hot topic in the field of solar energy. By merging the advantages of these two forms of power generation, this system can provide the cheap and controllable solar energy. To match the demand of the grid, the proportion of different energy sources in this hybrid system need to be optimized carefully. However, most related works just consider the balance of energy output and consumption in the level of the power plant, while the key parameters of the CSP plant generally in varied forms with different situations. Thus, a method can optimize all the main parameters of the CSP and the hybrid system in the same time is in need. In this way, we process a method based on the artificial fish-swarm algorithm to complete the global optimization of CSP-PV Hybrid System, the experimental result proven the effectiveness of the method.
Nowadays, with the rapid development of related technologies, the solar power become an important component of the whole energy system. At present, there are two main forms of solar power generation: photovoltaics (PV) and concentrated solar power (CSP). Among them, PV is much cheaper, but more susceptible to resource conditions, while CSP is more controllable based on the thermal storage section, but still expensive. To integrate the advantages of these two kinds of technologies, the hybrid solar power system is proposed by many researchers. Some single objective optimization algorithms are used in the process of design such systems. However, it is still a dilemma to deal with the cost and stability in the hybrid system. In this paper, we try to propose an Multi-Objective Particle Swarm Optimization (MO_PSO) algorithm to solve this problem, which can consider the performance and cost of the project at the same time. The experimental result based on the real data shown that this algorithm can provide a feasible solution of the hybrid power system with stable output and acceptable cost. Furthermore, this method based on artificial intelligence can be used in other hybrid systems optimization in the smart grid.