Federated learning (FL) has expanded the scope of distributed machine learning by training a global model through the amalgamation of knowledge from various distributed clients. However, the challenge of non-i.i.d. local datasets among clients introduces statistical heterogeneity, thereby compromising the performance of a single global model. Personalized federated learning (PFL) seeks to mitigate this issue by training individualized models tailored for each client. Despite the improved performance achieved by PFL, current approaches lack interpretability in quantifying the significance of inter-client contributions. Furthermore, they often pursue individual models at clients while performing model aggregation to obtain a single global model at the FL server, which still struggles to effectively capture the distinctions among clients. In response to these problems, we propose the personalized Federated learning with Transparent Inter-client Contribution (pFedTIC.) approach. Specifically, pFedTIC. embraces a dual-level personalized model aggregation strategy to derive an individualized model for each client, and assesses inter-client contribution with the aggregation weights for enhancing transparency. It conducts model aggregation at both the server and client sides using the similarity of model parameters and learning representations, mutual contributions between clients, and model performance. Theoretical analyses are derived to establish the non-convex convergence rate of pFedTIC.. Experimental results on benchmark datasets demonstrate its superiority over competitive methods, affirming its effectiveness in handling data heterogeneity. Moreover, the experiments also showcase its capability to interpret inter-client contributions, fostering more transparent FL collaborations.
Alternatively spliced isoforms from the same gene can perform distinct functions; however, their cell-type-specific roles remain largely uncharacterized, limiting our ability to understand cellular diversity and development beyond traditional gene-level analyses. We present cIsoFun, a multi-modal fusion framework for cell-type-specific isoform function prediction from single-cell transcriptomics data. cIsoFun leverages pre-trained ESM-2 and BERT models to extract initial sequence features, constructs a multiplex heterogeneous network over genes, isoforms, GO terms, and cell types to represent their complex relationships, and applies relation-aware attention to integrate multi-modal information and refine node embeddings. It then optimizes a multi-component loss on the updated embeddings to predict isoform functions, enabling biological interpretability via sequence-importance and cell-type-specific analyses. Experiments demonstrate that cIsoFun outperforms existing methods, particularly for sparse GO terms, and reveal distinct functional programs across contexts: kidney tumor cells are enriched for metabolism and growth regulation, skin tumor cells emphasize immune surveillance and migration, and cell lines prioritize DNA repair and telomere maintenance. Sequence-importance analysis highlights critical amino-acid regions and shows that domains annotated with the same function can exhibit distinct importance profiles across spliced isoforms. Together, these results provide new insights into cell-type-specific isoform functionality and establish cIsoFun as a practical tool for single-cell isoform analysis. Code and datasets are available at www.sdu-idea.cn/codes.php?name=cIsoFun.
Federated learning (FL) has expanded the scope of distributed learning by training models through the combination of knowledge from various dispersed data sources. Traditional FL methods, which rely on synchronous communication, often suffer inefficiencies due to the heterogeneous nature of client devices. To address these limitations, asynchronous federated learning (AFL) allows clients to communicate with the central server at their own pace, enhancing flexibility and scalability. However, AFL struggles with efficiency and performance in scenarios involving heterogeneous clients with non-i.i.d. data and varied model architectures, which is a pervasive but under-studied framework. We formalize this problem as a new learning topic called Asynchronous Federated Learning with Data and Model Heterogeneity (AFL-DMH), and introduce the Federated Asynchronous and Personalized Prototype aggregation (FedAPP) method to tackle it. Specifically, FedAPP leverages shared prototypes to facilitate effective knowledge transfer among clients. It introduces the asynchronous and personalized prototype aggregation strategy that performs aggregation based on participant delay, models the staleness and quality of local prototypes and adopts the attention-based aggregation to generate individualized prototypes for each client, providing them with collective knowledge and thereby boosting local model training. Theoretical analyses are conducted to establish the non-convex convergence rate of FedAPP. Experiments on benchmark datasets demonstrate the superior performance and efficiency of FedAPP compared to competitive baselines, affirming its effectiveness in addressing asynchronous communication, heterogeneous data and model challenges.
Abstract Spatial transcriptomics enables high-resolution profiling of gene expression within spatial contexts, yet its potential is often hindered by fragmented toolchains, intricate parameters, and cognitive bottlenecks of interpreting high-dimensional data. While recent Large Language Model agents have attempted to automate this process, they remain constrained by rigid execution logic, lack multimodal feedback for self-correction, and operate in epistemic isolation from established biological knowledge. Here, we present STAnalyzer, an intelligent multi-agent framework designed to automate the end-to-end analytical lifecycle—from raw data processing to biological hypothesis generation. Transcending traditional pipelines, STAnalyzer employs a collaborative intelligence architecture to achieve three core capabilities: (1) Intent-Driven Orchestration , which dynamically translates natural language queries into rigorous bioinformatics workflows; (2) Multi-Modal Self-Refinement , which autonomously ensures analytical robustness through closed-loop synthesis of evidence from visual patterns and statistical metrics; and (3) Evidence-based Cross-Validation , which bridges the gap between data-driven correlations and biological causation by anchoring findings in ground-truth literature and structured databases. By eliminating manual analytical bottlenecks and ensuring rigorous evidentiary traceability and transparency, STAnalyzer makes high-resolution spatial omics more accessible to a broader research community. It provides a robust and scalable framework for cross-platform automated analysis and accelerated biological discovery, translating massive spatial datasets into verifiable biological insights.
Fairness-aware machine learning aims to build predictive models that comply with fairness requirements, particularly concerning sensitive attributes such as race, gender, and age. Among causality-based fairness notions, counterfactual fairness is widely adopted for its individual-level guarantees, requiring that an individual’s predicted outcome remains unchanged in a counterfactual world where its sensitive attribute is altered. However, existing methods critically assume that the true causal graph is fully known, which is rarely the case in practice. Moreover, counterfactual fairness suffers from inherent identifiability limitations, as counterfactual quantities cannot always be uniquely estimated from observational data, especially under incomplete causal knowledge. To address these challenges, we propose a principled framework (CF-ICG) for counterfactual fairness under imperfectly known causal graphs, e.g., Completed Partially Directed Acyclic Graphs (CPDAGs). We first introduce a criterion to determine the identifiability, and bound the counterfactual quantities under CPDAGs. Building upon this, we develop an efficient local algorithm that avoids the exhaustive enumeration of all DAGs, ensuring robustness against worst-case fairness violations. Experimental results on synthetic and real-world datasets demonstrate the practical effectiveness and theoretical soundness of CF-ICG.
With growing concerns over user privacy, federated recommendation (FedRec) has emerged as a mainstream solution for personalized recommendation services. FedRec trains user-private parameters on local clients while collaboratively updating global parameters on a centralized server. However, despite advances in optimizing these local and global parameters, existing methods overlook two key challenges: tradeoff training and distribution discrepancy. Tradeoff training balances timely local updates with diverse global parameters, limiting the model's learning ability. Distribution discrepancy arises from the divergence between locally trained global parameters and those aggregated by the server, corrupting inference performance. To fill in the gap, we propose FedSC, a principled federated recommendation framework that boosts FedRec's training and inference processes with minimal yet nontrivial efforts. During training, FedSC employs a stochastic aggregation strategy where all users participate in every round, while only a random subset is selected for aggregation, preserving the diversity of global parameters and ensuring timely local updates. During inference, FedSC makes recommendations with a consistency inference mechanism that uses the most recent locally trained global parameters of each user to improve the model's understanding of user preferences. Extensive experiments on multiple benchmark datasets demonstrate the superiority of FedSC, achieving up to a 20% improvement in most evaluation scenarios.
Epistasis plays a crucial role in explaining missing heritability in complex traits, yet most detection methods fail to effectively capture local and global interaction patterns and long-range dependencies critical to complex trait architecture. We propose Epiformer that leverages genome language model Evo 2 to capture long-range dependencies from genetic background, and a dual-channel network to jointly model local and global epistasis and additive effects. Epiformer can identify key SNPs and their interactions from complex genomic data to empower phenotype prediction with interpretability, which reinforces epistasis detection. Epiformer performs robustly across species, revealing biologically meaningful patterns and offering new insights into genetic architecture.
Machine learning, viewed through a causal lens, has sparked a strong interest in the pursuit of fairness. Counterfactual fairness, a popular notion within this framework, evaluates the fairness of a model by comparing its predictions for each individual in the real world with those in counterfactual scenarios, where sensitive attributes (e.g., race, gender, age) are modified. Existing methods for learning counterfactual fairness models rely on having access to complete and clean data. However, real-world data are often of low quality, frequently affected by issues such as missing values. These challenges hinder the training of accurate causal models and mislead the development of counterfactual fairness models. In this paper, we propose the Counterfactual Fair prediction over Missing Data (CFairMD) method to bridge this important gap. CFairMD proposes a causal importance-weighted autoencoder to impute missing data and perform counterfactual inference. It integrates missing data within a joint model framework that captures the relationships between covariates and outcomes. Additionally, we design a counterfactual symmetric function to generate fair representations, complemented by a causally invariant penalty. Theoretical analysis shows that CFairMD achieves counterfactual fairness guarantees in a scalable and flexible manner. Extensive experimental results on four benchmarking datasets show that CFairMD outperforms eight state-of-the-art approaches, with over 22% higher counterfactual fairness gain on average.
The safety and modernization of traditional Chinese medicine (TCM) are significant concerns for human beings. Recently, the adverse effects caused by the use of certain TCMs have been frequently reported. Although TCMs may cause toxic reactions, they also play critical roles in treating multiple complex diseases. Therefore, toxicity research is urgently needed for the safe usage of TCMs. However, existing databases for TCMs primarily focus on the pharmacological effects of TCMs, with limited attention to the toxicity. They neither distinguish the toxic effects of formulas, herbs, and ingredients, nor classify and summarize targets for specific toxic manifestations, or assemble evidence from previous studies. We developed TCMToxDB, a comprehensive database that focuses on the toxicity and safe usage of TCMs. TCMToxDB systematically integrates and analyses the research results of toxic TCMs, offering users diverse information acquisition and analysis services. In addition, it assembles five canonical herb-target and ingredient-target interaction prediction algorithms with different advantages, which support the prediction of toxic targets of herbs and ingredients to empower the toxicity research of TCMs and to meet users' personal needs. TCMToxDB is accessible at https://www.sdu-idea.cn/TCMToxDB.
Proteoforms translated from alternatively spliced transcripts contribute to the functional repertoire of the cell by performing diverse biological functions, contributing to the functional diversity of genomics and proteomics. However, the lack of existing databases that integrate functional annotations of proteoforms, and analyse the drivers of their functional differences significantly hinders in-depth research into proteoform functions. We introduce ProteoformDB, a new web resource with integrated in-platform analytical capabilities, organizes transcript-level functional annotations of proteoforms across multiple species, and provides services for prediction of proteoform functions and analysis of functional regulatory mechanisms. ProteoformDB develops user-friendly interfaces for information search, visualization, function supplement, differential analysis, and data download services. Particularly, it enables users to investigate the impact of molecular events on the function of proteoforms at multiple levels, including sequences, domains, and post-translational modifications, among others, thereby uncovering the functional differences between protein variants. The current version includes processed data (154.83 GB) for 214 animal and 28 plant species, and will become a valuable and expandable proteoform functional resource for studying genome and transcriptome functions, disease mechanisms, and other related research.
Multiple clustering aims to uncover diverse latent structures within the data, enabling a more comprehensive understanding of complex datasets. However, existing approaches either heavily rely on user-supplied keywords or disregard user-interested clustering types, limiting the ability to discover the full range of explainable clusterings of interests, particularly in high-dimensional settings. Furthermore, existing methods insufficiently leverage the rich textual semantics and fall short in fully integrating multi-modal information. To address these challenges, we propose MLLM enriched Multiple Clustering (MLLMMC), a novel framework that leverages multi-modal large language model (MLLM) to explore explainable non-redundant clustering. Specifically, MLLMMC first employs MLLM to generate sample descriptions, which serve as input for LLM to perform prompt-driven reasoning and infer latent clustering types, and then merges them with user-interested types to obtain diverse and explainable clustering types. For each selected type, MLLMMC utilizes MLLM to generate sample-level textual descriptions and aligns them with corresponding visual features through a cross-attention fusion module, which produces a semantically aligned and enriched representation for the target clustering type. Extensive experiments on six benchmark datasets from diverse domains demonstrate that MLLMMC achieves diverse, explainable, and high-quality clustering outcomes, outperforming state-of-the-art multiple clustering methods with a large margin.
Learning the dynamic causal structure is a difficult challenge in discovering causality from time series. Most existing studies rely on distributional or structural invariance to uncover the underlying causal dynamics, assuming stationary or partially stationary causality, which frequently conflicts with complex causal relationships in the real world. This boosts temporal causal discovery to encompass fully dynamic causality, where both instantaneous and lagged causal dependencies may change over time, bringing significant challenges to the efficiency and stability of causal discovery. To tackle these challenges, we introduce DyCausal, a dynamic causal structure learning framework that leverages convolutional networks to effectively model causal structures within coarse-grained time windows, and introduces linear interpolation to refine causal structures to each time step and recover time-varying causal graphs. In addition, we propose an acyclic constraint based on matrix norm scaling. It is more stable both theoretically and empirically, and constrains loops in dynamic causal structures with improved efficiency. Evaluations on both synthetic and real-world datasets prove that DyCausal significantly outperforms existing methods and identifies fully dynamic causal structures from coarse to fine.
Cancer survival analysis with multimodal data is crucial for precise treatments and patient benefits. However, the following challenges prohibit integrating histopathology and genomics: (i) multimodal data is not always complete, especially for the more costly genomics data; (ii) intricate interactions between different modalities are difficult to capture and understand. To response, we propose an end-to-end framework (CIMA) that coordinates Cyclic modality generation and Multi-grained multimodal Alignment. Specifically, CIMA designs a cyclic modality reconstruction module to reciprocally impute missing modalities and infer the interactions between them. Next, it introduces the multi-grained alignment module over the imputed data and interactions to mine fine-grained alignments between histopathology (slide patches) and genomics (biological pathways). CIMA then constructs the adaptive fusion module to leverage multimodal data and alignments for survival prediction. Extensive experiments on cancer benchmark datasets demonstrate that CIMA outperforms existing methods and exhibits good interpretability, providing valuable insights into intricate relationships between pathological phenotypes and biological pathways.Our code is released in the supplementary materials.
Federated prompt learning (FPL) offers a parameter-efficient way to adapt large-scale vision-language models by collaboratively optimizing lightweight prompts across distributed clients. Existing approaches typically assume that prompts learned on heterogeneous domains can be safely aggregated. We show that this assumption breaks down in cross-domain federated settings with domain and model heterogeneity: naive global averaging induces cross-domain prompt interference and can even underperform simple intra-domain collaboration. Through geometric and optimization analyses, we find that prompts from different domains are semantically separated and exhibit low gradient alignment, which explains their poor compatibility under global aggregation. Motivated by these observations, we propose DaFPL, a domain-aware FPL framework that decomposes each client prompt into two complementary parts: a domain-transferable component that captures domain-invariant semantics and a domain-specific component that preserves domain-dependent characteristics. We introduce a domain discriminator to enforce the intended functional roles of the two components. In addition, we design a domain-aware aggregation strategy that aggregates domain-transferable prompts globally through an entropy-based invariance gate, while aggregating domain-specific prompts only within each domain. We further provide a non-convex convergence analysis of DaFPL. Extensive experiments on four multi-domain benchmarks demonstrate that DaFPL consistently outperforms strong FPL baselines.
Federated Learning is a data privacy-protected distributed machine learning framework, but malicious clients can damage it. Byzantine-robust federated learning aims to learn an accurate global model despite the presence of malicious clients. Most current defenses assume that clients have identically and independently distributed (i.i.d.) data and thus cannot perform well in canonical non-i.i.d. scenarios. Several non-i.i.d. statistic-based defenses have been recently proposed to identify malicious clients through gradient statistics without any auxiliary techniques. They thus can only ensure robustness under certain attacks with specific characteristics. We propose Sophon, a comprehensive defense using auxiliary data to combat an arbitrary number of malicious clients in both i.i.d. and non-i.i.d. cases. Specifically, Sophon first normalizes received client gradients to reduce the dominance of malicious gradients. Then it introduces a dual trust mechanism to assign the aggregation weight for each gradient. The dual trust mechanism estimates the consistency-based and diversity-based trust scores of client gradients and integrates the two scores as the aggregation weight to effectively suppress the impact of malicious gradients. Extensive experimental results on three datasets from different domains, with diverse models and FL scenarios, show that Sophon is robust in maintaining the overall accuracy of the training model.
Multiple clustering approaches aim to partition complex data in different ways. These methods often exhibit a one-to-many relationship in their results, and relying solely on the data context may be insufficient to capture the patterns relevant to the user. User's expectation is key for the multiple clustering task. Two main challenges exist: identifying the significant features to represent user interests and aligning those interests with the clustering results. To address this issue, we propose Contrastive Multiple Clusterings (CMClusts), which extends contrastive learning to multiple clustering by elevating traditional instance-level contrast to clustering-level contrast. Furthermore, CMClusts integrates user expectations or interests by extracting desired features through tailored data augmentations, enabling the model to effectively capture user-relevant clustering features. Experimental results on benchmark datasets show that CMClusts can generate interpretable and high-quality clusterings, which reflect different user interests.
Federated Recommendation (FedRec) systems are recognized as privacy-preserving solutions for collaboratively training recommender models without sharing users' private data. However, recent studies have revealed that FedRec systems are vulnerable to interaction-level membership inference attacks. In such attacks, a semi-honest server can employ crafted methods to infer users' interacted items. In this article, we identify that user preference information is predominantly stored in the user-uploaded parameters rather than in the local parameters after local training. Leveraging this insight, we expose a new interaction vulnerability and introduce the PubPara attack. Our experiments show that PubPara improves the inference performance by at least 40% over existing attacks, while requiring minimal inference time and remaining robust against current defense methods. To safeguard user privacy without compromising recommender performance, we propose MultiVerse, a novel countermeasure. MultiVerse utilizes untrained items outside the user's local training data to obfuscate the server's inference of interacted items. It includes a four-step strategy (training, optimization, refinement, and denoising) to achieve robust defense. Extensive experiments on three representative FedRec models (F-NCF, F-LightGCN, and FedRAP) across three real-world datasets validate that MultiVerse significantly degrades the attack's inference performance to near the level of random guess while maintaining lossless recommender performance.
Incomplete multi-view data presents a significant challenge for multi-view clustering (MVC). Existing incomplete MVC solutions commonly rely on data imputation to convert incomplete data into complete data. However, this paradigm suffers from the risk of error accumulation when clustering unreliable imputed data, causing suboptimal clustering performance. Moreover, using imputation to fulfill missing data is inefficient, while inferring data categories based solely on the existing views is extremely challenging. To this end, we propose an Imputation-free Incomplete MVC (I2MVC) via pseudo-supervised knowledge distillation. Specifically, I2MVC decomposes the incomplete MVC problem into two tasks: an MVC task for complete data and a pseudo-supervised classification task for fully incomplete data. A self-supervised simple contrastive Teacher network is trained for clustering complete data, and its knowledge is distilled into a lightweight pseudo-supervised Student network. The Student network, unrestricted by view completeness, further guides the clustering of fully incomplete data. Finally, the clustering results from both tasks are merged to generate the final clustering outcome. Experimental results on benchmark datasets demonstrate the effectiveness of I2MVC.
We study the problem of learning rules for graphs. Traditional methods often suffer from large search spaces due to the enumeration of all candidate rules. Although some recent neural logic methods are more efficient in learning rules, they are generally restricted to learning chain-like rules with limited expressiveness. Taking the advantage of Reinforcement Learning (RL) in reducing search space, we implement a policy network based RL method for learning graph rules, denoted as GraphRulRL. In our research, we convert graph rules into sequences of edges, transforming the task of graph rule learning into a process of sequentially adding edges that can be solved by RL. Specifically, GraphRulRL follows a two-stage framework. In the first stage, we train a policy network for graph rule learning, which evaluates graph rules using support with anti-monotonicity as rewards during training. In the second stage, we integrate the well-trained policy network with beam search for iterative searching to generate graph rules. Experimental results prove the effectiveness of the proposed method.