• 学术搜索
  • 科研智能体
    • Research Labs
    • AI 阅读
    • AI 文库
    • 深度研究
    • 学者亮点
  • 学术资源
    • AI2000
    • 期刊/会议
    • 学者库
    • 学术API
      MCP&Skill
    • 溯源树
    • 数据集
  • 知识沉淀
    • 学术空间
订阅小程序
旧版功能
aminer vip
开通会员低至0.73元/天
一次搞定AI科研
立即登录
  • English
  • 联系方式
    H

    Helmholtz Center for Information Security,Helmholtz Association of German Research Centres

    EST. 2011
    351论文总数
    6,855引用总数

    论文量&引用量时间轴

    机构学者

    论文(352)

    年份
    起
    –
    止
    排序
    1Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
    Mike A Merrill, Alexander Glenn Shaw,Nicholas Carlini,Boxuan Li, Harsh Raj, Ivan Bercovich, Lin Shi, Jeong Yeon Shin, Thomas Walshe, E. Kelly Buchanan,Junhong Shen,Guanghao Ye,

    AI agents may soon become capable of autonomously completing valuable, long-horizon tasks in diverse domains. Current benchmarks either do not measure real-world tasks, or are not sufficiently difficult to meaningfully measure frontier models. To this end, we present Terminal-Bench 2.0: a carefully curated hard benchmark composed of 89 tasks in computer terminal environments inspired by problems from real workflows. Each task features a unique environment, human-written solution, and comprehensive tests for verification. We show that frontier models and agents score less than 65% on the benchmark and conduct an error analysis to identify areas for model and agent improvement. We publish the dataset and evaluation harness to assist developers and researchers in future work at tbench.ai.

    ICLR 2026引用:720
    引用
    AI阅读
    加入学术空间
    2FedMuon: Federated Learning with Bias-corrected LMO-based Optimization
    Yuki Takezawa,Anastasia Koloskova,Xiaowen Jiang,Sebastian U Stich

    Recently, a new optimization method based on the linear minimization oracle (LMO), called Muon, has been attracting increasing attention since it can train neural networks faster than the existing adaptive optimization methods, such as Adam. In this paper, we study how Muon can be utilized in federated learning. We first show that straightforwardly using Muon as the local optimizer of FedAvg does not work since the LMO is a biased operator. We then propose FedMuon, which can mitigate this issue and can converge to the stationary point. We also analyze how solving the LMO approximately affects the convergence rate and find that, surprisingly, FedMuon can converge for any number of Newton-Schulz iterations, while it can converge faster as we solve the LMO more accurately. Through experiments, we demonstrated that FedMuon can outperform the state-of-the-art federated learning methods.

    ICLR 2026引用:10
    引用
    AI阅读
    加入学术空间
    3Agentic AI Software Engineers: Programming with Trust
    Abhik Roychoudhury, Corina Păsăreanu,Michael Pradel,Baishakhi Ray

    How LLM agents present AI software engineering workflows of the future, and whether the focus of programming will shift from scale to trust.

    2026Communications of the ACM(2026)引用:7
    引用
    AI阅读
    加入学术空间
    4PeerCheck: Enhancing LLM-Generated Academic Reviews Towards Human-Level Quality
    Zeyuan Chen, Ziqing Yang, Yihan Ma,Michael Backes,Yang Zhang

    As academic submissions grow, the traditional peer review process struggles to keep up, raising concerns about quality and fairness. A trend of using large language models (LLMs) for assistance has emerged. In this work, we take a critical step toward improving the quality of LLM-generated reviews. We propose the PeerCheck framework, which investigates LLM-human review differences (RQ1) and explores methods to improve LLM-generated review quality (RQ2). We first analyzed the human-written reviews with reviews generated by various LLMs and found that LLMs and humans focus on different terms, e.g., LLMs prioritize theory while humans emphasize methodology and experiments. We further adopt prompt engineering, such as Chain-of-Thought (CoT), and utilize retrieval-augmented generation (RAG) to enhance the LLM-generated reviews towards human-level quality. We find CoT significantly improves the quality of LLM reviews, while we discover an unexpected "RAG paradox," i.e., experiments with RAG produce different results for various LLMs and, in some cases, even reduce review quality. Our comprehensive analysis of LLM-generated academic reviews illustrates both possibilities and limitations, contributing to a more effective, human-aligned review system. Our dataset is available on https://github.com/TrustAIRLab/PeerCheck.

    2026Annual Meeting of the Association for Computational Linguistics(2026)引用:6
    引用
    AI阅读
    加入学术空间
    5Verbalizing LLM's Higher-order Uncertainty Via Imprecise Probabilities
    Anita Yang,Krikamol Muandet,Michele Caprio,Siu Lun Chau,Masaki Adachi

    Despite the growing demand for eliciting uncertainty from large language models (LLMs), empirical evidence suggests that LLM behavior is not always adequately captured by the elicitation techniques developed under the classical probabilistic uncertainty framework. This mismatch leads to systematic failure modes, particularly in settings that involve ambiguous question-answering, in-context learning, and self-reflection. To address this, we propose novel prompt-based uncertainty elicitation techniques grounded in *imprecise probabilities*, a principled framework for representing and eliciting higher-order uncertainty. Here, first-order uncertainty captures uncertainty over possible responses to a prompt, while second-order uncertainty (uncertainty about uncertainty) quantifies indeterminacy in the underlying probability model itself. We introduce general-purpose prompting and post-processing procedures to directly elicit and quantify both orders of uncertainty, and demonstrate their effectiveness across diverse settings. Our approach enables more faithful uncertainty reporting from LLMs, improving credibility and supporting downstream decision-making.

    UAI 2026引用:6
    引用
    AI阅读
    加入学术空间
    立即登录,查看全部 352 篇论文

    机构统计