• 学术搜索
  • 科研智能体
    • Research Labs
    • AI 阅读
    • AI 文库
    • 深度研究
    • 学者亮点
  • 学术资源
    • AI2000
    • 期刊/会议
    • 学者库
    • 学术API
      MCP&Skill
    • 溯源树
    • 数据集
  • 知识沉淀
    • 学术空间
订阅小程序
旧版功能
aminer vip
开通会员低至0.73元/天
一次搞定AI科研
立即登录
  • English
  • 联系方式
    维

    维萨卡

    Visa Inc.
    企业
    194论文总数
    5,857引用总数

    论文量&引用量时间轴

    机构学者

    论文(197)

    年份
    起
    –
    止
    排序
    1ALERT: Zero-shot LLM Jailbreak Detection Via Internal Discrepancy Amplification
    Xiao Lin, Philip Li,Zhichen Zeng,Ting-Wei Li,Tianxin Wei,Xuying Ning,Gaotang Li,Yuzhong Chen,Hanghang Tong

    Despite rich safety alignment strategies, large language models (LLMs) remain highly susceptible to jailbreak attacks, which compromise safety guardrails and pose serious security risks. Existing detection methods mainly detect jailbreak status relying on jailbreak templates present in the training data. However, few studies address the more realistic and challenging zero-shot jailbreak detection setting, where no jailbreak templates are available during training. This setting better reflects real-world scenarios where new attacks continually emerge and evolve. To address this challenge, we propose a layer-wise, module-wise, and token-wise amplification framework that progressively magnifies internal feature discrepancies between benign and jailbreak prompts. We uncover safety-relevant layers, identify specific modules that inherently encode zero-shot discriminative signals, and localize informative safety tokens. Building upon these insights, we introduce ALERT (Amplification-based Jailbreak Detector), an efficient and effective zero-shot jailbreak detector that introduces two independent yet complementary classifiers on amplified representations. Extensive experiments on three safety benchmarks demonstrate that ALERT achieves consistently strong zero-shot detection performance. Specifically, (i) across all datasets and attack strategies, ALERT reliably ranks among the top two methods, and (ii) it outperforms the second-best baseline by at least 10% in average Accuracy and F1-score, and sometimes by up to 40%.

    2026EMNLP 2026(2026)引用:5
    引用
    AI阅读
    加入学术空间
    2LastOPD: Taming Collapse in Latent On-Policy Distillation
    Jie Yang, Zhengyu Fang,Zelin Xu, Jiarui Sun, Xiran Fan,Junpeng Wang,Liang Wang, Qinghua Liu, Yiwei Cai,Yan Zheng

    On-policy distillation (OPD) corrects a student on the responses it writes, but its signal is the teacher's next-token distribution: it tells the student what the teacher says but misses how it thinks. Latent supervision promises the missing part by aligning the student's latent states to the teacher's. Recent methods such as OPRD bring this signal into on-policy distillation. However, we observe two failures of this recipe when distilling Qwen3-4B and Qwen3-8B into Qwen3-1.7B-Base. Early gain, late collapse: latent supervision alone lifts MATH-500 accuracy from 25 to 46 in 10 steps, but subsequent training degrades performance down to 11 with no recovery. Better alignment, worse behavior: although the alignment metric steadily improves throughout this collapse, the most aligned model turns out to be the worst performing. Further analysis suggests a mismatch in how the latent signal is applied: layers paired by depth play different roles in the two models, so continued alignment may pull the student toward teacher states it cannot understand. To address this, we propose LastOPD, which applies the latent signal only at the last-layer state, the common interface both LM heads read, and only during a 10-step crossfade into token-level OPD. This keeps the useful part of the latent signal and hands the student to token-level supervision before the collapse sets in. Extensive experiments show that LastOPD improves MATH-500 over token-only OPD by 5.55 and 4.02 points with the 4B and 8B teachers, leads on most held-out datasets, and reaches the final score of token-only OPD in about half the steps. Code is available at https://github.com/Muyiiiii/LastOPD.

    2026引用:4
    引用
    AI阅读
    加入学术空间
    3The Organization of Innovation: Property Rights and the Outsourcing Decision
    Thomas Jungbauer,Sean Nicholson,June Pan,Michael Waldman,Lucy Xiaolu Wang

    Why do firms outsource research and development (R&D) for some products while conducting R&D in-house for similar ones?An innovating firm risks cannibalizing its existing products.The more profitable these products, the more the firm wants to limit cannibalization.We apply this logic to the organization of R&D by introducing a novel theoretical model in which developing in-house provides the firm more control over the new product's location in product space.An empirical analysis of our testable predictions using pharmaceutical data concerning patents, patent expiration, and outsourcing at various stages of the R&D process supports our theoretical findings.

    2026AMERICAN ECONOMIC JOURNAL-MICROECONOMICS(2026)引用:2
    引用
    AI阅读
    加入学术空间
    4Prompt Overflow: What the Guardrail Inspects is Not What the Model Infers
    Yuanbo Zhou, Changjia Zhu, Junyu Wang, Xu He, Yan Zhai,Kun Sun, Mingkui Wei, Junjie Xiong

    Guardrail models (a.k.a. safety checkers) are widely deployed to screen user inputs before they reach large language models (LLMs), serving as a primary defense against prompt injection attacks. Due to strict context constraints, these models handle overlength prompts through truncation or segmentation-based inspection. While prior work has focused on semantic adversarial inputs, the security implications of these long-input processing mechanisms remain largely unexplored. In this paper, we identify a critical blind spot arising from the mismatch between the limited inspection windows of guardrail models and the substantially larger context inference windows of downstream LLMs. We introduce a novel Prompt Overflow Attack, which exploits this mismatch by fragmenting malicious instructions and interleaving them with benign filler content across an overlong prompt, such that no individual inspected segment appears malicious while the full context remains actionable to the LLM. Through a systematic evaluation against state-of-the-art guardrail models, including Meta Llama Prompt Guard, IBM Granite Guardian, and DeBERTa-based detectors, we demonstrate that prompts reliably detected in short-context settings can evade guardrail models once adversarially manipulated into over-length inputs, yet remain fully actionable by downstream LLMs. We further propose potential defense strategies and outline mitigation directions to strengthen guardrail models.

    2026引用:2
    引用
    AI阅读
    加入学术空间
    5TimeEvo: Failure-Driven Self-Evolution of a Time Series Agent
    Jie Yang,Yan Zheng, Jiarui Sun, Xiran Fan,Junpeng Wang,Liang Wang,Zelin Xu, Qinghua Liu, Zhengyu Fang, Yiwei Cai,Philip S. Yu

    Time series agents answer analytical questions by calling external tools, and which tools they carry is decided by people before the agent runs. However, we identify two failures in this setup. Human-Agent Tool Misalignment: a library of 21 expert-curated tools helps on some tasks and hurts on others, dropping anomaly accuracy under every backbone we test. Silent Harm: one round of generic self-revision changes 147 answers and breaks 56 of them, while the final score moves by less than a point. Both follow from the same gap: whether a tool helps is decided question by question at runtime, while tools are supplied in advance and judged by a single average. To address this, we propose TimeEvo, which clusters an agent's diagnosed failures into capability gaps, plans a measurement for each, synthesizes evidence-only tools that fill them, and admits the candidate library only through a paired admission gate. Experiments on ten time series QA tasks and three backbones show that TimeEvo, starting from an empty library, improves accuracy on every task and every backbone, and that a library grown on a cheap model still gains when it is installed into stronger ones. Code is available at https://github.com/Muyiiiii/TimeEvo.

    2026引用:1
    引用
    AI阅读
    加入学术空间
    立即登录,查看全部 197 篇论文

    合作机构(100)

    伊利诺伊大学香槟分校合作论文 7
    明尼苏达大学合作论文 5
    乔治梅森大学合作论文 4
    University of the Cumberlands合作论文 4
    德克萨斯 A&M 大学合作论文 4
    谷歌合作论文 4
    曼彻斯特大学合作论文 4
    国际商业机器公司合作论文 4
    上海交通大学合作论文 3
    莱斯大学合作论文 3

    机构统计