• 学术搜索
  • 科研智能体
    • Research Labs
    • AI 阅读
    • AI 文库
    • 深度研究
    • 学者亮点
  • 学术资源
    • AI2000
    • 期刊/会议
    • 学者库
    • 学术API
      MCP&Skill
    • 溯源树
    • 数据集
  • 知识沉淀
    • 学术空间
订阅小程序
旧版功能
aminer vip
开通会员低至0.73元/天
一次搞定AI科研
立即登录
  • English
  • 联系方式
    Proceedings of the ... conference of the North American Chapter of the Association for Computational Linguistics

    Proceedings of the ... conference of the North American Chapter of the Association for Computational Linguistics

    Conference

    年发文量

    研究主题

    论文(33)

    排序
    1Protein2Text: Resampling Mechanism to Translate Protein Sequences into Human-Interpretable Text.
    Ala Jararweh,Oladimeji Macaulay,David Arredondo,Yue Hu,Luis Tafoya,Kushal Virupakshappa,Avinash Sahu

    Proteins play critical roles in biological systems, yet 99.7% of over 227 million known protein sequences remain uncharacterized due to the limitations of experimental methods. To assist experimentalists in narrowing down hypotheses and accelerating protein characterization, we present Protein2Text, a multimodal large language model that interprets protein sequences and generates informative text to address open-ended questions about protein functions and attributes. By integrating a resampling mechanism within an adapted LLaVA framework, our model effectively maps protein sequences into a language-compatible space, enhancing its capability to handle diverse and complex queries. Trained on a newly curated dataset derived from PubMed articles and rigorously evaluated using four comprehensive benchmarks-including in-domain and cross-domain evaluations-Protein2Text outperforms several existing models in open-ended question-answering tasks. Our work also highlights the limitations of current evaluation metrics applied to template-based approaches, which may lead to misleading results, emphasizing the need for unbiased assessment methods. Our model weights, evaluation datasets, and evaluation scripts are publicly available at https://github.com/alaaj27/Protein2Text.git.

    2025引用:4
    引用
    AI阅读
    加入学术空间
    2Capturing Human Cognitive Styles with Language: Towards an Experimental Evaluation Paradigm
    Vasudha Varadarajan,Syeda Mahwish,Xiaoran Liu,Julia Buffolino,Christian C Luhmann,Ryan L Boyd,H Andrew Schwartz

    While NLP models often seek to capture cognitive states via language, the validity of predicted states is determined by comparing them to annotations created without access the cognitive states of the authors. In behavioral sciences, cognitive states are instead measured via experiments. Here, we introduce an experiment-based framework for evaluating language-based cognitive style models against human behavior. We explore the phenomenon of decision making, and its relationship to the linguistic style of an individual talking about a recent decision they made. The participants then follow a classical decision-making experiment that captures their cognitive style, determined by how preferences change during a decision exercise. We find that language features, intended to capture cognitive style, can predict participants' decision style with moderate-to-high accuracy (AUC 0.8), demonstrating that cognitive style can be partly captured and revealed by discourse patterns.

    2025引用:4
    引用
    AI阅读
    加入学术空间
    3MCQG-SRefine: Multiple Choice Question Generation and Evaluation with Iterative Self-Critique, Correction, and Comparison Feedback
    Zonghai Yao,Aditya Parashar,Huixue Zhou,Won Seok Jang,Feiyun Ouyang,Zhichao Yang,Hong Yu

    Automatic question generation (QG) is essential for AI and NLP, particularly in intelligent tutoring, dialogue systems, and fact verification. Generating multiple-choice questions (MCQG) for professional exams, like the United States Medical Licensing Examination (USMLE), is particularly challenging, requiring domain expertise and complex multi-hop reasoning for high-quality questions. However, current large language models (LLMs) like GPT-4 struggle with professional MCQG due to outdated knowledge, hallucination issues, and prompt sensitivity, resulting in unsatisfactory quality and difficulty. To address these challenges, we propose MCQG-SRefine, an LLM self-refine-based (Critique and Correction) framework for converting medical cases into high-quality USMLE-style questions. By integrating expert-driven prompt engineering with iterative self-critique and self-correction feedback, MCQG-SRefine significantly enhances human expert satisfaction regarding both the quality and difficulty of the questions. Furthermore, we introduce an LLM-as-Judge-based automatic metric to replace the complex and costly expert evaluation process, ensuring reliable and expert-aligned assessments.

    2025引用:22
    引用
    AI阅读
    加入学术空间
    4Pedagogically Aligned Objectives Create Reliable Automatic Cloze Tests.
    Brian Ondov,Dina Demner-Fushman,Kush Attal

    The cloze training objective of Masked Language Models makes them a natural choice for generating plausible distractors for human cloze questions. However, distractors must also be both distinct and incorrect, neither of which is directly addressed by existing neural methods. Evaluation of recent models has also relied largely on automated metrics, which cannot demonstrate the reliability or validity of human comprehension tests. In this work, we first formulate the pedagogically motivated objectives of plausibility, incorrectness, and distinctiveness in terms of conditional distributions from language models. Second, we present an unsupervised, interpretable method that uses these objectives to jointly optimize sets of distractors. Third, we test the reliability and validity of the resulting cloze tests compared to other methods with human participants. We find our method has stronger correlation with teacher-created comprehension tests than the state-of-the-art neural method and is more internally consistent. Our implementation is freely available and can quickly create a multiple choice cloze test from any given passage.

    2024引用:3
    引用
    AI阅读
    加入学术空间
    5PromptFix: Few-shot Backdoor Removal Via Adversarial Prompt Tuning
    Tianrong Zhang,Zhaohan Xi,Ting Wang,Prasenjit Mitra,Jinghui Chen

    Pre-trained language models (PLMs) have attracted enormous attention over the past few years with their unparalleled performances. Meanwhile, the soaring cost to train PLMs as well as their amazing generalizability have jointly contributed to few-shot fine-tuning and prompting as the most popular training paradigms for natural language processing (NLP) models. Nevertheless, existing studies have shown that these NLP models can be backdoored such that model behavior is manipulated when trigger tokens are presented. In this paper, we propose PromptFix, a novel backdoor mitigation strategy for NLP models via adversarial prompt-tuning in few-shot settings. Unlike existing NLP backdoor removal methods, which rely on accurate trigger inversion and subsequent model fine-tuning, PromptFix keeps the model parameters intact and only utilizes two extra sets of soft tokens which approximate the trigger and counteract it respectively. The use of soft tokens and adversarial optimization eliminates the need to enumerate possible backdoor configurations and enables an adaptive balance between trigger finding and preservation of performance. Experiments with various backdoor attacks validate the effectiveness of the proposed method and the performances when domain shift is present further shows PromptFix's applicability to models pretrained on unknown data source which is the common case in prompt tuning scenarios.

    2024引用:3
    引用
    AI阅读
    加入学术空间
    立即登录,查看全部 33 篇论文

    高被引作者

    作者引用发文
    Louis-Philippe Morency7031
    Soujanya Poria7031
    Devamanyu Hazarika7031
    Roger Zimmermann7031
    Amir Zadeh7031
    Erik Cambria7031
    Hong Yu4964
    Abhyuday Jagannatha4521
    Byron C. Wallace2254
    Iain Marshall2193

    高产作者

    作者引用发文
    Byron C. Wallace2254
    Hong Yu4964
    Jan P. H. Van Santen643
    H. Andrew Schwartz743
    Steven Bedrick213
    Iain Marshall2193
    Masoud Rouhizadeh562
    Tim Miller612
    Ani Nenkova552
    Vasudha Varadarajan102

    相关期刊

    SIGIR Forum
    Annual Conference of the Spanish Society for Natural Language Processing
    Biomedical Natural Language Processing
    Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis
    Workshop on Computational Linguistics and Clinical Psychology
    Clinical Natural Language Processing
    Australasian Language Technology Association Workshop
    International Workshop on Health Text Mining and Information Analysis
    Recent Advances in Slavonic Natural Languages Processing
    Proceedings of COLING. International Conference on Computational Linguistics