研究兴趣

论文共 96 篇作者统计合作学者相似作者

按年份排序按引用量排序主题筛选期刊级别筛选合作者筛选合作机构筛选
时间
引用量
主题
期刊级别
合作者
合作机构
加载更多
作者统计
  • 合作者
  • 学生
  • 导师
暂无相似学者,你可以通过学者研究领域进行搜索筛选
数据免责声明
页面数据均来自互联网公开来源、合作出版商和通过AI技术自动分析结果,我们不对页面数据的有效性、准确性、正确性、可靠性、完整性和及时性做出任何承诺和保证。若有疑问,可以通过电子邮件方式联系我们:report@aminer.cn
s RLHF by controlling its embedding's intrinsic dimension through informed prompt manipulation. Second, we derive $7$ interpretable spline features that can be extracted from any (pre-trained) LLM layer, providing a rich abstract representation of their inputs. Those features alone ($224$ for Mistral-7B and Llama$2$-7B) are sufficient to help solve toxicity detection, infer the domain of the prompt, and even tackle the Jigsaw challenge, which aims at characterizing the type of toxicity of various prompts. Our results demonstrate how, even in large-scale regimes, exact theoretical results can answer practical questions in language models. Code: \\url{https:\u002F\u002Fgithub.com\u002FRandallBalestriero\u002FSplineLLM}. ","authors":[{"id":"562539e745ce1e5964d50205","name":"Randall Balestriero"},{"id":"6176f74760a9657359706e94","name":"Romain Cosentino"},{"id":"638b6916cba47807f61b69b5","name":"Sarath Shekkizhar"}],"create_time":"2023-12-05T03:35:25.51Z","hashs":{"h1":"cllmg","h3":"stdg"},"id":"656e8e53939a5f408286f8d2","num_citation":0,"pdf":"https:\u002F\u002Fcz5waila03cyo0tux1owpyofgoryroob.aminer.cn\u002F61\u002F33\u002F74\u002F613374CD63C3F1B0A4440F38EA283BFC.pdf","title":"Characterizing Large Language Model Geometry Solves Toxicity Detection\n and Generation","urls":["db\u002Fjournals\u002Fcorr\u002Fcorr2312.html#abs-2312-01648","https:\u002F\u002Fdoi.org\u002F10.48550\u002FarXiv.2312.01648","https:\u002F\u002Farxiv.org\u002Fabs\u002F2312.01648"],"venue":{"info":{"name":"CoRR"},"volume":"abs\u002F2312.01648"},"versions":[{"id":"656e8e53939a5f408286f8d2","sid":"2312.01648","src":"arxiv","year":2023},{"id":"6593a6ae939a5f4082efab13","sid":"journals\u002Fcorr\u002Fabs-2312-01648","src":"dblp","year":2023}],"year":2023}],"profilePubsTotal":96,"profilePatentsPage":0,"profilePatents":null,"profilePatentsTotal":null,"profilePatentsEnd":false,"profileProjectsPage":1,"profileProjects":{"success":true,"msg":"","data":null,"log_id":"2cmtnKg6Llv3pazeyVB1wuNrw9b"},"profileProjectsTotal":0,"newInfo":null,"checkDelPubs":[]}};