{"id":6401,"date":"2025-03-12T05:36:00","date_gmt":"2025-03-11T20:36:00","guid":{"rendered":"https:\/\/devneko.jp\/wordpress\/?p=6401"},"modified":"2025-03-12T05:36:00","modified_gmt":"2025-03-11T20:36:00","slug":"unnatural-languages-are-not-bugs-but-features-for-llms","status":"publish","type":"post","link":"https:\/\/devneko.jp\/wordpress\/?p=6401","title":{"rendered":"Unnatural Languages Are Not Bugs but Features for LLMs\u00a0"},"content":{"rendered":"\n<ul class=\"wp-block-list\">\n<li><strong>Unnatural Languages Are Not Bugs but Features for LLMs\u00a0<\/strong>[92.8]<br>\u5927\u898f\u6a21\u8a00\u8a9e\u30e2\u30c7\u30eb(LLM)\u306f\u3001\u30b8\u30a7\u30a4\u30eb\u30d6\u30ec\u30a4\u30af\u30d7\u30ed\u30f3\u30d7\u30c8\u306a\u3069\u306e\u975e\u53ef\u8aad\u30c6\u30ad\u30b9\u30c8\u30b7\u30fc\u30b1\u30f3\u30b9\u3092\u51e6\u7406\u3059\u308b\u305f\u3081\u306b\u89b3\u5bdf\u3055\u308c\u3066\u3044\u308b\u3002 \u6211\u3005\u306f\u3053\u306e\u8a8d\u8b58\u306b\u6311\u6226\u3059\u308b\u4f53\u7cfb\u7684\u306a\u8abf\u67fb\u3092\u884c\u3044\u3001\u975e\u81ea\u7136\u8a00\u8a9e\u306b\u306f\u30e2\u30c7\u30eb\u3067\u4f7f\u7528\u53ef\u80fd\u306a\u6f5c\u5728\u7684\u7279\u5fb4\u304c\u542b\u307e\u308c\u3066\u3044\u308b\u3053\u3068\u3092\u793a\u3057\u305f\u3002<br><a href=\"http:\/\/arxiv.org\/abs\/2503.01926v1\">\u8ad6\u6587<\/a>\u00a0\u00a0<a href=\"https:\/\/fugumt.com\/fugumt\/paper_check\/2503.01926v1\">\u53c2\u8003\u8a33\uff08\u30e1\u30bf\u30c7\u30fc\u30bf\uff09<\/a>\u00a0 \u00a0(Sun, 02 Mar 2025 12:10:17 GMT)<\/li>\n\n\n\n<li>\u300cwe study a phenomenon named unnatural languages &#8211; strings that deviate from natural language syntax and appear extremely noisy to human readers, yet remain understandable to LLMs.\u300d\u3068\u3044\u3046\u7814\u7a76\u3002Abstract\u306b\u3082\u3042\u308b\u901a\u308aJailbreak\u306e\u8d77\u70b9\u3068\u306a\u3063\u305f\u308a\u3059\u308b\u91cd\u8981\u306a\u3082\u306e\u3002<\/li>\n\n\n\n<li>\u300cThese findings strongly demonstrate our key findings: unnatural languages are not bugs but features for LLMs.\u300d\u3067\u300cWe demonstrate that LLMs process unnatural languages by effectively filtering out irrelevant tokens. Furthermore, LLMs combine relevant tokens from unnatural languages and infer contextual meaning in response to natural version questions.\u300d\u3068\u306e\u3053\u3068\u3002LLM\u306e\u80fd\u529b\u304c\u3059\u3054\u3044\u3002<\/li>\n\n\n\n<li>\u30ea\u30dd\u30b8\u30c8\u30ea\u306f<a href=\"https:\/\/github.com\/John-AI-Lab\/Unnatural_Language\">GitHub &#8211; John-AI-Lab\/Unnatural_Language: The official repository of &#8216;Unnatural Language Are Not Bugs but Features for LLMs&#8217;<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[223],"class_list":["post-6401","post","type-post","status-publish","format-standard","hentry","category-arxiv","tag-llm"],"_links":{"self":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/6401","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=6401"}],"version-history":[{"count":0,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/6401\/revisions"}],"wp:attachment":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=6401"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=6401"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=6401"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}