{"id":5110,"date":"2024-07-12T04:36:00","date_gmt":"2024-07-11T19:36:00","guid":{"rendered":"https:\/\/devneko.jp\/wordpress\/?p=5110"},"modified":"2024-07-12T04:36:00","modified_gmt":"2024-07-11T19:36:00","slug":"how-does-quantization-affect-multilingual-llms","status":"publish","type":"post","link":"https:\/\/devneko.jp\/wordpress\/?p=5110","title":{"rendered":"How Does Quantization Affect Multilingual LLMs?\u00a0"},"content":{"rendered":"\n<ul class=\"wp-block-list\">\n<li><strong>How Does Quantization Affect Multilingual LLMs?\u00a0<\/strong>[50.9]<br>\u91cf\u5b50\u5316\u6280\u8853\u306f\u3001\u5927\u898f\u6a21\u306a\u8a00\u8a9e\u30e2\u30c7\u30eb\u306e\u63a8\u8ad6\u901f\u5ea6\u3068\u5c55\u958b\u3092\u6539\u5584\u3059\u308b\u305f\u3081\u306b\u5e83\u304f\u4f7f\u308f\u308c\u3066\u3044\u308b\u3002 \u91cf\u5b50\u5316\u591a\u8a00\u8a9e LLM \u306e\u5fb9\u5e95\u7684\u306a\u89e3\u6790\u3092\u884c\u3044\u3001\u8a00\u8a9e\u9593\u304a\u3088\u3073\u69d8\u3005\u306a\u30b9\u30b1\u30fc\u30eb\u3067\u305d\u306e\u6027\u80fd\u306b\u7126\u70b9\u3092\u3042\u3066\u308b\u3002\u81ea\u52d5\u30d9\u30f3\u30c1\u30de\u30fc\u30af, LLM-as-a-Judge \u6cd5, \u4eba\u7684\u8a55\u4fa1\u3092\u7528\u3044\u3066, 1) \u91cf\u5b50\u5316\u306e\u6709\u5bb3\u306a\u5f71\u97ff\u306f\u4eba\u7684\u8a55\u4fa1\u306b\u304a\u3044\u3066\u660e\u3089\u304b\u3067\u3042\u308a, 1) \u81ea\u52d5\u30bf\u30b9\u30af\u306b\u304a\u3051\u308b\u65e5\u672c\u8a9e\u306e1.7%\u306e\u5e73\u5747\u4f4e\u4e0b\u306f, \u73fe\u5b9f\u7684\u306a\u30d7\u30ed\u30f3\u30d7\u30c8\u4e0a\u3067\u306e\u4eba\u9593\u306e\u8a55\u4fa1\u8005\u306b\u3088\u308b16.0%\u306e\u6e1b\u5c11\u306b\u5bfe\u5fdc\u3057, 2) \u8a00\u8a9e\u306f\u91cf\u5b50\u5316\u306e\u5f71\u97ff\u3092\u53d7\u3051, \u975e\u30e9\u30c6\u30f3\u8a9e\u306e\u30b9\u30af\u30ea\u30d7\u30c8\u8a00\u8a9e\u304c\u6700\u60aa\u306e\u5f71\u97ff\u3092\u53d7\u3051, (3) \u6570\u5b66\u7684\u63a8\u8ad6\u306a\u3069\u306e\u8ab2\u984c\u304c\u6025\u901f\u306b\u60aa\u5316\u3059\u308b\u3002<br><a href=\"http:\/\/arxiv.org\/abs\/2407.03211v1\">\u8ad6\u6587<\/a>\u00a0\u00a0<a href=\"https:\/\/fugumt.com\/fugumt\/paper_check\/2407.03211v1\">\u53c2\u8003\u8a33\uff08\u30e1\u30bf\u30c7\u30fc\u30bf\uff09<\/a>\u00a0 \u00a0(Wed, 03 Jul 2024 15:39:40 GMT)<\/li>\n\n\n\n<li>LLM\u306b\u5bfe\u3059\u308b\u91cf\u5b50\u5316\u306e\u5f71\u97ff\u3092\u591a\u8a00\u8a9e\u306e\u89b3\u70b9\u3067\u8abf\u67fb\u3057\u305f\u8ad6\u6587\u3002\u300c(1) Damage from quantization is much worse than appears from automatic metrics: even when not observed automatically, human evaluators notice it.\u300d\u3001\u300c(2) Quantization affects languages to varying degrees, with nonLatin script languages more severely affected on automatic benchmarks.\u300d\u3001\u300c(3) Challenging tasks degrade fast and severely: math performance is strikingly reduced, as are responses on realistic challenging\u300d\u3068\u3044\u3046\u7d50\u8ad6\u3002<\/li>\n\n\n\n<li>\u591a\u8a00\u8a9e\uff08\u3068\u3044\u3046\u304b\u65e5\u672c\u8a9e\uff09\u3078\u306e\u5f71\u97ff\u306f\u7d4c\u9a13\u7684\u306b\u3082\u305d\u3046\u3060\u3068\u601d\u3046\u3002\u82f1\u8a9e\u4ee5\u5916\u306e\u5bfe\u5fdc\u306b\u3082\u529b\u3092\u5165\u308c\u3066\u3044\u308bCohere\u3089\u3057\u3044\u8abf\u67fb\u306a\u6c17\u304c\u3059\u308b\u3002<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[223,229],"class_list":["post-5110","post","type-post","status-publish","format-standard","hentry","category-arxiv","tag-llm","tag-low-bit-quantization"],"_links":{"self":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/5110","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5110"}],"version-history":[{"count":0,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/5110\/revisions"}],"wp:attachment":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5110"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5110"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5110"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}