{"id":5966,"date":"2025-01-02T03:18:00","date_gmt":"2025-01-01T18:18:00","guid":{"rendered":"https:\/\/devneko.jp\/wordpress\/?p=5966"},"modified":"2025-01-02T03:18:00","modified_gmt":"2025-01-01T18:18:00","slug":"revisiting-in-context-learning-with-long-context-language-models","status":"publish","type":"post","link":"https:\/\/devneko.jp\/wordpress\/?p=5966","title":{"rendered":"Revisiting In-Context Learning with Long Context Language Models\u00a0"},"content":{"rendered":"\n<ul class=\"wp-block-list\">\n<li><strong>Revisiting In-Context Learning with Long Context Language Models\u00a0<\/strong>[22.9]<br>In-Context Learning (ICL) \u306f\u3001\u8a00\u8a9e\u30e2\u30c7\u30eb\u304c\u5165\u529b\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u3067\u63d0\u4f9b\u3055\u308c\u308b\u4f8b\u306b\u57fa\u3065\u3044\u3066\u4e88\u6e2c\u3092\u884c\u3046\u624b\u6cd5\u3067\u3042\u308b\u3002 LCLM(Long Context Language Models)\u306e\u51fa\u73fe\u306b\u3088\u308a\u3001\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u306b\u542b\u307e\u308c\u308b\u30b5\u30f3\u30d7\u30eb\u306e\u6570\u304c\u5927\u5e45\u306b\u5897\u52a0\u3057\u305f\u3002 4\u3064\u306e\u30bf\u30b9\u30af\u306b\u307e\u305f\u304c\u308b18\u306e\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u306b\u95a2\u3059\u308b\u5e83\u7bc4\u306a\u5b9f\u9a13\u3092\u901a\u3058\u3066\u3001LCLM\u306e\u6587\u8108\u3067\u3053\u308c\u3089\u306e\u30a2\u30d7\u30ed\u30fc\u30c1\u3092\u518d\u8003\u3059\u308b\u3002<br><a href=\"http:\/\/arxiv.org\/abs\/2412.16926v1\">\u8ad6\u6587<\/a>\u00a0\u00a0<a href=\"https:\/\/fugumt.com\/fugumt\/paper_check\/2412.16926v1\">\u53c2\u8003\u8a33\uff08\u30e1\u30bf\u30c7\u30fc\u30bf\uff09<\/a>\u00a0 \u00a0(Sun, 22 Dec 2024 08:55:19 GMT)<\/li>\n\n\n\n<li>\u300cwe find that the advent of LCLMs has fundamentally shifted the challenge of ICL from that of selecting the most effective examples to that of collecting sufficient examples to fill the context window.\u300d\u3068\u3044\u3046\u5831\u544a\u3001LCLM = Long Context Language Models\u3002<\/li>\n\n\n\n<li>LLM\u306e\u9ad8\u6027\u80fd\u5316\u3082\u3042\u3063\u3066\u904e\u53bb\u306e\u30c6\u30af\u30cb\u30c3\u30af\u306e\u6709\u52b9\u6027\u304c\u8584\u308c\u3066\u3044\u308b\u3088\u3046\u3002\u3053\u306e\u624b\u306e\u9032\u5316\u306b\u5bfe\u5fdc\u3059\u308b\u305f\u3081\u3001\u6bd4\u8f03\u691c\u8a3c\u3092\u6b63\u3057\u304f\u5bb9\u6613\u306b\u884c\u3048\u308b\u3088\u3046\u306b\u3057\u3066\u304a\u304f\u306e\u306f\u91cd\u8981\u3002<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[200],"class_list":["post-5966","post","type-post","status-publish","format-standard","hentry","category-arxiv","tag-in-context-learning"],"_links":{"self":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/5966","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5966"}],"version-history":[{"count":0,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/5966\/revisions"}],"wp:attachment":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5966"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5966"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5966"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}