{"id":6848,"date":"2025-06-03T05:41:00","date_gmt":"2025-06-02T20:41:00","guid":{"rendered":"https:\/\/devneko.jp\/wordpress\/?p=6848"},"modified":"2025-06-01T10:45:17","modified_gmt":"2025-06-01T01:45:17","slug":"the-avengers-a-simple-recipe-for-uniting-smaller-language-models-to-challenge-proprietary-giants","status":"publish","type":"post","link":"https:\/\/devneko.jp\/wordpress\/?p=6848","title":{"rendered":"The Avengers: A Simple Recipe for Uniting Smaller Language Models to Challenge Proprietary Giants"},"content":{"rendered":"\n<ul class=\"wp-block-list\">\n<li><strong>The Avengers: A Simple Recipe for Uniting Smaller Language Models to Challenge Proprietary Giants\u00a0<\/strong>[66.7]<br>\u6211\u3005\u306f\u3001\u30aa\u30fc\u30d7\u30f3\u30bd\u30fc\u30b9\u306e\u3088\u308a\u5c0f\u3055\u306a\u8a00\u8a9e\u30e2\u30c7\u30eb\u306e\u96c6\u5408\u7684\u30a4\u30f3\u30c6\u30ea\u30b8\u30a7\u30f3\u30b9\u3092\u52b9\u679c\u7684\u306b\u6d3b\u7528\u3059\u308b\u7c21\u5358\u306a\u30ec\u30b7\u30d4\u3067\u3042\u308bAvengers\u3092\u7d39\u4ecb\u3057\u307e\u3059\u3002 10\u306e\u30aa\u30fc\u30d7\u30f3\u30bd\u30fc\u30b9\u30e2\u30c7\u30eb(\u305d\u308c\u305e\u308c7B\u30d1\u30e9\u30e1\u30fc\u30bf)\u306b\u3088\u308a\u3001Avengers\u306f15\u306e\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u306e\u3046\u306110\u3067GPT-4.1\u3092\u4e0a\u56de\u3063\u3066\u3044\u308b\u3002 \u7279\u306b\u6570\u5b66\u30bf\u30b9\u30af\u3067\u306f GPT-4.1 \u3092 18.21% \u3001\u30b3\u30fc\u30c9\u30bf\u30b9\u30af\u3067\u306f 7.46% \u3067\u4e0a\u56de\u3063\u3066\u3044\u308b\u3002<br><a href=\"http:\/\/arxiv.org\/abs\/2505.19797v1\">\u8ad6\u6587<\/a>\u00a0\u00a0<a href=\"https:\/\/fugumt.com\/fugumt\/paper_check\/2505.19797v1\">\u53c2\u8003\u8a33\uff08\u30e1\u30bf\u30c7\u30fc\u30bf\uff09<\/a>\u00a0 \u00a0(Mon, 26 May 2025 10:29:42 GMT)<\/li>\n\n\n\n<li>7B \u00d7 10\u306eSLM\u3067\u5546\u7528\u30e2\u30c7\u30eb\u3068\u7af6\u5408\u3059\u308b\u6027\u80fd\u3092\u9054\u6210\u3068\u306e\u3053\u3068\u3002\u300cIn this paper, we introduce the Avengers, a simple yet effective framework to unite multiple smaller language models (SLMs) and challenge the dominance of proprietary large models. The core of the Avengers involves straightforward embedding, clustering, scoring, and voting, without requiring neural network training, prompt engineering, or careful architecture-specific model choices.\u300d<\/li>\n\n\n\n<li>leak\u3068\u3044\u3046\u306e\u304c\u982d\u306b\u3088\u304e\u3089\u306a\u304f\u306f\u306a\u3044\u304c\u3001\u8fd1\u5e74\u306e\u516c\u958b\u30e2\u30c7\u30eb\u306e\u6027\u80fd\u306f\u5927\u304d\u304f\u5411\u4e0a\u3057\u3066\u3044\u3066\u3042\u308a\u5f97\u308b\u7d50\u679c\u3067\u306f\u3042\u308b\u3068\u601d\u3046\u3002<\/li>\n\n\n\n<li>\u30ea\u30dd\u30b8\u30c8\u30ea\u306f<a href=\"https:\/\/github.com\/ZhangYiqun018\/Avengers\">GitHub &#8211; ZhangYiqun018\/Avengers<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[223],"class_list":["post-6848","post","type-post","status-publish","format-standard","hentry","category-arxiv","tag-llm"],"_links":{"self":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/6848","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=6848"}],"version-history":[{"count":1,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/6848\/revisions"}],"predecessor-version":[{"id":6849,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/6848\/revisions\/6849"}],"wp:attachment":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=6848"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=6848"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=6848"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}