{"id":6998,"date":"2025-06-30T04:56:00","date_gmt":"2025-06-29T19:56:00","guid":{"rendered":"https:\/\/devneko.jp\/wordpress\/?p=6998"},"modified":"2025-06-28T20:59:39","modified_gmt":"2025-06-28T11:59:39","slug":"language-modeling-by-language-models","status":"publish","type":"post","link":"https:\/\/devneko.jp\/wordpress\/?p=6998","title":{"rendered":"Language Modeling by Language Models"},"content":{"rendered":"\n<ul class=\"wp-block-list\">\n<li><strong>Language Modeling by Language Models\u00a0<\/strong>[28.8]<br>\u672c\u7a3f\u3067\u306f,\u5f93\u6765\u306e\u7814\u7a76\u6bb5\u968e\u3092\u30b7\u30df\u30e5\u30ec\u30fc\u30c8\u3059\u308b\u30de\u30eb\u30c1\u30a8\u30fc\u30b8\u30a7\u30f3\u30c8\u8a00\u8a9e\u30e2\u30c7\u30eb(LM)\u3092\u63d0\u6848\u3059\u308b\u3002 \u65b0\u3057\u3044\u30c7\u30b6\u30a4\u30f3\u304c\u63d0\u6848\u3055\u308c\u3001\u53cd\u5bfe\u306b\u30ec\u30d3\u30e5\u30fc\u3055\u308c\u3001\u5b9f\u88c5\u3055\u308c\u3001\u9078\u629e\u7684\u306b\u691c\u8a3c\u3055\u308c\u308b\u3002 \u65b0\u305f\u306b\u767a\u898b\u3055\u308c\u305f1,162\u500b\u306e\u8a2d\u8a08\u306b\u95a2\u3059\u308b\u5b9f\u9a13\u3092\u5831\u544a\u3059\u308b\u3002<br><a href=\"http:\/\/arxiv.org\/abs\/2506.20249v1\">\u8ad6\u6587<\/a>\u00a0\u00a0<a href=\"https:\/\/fugumt.com\/fugumt\/paper_check\/2506.20249v1\">\u53c2\u8003\u8a33\uff08\u30e1\u30bf\u30c7\u30fc\u30bf\uff09<\/a>\u00a0 \u00a0(Wed, 25 Jun 2025 08:46:10 GMT)<\/li>\n\n\n\n<li>\u300cWe introduce Genesys, an autonomous system for discovering novel LM designs, featuring a novel unit-based design agent and cost-effective distributed evolution. We also present LMADE, a resource environment to support further research in this field.\u300d\u3068\u3044\u3046AI\u306b\u3088\u308bAI\u306e\u7814\u7a76\u3002<\/li>\n\n\n\n<li>\u300cGenesys produced highly competitive designs; some outperformed human baselines such as the GPT and Mamba2 models in common downstream tasks. These results show the feasibility and lay the groundwork for autonomous evolutionary systems in scientifically complex and costly domains.\u300d\u3068\u73fe\u6642\u70b9\u3067\u3082\u4e00\u5b9a\u306e\u6210\u679c\u3001\u5b9f\u73fe\u53ef\u80fd\u6027\u304c\u3042\u308a\u305d\u3046\u306a\u306e\u304c\u8208\u5473\u6df1\u3044\u3002<\/li>\n\n\n\n<li>\u30d7\u30ed\u30b8\u30a7\u30af\u30c8\u30b5\u30a4\u30c8\u306f<a href=\"https:\/\/genesys.allen.ai\/\">Genesys<\/a>\u3001\u30ea\u30dd\u30b8\u30c8\u30ea\u306f<a href=\"https:\/\/github.com\/allenai\/genesys\">GitHub &#8211; allenai\/genesys: Source code and utilities for the Genesys distributed language model architecture discovery system.<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[623],"class_list":["post-6998","post","type-post","status-publish","format-standard","hentry","category-arxiv","tag-623"],"_links":{"self":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/6998","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=6998"}],"version-history":[{"count":1,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/6998\/revisions"}],"predecessor-version":[{"id":6999,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/6998\/revisions\/6999"}],"wp:attachment":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=6998"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=6998"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=6998"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}