{"id":5449,"date":"2024-09-17T04:52:00","date_gmt":"2024-09-16T19:52:00","guid":{"rendered":"https:\/\/devneko.jp\/wordpress\/?p=5449"},"modified":"2024-09-17T04:52:00","modified_gmt":"2024-09-16T19:52:00","slug":"can-llms-generate-novel-research-ideas-can-large-language-models-unlock-novel-scientific-research-ideas","status":"publish","type":"post","link":"https:\/\/devneko.jp\/wordpress\/?p=5449","title":{"rendered":"Can LLMs Generate Novel Research Ideas? \/ Can Large Language Models Unlock Novel Scientific Research Ideas?"},"content":{"rendered":"\n<p>LLM\u304c\u7814\u7a76\u306e\u30a2\u30a4\u30c7\u30a2\u3092\u751f\u6210\u3067\u304d\u308b\u304b\u306b\u3064\u3044\u3066\u306e\u8ad6\u6587\u304c2\u3064\u3067\u3044\u305f\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers\u00a0<\/strong>[90.3]<br>\u5927\u578b\u8a00\u8a9e\u30e2\u30c7\u30eb(LLM)\u306f\u3001\u79d1\u5b66\u7684\u306a\u767a\u898b\u3092\u52a0\u901f\u3059\u308b\u53ef\u80fd\u6027\u306b\u3064\u3044\u3066\u306e\u697d\u89b3\u4e3b\u7fa9\u3092\u559a\u8d77\u3057\u305f\u3002 \u65b0\u3057\u3044\u30a2\u30a4\u30c7\u30a2\u3068LLM\u3068\u4eba\u9593\u306e\u30a2\u30a4\u30c7\u30a2\u306e\u76f2\u70b9\u30ec\u30d3\u30e5\u30fc\u3092\u66f8\u304f\u3053\u3068\u3067\u3001\u7814\u7a76\u30a2\u30a4\u30c7\u30a2\u306e\u305f\u3081\u306e\u73fe\u5728\u306eLLM\u80fd\u529b\u306b\u95a2\u3059\u308b\u6700\u521d\u306e\u7d71\u8a08\u7684\u306b\u91cd\u8981\u306a\u7d50\u8ad6\u3092\u5f97\u308b\u3002 LLM\u306e\u81ea\u5df1\u8a55\u4fa1\u306e\u5931\u6557\u3084\u4e16\u4ee3\u306b\u304a\u3051\u308b\u591a\u69d8\u6027\u306e\u6b20\u5982\u306a\u3069,\u7814\u7a76\u30a8\u30fc\u30b8\u30a7\u30f3\u30c8\u306e\u69cb\u7bc9\u3068\u8a55\u4fa1\u306b\u304a\u3051\u308b\u30aa\u30fc\u30d7\u30f3\u306a\u554f\u984c\u3092\u660e\u3089\u304b\u306b\u3059\u308b\u3002\u00a0<br><a href=\"http:\/\/arxiv.org\/abs\/2409.04109v1\">\u8ad6\u6587<\/a>\u00a0\u00a0<a href=\"https:\/\/fugumt.com\/fugumt\/paper_check\/2409.04109v1\">\u53c2\u8003\u8a33\uff08\u30e1\u30bf\u30c7\u30fc\u30bf\uff09<\/a>\u00a0 \u00a0(Fri, 06 Sep 2024 08:25:03 GMT)<\/li>\n\n\n\n<li>LLM\u306e\u30a2\u30a4\u30c7\u30a2\u3068\u4eba\u9593\u306e\u30a2\u30a4\u30c7\u30a2\u3092\u7814\u7a76\u8005\u304c\u6bd4\u8f03\u300cwe find LLM-generated ideas are judged as more novel (p &lt; 0.05) than human expert ideas while being judged slightly weaker on feasibility.\u300d\u3068\u306e\u3053\u3068\u3002\u7d50\u679c\u3082\u9762\u767d\u3044\u304c\u300c7 Limitations of LLMs<br>\u300d\u3001\u300c11 Ethical Considerations\u300d\u306e\u8003\u5bdf\u3082\u8208\u5473\u6df1\u3044\u3002<\/li>\n\n\n\n<li>\u30ea\u30dd\u30b8\u30c8\u30ea\u306f<a href=\"https:\/\/github.com\/NoviScl\/AI-Researcher\">GitHub &#8211; NoviScl\/AI-Researcher<\/a><\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Can Large Language Models Unlock Novel Scientific Research Ideas?\u00a0<\/strong>[21.2]<br>\u5927\u898f\u6a21\u8a00\u8a9e\u30e2\u30c7\u30eb(LLM)\u3068\u516c\u958b\u53ef\u80fd\u306aChatGPT\u306f\u3001\u4eba\u5de5\u77e5\u80fd\u3092\u4eba\u3005\u306e\u65e5\u5e38\u751f\u6d3b\u306b\u7d44\u307f\u8fbc\u3080\u4e0a\u3067\u3001\u5927\u304d\u306a\u8ee2\u63db\u70b9\u3068\u306a\u3063\u3066\u3044\u308b\u3002 \u672c\u7814\u7a76\u306f,\u7814\u7a76\u8ad6\u6587\u304b\u3089\u306e\u60c5\u5831\u306b\u57fa\u3065\u304f\u65b0\u305f\u306a\u7814\u7a76\u30a2\u30a4\u30c7\u30a2\u3092\u5275\u51fa\u3059\u308b\u4e0a\u3067\u306eLLM\u306e\u80fd\u529b\u306b\u3064\u3044\u3066\u8003\u5bdf\u3059\u308b\u3002<br><a href=\"http:\/\/arxiv.org\/abs\/2409.06185v1\">\u8ad6\u6587<\/a>\u00a0\u00a0<a href=\"https:\/\/fugumt.com\/fugumt\/paper_check\/2409.06185v1\">\u53c2\u8003\u8a33\uff08\u30e1\u30bf\u30c7\u30fc\u30bf\uff09<\/a>\u00a0 \u00a0(Tue, 10 Sep 2024 03:26:42 GMT)<\/li>\n\n\n\n<li>\u4e0a\u8a18\u3068\u8fd1\u3044\u30bf\u30a4\u30c8\u30eb\u3060\u304c\u3001\u3053\u3061\u3089\u306f\u300cTo address this task, we create a dataset of papers published after the year 2022 from these five domains.We annotate the papers with future research ideas.To evaluate the novelty and relevance of ideas generated by the LLMs, we propose an Idea Alignment Score (IAScore).This score reflects how well the generated ideas align with those proposed by the authors.\u300d\u3068\u3044\u3046\u65b9\u91dd\u3067\u904e\u53bb\u8ad6\u6587\u3092\u3082\u3068\u306b\u3057\u3066\u3044\u308b\u3002Leakage\u304c\u6c17\u306b\u306a\u308b\u3068\u3053\u308d\u3002<\/li>\n\n\n\n<li>\u30ea\u30dd\u30b8\u30c8\u30ea\u306f<a href=\"https:\/\/github.com\/sandeep82945\/Future-Idea-Generation\">GitHub &#8211; sandeep82945\/Future-Idea-Generation<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>LLM\u304c\u7814\u7a76\u306e\u30a2\u30a4\u30c7\u30a2\u3092\u751f\u6210\u3067\u304d\u308b\u304b\u306b\u3064\u3044\u3066\u306e\u8ad6\u6587\u304c2\u3064\u3067\u3044\u305f\u3002<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[223,457],"class_list":["post-5449","post","type-post","status-publish","format-standard","hentry","category-arxiv","tag-llm","tag-457"],"_links":{"self":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/5449","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5449"}],"version-history":[{"count":0,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/5449\/revisions"}],"wp:attachment":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5449"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5449"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5449"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}