{"id":5979,"date":"2024-12-30T04:08:00","date_gmt":"2024-12-29T19:08:00","guid":{"rendered":"https:\/\/devneko.jp\/wordpress\/?p=5979"},"modified":"2024-12-30T04:08:00","modified_gmt":"2024-12-29T19:08:00","slug":"improving-factuality-with-explicit-working-memory","status":"publish","type":"post","link":"https:\/\/devneko.jp\/wordpress\/?p=5979","title":{"rendered":"Improving Factuality with Explicit Working Memory"},"content":{"rendered":"\n<ul class=\"wp-block-list\">\n<li><strong>Improving Factuality with Explicit Working Memory\u00a0<\/strong>[63.5]<br>\u5927\u898f\u6a21\u306a\u8a00\u8a9e\u30e2\u30c7\u30eb\u306f\u3001\u5e7b\u899a\u3068\u3057\u3066\u77e5\u3089\u308c\u308b\u3001\u4e8b\u5b9f\u7684\u306b\u4e0d\u6b63\u78ba\u306a\u30b3\u30f3\u30c6\u30f3\u30c4\u3092\u751f\u6210\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u308b\u3002 EWE(Explicit Working Memory)\u306f\u3001\u5916\u90e8\u30ea\u30bd\u30fc\u30b9\u304b\u3089\u306e\u30ea\u30a2\u30eb\u30bf\u30a4\u30e0\u30d5\u30a3\u30fc\u30c9\u30d0\u30c3\u30af\u3092\u53d7\u4fe1\u3059\u308b\u30ef\u30fc\u30ad\u30f3\u30b0\u30e1\u30e2\u30ea\u3092\u7d71\u5408\u3059\u308b\u3053\u3068\u3067\u3001\u9577\u6587\u30c6\u30ad\u30b9\u30c8\u751f\u6210\u306b\u304a\u3051\u308b\u4e8b\u5b9f\u6027\u3092\u9ad8\u3081\u308b\u65b0\u3057\u3044\u624b\u6cd5\u3067\u3042\u308b\u3002<br><a href=\"http:\/\/arxiv.org\/abs\/2412.18069v1\">\u8ad6\u6587<\/a>\u00a0\u00a0<a href=\"https:\/\/fugumt.com\/fugumt\/paper_check\/2412.18069v1\">\u53c2\u8003\u8a33\uff08\u30e1\u30bf\u30c7\u30fc\u30bf\uff09<\/a>\u00a0 \u00a0(Tue, 24 Dec 2024 00:55:59 GMT)<\/li>\n\n\n\n<li>\u4e8b\u5b9f\u6027\u3092\u5b88\u308b\u751f\u6210\u3092\u652f\u63f4\u3059\u308b\u624b\u6cd5\u306e\u63d0\u6848\u3002\u300cEwe pauses at given intervals and refreshes its working memory based on feedback from retrieval and fact-checking models, ensuring that the generated content remains accurate and relevant. By integrating this working memory into each attention layer of the Transformer architectures, Ewe can be easily adapted to various large language models.\u300d\u3068\u3044\u3046\u52d5\u4f5c\u3067\u3001\u3053\u306e\u3088\u3046\u306a\u30e2\u30c7\u30eb\u306b\u51e6\u7406\uff08\u306e\u4e00\u90e8\uff09\u3092\u7d44\u307f\u8fbc\u3080RAG\u7684\u306a\u52d5\u4f5c\u306f\u6d41\u884c\u3063\u3066\u3044\u304f\u3093\u3060\u308d\u3046\u306a\u30fc\u3068\u601d\u308f\u306a\u304f\u3082\u306a\u3044\u3002<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[324],"class_list":["post-5979","post","type-post","status-publish","format-standard","hentry","category-arxiv","tag-rag"],"_links":{"self":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/5979","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5979"}],"version-history":[{"count":0,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/5979\/revisions"}],"wp:attachment":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5979"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5979"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5979"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}