{"id":93,"date":"2021-04-19T21:08:27","date_gmt":"2021-04-19T12:08:27","guid":{"rendered":"https:\/\/devneko.jp\/wordpress\/?p=93"},"modified":"2021-04-19T21:08:27","modified_gmt":"2021-04-19T12:08:27","slug":"%e3%83%9e%e3%83%ab%e3%83%81%e3%83%aa%e3%83%b3%e3%82%ac%e3%83%ab%e3%81%aa%e5%a4%a7%e8%a6%8f%e6%a8%a1%e4%ba%8b%e5%89%8d%e5%ad%a6%e7%bf%92%e3%83%a2%e3%83%87%e3%83%ab","status":"publish","type":"post","link":"https:\/\/devneko.jp\/wordpress\/?p=93","title":{"rendered":"\u30de\u30eb\u30c1\u30ea\u30f3\u30ac\u30eb\u306a\u5927\u898f\u6a21\u4e8b\u524d\u5b66\u7fd2\u30e2\u30c7\u30eb\u3001\u4f4e\u30b3\u30b9\u30c8\u306aBERT"},"content":{"rendered":"\n<ul class=\"wp-block-list\"><li><strong>ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation&nbsp;<\/strong>[80.2]<br>ProphetNet\u306f\u3001\u4e8b\u524d\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u30d9\u30fc\u30b9\u306e\u81ea\u7136\u8a00\u8a9e\u751f\u6210\u65b9\u6cd5\u3067\u3059\u3002 ProphetNet\u3092\u4ed6\u306e\u30c9\u30e1\u30a4\u30f3\u3084\u8a00\u8a9e\u306b\u62e1\u5f35\u3057\u3001ProphetNet\u30d5\u30a1\u30df\u30ea\u30fc\u30d7\u30ec\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u30e2\u30c7\u30eb\u3067\u3042\u308bProphetNet-X\u3092\u63d0\u793a\u3059\u308b\u3002 \u5b9f\u9a13\u3067\u306f,ProphetNet-X\u30e2\u30c7\u30eb\u304c10\u30d9\u30f3\u30c1\u30de\u30fc\u30af\u3067\u65b0\u3057\u3044\u6700\u5148\u7aef\u6027\u80fd\u3092\u5b9f\u73fe\u3059\u308b\u3002<br><a href=\"http:\/\/arxiv.org\/abs\/2104.08006v1\">\u8ad6\u6587<\/a>&nbsp;&nbsp;<a href=\"https:\/\/fugumt.com\/fugumt\/paper_check\/2104.08006v1\">\u53c2\u8003\u8a33\uff08\u30e1\u30bf\u30c7\u30fc\u30bf\uff09<\/a>&nbsp; &nbsp;(Fri, 16 Apr 2021 10:00:43 GMT)<ul><li>ProphetNet&nbsp;\u7cfb\u306e\u30de\u30eb\u30c1\u30ea\u30f3\u30ac\u30eb\u30e2\u30c7\u30eb\u3002\u30d9\u30f3\u30c1\u30de\u30fc\u30af\u7d50\u679c\u304b\u3089\u306f\u304b\u306a\u308a\u5f37\u529b\u3068\u601d\u308f\u308c\u308b\u3002<\/li><\/ul><\/li><\/ul>\n\n\n\n<ul class=\"wp-block-list\"><li><strong>How to Train BERT with an Academic Budget&nbsp;<\/strong>[19.2]<br>\u5927\u898f\u6a21\u306a\u8a00\u8a9e\u30e2\u30c7\u30ebBERT \u306f\u3001NLP \u3067\u666e\u904d\u7684\u306b\u4f7f\u7528\u3055\u308c\u3066\u3044\u307e\u3059\u304c\u3001\u4e8b\u524d\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u306f\u3001\u5c11\u6570\u306e\u3088\u304f\u8cc7\u91d1\u63d0\u4f9b\u3055\u308c\u305f\u696d\u754c\u30e9\u30dc\u3067\u3057\u304b\u5229\u7528\u3067\u304d\u306a\u3044\u9ad8\u7d1a\u54c1\u3068\u307f\u306a\u3055\u308c\u307e\u3059\u3002 \u4f4e\u30ec\u30f3\u30b8\u306e12GBGPU\u30928\u53f0\u306e\u307f\u4f7f\u7528\u3057\u30de\u30b9\u30af\u4ed8\u304d\u8a00\u8a9e\u30e2\u30c7\u30eb\u309224\u6642\u9593\u3067\u30d7\u30ea\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u3059\u308b\u30ec\u30b7\u30d4\u3092\u63d0\u6848\u3059\u308b\u3002<br><a href=\"http:\/\/arxiv.org\/abs\/2104.07705v1\">\u8ad6\u6587<\/a>&nbsp;&nbsp;<a href=\"https:\/\/fugumt.com\/fugumt\/paper_check\/2104.07705v1\">\u53c2\u8003\u8a33\uff08\u30e1\u30bf\u30c7\u30fc\u30bf\uff09<\/a>&nbsp; &nbsp;(Thu, 15 Apr 2021 18:17:12 GMT)<ul><li>&nbsp;Nvidia Titan-V GPU\u00d78\u3067\u306eBERT\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u3082\u4f4e\u30b3\u30b9\u30c8\u3067\u306f\u306a\u3044\u3082\u306e\u306e\u304b\u306a\u308a\u73fe\u5b9f\u7684\u3002\u305f\u3060\u3001\u4f4e\u30b3\u30b9\u30c8\u6027\u3068\u3044\u3046\u610f\u5473\u3067\u306fColab\u3067\u3068\u601d\u308f\u306a\u304f\u306f\u306a\u3044\u3002<\/li><\/ul><\/li><\/ul>\n","protected":false},"excerpt":{"rendered":"<p>ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation &hellip; <a href=\"https:\/\/devneko.jp\/wordpress\/?p=93\" class=\"more-link\"><span class=\"screen-reader-text\">&#8220;\u30de\u30eb\u30c1\u30ea\u30f3\u30ac\u30eb\u306a\u5927\u898f\u6a21\u4e8b\u524d\u5b66\u7fd2\u30e2\u30c7\u30eb\u3001\u4f4e\u30b3\u30b9\u30c8\u306aBERT&#8221; \u306e<\/span>\u7d9a\u304d\u3092\u8aad\u3080<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[567],"class_list":["post-93","post","type-post","status-publish","format-standard","hentry","category-arxiv","tag-567"],"_links":{"self":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/93","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=93"}],"version-history":[{"count":0,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/93\/revisions"}],"wp:attachment":[{"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=93"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=93"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devneko.jp\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=93"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}