{"id":591,"date":"2020-08-19T00:33:59","date_gmt":"2020-08-18T15:33:59","guid":{"rendered":"http:\/\/www.mukgee.com\/?p=591"},"modified":"2020-12-27T01:24:16","modified_gmt":"2020-12-26T16:24:16","slug":"m-lhugging-face%eb%a5%bc-%ec%9d%b4%ec%9a%a9%ed%95%9c-%eb%ac%b8%ec%9e%a5-generator-%ed%95%99%ec%8a%b5","status":"publish","type":"post","link":"http:\/\/mukgee.com\/?p=591","title":{"rendered":"[M\/L]Hugging Face\ub97c \uc774\uc6a9\ud55c \ubb38\uc7a5 generator \ud559\uc2b5"},"content":{"rendered":"<p>\uc774\uae00\uc740 Transformer \ubaa8\ub378(BERT\/GPT \ub4f1)\uc758 Library \uc778<a href=\"http:\/\/huggingface.co\/\" target=\"_blank\" rel=\"noopener noreferrer\"> hugging face<\/a>\ub97c \ud65c\uc6a9\ud55c generator \ud559\uc2b5\uc744 \uc704\ud55c \uae00\uc785\ub2c8\ub2e4.<br \/>\n\ubaa8\ub4e0 \ub0b4\uc6a9\uc740\u00a0<a href=\"https:\/\/huggingface.co\/blog\/how-to-generate\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/huggingface.co\/blog\/how-to-generate<\/a> \uc744 \ucc38\uace0\ud558\uc600\uc2b5\ub2c8\ub2e4.<\/p>\n<p>&nbsp;<\/p>\n<p>\uc758\ubbf8 \uc788\ub294 sequence \uc788\ub294 \uc0dd\uc131\uc744 \uc704\ud55c \ud559\uc2b5 \uc911 transformer \ubaa8\ub378\uc758 decoder \ub97c \uc0ac\uc6a9 \ud558\uc600\uc73c\ub098\u00a0repetition \ubb38\uc81c\ub97c \ud574\uacb0\ud558\uc9c0 \ubabb\ud558\uc5ec hugging face \uc758 generate API\ub97c \ud65c\uc6a9\ud558\uace0\uc790 \ud569\ub2c8\ub2e4.<\/p>\n<p>hugging face \uc758 \uc124\uce58\ub294\u00a0pip install transformers \ub85c \uc644\ub8cc\ud558\uc600\uc2b5\ub2c8\ub2e4.<\/p>\n<p>\ube14\ub85c\uadf8\uc758 \ud29c\ud1a0\ub9ac\uc5bc\uc774 tensorflow 2\ub97c \uc0ac\uc6a9\ud558\uae30 \ub54c\ubb38\uc5d0 \uc774\uae00\uc5d0\uc11c\ub3c4 \ub3d9\uc77c\ud55c \ud658\uacbd\uc5d0\uc11c \uc9c4\ud589\ud569\ub2c8\ub2e4.<\/p>\n<p>\uae30\ubcf8\uc801\uc73c\ub85c lanuage generator \ubaa8\ub378\uc740 A \ub77c\ub294 \ub2e8\uc5b4\uac00 \uc8fc\uc5b4\uc84c\uc744\ub54c \ub2e4\uc74c\uc5d0 \ub098\ud0c0\ub0a0 \ub2e8\uc5b4\uc758 probability distribution \uc744 \ucd94\uc815\ud558\uc5ec \uc0c8\ub85c\uc6b4 \ub2e8\uc5b4\ub97c \ub9cc\ub4e4\uc5b4 \ub098\uac00\ub294 \uacfc\uc815\uc785\ub2c8\ub2e4.<\/p>\n<p><img loading=\"lazy\" class=\"alignnone size-large wp-image-596\" src=\"http:\/\/www.mukgee.com\/wp-content\/uploads\/2020\/08\/80E5258D-572A-4610-8CC3-38590CC5A306-1024x160.png\" alt=\"\" width=\"843\" height=\"132\" \/><\/p>\n<p>\ub2e4\uc74c \ub2e8\uc5b4\uc758 probability distribution \uc744 \ucd94\uc815\ud558\uc5ec \ubb38\uc7a5\uc744 \uc0dd\uc131\ud558\ub294 \ubaa8\ub378\ub85c\ub294 GPT2, Bart \ub4f1\uc774 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<p>\ud559\uc2b5\ub41c distribution \uc5d0\uc11c \uc5b4\ub5a4 \ub2e8\uc5b4\ub97c \uc120\ud0dd\ud558\ub294\uc9c0\uc5d0 \ub530\ub77c greedy search, beam search, Top-K, Top-p \uac19\uc740 \ubc29\ubc95\uc774 \uc874\uc7ac\ud569\ub2c8\ub2e4.<\/p>\n<p>\uc774\uae00\uc5d0\uc11c\ub294 Pre-trained \ub41c GPT2 \ubaa8\ub378\uc744 \ubd88\ub7ec\uc640\uc11c \ub2e8\uc5b4 \uc120\ud0dd \ubc29\ubc95\uc5d0 \ub530\ub77c \uc5b4\ub5a4 \ucc28\uc774\uac00 \uc788\ub294\uc9c0 \uc54c\uc544\ubcf4\ub824\uace0 \ud569\ub2c8\ub2e4.<\/p>\n<p><strong>-. Greedy Search<\/strong><\/p>\n<p>\ub2e8\uc5b4 A \uac00 \uc8fc\uc5b4\uc84c\uc744\ub54c \ub2e8\uc21c\ud788 probability \uac00 \uac00\uc7a5 \ub192\uc740 \ub2e8\uc5b4\ub97c \uc120\ud0dd\ud558\ub294 \ubc29\ubc95\uc785\ub2c8\ub2e4.<\/p>\n<p>\uac00\uc7a5 \uac04\ub2e8\ud55c \ubc29\ubc95\uc774\uc9c0\ub9cc max operator\ub85c \uc778\ud574 \uc804\ud615\uc801\uc778\u00a0Maximization bais \uc5d0 \ube60\uc9c0\ub294 \ubb38\uc81c\uac00 \ubc1c\uc0dd\ud569\ub2c8\ub2e4. \ubb38\uc7a5 generator \uc5d0\uc11c\ub294 \ub3d9\uc77c \ub2e8\uc5b4\uac00 \ubc18\ubcf5\uc801\uc73c\ub85c \uc0dd\uc131\ub418\ub294 \ubb38\uc81c\uac00 \ubc1c\uc0dd\ud569\ub2c8\ub2e4.<\/p>\n<p><img loading=\"lazy\" class=\"alignnone size-full wp-image-597\" src=\"http:\/\/www.mukgee.com\/wp-content\/uploads\/2020\/08\/6FD9BF05-737F-4D36-ADC3-6FFBA7AACE4C.png\" alt=\"\" width=\"600\" height=\"495\" \/><\/p>\n<p>\uc704 \uadf8\ub9bc\uc5d0\uc11c \ucc98\ub7fc The \ub77c\ub294 \ub2e8\uc5b4\uac00 \uc8fc\uc5b4 \uc84c\uc744\ub54c \uac00\uc7a5 \ub192\uc740 probability \ub97c \uac00\uc9c0\ub294 \ub2e8\uc5b4\ub294 nice \uc785\ub2c8\ub2e4. \uc774\ub7f4 \uacbd\uc6b0 The nice woman \uc774\ub77c\ub294 \ub2e8\uc5b4\ub9cc \ubc18\ubcf5\uc801\uc73c\ub85c \ub098\ud0c0\ub098\uac8c \ub429\ub2c8\ub2e4.<\/p>\n<p><img loading=\"lazy\" class=\"alignnone size-large wp-image-598\" src=\"http:\/\/www.mukgee.com\/wp-content\/uploads\/2020\/08\/9C96C384-5AF1-481C-86CC-C8B5724329AE-1024x640.png\" alt=\"\" width=\"843\" height=\"527\" \/><\/p>\n<p>\uc2e4\uc81c \ucf54\ub4dc\ub97c \uc2e4\ud589\ud574\ubcf4\uba74 \ubb38\uc7a5 \uc790\uccb4\ub3c4 \uc5b4\uc0c9\ud558\uc9c0\ub9cc (I&#8217;ll ever be able to walk with my dog)\uc774 \ubc18\ubcf5\uc801\uc73c\ub85c \ub098\ud0c0\ub098\uac8c \ub429\ub2c8\ub2e4.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>-. Beam Search<\/strong><\/p>\n<p>\ub2e4\uc2dc \uc6b0\ub9ac\uac00 \ubcf4\uc558\ub358 \ub2e8\uc5b4 \ubcc4 probability \uadf8\ub798\ud504\ub97c \ubcf4\uba74 the \uac00 \uc8fc\uc5b4\uc84c\uc744\ub54c dog \ub610\ud55c \uaf64\ub098 \ub192\uc740 probability(0.4) \ub97c \uac00\uc9c0\uace0 \uc788\uc2b5\ub2c8\ub2e4. dog \ub4a4\uc5d0 \ub098\uc624\ub294 \uc5b4\ub5a4 \ub2e8\uc5b4\uc640 \uc870\ud569\ud574\ubcfc \uc218 \uc788\ub2e4\uba74 nice woman \ubcf4\ub2e4 \ub192\uc740 probaility \ub97c \uac00\uc9c4 \ubb38\uc7a5\uc744 \ub9cc\ub4e4 \uc218\ub3c4 \uc788\uc744\uc9c0 \ubaa8\ub985\ub2c8\ub2e4.<\/p>\n<p><img loading=\"lazy\" class=\"alignnone size-full wp-image-599\" src=\"http:\/\/www.mukgee.com\/wp-content\/uploads\/2020\/08\/1E3B6A44-905C-4BDF-87FF-FF361A22327D.png\" alt=\"\" width=\"600\" height=\"495\" \/><\/p>\n<p>\uadf8\ub798\uc11c \ub2e8\uc21c\ud788 The \uc774\ud6c4\uc758 \ud558\ub098\uc758 \ub2e8\uc5b4\ub9cc \ubcf4\ub294\uac8c \uc544\ub2cc beam size \ub9cc\ud07c\uc758 \ub2e8\uc5b4\ub97c \ud655\uc778\ud574\ubd05\ub2c8\ub2e4. \uc774 \uacbd\uc6b0 dog has \ub294 0.4 * 0.9 = 0.36 \uc774\uace0 nice woman \uc740 0.5 * 0.4 = 0.2 \uc785\ub2c8\ub2e4. the dog has \ub77c\ub294 \uc2dc\ud000\uc2a4\uac00 \uc880 \ub354 \ub192\uc740 probability \ub97c \uac00\uc9c0\uac8c \ub418\uc5b4 \uc120\ud0dd\ub429\ub2c8\ub2e4.<\/p>\n<p>greedy \ubcf4\ub2e4\ub294 exploration \uad00\uc810\uc5d0\uc11c beam size \ub9cc\ud07c \uc880 \ub354 \ub9ce\uc740 \ub2e8\uc5b4\ub97c \ud0d0\uc0c9 \ud560 \uc218 \uc788\uc9c0\ub9cc \uadf8\ub7fc\uc5d0\ub3c4 max probability \ub97c \uc120\ud0dd \ud558\uae30 \ub54c\ubb38\uc5d0\u00a0Maximization bais \uc5d0\uc11c \uc790\uc720\ub85c\uc6b8 \uc218 \uc5c6\ub294 \ubc29\ubc95\uc785\ub2c8\ub2e4. (\ubc18\ubcf5\uc774 \ub098\ud0c0\ub0a0 \uc218 \uc788\ub2e4\ub294 \uc774\uc57c\uae30)<\/p>\n<p>hugging face \uc5d0\uc11c\ub294 num_beams \uc635\uc158\uc73c\ub85c \uc0ac\uc6a9 \uac00\ub2a5\ud569\ub2c8\ub2e4.<\/p>\n<p><img loading=\"lazy\" class=\"alignnone size-large wp-image-602\" src=\"http:\/\/www.mukgee.com\/wp-content\/uploads\/2020\/08\/44AD0780-6ACD-4F27-AA7E-9D8A9FE9B445-1024x377.png\" alt=\"\" width=\"843\" height=\"310\" \/><\/p>\n<p>\uc544\uc27d\uc9c0\ub9cc \uc2e4\uc81c\ub85c\ub3c4 \ub3d9\uc77c \ubb38\uc7a5\uc774 \ubc18\ubcf5\uc801\uc73c\ub85c \ub098\ud0c0\ub098\uace0 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<p>Beam Search \ub97c \uc0ac\uc6a9\ud558\uba74\uc11c\ub3c4 \ubc18\ubcf5\uc744 \ud574\uacb0 \ud558\uae30 \uc704\ud55c \ubc29\ubc95\uc73c\ub85c repeat-n-gram\uc744 \uc81c\ud55c\ud558\ub294 \ubc29\ubc95\uc774 \uc788\uc2b5\ub2c8\ub2e4. \ucf54\ub4dc\uc758 ouput \uc5d0\uc11c walk with him \uc774\ub77c\ub294 3-gram \uc774 \ubc18\ubcf5\uc801\uc73c\ub85c \ub098\ud0c0\ub098\uae30 \ub54c\ubb38\uc5d0 \uc81c\ud55c \ud55c\ub2e4\uba74 \ubc18\ubcf5\uc774 \uc904\uc5b4\ub4e0 \uc880\ub354 \uc88b\uc740 \ubb38\uc7a5\uc744 \uc0dd\uc131\ud560 \uc218 \uc788\uc744\uac83 \uc785\ub2c8\ub2e4.<\/p>\n<p>\ud558\uc9c0\ub9cc, Beam Search \uac00 \uac00\uc9c4 max operator \uc758 \ud55c\uacc4\ub294 \uc5ec\uc804\ud788 \uc874\uc7ac\ud569\ub2c8\ub2e4.\u00a0<em>New York<\/em> \uc5d0 \uad00\ud55c \uae00\uc744 \uc4f4\ub2e4\uba74 \uc9c0\uba85\uc740 \ubc18\ubcf5\uc801\uc73c\ub85c \ub098\uc640\uc57c\ud558\ub294\ub370 repeat\ub97c \uc81c\ud55c\ud574\uc11c \ub610\ub2e4\ub978 \uc5b4\uc0c9\ud55c \ubb38\uc7a5\uc774 \uc0dd\uc131 \ub420 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<p>\uacb0\uad6d randomess \ub97c \uc798 control \ud574\uc11c distribution \uc5d0\uc11c \uc801\uc808\ud55c \uc0d8\ud50c\uc744 \ubf51\uc544\ub0b4\ub294\uac8c \uac00\uc7a5 \uc911\uc694\ud560 \uac83\uc785\ub2c8\ub2e4.(Sampling)<\/p>\n<p><strong>-. Sampling<\/strong><\/p>\n<p>\ub2e4\uc74c \ub2e8\uc5b4\uac00 \ub098\uc62c \uc5b4\ub5a4 probability distribution \uc5d0\uc11c random\ud558\uac8c \ub2e8\uc5b4\ub97c \uc120\ud0dd\ud569\ub2c8\ub2e4.<\/p>\n<p>Randomess \ub97c \ud1b5\ud574 Maximization bais \ubb38\uc81c\uac00 \ud574\uacb0 \ub420\uac83\uc73c\ub85c \uae30\ub300 \ub429\ub2c8\ub2e4(\ub2e8\uc5b4 \ubc18\ubcf5 \ud574\uacb0)<\/p>\n<p>HugginFace \uc5d0\uc11c\ub294 generate \ud568\uc218\uc5d0 do_sample=True \ub85c samplinig \uc744 \uc0ac\uc6a9\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<p><img loading=\"lazy\" class=\"alignnone size-large wp-image-600\" src=\"http:\/\/www.mukgee.com\/wp-content\/uploads\/2020\/08\/8619B352-54F7-4F62-85BF-262009B5B5C3-1024x350.png\" alt=\"\" width=\"843\" height=\"288\" \/><img width=\"885\" height=\"302.5\" \/><\/p>\n<p>Sampling \ubc29\ubc95\uc744 \uc0ac\uc6a9\ud574\ubcf4\ub2c8 \ub2e8\uc5b4 \ubc18\ubcf5\uc740 \uc0ac\ub77c\uc84c\uc9c0\ub9cc \ubb38\uc7a5\uc774 \uc758\ubbf8\uac00 \uc5c6\uace0 \uc5b4\uc0c9\ud55c\uac83 \uac19\uc2b5\ub2c8\ub2e4.<\/p>\n<p>softmax \ud568\uc218\uc758 temperature \ub97c \uc801\uc6a9 \ud558\uc5ec \ub192\uc740 probability \ub97c \uac00\uc9c4 \ub2e8\uc5b4\uac00 \uc880\ub354 \uc120\ud0dd\ub418\ub3c4\ub85d \ud560 \uc218 \uc788\uc9c0\ub9cc randomess \ub85c \uc778\ud55c \uc5b4\uc0c9\ud55c \ub2e8\uc5b4 \uc870\ud569\uc740 \uc27d\uac8c \ud574\uacb0\ub418\uc9c0 \uc54a\uc744\uac83 \uac19\uc2b5\ub2c8\ub2e4.<\/p>\n<p>GPT2 \ub294 \uc774\ub7f0 \ubb38\uc81c\ub97c \ud574\uacb0 \ud558\uae30 \uc704\ud574 Top-K \/ Top-p \ubc29\ubc95\uc744 \ub3c4\uc785\ud588\uc2b5\ub2c8\ub2e4.<\/p>\n<p><strong>-. Top-K<\/strong><\/p>\n<p>sampling \uc2dc probability \uac00 \ub192\uc740 k \ubc88\uc9f8 \ub2e8\uc5b4 \uc911 sampling \ud558\ub294 \ubc29\ubc95 \uc785\ub2c8\ub2e4. \uc790\uc8fc \ub4f1\uc7a5 \ud558\uc9c0 \uc54a\ub294 \ub2e8\uc5b4\ub97c sampling \uc5d0\uc11c \uc81c\uc678\ud558\uc5ec \uc880 \ub354 \uc790\uc5f0\uc2a4\ub7ec\uc6b4 \ubb38\uc7a5 \uc0dd\uc131\uc744 \uae30\ub300\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<p><img loading=\"lazy\" class=\"alignnone size-large wp-image-601\" src=\"http:\/\/www.mukgee.com\/wp-content\/uploads\/2020\/08\/FD2E3E27-F54F-4479-9496-EF028502ABE4-1024x447.png\" alt=\"\" width=\"843\" height=\"368\" \/><\/p>\n<p>The \uac00 \uc8fc\uc5b4 \uc84c\uc744\ub54c top 6 \uc911 sampling \ud558\uace0 The car \uc5d0 \ub300\ud574 \uc11c\ub3c4 top 6 \ub85c sampling \ud569\ub2c8\ub2e4. The car \uc5d0 \ub300\ud574\uc11c\ub294 high probability \ub85c drives \uac00 \uc120\ud0dd\ub418\uc5b4 \uc880 \ub354 \uc790\uc5f0 \uc2a4\ub7ec\uc6b4 \ubb38\uc7a5\uc744 \uae30\ub300\ud560 \uc218 \uc788\uc744\uac83 \uac19\uc2b5\ub2c8\ub2e4.<\/p>\n<p>hugging face \uc5d0\uc11c\ub294 top_k \ub77c\ub294 \ud30c\ub77c\ub85c Top-K \ubc29\ubc95\uc744 \uc0ac\uc6a9\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<p><img loading=\"lazy\" class=\"alignnone size-large wp-image-603\" src=\"http:\/\/www.mukgee.com\/wp-content\/uploads\/2020\/08\/0923F898-B139-4213-867F-E87CACE90614-1024x365.png\" alt=\"\" width=\"843\" height=\"300\" \/><\/p>\n<p>Vanilla Sampling \ubcf4\ub2e4\ub294 \uc880\ub354 \uc790\uc5f0\uc2a4\ub7ec\uc6cc \ubcf4\uc774\uc9c0\ub9cc \uc544\uc9c1 \uc5b4\uc0c9\ud55c \ubd80\ubd84\uc774 \ub9ce\uc774 \ubcf4\uc785\ub2c8\ub2e4.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>-. Top-p<\/strong><\/p>\n<p>Top-p \ubc29\ubc95\uc740 k \uac19\uc774 \ub2e8\uc5b4 \uc218\ub85c sampling \ub300\uc0c1\uc744 \uc120\uc815\ud558\ub294\uac83\uc774 \uc544\ub2cc probability \ud569\uc0b0\uc73c\ub85c sampling \ub300\uc0c1\uc744 \uc120\ud0dd\ud569\ub2c8\ub2e4. \ub9cc\uc57d p\uac00 0.9 \uc77c \uacbd\uc6b0 top \uc5d0\uc11c \ubd80\ud130 \ud569\uc0b0 probability \uac00 0.9 \uac00 \ub418\ub294 \uc21c\uac04 \uae4c\uc9c0 sampling \ub300\uc0c1\uc744 \uc120\uc815\ud569\ub2c8\ub2e4.<\/p>\n<p><img loading=\"lazy\" class=\"alignnone size-large wp-image-604\" src=\"http:\/\/www.mukgee.com\/wp-content\/uploads\/2020\/08\/D1772C37-AE29-427D-920C-B9F6670A922B-1024x446.png\" alt=\"\" width=\"843\" height=\"367\" \/><\/p>\n<p>The car \uac00 \uc8fc\uc5b4\uc84c\uc744\ub54c top-k \ubc29\ubc95(k=6)\uc740 down , a \uac19\uc740 \uc5b4\uc0c9\ud55c \ub2e8\uc5b4\ub97c \uc120\ud0dd\ud560 \uac00\ub2a5\uc131\uc774 \uc788\uc9c0\ub9cc top-p\ub294 probability \uac00 \ub192\uc740 drives\/is\/turns \uc911 sampling \ud558\uc5ec \uc880 \ub354 \uc790\uc5f0\uc2a4\ub7ec\uc6b4 \ubb38\uc7a5\uc774 \uc644\uc131\ub420\uac83\uc774\ub77c\uace0 \uae30\ub300\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4. \ub610\ud55c \uc67c\ucabd\ucc98\ub7fc distribution\uc774 flat \ud560 \uacbd\uc6b0 \uc880\ub354 \ub9ce\uc740 \ub2e8\uc5b4\uc758 exploration\uc774 \uac00\ub2a5\ud558\uace0 \uc624\ub978\ucabd\ucc98\ub7fc distribution\uc774 sharp \ud560 \uacbd\uc6b0 \uc815\ud655\ud55c \ub2e8\uc5b4\ub97c \uc120\ud0dd\ud560 \ud655\ub960\uc774 \ub192\uc544\uc9c0\ub294 \uc7a5\uc810\uc744 \uac00\uc9c8 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<p>hugging face \uc5d0\uc11c\ub294 top_p \ub77c\ub294 \uc635\uc158\uc73c\ub85c top-p \ubc29\ubc95\uc744 \uc0ac\uc6a9 \ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n<p><img loading=\"lazy\" class=\"alignnone size-large wp-image-605\" src=\"http:\/\/www.mukgee.com\/wp-content\/uploads\/2020\/08\/7C5925FC-8D59-4697-9486-F6BEB404EFC2-1024x371.png\" alt=\"\" width=\"843\" height=\"305\" \/><img width=\"876.5\" height=\"317.5\" \/><\/p>\n<p>\uc0dd\uc131\ub41c \ubb38\uc7a5\uc774 \uc644\uc804 \uc790\uc5f0\uc2a4\ub7ec\uc6cc \ubcf4\uc774\uc9c0\ub294 \uc54a\uc9c0\ub9cc \uadf8\ub7fc\uc5d0\ub3c4 greedy \ubc29\ubc95\uacfc \ube44\uad50\ud574\uc11c \ub9ce\uc740 \ubc1c\uc804\uc774 \uc788\uc5c8\uc2b5\ub2c8\ub2e4.<\/p>\n<p><a href=\"https:\/\/huggingface.co\/blog\/how-to-generate\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/huggingface.co\/blog\/how-to-generate<\/a> \uc5d0\uc11c \uc18c\uac1c\ud55c \uac04\ub2e8\ud55c \ubb38\uc7a5 \uc0dd\uc131 \uc608\uc81c\ub97c \ub530\ub77c\uac00\uba74\uc11c \ub2e8\uc5b4 \uc120\ud0dd \ubc29\ubc95\ubcc4 \ud2b9\uc9d5\uc744 \ud655\uc778\ud574 \ubcf4\uc558\uc2b5\ub2c8\ub2e4.<\/p>\n<p>\ud29c\ud1a0\ub9ac\uc5bc\uc758 \uacb0\ub860\uc5d0\uc11c \uc800\uc790\ub294 case \ubcc4\ub85c \uac01 \uc120\ud0dd \ubc29\ubc95\uc744 \uc801\uc6a9\uc2dc\ucf1c\ubcf4\uba70 \ucd5c\uc801\uc758 \ubc29\ubc95\uc744 \ucc3e\uc73c\ub77c\uace0 \uc870\uc5b8\ud569\ub2c8\ub2e4. \ubb38\uc7a5 \uc0dd\uc131 \ubaa8\ub378\uc740 \uc5ec\uc804\ud788 \ube60\ub974\uac8c \ubc1c\uc804\ud558\uace0 \uc788\uace0 \ub2e4\uc591\ud55c \uc2dc\ub3c4\uac00 \uc9c4\ud589\ub418\uace0 \uc788\uc5b4 \uc55e\uc73c\ub85c \ub2e4\ub978 \ub2e4\uc591\ud55c \ubc29\ubc95\uc774 \ub4f1\uc7a5\ud560 \uac83 \uac19\uc2b5\ub2c8\ub2e4.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\uc774\uae00\uc740 Transformer \ubaa8\ub378(BERT\/GPT \ub4f1)\uc758 Library \uc778 hugging face\ub97c \ud65c\uc6a9\ud55c generator \ud559\uc2b5\uc744 \uc704\ud55c \uae00\uc785\ub2c8\ub2e4. \ubaa8\ub4e0 \ub0b4\uc6a9\uc740\u00a0https:\/\/huggingface.co\/blog\/how-to-generate \uc744 \ucc38\uace0\ud558\uc600\uc2b5\ub2c8\ub2e4. &nbsp; \uc758\ubbf8 \uc788\ub294 sequence \uc788\ub294 \uc0dd\uc131\uc744 \uc704\ud55c \ud559\uc2b5&hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":""},"categories":[3],"tags":[16,17,24,31,42,49],"aioseo_notices":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"http:\/\/mukgee.com\/index.php?rest_route=\/wp\/v2\/posts\/591"}],"collection":[{"href":"http:\/\/mukgee.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/mukgee.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/mukgee.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/mukgee.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=591"}],"version-history":[{"count":1,"href":"http:\/\/mukgee.com\/index.php?rest_route=\/wp\/v2\/posts\/591\/revisions"}],"predecessor-version":[{"id":593,"href":"http:\/\/mukgee.com\/index.php?rest_route=\/wp\/v2\/posts\/591\/revisions\/593"}],"wp:attachment":[{"href":"http:\/\/mukgee.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=591"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/mukgee.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=591"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/mukgee.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=591"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}