{"id":877,"date":"2021-02-25T18:51:47","date_gmt":"2021-02-25T09:51:47","guid":{"rendered":"http:\/\/cedartrees.co.kr\/?p=877"},"modified":"2021-04-03T19:06:06","modified_gmt":"2021-04-03T10:06:06","slug":"cnn-text","status":"publish","type":"post","link":"http:\/\/blog.cedartrees.co.kr\/index.php\/2021\/02\/25\/cnn-text\/","title":{"rendered":"CNN\uc744 \ud65c\uc6a9\ud55c \ud14d\uc2a4\ud2b8 \ubd84\ub958"},"content":{"rendered":"\n<p>CNN(Convolutional Neural Networks)\uc740 \uc774\ubbf8\uc9c0 \ubd84\ub958\uc5d0 \ub192\uc740 \uc131\ub2a5\uc744 \ubc1c\ud718\ud558\ub294 \uc54c\uace0\ub9ac\uc998\uc774\ub098 \uc774 \uc678\uc5d0\ub3c4 \uc5ec\ub7ec \ubd84\uc57c\uc5d0\uc11c\ub3c4 \ud65c\uc6a9\ub418\uace0 \uc788\uc2b5\ub2c8\ub2e4. \uadf8\uc911\uc5d0 \ud558\ub098\uac00 \ud14d\uc2a4\ud2b8\ub97c \ubd84\ub958\ud558\ub294 \ubb38\uc81c\uc785\ub2c8\ub2e4.<\/p>\n\n\n\n<p>\ubcf8 \uc608\uc81c\ub294 \uc544\ub798\uc758 \ub17c\ubb38\uc744 \ucc38\uc870\ud558\uace0 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\"><p>Convolutional Neural Networks for Sentence Classification<\/p><cite>We report on a series of experiments with convolutional neural networks (CNN) trained on top of pre-trained word vectors for sentence-level classification tasks. We show that a simple CNN with little hyperparameter tuning and static vectors achieves excellent results on multiple benchmarks. Learning task-specific vectors through fine-tuning offers further gains in performance. We additionally propose a simple modification to the architecture to allow for the use of both task-specific and static vectors. The CNN models discussed herein improve upon the state of the art on 4 out of 7 tasks, which include sentiment analysis and question classification.<\/cite><\/blockquote>\n\n\n\n<p><a href=\"https:\/\/arxiv.org\/abs\/1408.5882\">https:\/\/arxiv.org\/abs\/1408.5882<\/a><\/p>\n\n\n\n<p>\ud569\uc131\uacf1\uc2e0\uacbd\ub9dd\uc774\ub77c\uace0\ub3c4 \ubd88\ub9ac\ub294 CNN \uc54c\uace0\ub9ac\uc998\uc740 \uc5ec\ub7ec \uc88b\uc740 \uac15\uc758\uac00 \uc788\uc73c\ub2c8 \ucc38\uace0\ud558\uc2dc\uae30 \ubc14\ub78d\ub2c8\ub2e4. \ub610 \uad00\ub828\ud574\uc11c \uc88b\uc740 \uc608\uc81c\ub4e4\ub3c4 \ub9ce\uc774 \uc788\uc73c\ub2c8 \uc544\ub798 \uc608\uc81c\ub97c \uc218\ud589\ud558\uc2dc\uae30 \uc804\uc5d0 \uc0b4\ud3b4\ubcf4\uc2dc\uba74 \ub3c4\uc6c0\uc774 \ub418\uc2dc\ub9ac\ub77c \uc0dd\uac01\ud569\ub2c8\ub2e4. <br>\uc544\ub798\uc758 \uc608\uc81c\ub294 \uac00\uc7a5 \uc720\uba85\ud55c \uc608\uc81c \uc911\uc5d0 \ud558\ub098\uc778 MNIST \ubd84\ub958 \uc608\uc81c\uc785\ub2c8\ub2e4. <\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-wp-embed is-provider-\uc138\ub2e4\ud2b8\ub9ac\uc2a4-\uc778\uacf5\uc9c0\ub2a5\uc5f0\uad6c\uc18c wp-block-embed-\uc138\ub2e4\ud2b8\ub9ac\uc2a4-\uc778\uacf5\uc9c0\ub2a5\uc5f0\uad6c\uc18c\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"wp-embedded-content\" data-secret=\"PKf0iUk56L\"><a href=\"http:\/\/cedartrees.co.kr\/index.php\/2020\/08\/11\/cnn-mnist-dataset\/\">CNN MNIST \ud14c\uc2a4\ud2b8 (PyTorch)<\/a><\/blockquote><iframe class=\"wp-embedded-content\" sandbox=\"allow-scripts\" security=\"restricted\" style=\"position: absolute; clip: rect(1px, 1px, 1px, 1px);\" title=\"&#8220;CNN MNIST \ud14c\uc2a4\ud2b8 (PyTorch)&#8221; &#8212; \uc138\ub2e4\ud2b8\ub9ac\uc2a4 \uc778\uacf5\uc9c0\ub2a5\uc5f0\uad6c\uc18c\" src=\"http:\/\/cedartrees.co.kr\/index.php\/2020\/08\/11\/cnn-mnist-dataset\/embed\/#?secret=PKf0iUk56L\" data-secret=\"PKf0iUk56L\" width=\"525\" height=\"296\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>\uba3c\uc800 config\ub97c \uc815\uc758\ud569\ub2c8\ub2e4. config\uc5d0\ub294 \ud559\uc2b5\uc5d0 \ud544\uc694\ud55c \uc5ec\ub7ec\uac00\uc9c0 \ubcc0\uc218\ub4e4\uc744 \ubbf8\ub9ac \uc815\uc758\ud558\ub294 \ubd80\ubd84\uc785\ub2c8\ub2e4. model\uc744 \uc800\uc7a5\ud560 \ub54c\uc5d0 \ud568\uaed8 \uc800\uc7a5\ud558\uba74 \ud559\uc2b5 \ubaa8\ub378\uc744 \uc774\ud574\ud558\ub294\ub370 \ub3c4\uc6c0\uc774 \ub429\ub2c8\ub2e4. <\/p>\n\n\n\n<p>\ud559\uc2b5\uc744 \uc644\ub8cc\ud558\uace0 \uc800\uc7a5\ub41c \ubaa8\ub378 \ud30c\uc77c\uc744 \uc5c5\ub85c\ub4dc\ud574\uc11c \uc0ac\uc6a9\ud560 \ub54c\uc5d0 \ud574\ub2f9 \ubaa8\ub378\uc774 \uc5b4\ub5bb\uac8c \ud559\uc2b5\ub410\ub294\uc9c0\uc5d0 \ub300\ud55c \uc815\ubcf4\uac00 \uc5c6\uc744 \uacbd\uc6b0\ub098 \ubaa8\ub378\uc744 \uc7ac\ud559\uc2b5 \ud55c\ub2e4\uac70\ub098 \ud560 \ub54c\uc5d0 config \uc815\ubcf4\uac00 \uc720\uc6a9\ud558\uac8c \uc0ac\uc6a9\ub429\ub2c8\ub2e4. \ubcf8 \uc608\uc81c\ub294 \ud574\ub2f9 \uc54c\uace0\ub9ac\uc998\uc744 \uc774\ud574\ud558\ub294 \uc815\ub3c4\ub85c \ud65c\uc6a9\ud560 \uc608\uc815\uc774\uae30 \ub54c\ubb38\uc5d0 \ud559\uc2b5\uc740 100\ubc88 \uc815\ub3c4\ub85c \uc81c\ud55c\ud569\ub2c8\ub2e4.<\/p>\n\n\n\n<p>\ub098\uba38\uc9c0 \uc815\uc758\ub41c \ubcc0\uc218\ub4e4\uc740 \uc608\uc81c\uc5d0\uc11c \uc0ac\uc6a9\ud560 \ub54c\uc5d0 \uc124\uba85\ud558\ub3c4\ub85d \ud558\uaca0\uc2b5\ub2c8\ub2e4.<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">from argparse import Namespace\nconfig = Namespace(\n    number_of_epochs=100, lr=0.001, batch_size=50, sentence_lg=30, train_ratio=0.2, embedding_dim=100, n_filters=100, n_filter_size=[2,3,4], output_dim=2\n)<\/pre>\n\n\n\n<p>\ubcf8 \uc608\uc81c\ub294 \uc601\ud654\uc758 \ud3c9\uc810 \ub370\uc774\ud130\ub97c \ud65c\uc6a9\ud569\ub2c8\ub2e4. \ud574\ub2f9 \ub370\uc774\ud130\ub294 \ub124\uc774\ubc84 \uc601\ud654 \ud3c9\uc810\uacfc \uc774\uc5d0 \ub300\ud55c \uae0d\uc815,\ubd80\uc815\uc758 \ubc18\uc751\uc774 \uc800\uc7a5\ub41c \ub370\uc774\ud130\uc785\ub2c8\ub2e4.  \uceec\ub7fc\uc740 [id, document, label]\uc758 \uad6c\uc870\ub85c \ub418\uc5b4 \uc788\uc2b5\ub2c8\ub2e4. \uc601\ud654 \ud3c9\uc774 \ubd80\uc815\uc801\uc778 \uacbd\uc6b0\ub294 label=0, \uadf8\ub807\uc9c0 \uc54a\uc740 \uacbd\uc6b0\ub294 label=1\uc73c\ub85c \ub418\uc5b4 \uc788\uc5b4 \ube44\uad50\uc801 \uac04\ub2e8\ud558\uac8c \ud65c\uc6a9\ud560 \uc218 \uc788\ub294 \ub370\uc774\ud130\uc785\ub2c8\ub2e4. <\/p>\n\n\n\n<p>\uc544\ub798\uc758 \ucf54\ub4dc\ub97c \uc2e4\ud589\ud558\uba74 \ub370\uc774\ud130\ub97c \uc77d\uc5b4 \uc62c \uc218 \uc788\uc2b5\ub2c8\ub2e4.  \ud574\ub2f9 \ub370\uc774\ud130\uc5d0 \uac80\uc0c9\ud574\ubcf4\uba74 \uc27d\uac8c \ucc3e\uc744 \uc218 \uc788\uc2b5\ub2c8\ub2e4.  \ud30c\uc77c\uc778 train \ub370\uc774\ud130\uc640 test \ub370\uc774\ud130\ub85c \ub418\uc5b4 \uc788\uc2b5\ub2c8\ub2e4. \ubcf8 \uc608\uc81c\uc5d0\uc11c\ub294 train \ub370\uc774\ud130\ub9cc \uc0ac\uc6a9\ud569\ub2c8\ub2e4. \ub9ce\uc740 \ub370\uc774\ud130\ub97c \ud1b5\ud574\uc11c \uacb0\uacfc\ub97c \ud655\uc778\ud558\uace0\uc790 \ud558\uc2dc\ub294 \ubd84\uc740 train, test \ubaa8\ub450 \uc0ac\uc6a9\ud574\ubcf4\uc2dc\uae38 \ucd94\ucc9c\ud569\ub2c8\ub2e4.<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">def read_data(filename):\n    with open(filename, 'r',encoding='utf-8') as f:\n        data = [line.split('\\t') for line in f.read().splitlines()]\n        data = data[1:]\n    return data  \ntrain_data = read_data(\"..\/Movie_rating_data\/ratings_train.txt\")<\/pre>\n\n\n\n<p>\uc77d\uc5b4\uc628 \ub370\uc774\ud130\ub97c \uba87\uac1c \uc0b4\ud3b4\ubcf4\uba74 \uc544\ub798\uc640 \uac19\uc2b5\ub2c8\ub2e4. \uc544\ub798 \uc0d8\ud50c\uc5d0\ub294 Label \ub370\uc774\ud130\ub97c \ud45c\uc2dc\ud558\uc9c0 \uc54a\uc558\uc2b5\ub2c8\ub2e4. \ud558\uc9c0\ub9cc \uc77d\uc5b4 \ubcf4\uba74 \ub300\ucda9 \uc774 \ub9ac\ubdf0\ub97c \uc791\uc131\ud55c \uc0ac\ub78c\uc774 \uc601\ud654\ub97c \ucd94\ucc9c\ud558\uace0 \uc2f6\uc740\uc9c0 \uadf8\ub807\uc9c0 \uc54a\uc740\uc9c0\ub97c \uc774\ud574\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4. \uc0ac\ub78c\uc758 \uacbd\uc6b0\uc5d0\ub294 \uc774\ub7ec\ud55c \uae00\uc744 \uc77d\uace0 \ud310\ub2e8 \ud560 \uc218 \uc788\uc9c0\ub9cc \ucef4\ud4e8\ud130\uc758 \uacbd\uc6b0\uc5d0\ub294 \uc774\ub7f0 \ud14d\uc2a4\ud2b8(\uc790\uc5f0\uc5b4)\ub97c \ubc14\ub85c \uc77d\uc5b4\uc11c \uae0d\uc815\uc774\ub098 \ubd80\uc815\uc744 \ud30c\uc545\ud558\ub294 \uac83\uc740 \uc5b4\ub835\uc2b5\ub2c8\ub2e4. \uadf8\ub807\uae30 \ub54c\ubb38\uc5d0 \uac01 \ub2e8\uc5b4\ub4e4\uc744 \uc22b\uc790 \ud615\ud0dc\uc758 \ubca1\ud130\ub85c \ubcc0\ud658\ud558\ub294 \uc791\uc5c5\uc744 \uc218\ud589\ud569\ub2c8\ub2e4.<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">['\ub9ce\uc740 \uc0ac\ub78c\ub4e4\uc774 \uc774 \ub2e4\ud050\ub97c \ubcf4\uace0 \uc6b0\ub9ac\ub098\ub77c \uc2ac\ud508 \ud604\ub300\uc0ac\uc758 \ud55c \ub2e8\uba74\uc5d0 \ub300\ud574 \uae4a\uc774 \uc0dd\uac01\ud558\uace0 \uc0ac\uc8c4\ud558\uace0 \ubc14\ub85c \uc7a1\uae30 \uc704\ud574 \ub178\ub825\ud588\uc73c\uba74 \ud569\ub2c8\ub2e4. \ub9d0\ub85c\ub9cc \ub4e3\ub358 \ubcf4\ub3c4\uc5f0\ub9f9, \uadf8 \ubbfc\uac04\uc778 \ud559\uc0b4\uc774 \uc774\uc815\ub3c4 \uc77c \uc904\uc774\uc57c. \uc774\uac74 \uba85\ubc31\ud55c \uc0b4\uc778\uc785\ub2c8\ub2e4. \uc0b4\uc778\uc790\ub4e4\uc740 \ub2e4 \uc5b4\ub514\uc788\ub098\uc694?',\n '\uc774\ud2c0\ub9cc\uc5d0 \ub2e4 \ubd24\uc5b4\uc694 \uc7ac\ubc0c\uc5b4\uc694 \uadfc\ub370 \ucc28 \uc548\uc5d0 \ubb3c\uac74 \ub123\uc5b4 \uc870\uc791\ud558\ub824\uace0 \ud558\uba74 \ucc28 \uc548\uc774 \uc5f4\ub824\uc788\ub2e4\ub358\uc9c0 \uc9d1 \uc548\uc774 \ud65c\uc9dd \uc5f4\ub824\uc11c \uc544\ubb34\ub098 \ub4e4\uc5b4\uac04\ub2e4\ub358\uac00 \ubb38\uc790\ub97c \uc870\uc791\ud558\ub824\uace0\ud558\uba74 \ube44\ubc88\uc774 \uc548 \uac78\ub824\uc788\uace0 \u314b\u314b\u314b \uadf8\ub7f0 \uac74 \uc5b5\uc9c0\uc2a4\ub7ec\uc6e0\ub294\ub370 \uadf8\ub798\ub3c4 \ub0b4\uc6a9 \uc790\uccb4\ub294 \uc88b\uc558\uc5b4\uc694',\n '\uc774 \uc601\ud654\ub97c \uc774\uc81c\uc11c\uc57c \ubcf4\ub2e4\ub2c8.. \uac10\ud788 \ub0b4 \uc778\uc0dd \ucd5c\uace0\uc758 \uc601\ud654\uc911 \ud558\ub098\ub85c \uaf3d\uc744 \uc218 \uc788\uc744\ub9cc\ud55c \uc791\ud488. \uc5b4\ub5bb\uac8c \uc0b4\uc544\uc57c\ud560\uc9c0 \ub098\ub97c \uc704\ud55c \uace0\ubbfc\uc744 \ud55c\ubc88 \ub354 \ud558\uac8c \ub418\ub294 \uc2dc\uac04. \uadf8\ub9ac\uace0 \ubaa8\uac74 \ud504\ub9ac\uba3c\uc740 \ub098\uc774\uac00 \ub4e4\uc5b4\ub3c4 \uc5ec\uc804\ud788 \uc139\uc2dc\ud558\ub2e4.',\n '\uc544~ \uc9c4\uc9dc \uc870\uae08\ub9cc \ub354 \uc190 \uc880 \ubcf4\uba74 \uc660\ub9cc\ud55c \uc0c1\uc5c5 \uc601\ud654 \ubabb\uc9c0 \uc54a\uac8c \ud004\ub9ac\ud2f0 \uca54\uac8c \ub9cc\ub4e4\uc5b4 \uc9c8 \uc218 \uc788\uc5c8\ub294\ub370 \uc544\uc27d\ub124\uc694 \uadf8\ub798\ub3c4 \ucda9\ubd84\ud788 \uc7ac\ubbf8\uc788\uc5c8\uc2b5\ub2c8\ub2e4 \uac1c\uc778\uc801\uc73c\ub85c \uc870\uae08\ub9cc \ub354 \uc794\uc778\ud558\uac8c \ub354 \uc790\uadf9\uc801\uc73c\ub85c \ub178\ucd9c\uc52c\ub3c4 \ud654\ub048\ud558\uac8c \ud588\ub354\ub77c\uba74 \uc5b4\ub560\uc744\uae4c \ud558\ub294 \uad6d\uc0b0\uc601\ud654\ub77c \ub9ce\uc774 \uc544\ub080 \ub4ef \ubcf4\uc784',\n '\ud3c9\uc810\uc774 \ub108\ubb34 \ub192\ub2e4. \uc804\ud600 \uc7ac\ubbf8\uc788\uc9c0 \uc54a\uc558\ub2e4. \uc4f8\ub370\uc5c6\uc774 \ub9d0\ub9cc \ub9ce\uc74c. \uc774\ub7f0 \ub958\uc758 \uc601\ud654\ub294 \uc870\uc5f0\ub4e4\uc758 \ub4b7\ubc1b\uce68\uc774 \uc911\uc694\ud55c\ub370 \uc870\uc5f0\ub4e4\uc758 \ub0b4\uc6a9\uc790\uccb4\uac00 \uc804\ud600 \uc5c6\uc74c. \ub610\ud55c \uc5ec\ubc30\uc6b0\ub3c4 \ubcc4\ub85c \ub9e4\ub825 \uc5c6\uc5c8\ub2e4. \uc774\ud2c0\uc804\uc5d0 \uc800\uc2a4\ud2b8\uace0\uc704\ub4dc\uc787\uc758 \uc560\ub2c8\uc2a4\ud1a4\uc744 \ubcf4\uace0 \uc774 \uc601\ud654\ub97c \ubd10\uc11c \uadf8\ub7f0\uac00. \uc2e4\ub9dd\ud588\uc74c',\n '\uc65c \uadf9\uc744 \ub04c\uc5b4\uac00\ub294 \uc911\uc2ec\uc788\ub294 \uce90\ub9ad\ud130\uac00 \uc788\uc5b4\uc57c \ud558\ub294\uc9c0 \uc54c\uac8c \ub41c\uc601\ud654 \uc0b4\uc778\ub9c8\uc640 \ub300\uc801\ud558\ub294 \uadf8\ub9ac\uace0 \uc0ac\uac74\uc744 \ud574\uacb0\ud558\ub294 \uc778\ubb3c\uc774 \uc5c6\uace0 \uadf8\ub9ac\uace0 \uc65c \ub9c8\uc9c0\ub9c9\uc5d0 \ub2e4 \ud0c8\ucd9c \ud574\ub193\uace0 \ub098\uc11c \uc7a1\ud788\uace0 \uc8fd\uc784\uc744 \ub2f9\ud558\ub294\uc9c0 \uc774\ud574\ud560\uc218\uac00 \uc5c6\ub2e4. \ub300\uccb4 \uc870\ub2ec\ud658 \uc815\uc720\ubbf8\ub294 \uc65c \ub098\uc634?',\n '\ucd08\ub529 \ub54c \uce5c\ucc99\ud615\uc774 \ube44\ub514\uc624\ub85c \ube4c\ub824\uc640\uc11c \ubd24\ub358 \uae30\uc5b5\uc774 \ub09c\ub2e4...\ub108\ubb34 \uc7ac\ubbf8 \uc5c6\uc5c8\ub2e4 \uadfc\ub370 \ub098\uc911\uc5d0 \uc6b0\uc5f0\ud788 \ub2e4\uc2dc\ubcf4\ub2c8 \uc7ac\ubc0c\ub354\ub77c \uadf8 \ub550 \uc65c \uadf8\ub807\uac8c \uc7ac\ubbf8\uac00 \uc5c6\uc5c8\uc744\uae4c?? 98\ub144\uc774\uba74 \ub0b4\uac00 \ucd08\ub4f1\ud559\uad50 2\ud559\ub144 \ub54c\ub2c8\uae4c...\uc0ac\ucd0c\ud615\uc774 \ub2f9\uc2dc \ub098\ub984 \ucd5c\uc2e0 \ube44\ub514\uc624\ub97c \ube4c\ub824\uc628\uac70 \uac19\ub2e4',\n '\ucc3d\uc5c5\uc744 \uafc8\uafb8\ub294\uac00! \uc88b\uc740 \uc544\uc774\ud15c\uc774 \uc788\uc5b4 \uc0ac\uc5c5\uc744 \ud558\ub824\ud558\ub294\uac00!! \uadf8\ub807\ub2e4\uba74 \uae30\ub97c \uc4f0\uace0 \uc774 \uc601\ud65c \ubcf4\uae30\ubc14\ub780\ub2e4!! \uadf8 \uba40\uace0 \ud5d8\ud55c \uc5ec\uc815\uc5d0 \uc2a4\uc2b9\uc774 \ub420\uac83\uc774\uc694 \uc9c0\uce68\uc11c\uac00 \ub420\uac83\uc774\ub2e4... \ud639\uc740 \ub2e8\ub150\uc5d0 \ub3c4\uc6c0\uc774 \ub420\uc9c0\ub3c4... \ucc38 \uc624\ub79c\ub9cc\uc5d0 \ubc15\uc7a5\ub300\uc18c\ud558\uba70 \ubcf8 \ub3c5\ub9bd\uc601\ud65c\uc138~~~ \u2605',\n \"\uc601\ud654'\uc0b0\uc5c5'\uc774\ub77c\uace0 \ud558\uc796\ub294\uac00? \uc774\ub534\uc2dd\uc73c\ub85c \ud64d\ubcf4 \ud574\ub193\uace0 \uc18d\uc5ec\uc11c \ud314\uc558\ub2e4\ub294 \uac8c \uc18c\ube44\uc790 \uc785\uc7a5\uc5d0\uc11c\ub294 \uc9dc\uc99d\ub09c\ub2e4. \uadf8\ub098\ub9c8 \ub2e4\ud589\uc740 \uc544\uc8fc \uc2f8\uad6c\ub824\ub97c \uc0c1\uae09\ud488\uc73c\ub85c \uc18d\uc5ec\ud310 \uac8c \uc544\ub2c8\ub77c\ub294 \uc810. \uadf8\ub798\uc11c 1\uc810. \ucc28\ub77c\ub9ac \uc5f0\uc0c1\ud638 \uac10\ub3c5 \uc791\ud488 \ucc98\ub7fc \ud64d\ubcf4\uac00 \ub410\ub2e4\uba74, \uadf8 \ube44\uc2b7\ud558\uac8c \ub9cc\uc774\ub77c\ub3c4 \ud558\uc9c0\",\n '\ub3c4\uc785\ubd80\ub97c \uc81c\uc678\ud558\uace0\ub294 \ub530\ubd84.\ud5ec\uae30\uc5d0\uc11c \ubbfc\uac04\uc778\uc744 \ub9c8\uad6c \uc3f4 \uc8fd\uc774\ub294 \ubbf8\uad70, \ubca0\ud2b8\uacf5 \uc5ec\uc131 \uc2a4\ub098\uc774\ud37c \ub4f1,\ud604\uc2e4\uac10 \uc5c6\ub294 \uadf9\ub2e8\uc801\uc778 \uc124\uc815.\ub77c\uc774\uc5b8 \uc77c\ubcd1\uc5d0\uc11c\uc758 \uc5c5\ud584 \uadf8\ub9ac\uace0 \uc774 \uc601\ud654 \uc8fc\uc778\uacf5\uc778 \uc870\ucee4, \ub450 \ub118 \ubaa8\ub450 \ub0b4\uac00 \uc2eb\uc5b4\ud558\ub294 \uce90\ub9ad\ud130, \ucc29\ud55c\ucc99 \ud558\uba74\uc11c \uc8fc\uc704\uc5d0 \ud53c\ud574\ub97c \uc8fc\ub294 \ub118\ub4e4.']<\/pre>\n\n\n\n<p>\uac01 \ub9ac\ubdf0\ub97c \uc77d\uc740 \ud6c4\uc5d0 \ubb38\uc7a5\uc744 \uc5b4\uc808 \ub2e8\uc704\ub85c \ubd84\ub9ac\ud569\ub2c8\ub2e4. \ubd84\ub9ac\ud55c \uc5b4\uc808\uc744 \ud615\ud0dc\uc18c\uae4c\uc9c0 \ubd84\ub9ac\ud574\uc11c \ud65c\uc6a9\ud558\uba74 \uc88b\uaca0\uc9c0\ub9cc \ubcf8 \uc608\uc81c\uc5d0\uc11c\ub294 \uac04\ub2e8\ud788 \uc5b4\uc808 \ub2e8\uc704\ub85c\ub9cc \ubd84\ub9ac\ud569\ub2c8\ub2e4. \ud615\ud0dc\uc18c\ub85c \ubd84\ub9ac\ud558\ub294 \uc608\uc81c\ub294 \ubcf8 \ube14\ub85c\uadf8\uc5d0 \ub2e4\ub978 \uc608\uc81c\uc5d0\uc11c\ub3c4 \ub0b4\uc6a9\uc774 \uc788\uc73c\ub2c8 \ucc38\uace0\ud558\uc2dc\uae30 \ubc14\ub78d\ub2c8\ub2e4. \uc5b4\uc808 \ub2e8\uc704\ub85c \ubd84\ub9ac\ud55c \ud14d\uc2a4\ud2b8\uc5d0\uc11c \uc911\ubcf5\uc744 \uc81c\uac70\ud574\ubcf4\uba74 32,435\uac1c \uc5b4\uc808\uc744 \uc5bb\uc744 \uc218 \uc788\uc2b5\ub2c8\ub2e4. <\/p>\n\n\n\n<p>\uc774\ub807\uac8c \uc5bb\uc740 32,435\uac1c\uc758 \uc5b4\uc808\uc744 \uc5b4\ub5bb\uac8c \ubca1\ud130\ub85c \ub098\ud0c0\ub0b4\ub294\uac00\uc5d0 \ub300\ud574\uc11c\ub294 pytorch\uc758 Embedding\uc744 \uc0ac\uc6a9\ud558\uc5ec \ud45c\ud55c\ud569\ub2c8\ub2e4. \ud574\ub2f9 \ub0b4\uc6a9\ub3c4 \ubcf8 \ube14\ub85c\uadf8\uc758 \ub2e4\ub978 \uc608\uc81c\uc5d0\uc11c \ub9ce\uc774 \ub2e4\ub918\uae30 \ub54c\ubb38\uc5d0 \uc5ec\uae30\uc11c\ub294 \uc0dd\ub7b5\ud558\uace0 \ub118\uc5b4\uac00\ub3c4\ub85d \ud558\uaca0\uc2b5\ub2c8\ub2e4.<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">words = []\nfor s in sentences:\n    words.append(s.split(' '))\n    \nwords = [j for i in words for j in i]\nwords = set(list(words))\n\nprint('vocab size:{}'.format(len(words)))\nvocab_size = len(words) #vocab size:32435<\/pre>\n\n\n\n<p>\ub9ac\ubdf0\uc758 \uae38\uc774\ub97c \ubcf4\uba74 \uae38\uc740 \uac83\uc740 70 \uc5b4\uc808\uc774 \ub118\uace0 \uc9e7\uc740 \uac83\uc740 1 \uc5b4\uc808\ub3c4 \uc788\uae30 \ub54c\ubb38\uc5d0 \uc5b4\uc808\uc758 \ud3b8\ucc28\uac00 \ud06c\ub2e4\ub294 \uac83\uc744 \ud655\uc778 \ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4. \uadf8\ub807\uae30 \ub54c\ubb38\uc5d0 \ubcf8 \uc608\uc81c\uc5d0\uc11c\ub294 30 \uc5b4\uc808 \uc774\uc0c1 \ub418\ub294 \ub9ac\ubdf0\ub4e4\ub9cc \uc0ac\uc6a9\ud558\uaca0\uc2b5\ub2c8\ub2e4. \uc774\ub97c \uc704\ud574\uc11c config \ud30c\uc77c\uc5d0 sentence_lg=30\uc640 \uac19\uc740 \uac12\uc744 \uc124\uc815\ud588\uc2b5\ub2c8\ub2e4.<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">x_data = [[word2index[i] for i in sentence.split(' ')] for sentence in sentences]\nsentence_length = np.array([len(x) for x in x_data])\nmax_length = np.array([len(x) for x in x_data]).max()<\/pre>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><img loading=\"lazy\" width=\"368\" height=\"248\" src=\"http:\/\/cedartrees.co.kr\/wp-content\/uploads\/2021\/02\/download.png\" alt=\"\" class=\"wp-image-878\" srcset=\"http:\/\/blog.cedartrees.co.kr\/wp-content\/uploads\/2021\/02\/download.png 368w, http:\/\/blog.cedartrees.co.kr\/wp-content\/uploads\/2021\/02\/download-300x202.png 300w\" sizes=\"(max-width: 368px) 100vw, 368px\" \/><\/figure><\/div>\n\n\n\n<p>\uc704\uc758 \uadf8\ub798\ud504\ub294 \uc0d8\ud50c \uc5b4\uc808\uc758 \ubd84\ud3ec\ub97c \ub098\ud0c0\ub0c5\ub2c8\ub2e4. \ubcf8 \uc608\uc81c\uc5d0\uc11c\ub294 \uc57d 30~40 \uc0ac\uc774\uc758 \uc5b4\uc808 \uc815\ub3c4\ub9cc \uc0ac\uc6a9\ud558\ub3c4\ub85d \ud558\uaca0\uc2b5\ub2c8\ub2e4. \ub9cc\uc57d \uc5b4\uc808\uc758 \ud3b8\ucc28\uac00 \ub108\ubb34 \ud06c\uba74 \uc0c1\ub2f9 \ubd80\ubd84\uc744 \uc758\ubbf8 \uc5c6\ub294 \ub370\uc774\ud130\ub85c \ucc44\uc6cc\uc57c \ud569\ub2c8\ub2e4. \uc544\ub798\uc758 \uc608\uc81c\ub294 \ube48 \uc5b4\uc808\uc744 \ud328\ub529\uac12(0)\uc73c\ub85c \ucc44\uc6b0\ub294 \ubd80\ubd84\uc785\ub2c8\ub2e4.<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">for ndx,d in enumerate(x_data):\n    x_data[ndx] = np.pad(d, (0, max_length), 'constant', constant_values=0)[:max_length]<\/pre>\n\n\n\n<p>\uc544\ub798\uc640 \uac19\uc774 \uac01 \uc5b4\uc808\uc744 \uc22b\uc790 \ud615\ud0dc\uc758 \uac12\uc73c\ub85c \ubcc0\ud658\ud558\uba74 \ub9ac\ubdf0\uc758 \ub0b4\uc6a9\uc740 \uc22b\uc790\ub85c \uad6c\uc131\ub41c \ub9ac\uc2a4\ud2b8 \ud615\ud0dc\uac00 \ub429\ub2c8\ub2e4. \uc774\ub54c 0\uc740 \ud328\ub529 \uac12\uc73c\ub85c max_length \ubcf4\ub2e4 \uc791\uc744 \uacbd\uc6b0 \ub0a8\uc740 \uac12\uc744 0\uc73c\ub85c \ucc44\uc6b0\uac8c \ub429\ub2c8\ub2e4. 0 \ub370\uc774\ud130\uac00 \ub9ce\uc744 \uc218\ub85d \uc608\uce21\uc758 \uc815\ud655\ub3c4\uac00 \ub5a8\uc5b4\uc9c0\uac8c \ub429\ub2c8\ub2e4.<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">[array([18196, 16747,  1952, 27879,  4206, 29579,  3641, 14582,  8661,\n        16754,   964, 10240,  6070, 25011,  3902, 16410, 30182, 22634,\n         5531, 24456,  6360,  6482, 26016,  9239, 25466, 31032,  6505,\n        30782, 30861, 30494,  6876, 12237, 27035, 14997,     0,     0,\n            0,     0,     0,     0,     0]),\n array([30000, 27035, 15316,  4633, 26703,  7875,  5042, 16695, 25520,\n        14681, 20133,  7875,    71,  8983,   363,    71,  5149,  2391,\n        27910, 28746, 23902, 32136, 12475, 24439, 15973, 20236,  4726,\n         6190, 17515, 20610, 29270, 13967, 28490,     0,     0,     0,\n            0,     0,     0,     0,     0]),\n array([ 1952, 12632, 10665, 27623, 25106,  1978,   184,  1537, 29451,\n         4705, 22537, 21866, 14473, 26012,  6744, 15690, 27119, 15822,\n        12491, 31747, 11202, 14268, 31494,  3202, 10936, 21619, 29214,\n        15185,  5496, 12854, 27679,     0,     0,     0,     0,     0,\n            0,     0,     0,     0,     0])]<\/pre>\n\n\n\n<p>\ud559\uc2b5\uc744 \uc704\ud55c \ub370\uc774\ud130\ub97c train, test \ud615\ud0dc\ub85c \ubd84\ub9ac\ud558\uac8c \ub429\ub2c8\ub2e4. \ubd84\ub9ac\ud558\uba74\uc11c \ud559\uc2b5\uc6a9 \ub370\uc774\ud130\uc640 \ud14c\uc2a4\ud2b8\uc6a9 \ub370\uc774\ud130\uc758 \ube44\uc728\uc744 8:2\ub85c \uc124\uc815\ud569\ub2c8\ub2e4. test \ub370\uc774\ud130\ub294 \ud559\uc2b5\uc5d0 \uc0ac\uc6a9\ud558\uc9c0 \uc54a\ub294 \ub370\uc774\ud130\ub85c \ubaa8\ub378\uc758 \uc815\ud655\ub3c4 \ud3c9\uac00\uc5d0\ub9cc \uc0ac\uc6a9\ub429\ub2c8\ub2e4.<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">from sklearn.model_selection import train_test_split\n\ny_data = np.array(label).astype(np.long)\nx_train, x_test, y_train, y_test = train_test_split(np.array(x_data), y_data, test_size = config.train_ratio, random_state=0) # 8:2\nprint(x_train.shape, y_train.shape, x_test.shape, y_test.shape)<\/pre>\n\n\n\n<p>\ud559\uc2b5\uc6a9 \ub370\uc774\ud130\ub294 \ub370\uc774\ud130\ub85c\ub354\uc5d0 \uc785\ub825\ud558\uc5ec \uc77c\uc815 \ud06c\uae30(config.batch_size)\ub85c \ubb36\uc5b4 \uc90d\ub2c8\ub2e4. \uc608\ub97c \ub4e4\uc5b4 100\uac74\uc758 \ub370\uc774\ud130\ub97c 20\uac1c\ub85c \ubb36\ub294\ub2e4\uba74 5\uac1c\uc758 \ubb36\uc74c\uc73c\ub85c \ub098\ud0c0\ub0bc \uc218 \uc788\uc2b5\ub2c8\ub2e4. \uc9c0\uae08 \uc218\ud589\ud558\ub294 \uc608\uc81c\ub294 \ube44\uad50\uc801 \uc801\uc740 \uc591\uc758 \ub370\uc774\ud130\uc774\uae30 \ub54c\ubb38\uc5d0 \uc774\ub7f0 \uacfc\uc815\uc774 \ubd88\ud544\uc694\ud560 \uc218\ub3c4 \uc788\uc9c0\ub9cc \ub9ce\uc740 \ub370\uc774\ud130\ub97c \ud1b5\ud574\uc11c \ud559\uc2b5\ud558\uc2dc\ub294 \ubd84\uc744 \uc704\ud574\uc11c \ud574\ub2f9 \ub85c\uc9c1\uc744 \uad6c\ud604\ud588\uc2b5\ub2c8\ub2e4. \uadf8\ub9ac\uace0 \ud559\uc2b5 \ub370\uc774\ud130\ub97c shuffle \ud574\uc90d\ub2c8\ub2e4. \uc774 \uacfc\uc815\ub3c4 \ud6c8\ub828\uc758 \uc815\ud655\ub3c4\ub97c \ub192\uc774\uae30 \uc704\ud574\uc11c \ud544\uc694\ud55c \ubd80\ubd84\uc774\ub2c8 True\ub85c \uc124\uc815\ud558\uc2dc\uae30 \ubc14\ub78d\ub2c8\ub2e4.<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">from torch.utils.data import Dataset, DataLoader\nclass TxtDataSet(Dataset):\n\n    def __init__(self, data, labels):\n        super().__init__()\n        self.data = data\n        self.labels = labels\n\n    def __len__(self):\n        return len(self.data)\n\n    def __getitem__(self, idx):\n        return self.data[idx], self.labels[idx]\ntrain_loader = DataLoader(dataset=TxtDataSet(x_train, y_train), batch_size=config.batch_size, shuffle=True)<\/pre>\n\n\n\n<p>\ud30c\uc774\ud1a0\uce58\ub97c \ud65c\uc6a9\ud574\uc11c \uc218\ud589\ud558\uae30 \ub54c\ubb38\uc5d0 \ud544\uc694\ud55c \ubaa8\ub4c8\uc744 \uc784\ud3ec\ud2b8\ud569\ub2c8\ub2e4.<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">import numpy as np\n\nimport torch\nimport torch.nn as nn\nimport torch.optim as optim\nimport torch.nn.functional as F<\/pre>\n\n\n\n<p>CNN  \ubaa8\ub378\uc744 \uc544\ub798\uc640 \uac19\uc774 \uc0dd\uc131\ud569\ub2c8\ub2e4. \uc774\ubbf8 \uc124\uba85\ud55c \ub0b4\uc6a9\ub3c4 \uc788\uae30 \ub54c\ubb38\uc5d0 \uc790\uc138\ud55c \ub0b4\uc6a9\uc740 \ub118\uc5b4\uac00\uaca0\uc2b5\ub2c8\ub2e4. \uac00\uc7a5 \uc911\uc694\ud55c \ubd80\ubd84\uc740  \ud14d\uc2a4\ud2b8 \ub370\uc774\ud130\ub97c [number_of_batch, channel, n, m] \ud615\ud0dc\uc758 \ub370\uc774\ud130\ub85c \ub9cc\ub4dc\ub294 \uacfc\uc815\uc774 \uc911\uc694\ud569\ub2c8\ub2e4. \uc774\ub807\uac8c \ub370\uc774\ud130\uac00 \ub9cc\ub4e4\uc5b4\uc9c0\uba74 \ud574\ub2f9 \ub370\uc774\ud130\ub97c \ud1b5\ud574\uc11c \ud559\uc2b5\uc744 \uc218\ud589\ud569\ub2c8\ub2e4.<\/p>\n\n\n\n<p><a href=\"https:\/\/halfundecided.medium.com\/%EB%94%A5%EB%9F%AC%EB%8B%9D-%EB%A8%B8%EC%8B%A0%EB%9F%AC%EB%8B%9D-cnn-convolutional-neural-networks-%EC%89%BD%EA%B2%8C-%EC%9D%B4%ED%95%B4%ED%95%98%EA%B8%B0-836869f88375\">https:\/\/halfundecided.medium.com\/%EB%94%A5%EB%9F%AC%EB%8B%9D-%EB%A8%B8%EC%8B%A0%EB%9F%AC%EB%8B%9D-cnn-convolutional-neural-networks-%EC%89%BD%EA%B2%8C-%EC%9D%B4%ED%95%B4%ED%95%98%EA%B8%B0-836869f88375<\/a><\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><img src=\"https:\/\/miro.medium.com\/max\/640\/1*usA-K08Tn5i6P7eLvV8htg.png\" alt=\"\"\/><\/figure><\/div>\n\n\n\n<p>CNN \uc54c\uace0\ub9ac\uc998\uc744 \uc798 \uc124\uba85\ud558\uace0 \uc788\ub294 \ube14\ub85c\uadf8\uc758 \ub9c1\ud06c\ub97c \uc62c\ub9bd\ub2c8\ub2e4. \uc790\uc138\ud55c \ub0b4\uc6a9\uc740 \uc774\uacf3 \ube14\ub85c\uadf8\ub3c4 \ucc38\uace0\ud574 \ubcf4\uc2dc\uae30 \ubc14\ub78d\ub2c8\ub2e4.<\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">class CNN(nn.Module):\n\n    def __init__(self, vocab_size, embedding_dim, n_filters, filter_size, output_dim):\n        super().__init__()\n        self.embedding = nn.Embedding(vocab_size, embedding_dim)\n        self.convs = nn.ModuleList([\n            nn.Conv2d(in_channels=1, out_channels=n_filters, kernel_size=(fs, embedding_dim)) for fs in filter_size\n            ])\n        self.fc = nn.Linear(len(filter_size)*n_filters, output_dim)\n\n    def forward(self, text):\n        embedded = self.embedding(text)\n        embedded = embedded.unsqueeze(1)\n        conved = [F.relu(conv(embedded)).squeeze(3) for conv in self.convs]\n        pooled = [F.max_pool1d(conv, conv.shape[2]).squeeze(2) for conv in conved]\n        \n        return self.fc(torch.cat(pooled, dim=1)) # make fully-connected\n    \nembedding_dim = config.embedding_dim\nn_filters = config.n_filters\nn_filter_size = config.n_filter_size\noutput_dim = config.output_dim # 0 or 1\n\nmodel = CNN(vocab_size, embedding_dim, n_filters, n_filter_size, output_dim)\nprint(model)<\/pre>\n\n\n\n<pre class=\"wp-block-preformatted\">CNN(\n  (embedding): Embedding(32435, 100)\n  (convs): ModuleList(\n    (0): Conv2d(1, 100, kernel_size=(2, 100), stride=(1, 1))\n    (1): Conv2d(1, 100, kernel_size=(3, 100), stride=(1, 1))\n    (2): Conv2d(1, 100, kernel_size=(4, 100), stride=(1, 1))\n  )\n  (fc): Linear(in_features=300, out_features=2, bias=True)\n)<\/pre>\n\n\n\n<p>\uc544\ub798\uc640 \uac19\uc774 \ud559\uc2b5\uc744 \uc218\ud589\ud569\ub2c8\ub2e4. \uac04\ub2e8\ud788 100\ubc88 \uc815\ub3c4\ub9cc \ubc18\ubcf5\ud588\uc2b5\ub2c8\ub2e4. <\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">optimizer = optim.Adam(model.parameters())\ncriterion = nn.CrossEntropyLoss()\n\nmodel.train()\nfor epoch in range(config.number_of_epochs):\n    train_loss, valid_loss = 0, 0\n    \n    # train_batch start\n    for x_i, y_i in train_loader:\n        optimizer.zero_grad()\n        \n        output = model(x_i)\n        loss = criterion(output, y_i)\n        \n        loss.backward()\n        optimizer.step()\n        \n        train_loss += float(loss)\n    if epoch % 5 == 0:\n        print('Epoch : {}, Loss : {:.5f}'.format(epoch, train_loss\/len(train_loader)))<\/pre>\n\n\n\n<pre class=\"wp-block-preformatted\">Epoch : 0, Loss : 0.69145\nEpoch : 5, Loss : 0.04431\nEpoch : 10, Loss : 0.00848\nEpoch : 15, Loss : 0.00352\nEpoch : 20, Loss : 0.00192\nEpoch : 25, Loss : 0.00120\nEpoch : 30, Loss : 0.00082\nEpoch : 35, Loss : 0.00059\nEpoch : 40, Loss : 0.00044\nEpoch : 45, Loss : 0.00034\nEpoch : 50, Loss : 0.00027\nEpoch : 55, Loss : 0.00022\nEpoch : 60, Loss : 0.00018\nEpoch : 65, Loss : 0.00015\nEpoch : 70, Loss : 0.00012\nEpoch : 75, Loss : 0.00010\nEpoch : 80, Loss : 0.00009\nEpoch : 85, Loss : 0.00008\nEpoch : 90, Loss : 0.00007\nEpoch : 95, Loss : 0.00006<\/pre>\n\n\n\n<p>\ud559\uc2b5\uc744 \uc644\ub8cc\ud558\uace0 \ud14c\uc2a4\ud2b8 \ub370\uc774\ud130\ub97c \ud1b5\ud574\uc11c \ubaa8\ub378\uc744 \ud3c9\uac00\ud574\ubcf8 \uacb0\uacfc 68.39%\uc758 \uc815\ud655\ub3c4\ub97c \uc5bb\uc5c8\uc2b5\ub2c8\ub2e4. <br>\ub192\uc740 \uc815\ud655\ub3c4\ub294 \uc544\ub2c8\uc9c0\ub9cc \ub9ce\uc740 \ubd80\ubd84 \uac04\uc18c\ud654\ud55c \ud559\uc2b5\uc774\uc5c8\uc74c\uc744 \uac10\uc548\ud558\uba74 \ub098\ub984\ub300\ub85c \uc720\uc758\ubbf8\ud55c \uacb0\uacfc\ub97c \uc5bb\uc5c8\ub2e4\uace0 \uc0dd\uac01\ub429\ub2c8\ub2e4. <\/p>\n\n\n\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"generic\" data-enlighter-theme=\"\" data-enlighter-highlight=\"\" data-enlighter-linenumbers=\"\" data-enlighter-lineoffset=\"\" data-enlighter-title=\"\" data-enlighter-group=\"\">with torch.no_grad():\n    output = model(torch.tensor(x_test, dtype=torch.long))\n    predict = torch.argmax(output, dim=-1)\n    predict = (predict==torch.tensor(y_test, dtype=torch.long))\n    print('Accuracy!',predict.sum().item()\/len(x_test)*100)\n    #Accuracy! 68.39622641509435<\/pre>\n","protected":false},"excerpt":{"rendered":"<p>CNN(Convolutional Neural Networks)\uc740 \uc774\ubbf8\uc9c0 \ubd84\ub958\uc5d0 \ub192\uc740 \uc131\ub2a5\uc744 \ubc1c\ud718\ud558\ub294 \uc54c\uace0\ub9ac\uc998\uc774\ub098 \uc774 \uc678\uc5d0\ub3c4 \uc5ec\ub7ec \ubd84\uc57c\uc5d0\uc11c\ub3c4 \ud65c\uc6a9\ub418\uace0 \uc788\uc2b5\ub2c8\ub2e4. \uadf8\uc911\uc5d0 \ud558\ub098\uac00 \ud14d\uc2a4\ud2b8\ub97c \ubd84\ub958\ud558\ub294 \ubb38\uc81c\uc785\ub2c8\ub2e4. \ubcf8 \uc608\uc81c\ub294 \uc544\ub798\uc758 \ub17c\ubb38\uc744 \ucc38\uc870\ud558\uace0 \uc788\uc2b5\ub2c8\ub2e4. Convolutional Neural Networks for Sentence Classification We report on a series of experiments with convolutional neural networks (CNN) trained on top of pre-trained word vectors for sentence-level classification tasks. &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/blog.cedartrees.co.kr\/index.php\/2021\/02\/25\/cnn-text\/\" class=\"more-link\">\ub354 \ubcf4\uae30<span class=\"screen-reader-text\"> &#8220;CNN\uc744 \ud65c\uc6a9\ud55c \ud14d\uc2a4\ud2b8 \ubd84\ub958&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[41,14],"tags":[37,86,6,61,72,55,81],"_links":{"self":[{"href":"http:\/\/blog.cedartrees.co.kr\/index.php\/wp-json\/wp\/v2\/posts\/877"}],"collection":[{"href":"http:\/\/blog.cedartrees.co.kr\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/blog.cedartrees.co.kr\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/blog.cedartrees.co.kr\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/blog.cedartrees.co.kr\/index.php\/wp-json\/wp\/v2\/comments?post=877"}],"version-history":[{"count":4,"href":"http:\/\/blog.cedartrees.co.kr\/index.php\/wp-json\/wp\/v2\/posts\/877\/revisions"}],"predecessor-version":[{"id":884,"href":"http:\/\/blog.cedartrees.co.kr\/index.php\/wp-json\/wp\/v2\/posts\/877\/revisions\/884"}],"wp:attachment":[{"href":"http:\/\/blog.cedartrees.co.kr\/index.php\/wp-json\/wp\/v2\/media?parent=877"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/blog.cedartrees.co.kr\/index.php\/wp-json\/wp\/v2\/categories?post=877"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/blog.cedartrees.co.kr\/index.php\/wp-json\/wp\/v2\/tags?post=877"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}