±à¼ÍƼö: |
±¾ÎÄÀ´×ÔÓÚcsdn£¬Ö÷Òª½²½âÁ˶Ի°ÏµÍ³¼¼ÄÜ¡¢ÏÖ×´¡¢»úÆ÷ѧϰºÍÉî¶Èѧϰ¡¢¶Ô»°»úÆ÷È˵ĵȵȡ£
|
|
¶Ô»°ÏµÍ³£¨¶Ô»°»úÆ÷ÈË£©±¾ÖÊÉÏÊÇͨ¹ý»úÆ÷ѧϰºÍÈ˹¤ÖÇÄܵȼ¼ÊõÈûúÆ÷Àí½âÈ˵ÄÓïÑÔ¡£Ëü°üº¬ÁËÖî¶àѧ¿Æ·½·¨µÄÈÚºÏʹÓã¬ÊÇÈ˹¤ÖÇÄÜÁìÓòµÄÒ»¸ö¼¼Êõ¼¯ÖÐÑÝÁ·Óª¡£Í¼1¸ø³öÁ˶Ի°ÏµÍ³¿ª·¢ÖÐÉæ¼°µ½µÄÖ÷Òª¼¼Êõ¡£
¶Ô»°ÏµÍ³¼¼Äܽø½×֮·
ͼ1¸ø³öµÄÖî¶à¶Ô»°ÏµÍ³Ïà¹Ø¼¼Êõ£¬´ÓÄÄЩÇþµÀ¿ÉÒÔÁË½âµ½ÄØ£¿ÏÂÃæÖ𲽸ø³ö˵Ã÷¡£

ͼ1 ¶Ô»°ÏµÍ³¼¼ÄÜÊ÷
Êýѧ
¾ØÕó¼ÆËãÖ÷ÒªÑо¿µ¥¸ö¾ØÕó»ò¶à¸ö¾ØÕóÏ໥×÷ÓÃʱµÄһЩÐÔÖÊ¡£»úÆ÷ѧϰµÄ¸÷ÖÖÄ£ÐͶ¼´óÁ¿Éæ¼°¾ØÕóÏà¹ØÐÔÖÊ£¬±ÈÈçPCAÆäʵÊÇÔÚ¼ÆËãÌØÕ÷ÏòÁ¿£¬MFÆäʵÊÇÔÚÄ£ÄâSVD¼ÆËãÆæÒìÖµÏòÁ¿¡£È˹¤ÖÇÄÜÁìÓòµÄºÜ¶à¹¤¾ß¶¼ÊÇÒÔ¾ØÕóÓïÑÔÀ´±à³ÌµÄ£¬±ÈÈçÖ÷Á÷µÄÉî¶Èѧϰ¿ò¼Ü£¬ÈçTensorflow¡¢PyTorchµÈÎÞÒ»ÀýÍâ¡£¾ØÕó¼ÆËãÓкܶà½Ì¿ÆÊ飬ÕÒ±¾ÄѶÈÊʺÏ×Ô¼ºµÄ¿´¿´¼´¿É¡£Èç¹ûÏë½ÏÉîÈëÀí½â£¬Ç¿ÁÒÍÆ¼ö¡¶Linear
Algebra Done Right¡·Õâ±¾Êé¡£
¸ÅÂÊͳ¼ÆÊÇ»úÆ÷ѧϰµÄ»ù´¡¡£³£Óõö¸ÅÂÊͳ¼Æ¸ÅÄî£ºËæ»ú±äÁ¿¡¢ÀëÉ¢Ëæ»ú±äÁ¿¡¢Á¬ÐøËæ»ú±äÁ¿¡¢¸ÅÂÊÃܶÈ/·Ö²¼£¨¶þÏîʽ·Ö²¼¡¢¶àÏîʽ·Ö²¼¡¢¸ß˹·Ö²¼¡¢Ö¸Ö¸Êý×å·Ö²¼£©¡¢Ìõ¼þ¸ÅÂÊÃܶÈ/·Ö²¼¡¢ÏÈÑéÃܶÈ/·Ö²¼¡¢ºóÑéÃܶÈ/·Ö²¼¡¢×î´óËÆÈ»¹À¼Æ¡¢×î´óºóÑé¹À¼Æ¡£¼òµ¥Á˽âµÄ»°¿ÉÒÔÈ¥··¾µäµÄ»úÆ÷ѧϰ½Ì²Ä£¬±ÈÈç¡¶Pattern
Recognition and Machine Learning¡·µÄǰÁ½Õ£¬¡¶Machine Learning:
A Probabilistic Perspective¡·µÄǰÁ½Õ¡£ÏµÍ³Ñ§Ï°µÄ»°¿ÉÒÔÕÒ±¾´óѧÀï¸ÅÂÊͳ¼ÆÀïµÄ½Ì²Ä¡£
×îÓÅ»¯·½·¨±»¹ã·ºÓÃÓÚ»úÆ÷ѧϰģÐ͵ÄѵÁ·¡£»úÆ÷ѧϰÖг£¼ûµÄ¼¸¸ö×îÓÅ»¯¸ÅÄ͹/·Ç͹º¯Êý¡¢ÌݶÈϽµ¡¢Ëæ»úÌݶÈϽµ¡¢Ôʼ¶ÔżÎÊÌâ¡£Ò»°ã»úÆ÷ѧϰ½Ì²Ä»òÕ߿γ̶¼»á½²Ò»µã×îÓÅ»¯µÄ֪ʶ£¬±ÈÈçAndrew
Ng»úÆ÷ѧϰ¿Î³ÌÖÐZico Kolter½²µÄ¡¶Convex Optimization Overview¡·¡£µ±È»ÒªÏëϵͳÁ˽⣬×îºÃµÄ·½·¨¾ÍÊÇ¿´BoydµÄ¡¶Convex
Optimization¡·Ê飬ÒÔ¼°¶ÔÓ¦µÄPPT£¨https://web.stanford.edu/~boyd/cvxbook/£©ºÍ¿Î³Ì£¨https://see.stanford.edu/Course/EE364A£¬https://see.stanford.edu/Course/EE364B£©¡£Ï²»¶¿´´úÂëµÄͬѧҲ¿ÉÒÔ¿´¿´¿ªÔ´»úÆ÷ѧϰÏîÄ¿ÖÐÉæ¼°µ½µÄÓÅ»¯·½·¨£¬ÀýÈçLiblinear¡¢LibSVM¡¢Tensorflow¾ÍÊDz»´íµÄÑ¡Ôñ¡£
³£ÓõÄһЩÊýѧ¼ÆËãPython°ü£º
NumPy£ºÓÃÓÚÕÅÁ¿¼ÆËãµÄ¿ÆÑ§¼ÆËã°ü
SciPy£º×¨Îª¿ÆÑ§ºÍ¹¤³ÌÉè¼ÆµÄÊýѧ¼ÆË㹤¾ß°ü
Matplotlib£º»Í¼¡¢¿ÉÊÓ»¯°ü
»úÆ÷ѧϰºÍÉî¶Èѧϰ
Andrew NgµÄ¡°Machine Learning¡±¿Î³ÌÒÀ¾ÉÊÇ»úÆ÷ѧϰÁìÓòµÄÈëÃÅÉñÆ÷¡£²»ÒªÐ¡ÇÆËùνµÄÈëÃÅ£¬Õæ°ÑÕâÀïÃæµÄ֪ʶÀí½â͸£¬ÍêÈ«¿ÉÒÔȥӦƸËã·¨¹¤³ÌʦְλÁË¡£ÍƼö¼¸±¾¹«Èϵĺý̲ģºHastieµÈÈ˵ġ¶The
Elements of Statistical Learning¡·£¬BishopµÄ¡¶Pattern
Recognition and Machine Learning¡·£¬MurphyµÄ¡¶Machine
Learning: A Probabilistic Perspective¡·£¬ÒÔ¼°ÖÜÖ¾»ªµÄÎ÷¹ÏÊé¡¶»úÆ÷ѧϰ¡·¡£Éî¶Èѧϰ×ÊÁÏÍÆ¼öYoshua
BengioµÈÈ˵ġ¶Deep Learning¡·£¬ÒÔ¼°TensorflowµÄ¹Ù·½½Ì³Ì¡£
³£ÓõÄһЩ¹¤¾ß£º
scikit-learn£º°üº¬¸÷ÖÖ»úÆ÷ѧϰģÐ͵ÄPython°ü
Liblinear£º°üº¬ÏßÐÔÄ£Ð͵ĶàÖÖ¸ßЧѵÁ··½·¨
LibSVM£º°üº¬¸÷ÖÖSVMµÄ¶àÖÖ¸ßЧѵÁ··½·¨
Tensorflow£ºGoogleµÄÉî¶Èѧϰ¿ò¼Ü
PyTorch£ºFacebookµÄÉî¶Èѧϰ¿ò¼Ü
Keras: ¸ß²ãµÄÉî¶ÈѧϰʹÓÿò¼Ü
Caffe: ÀÏÅÆÉî¶Èѧϰ¿ò¼Ü
×ÔÈ»ÓïÑÔ´¦Àí
ºÜ¶à´óѧ¶¼ÓÐNLPÏà¹ØµÄÑо¿ÍŶӣ¬±ÈÈç˹̹¸£NLP×飬ÒÔ¼°¹úÄڵĹþ¹¤´óSCIRʵÑéÊҵȡ£ÕâЩÍŶӵĶ¯Ì¬ÖµµÃ¹Ø×¢¡£
NLPÏà¹ØµÄ×ÊÁÏÍøÉÏËæ´¦¿É¼û£¬¿Î³ÌÍÆ¼ö˹̹¸£µÄ¡°CS224n: Natural Language
Processing with Deep Learning¡±£¬ÊéÍÆ¼öManningµÄ¡¶Foundations
of Statistical Natural Language Processing¡·£¨ÖÐÎİæ½Ð¡¶Í³¼Æ×ÔÈ»ÓïÑÔ´¦Àí»ù´¡¡·£©¡£
ÐÅÏ¢¼ìË÷·½Ãæ£¬ÍÆ¼öManningµÄ¾µäÊé¡¶Introduction to Information
Retrieval¡·£¨Íõ±óÀÏʦ·ÒëµÄÖÐÎİ桶ÐÅÏ¢¼ìË÷µ¼ÂÛ¡·£©£¬ÒÔ¼°Ë¹Ì¹¸£¿Î³Ì¡°CS 276: Information
Retrieval and Web Search¡±¡£
³£ÓõÄһЩ¹¤¾ß£º
Jieba: ÖÐÎķִʺʹÊÐÔ±ê×¢Python°ü
CoreNLP: ˹̹¸£µÄNLP¹¤¾ß£¨Java£©
NLTK: ×ÔÈ»ÓïÑÔ¹¤¾ß°ü
TextGrocery£º¸ßЧµÄ¶ÌÎı¾·ÖÀ๤¾ß£¨×¢£ºÖ»ÊÊÓÃÓÚ Python2£©
LTP: ¹þ¹¤´óµÄÖÐÎÄ×ÔÈ»ÓïÑÔ´¦Àí¹¤¾ß
Gensim£ºÎı¾·ÖÎö¹¤¾ß£¬°üº¬Á˶àÖÖÖ÷ÌâÄ£ÐÍ
Word2vec: ¸ßЧµÄ´Ê±íʾѧϰ¹¤¾ß
GloVe£ºË¹Ì¹¸£µÄ´Ê±íʾѧϰ¹¤¾ß
Fasttext : ¸ßЧµÄ´Ê±íʾѧϰºÍ¾ä×Ó·ÖÀà¿â
FuzzyWuzzy: ¼ÆËãÎı¾Ö®¼äÏàËÆ¶ÈµÄ¹¤¾ß
CRF++: ÇáÁ¿¼¶Ìõ¼þËæ»ú³¡¿â£¨C++£©
Elasticsearch: ¿ªÔ´ËÑË÷ÒýÇæ
¶Ô»°»úÆ÷ÈË
¶Ô»°ÏµÍ³Õë¶ÔÓû§²»Í¬ÀàÐ͵ÄÎÊÌ⣬ÔÚ¼¼ÊõÉÏ»áʹÓò»Í¬µÄ¿ò¼Ü¡£ÏÂÃæ½éÉܼ¸ÖÖ²»Í¬ÀàÐ͵ĶԻ°»úÆ÷ÈË¡£
¶Ô»°»úÆ÷ÈË´´½¨Æ½Ì¨
Èç¹ûÄãÖ»ÊÇÏë°ÑÒ»¸ö¹¦Äܽϼòµ¥µÄ¶Ô»°»úÆ÷ÈË£¨Bot£©Ó¦ÓÃÓÚ×Ô¼ºµÄ²úÆ·£¬Bot´´½¨Æ½Ì¨ÊÇ×îºÃµÄÑ¡Ôñ¡£Bot´´½¨Æ½Ì¨°ïÖúûÓÐÈ˹¤ÖÇÄܼ¼Êõ»ýÀÛµÄÓû§ºÍÆóÒµ¿ìËÙ´´½¨¶Ô»°»úÆ÷ÈË£¬¹úÍâ±È½ÏµäÐ͵ÄBot´´½¨Æ½Ì¨ÓÐFacebookµÄWit.aiºÍGoogleµÄDialogflow£¨Ç°ÉíΪApi.ai£©£¬¹úÄÚÒ²Óв»ÉÙ´´ÒµÍŶÓÔÚ×öÕâ·½ÃæµÄÊ£¬±ÈÈçÒ»¸öAI¡¢ÖªÂé¡¢ÈçÒâµÈ¡£
¼ìË÷Ð͵¥ÂÖ¶Ô»°»úÆ÷ÈË
¼ìË÷Ð͵¥ÂÖ»úÆ÷ÈË£¨FQA-Bot£©Éæ¼°µ½µÄ¼¼ÊõºÍÐÅÏ¢¼ìË÷ÀàËÆ£¬Á÷³Ìͼ2Ëùʾ¡£

ͼ2 FAQ-BotÁ÷³Ìͼ
ÒòΪqueryºÍºòÑ¡´ð°¸°üº¬µÄ´Ê¶¼ºÜÉÙ£¬ËùÒÔ»áÀûÓÃͬÒå´ÊºÍ¸´ÊöµÈ¼¼Êõ¶ÔqueryºÍºòÑ¡´ð°¸½øÐÐÀ©Õ¹ºÍ¸Äд¡£´Ê±íʾ¹¤¾ßWord2vec¡¢GloVe¡¢FasttextµÈ¿ÉÒÔ»ñµÃÿ¸ö´ÊµÄÏòÁ¿±íʾ£¬È»ºóʹÓÃÕâЩ´ÊÏòÁ¿¼ÆËãÿ¶Ô´ÊÖ®¼äµÄÏàËÆÐÔ£¬»ñµÃͬÒå´ÊºòÑ¡¼¯¡£µ±È»Í¬Òå´ÊÒ²¿ÉÒÔͨ¹ýÒѾ´æÔڵĽṹ»¯ÖªÊ¶Ô´ÈçWordNet¡¢HowNetµÈ»ñµÃ¡£¸´Êö¿ÉÒÔʹÓÃһЩ°ë¼à¶½·½·¨ÈçDIRTÔÚµ¥ÓïÓïÁÏÉϽøÐй¹½¨£¬Ò²¿ÉÒÔʹÓÃË«ÓïÓïÁϽøÐй¹½¨¡£PPDBÍøÕ¾°üº¬Á˺ܶà´ÓË«ÓïÓïÁϹ¹½¨³öÀ´µÄ¸´ÊöÊý¾Ý¼¯¡£
֪ʶͼÆ×ÐÍ»úÆ÷ÈË
֪ʶͼÆ×ÐÍ»úÆ÷ÈË£¨KG-Bot£¬Ò²³ÆÎªÎÊ´ðϵͳ£©£¬ÀûÓÃ֪ʶͼÆ×½øÐÐÍÆÀí²¢»Ø´ðһЩÊÂʵÐÍÎÊÌ⡣֪ʶͼÆ×ͨ³£°Ñ֪ʶ±íʾ³ÉÈýÔª×顪¡ª
(Ö÷Óï¡¢¹ØÏµ¡¢±öÓï) £¬ÆäÖйØÏµ±íʾÖ÷ÓïºÍ±öÓïÖ®¼ä´æÔÚµÄijÖÖ¹ØÏµ¡£
¹¹½¨Í¨ÓõÄ֪ʶͼÆ×·Ç³£À§ÄÑ£¬²»½¨Òé´Ó0¿ªÊ¼¹¹½¨¡£ÎÒÃÇ¿ÉÒÔÖ±½ÓʹÓÃһЩ¹«¿ªµÄͨÓÃ֪ʶͼÆ×£¬ÈçYAGO¡¢DBpedia¡¢CN-DBpedia¡¢FreebaseµÈ¡£Ìض¨ÁìÓò֪ʶͼÆ×µÄ¹¹½¨¿É²Î¿¼¡°ÖªÊ¶Í¼Æ×¼¼ÊõÔÀí½éÉÜ¡±£¨
http://suanfazu.com/t/topic/13105£©£¬¡°×îȫ֪ʶͼÆ××ÛÊö#1: ¸ÅÄîÒÔ¼°¹¹½¨¼¼Êõ¡±£¨
https://mp.weixin.qq.com/s/aFjZ3mKcJGszHKtMcO2zFQ£©µÈÎÄÕ¡£ÖªÊ¶Í¼Æ×¿ÉÒÔʹÓÃͼÊý¾Ý¿â´æ´¢£¬ÈçNeo4j¡¢OrientDBµÈ¡£µ±È»Èç¹ûÊý¾ÝÁ¿Ð¡µÄ»°MySQL¡¢SQLiteÒ²ÊDz»´íµÄÑ¡Ôñ¡£
ΪÁ˰ÑÓû§queryÓ³É䵽֪ʶͼÆ×µÄÈýÔª×éÉÏ£¬Í¨³£»áʹÓõ½ÊµÌåÁ´½Ó£¨°ÑqueryÖеÄʵÌå¶ÔÓ¦µ½ÖªÊ¶Í¼Æ×ÖеÄʵÌ壩¡¢¹ØÏµ³éÈ¡£¨Ê¶±ðqueryÖаüº¬µÄ¹ØÏµ£©ºÍÖªÊ¶ÍÆÀí£¨query¿ÉÄܰüº¬¶à¸ö¶ø²»Êǵ¥¸ö¹ØÏµ£¬¶ÔӦ֪ʶͼÆ×ÖеÄÒ»Ìõ·¾¶£¬ÍÆÀí¾ÍÊÇÕÒ³öÕâÌõ·¾¶£©µÈ¼¼Êõ¡£
ÈÎÎñÐͶàÂÖ¶Ô»°»úÆ÷ÈË
ÈÎÎñÐͶàÂÖ»úÆ÷ÈË£¨Task-Bot£©Í¨¹ý¶à´ÎÓëÓû§¶Ô»°½»»¥À´¸¨ÖúÓû§Íê³ÉijÏîÃ÷È·¾ßÌåµÄÈÎÎñ£¬Á÷³Ìͼ¼ûͼ3¡£

ͼ3 Task-BotÁ÷³Ìͼ
³ýÁËÓëÓïÒô½»»¥µÄASRºÍTTS²¿·Ö£¬Ëü°üº¬ÒÔϼ¸¸öÁ÷³Ì£º
ÓïÑÔÀí½â£¨SLU£©£º°ÑÓû§ÊäÈëµÄ×ÔÈ»ÓïÑÔת±äΪ½á¹¹»¯ÐÅÏ¢¡ª¡ªact-slot-valueÈýÔª×é¡£ÀýÈç²ÍÌü¶©×ùÓ¦ÓÃÖÐÓû§Ëµ¡°¶©Ôƺ£ëÈÖйشåµê¡±£¬ÎÒÃÇͨ¹ýNLU°ÑËüת»¯Îª½á¹¹»¯ÐÅÏ¢£º¡°inform(order_op=Ô¤¶©,
restaurant_name=ÔÆº£ëÈ, subbranch=Öйشåµê)¡±£¬ÆäÖеġ°inform¡±ÊǶ¯×÷Ãû³Æ£¬¶øÀ¨ºÅÖеÄÊÇʶ±ð³öµÄ²Ûλ¼°Æäȡֵ¡£
NLU¿ÉÒÔʹÓÃÓïÒå½âÎö»òÓïÒå±ê×¢µÄ·½Ê½»ñµÃ£¬Ò²¿ÉÒÔ°ÑËü·Ö½âΪ¶à¸ö·ÖÀàÈÎÎñÀ´½â¾ö£¬µäÐÍ´ú±íÊÇSemantic
Tuple Classifier£¨STC£©Ä£ÐÍ¡£
¶Ô»°¹ÜÀí£¨DM£©£º×ÛºÏÓû§µ±Ç°queryºÍÀúÊ·¶Ô»°ÖÐÒÑ»ñµÃµÄÐÅÏ¢ºó£¬¸ø³ö»úÆ÷´ð¸´µÄ½á¹¹»¯±íʾ¡£¶Ô»°¹ÜÀí°üº¬Á½¸öÄ£¿é£º¶Ô»°×´Ì¬×·×Ù£¨DST£©ºÍ²ßÂÔÓÅ»¯£¨DPO£©¡£
DSTά»¤¶Ô»°×´Ì¬£¬ËüÒÀ¾Ý×îеÄϵͳºÍÓû§ÐÐΪ£¬°Ñ¾É¶Ô»°×´Ì¬¸üÐÂΪжԻ°×´Ì¬¡£ÆäÖжԻ°×´Ì¬Ó¦¸Ã°üº¬³ÖÐø¶Ô»°ËùÐèÒªµÄ¸÷ÖÖÐÅÏ¢¡£
DPO¸ù¾ÝDSTά»¤µÄ¶Ô»°×´Ì¬£¬È·¶¨µ±Ç°×´Ì¬Ï»úÆ÷ÈËÓ¦ÈçºÎ½øÐд𸴣¬Ò²¼´²ÉÈ¡ºÎÖÖ²ßÂÔ´ð¸´ÊÇ×îÓŵġ£ÕâÊǵäÐ͵ÄÔöǿѧϰÎÊÌ⣬ËùÒÔ¿ÉÒÔʹÓÃDQNµÈÉî¶ÈÔöǿѧϰģÐͽøÐн¨Ä£¡£ÏµÍ³¶¯×÷ºÍ²Ûλ½ÏÉÙʱҲ¿ÉÒÔ°Ñ´ËÎÊÌâÊÓΪ·ÖÀàÎÊÌâ¡£
×ÔÈ»ÓïÑÔ²úÉú£¨NLG£©£º°ÑDMÊä³öµÄ½á¹¹»¯¶Ô»°²ßÂÔ»¹Ô³É¶ÔÈËÓѺõÄ×ÔÈ»ÓïÑÔ¡£¼òµ¥µÄNLG·½·¨¿ÉÒÔÊÇÊÂÏÈÉ趨ºÃµÄ»Ø¸´Ä£°å£¬¸´ÔӵĿÉÒÔʹÓÃÉî¶ÈѧϰÉú³ÉÄ£ÐÍ£¬Èç¡°Semantically
Conditioned LSTM¡±Í¨¹ýÔÚLSTMÖмÓÈë¶Ô»°¶¯×÷cell¸¨Öú´ð¸´Éú³É¡£
ÈÎÎñÐͶԻ°»úÆ÷ÈË×îȨÍþµÄÑо¿ÕßÊǽ£ÇÅ´óѧµÄSteve Young½ÌÊÚ£¬Ç¿ÁÒÍÆ¼öËûµÄ½Ì³Ì¡°Statistical
Spoken Dialogue Systems¡±¡£ËûµÄÖî¶à²©Ê¿ÉúÕë¶ÔÉÏÃæ¸÷¸öÁ÷³Ì¶¼×öÁ˺ÜϸÖµÄÑо¿£¬ÏëÁ˽âϸ½ÚµÄ»°¿ÉÒԲο¼ËûÃǵIJ©Ê¿ÂÛÎÄ¡£Ïà¹Ø¿Î³Ì¿É²Î¿¼Milica
Ga?i?µÄ¡°Speech and Language Technology¡±¡£
³ýÁ˰ÑÕû¸öÎÊÌâ·Ö½â³ÉÉÏÃæ¼¸¸öÁ÷³Ì·Ö±ðÓÅ»¯£¬Ä¿Ç°ºÜ¶àѧÕßÒ²ÔÚ̽Ë÷ʹÓö˵½¶Ë¼¼ÊõÕûÌå½â¾öÕâ¸öÎÊÌ⣬´ú±í¹¤×÷ÓÐTsung-Hsien
WenµÈÈ˵ġ°A Network-based End-to-End Trainable Task-Oriented
Dialogue System¡±ºÍXiujun LiµÈÈ˵ġ°End-to-End Task-Completion
Neural Dialogue Systems¡±¡£ºóһƪµÄ¿ªÔ´´úÂëhttps://github.com/MiuLab/TC-Bot£¬·Ç³£ÖµµÃѧϰ¡£
ÏÐÁÄÐÍ»úÆ÷ÈË
ÕæÊµÓ¦ÓÃÖУ¬Óû§Óëϵͳ½»»¥µÄ¹ý³ÌÖв»Ãâ»áÉæ¼°µ½ÏÐÁijɷ֡£ÏÐÁŦÄÜ¿ÉÒÔÈöԻ°»úÆ÷È˸üÓÐÇé¸ÐºÍζȡ£ÏÐÁÄ»úÆ÷ÈË£¨Chitchat-Bot£©Í¨³£Ê¹ÓûúÆ÷·ÒëÖеÄÉî¶Èѧϰseq2seq¿ò¼ÜÀ´²úÉú´ð¸´£¬Èçͼ4¡£

ͼ4 Chitchat-BotµÄseq2seqÄ£ÐÍ¿ò¼Ü
Óë»úÆ÷·Ò벻ͬµÄÊÇ£¬¶Ô»°ÖÐÓû§±¾´ÎqueryÌṩµÄÐÅϢͨ³£²»×ãÒÔ²úÉúºÏÀíµÄ´ð¸´£¬¶Ô»°µÄÀúÊ·±³¾°ÐÅϢͬÑùºÜÖØÒª¡£ÀýÈçͼ4ÖеÄquery£º¡°½ñÌìÐÄÇ鼫¶È²»ºÃ£¡¡±£¬Óû§¿ÉÄÜÊÇÒòΪǰ¼¸Ìì³öÓÎÀÛµÄÑüËᱳʹ²ÅÐÄÇé²»ºÃµÄ£¬Õâʱ´ð¸´¡°³öÈ¥ÍæÍæ°É¡±¾Í²»ºÏÇéÀí¡£Ñо¿·¢ÏÖ£¬±ê×¼µÄseq2seq+attentionÄ£ÐÍ»¹ÈÝÒײúÉú°²È«¶øÎÞÓõĴ𸴣¬Èç¡°ÎÒ²»ÖªµÀ¡±£¬¡°ºÃµÄ¡±¡£
ΪÁËÈòúÉúµÄ´ð¸´¸ü¶àÑù»¯¡¢¸üÓÐÐÅÏ¢Á¿£¬ºÜ¶àѧÕß×öÁËÖî¶à̽Ë÷¡£Jiwei LiµÈÈ˵ÄÂÛÎÄ¡°Deep
Reinforcement Learning for Dialogue Generation¡±¾Í½¨ÒéÔÚѵÁ·Ê±¿¼ÂÇÈôð¸´ÒýÈëÐÂÐÅÏ¢£¬±£Ö¤ÓïÒåÁ¬¹áÐÔµÈÒòËØ¡£Iulian
V. SerbanµÈÈ˵ÄÂÛÎÄ¡°Building End-To-End Dialogue Systems
Using Generative Hierarchical Neural Network Models¡±ÔÚ²úÉú´ð¸´Ê±²»Ö»Ê¹ÓÃÓû§µ±Ç°queryµÄÐÅÏ¢£¬»¹ÀûÓò㼶RNN°Ñ֮ǰ¶Ô»°µÄ±³¾°ÐÅÏ¢Ò²¼ÓÈë½øÀ´¡£Jun
YinµÈÈ˵ÄÂÛÎÄ¡°Neural Generative Question Answering¡±ÔÚ²úÉú´ð¸´Ê±ÈÚºÏÍⲿµÄ֪ʶ¿âÐÅÏ¢¡£
ÉÏÃæµÄ¸÷ÖÖ»úÆ÷È˶¼ÊÇΪ½â¾öijÀàÌØ¶¨ÎÊÌâ¶ø±»Ìá³öµÄ£¬ÎÒÃÇÇ°ÃæÒ²·Ö¿ª½éÉÜÁ˸÷¸ö»úÆ÷È˵ÄÖ÷Òª×é¼þ¡£µ«ÕâÆäÖеIJ»ÉÙ×é¼þÔÚ¶àÖÖ»úÆ÷ÈËÀï¶¼ÊÇ´æÔڵġ£ÀýÈç֪ʶͼÆ×ÔÚ¼ìË÷ÐÍ¡¢ÈÎÎñÐͺÍÏÐÁÄÐÍ»úÆ÷ÈËÀïÒ²¶¼»á±»Ê¹Óá£
ÕæÊµÓ¦ÓÃÖÐͨ³£»á°üº¬¶à¸ö²»Í¬ÀàÐ͵ĻúÆ÷ÈË£¬ËüÃÇÐͬºÏ×÷£¬½â´ðÓû§²»Í¬ÀàÐ͵ÄÎÊÌâ¡£ÎÒÃǰÑе÷²»Í¬»úÆ÷È˹¤×÷µÄ»úÆ÷È˳ÆÖ®ÎªÂ·ÓÉ»úÆ÷ÈË£¨Route-Bot£©¡£Â·ÓÉ»úÆ÷È˸ù¾ÝÀúÊ·±³¾°ºÍµ±Ç°query£¬¾ö¶¨°ÑÎÊÌâ·¢Ë͸øÄÄЩ»úÆ÷ÈË£¬ÒÔ¼°×îÖÕʹÓÃÄÄЩ»úÆ÷È˵Ĵð¸´×÷ΪÌṩ¸øÓû§µÄ×îÖմ𸴡£Í¼5Ϊ¿ò¼Üͼ¡£

ͼ5 Route-Bot¿ò¼Üͼ
¶Ô»°»úÆ÷ÈËÏÖ×´
¶Ô»°»úÆ÷ÈËÀúÊ·ÓÆ¾Ã£¬´Ó1966ÄêMITµÄ¾«ÉñÖÎÁÆÊ¦»úÆ÷ÈËELIZAµ½ÏÖÔÚÒÑÓаë¸öÊÀ¼Í¡£µ«ÏÖ´úÒâÒåµÄ»úÆ÷ÈËÆäʵ»¹ºÜÄêÇá¡£¼ìË÷Ð͵¥ÂÖ¶Ô»°»úÆ÷È˵ÃÒæÓÚËÑË÷ÒýÇæµÄÉÌÒµ³É¹¦ºÍÐÅÏ¢¼ìË÷µÄ¿ìËÙ·¢Õ¹£¬Ä¿Ç°¼¼ÊõÉÏÒѾ±È½Ï³ÉÊì¡£×î½üѧÊõ½çºÍ¹¤Òµ½çÒ²»ý¼«Ì½Ë÷Éî¶Èѧϰ¼¼ÊõÈçWord2vec¡¢CNNºÍRNNµÈÔÚ¼ìË÷ÐÍ»úÆ÷ÈËÖеÄʹÓ㬽øÒ»²½ÌáÉýÁËϵͳ¾«¶È¡£ËäÈ»¼¼ÊõÉϽÏΪ³ÉÊ죬µ«ÔÚʵ¼ÊÓ¦ÓÃÖмìË÷ÐÍ»úÆ÷ÈË»¹´æÔÚ²»ÉÙÆäËûÎÊÌâ¡£ÀýÈ磬ºÜ¶àÆóÒµÀúÊ·ÉÏ»ýÀÛÁË´óÁ¿·Ç½á¹¹»¯Êý¾Ý£¬µ«ÕâЩÊý¾Ý²¢²»ÄÜÖ±½ÓÊä½ø¼ìË÷ÐÍ»úÆ÷ÈË£¬¶øÊÇÐèÒªÊÂÏÈͨ¹ýÈ˹¤ÕûÀí¡£¼´±ãÓÐЩÆóÒµ´æÔÚһЩ»Ø´ð¶ÔµÄÊý¾Ý¿ÉÒÔÖ±½ÓÊäÈë¼ìË÷ÐÍ»úÆ÷ÈË£¬µ«ÊýÁ¿ÍùÍùÖ»Óм¸Ê®µ½¼¸°ÙÌõ£¬·Ç³£ÉÙ¡£¿ÉÓÃÊý¾ÝµÄÖÊÁ¿ºÍÊýÁ¿ÏÞÖÆÁ˼ìË÷ÐÍ»úÆ÷È˵ľ«¶ÈºÍÔÚ¹¤Òµ½çµÄ¹ã·ºÊ¹Óá£
Ïà½ÏÓÚ¼ìË÷ÐÍ»úÆ÷ÈË£¬ÖªÊ¶Í¼Æ×ÐÍ»úÆ÷È˸ü¼ÓÄêÇá¡£´ó¶àÊý֪ʶͼÆ×ÐÍ»úÆ÷ÈË»¹Ö»Äܻشð¼òµ¥ÍÆÀíµÄÊÂʵÀàÎÊÌâ¡£ÕâÆäÖеÄÒ»¸öÔÒòÊǹ¹½¨×¼È·¶È¸ßÇÒ¸²¸ÇÃæ¹ãµÄ֪ʶͼÆ×¼«ÆäÀ§ÄÑ£¬ÐèҪͶÈë´óÁ¿µÄÈËÁ¦´¦ÀíÊý¾Ý¡£Éî¶ÈѧϰģÐÍÈçMemory
NetworksµÈµÄÒýÈë¿ÉÒÔÈÆ¹ý»ò½â¾öÕâ¸öÄѹØÂð£¿
ÈÎÎñÐͶàÂÖ¶Ô»°»úÆ÷ÈËÖ»ÓÐÊ®À´ÄêµÄ·¢Õ¹ÀúÊ·£¬Ä¿Ç°ÒÑÄܽϺõؽâ¾öÈ·¶¨ÐԸߵĶàÂÖÈÎÎñ¡£µ«µ±Ç°ÈÎÎñÐÍ»úÆ÷ÈËÄÜÕý³£¹¤×÷µÄ³¡¾°ÍùÍù¹ýÓÚÀíÏ뻯£¬Óû§ËµµÄ»°´ó²¿·ÖÇéÐÎ϶¼ÎÞ·¨¾«È·±í´ï³Éact-slot-valueÈýÔª×飬ËùÒÔÔÚÕâ¸ö»ù´¡ÉϹ¹½¨µÄºóÐøÁ÷³Ì¾Í±äµÃºÜ´àÈõ¡£ºÜ¶àѧÕßÌá³öÁ˸÷Öֶ˵½¶ËµÄÑо¿·½°¸£¬ÊÔͼÌáÉýÈÎÎñÐÍ»úÆ÷È˵ÄʹÓó°ôÐÔ¡£µ«ÕâЩ·½°¸»ù±¾¶¼ÐèÒªÀûÓú£Á¿µÄÀúÊ·¶Ô»°Êý¾Ý½øÐÐѵÁ·£¬¶øÇÒЧ¹ûÒ²²¢Î´ÔÚÕæÊµ¸´ÔÓ³¡¾°Öеõ½¹ýÑéÖ¤¡£
¿ªÓòÏÐÁÄÐÍ»úÆ÷ÈËÊÇĿǰѧÊõ½çµÄ³è¶ù£¬¿ÉÄÜÊÇÒòΪ¿É¸Ä½øµÄµØ·½ÊµÔÚÌ«¶à°É¡£´¿´âµÄÉú³ÉʽģÐÍÔڴ𸴸ñʽ±È½ÏÈ·¶¨µÄÓ¦ÓÃÖÐЧ¹ûÒѾ²»´í£¬¿ÉÒÔÓ¦ÓÃÓÚÉú²ú»·¾³£»µ«Ôڴ𸴸ñʽ·Ç³£Áé»îµÄÇé¿öÏ£¬ËüÉú³ÉµÄ´ð¸´Á¬Í¨Ë³ÐÔ¶¼Î´±ØÄܱ£Ö¤£¬¸ü²»ÓÃ˵½á¹ûµÄºÏÀíÐÔ¡£Éú³ÉÄ£Ð͵ÄÁíÒ»¸öÎÊÌâÊÇËüµÄÉú³É½á¹û¿É¿ØÐԽϵͣ¬Ð§¹ûÓÅ»¯Ò²²¢²»ÈÝÒס£µ«Õâ·½ÃæµÄѧÊõ½øÕ¹·Ç³£¿ìËÙ£¬ºÜ¶àѧÕßÒѾÔÚ̽Ë÷Éî¶ÈÔöǿѧϰ¡¢GANµÈÐÂËã·¨¿ò¼ÜÔÚÆäÉϵÄʹÓÃЧ¹û¡£
ËäȻĿǰ¶Ô»°»úÆ÷ÈËÄܽâ¾öµÄÎÊÌâ·Ç³£ÓÐÏÞ£¬¶ÌÆÚÄÚ²»¿ÉÄÜÌæ´úÈËÍê³É½Ï¸´ÔӵŤ×÷¡£µ«Õâ²¢²»Òâζ×ÅÎÒÃÇÎÞ·¨ÔÚÉú³É»·¾³ÖÐʹÓöԻ°»úÆ÷ÈË¡£Ñ°ÕÒµ½ÊÊÒ˵ÄʹÓó¡¾°£¬¶Ô»°»úÆ÷ÈËÈÔÄÜ´ó·ùÌáÉýÉÌҵЧÂÊ¡£½ØÖ¹µ½Ä¿Ç°£¬°®Òò»¥¶¯ÒѾ³É¹¦°Ñ¶Ô»°»úÆ÷ÈËÓ¦ÓÃÓÚÖÇÄÜͶ¹Ë¡¢±£ÏÕ¡¢Àí²ÆµÈÏúÊÛת»¯³¡¾°£¬Ò²ÔÚµçÉ̲úÆ·µÄ¶Ô»°Ê½·¢ÏÖºÍÍÆ¼öÖÐÑéÖ¤Á˶Ի°»úÆ÷È˵Ä×÷Óá£
Èç¹ûÒ»¸ö¶Ô»°»úÆ÷ÈËÓëÕæÈËÄÜ˳Àû¹µÍ¨ÇÒ²»±»ÕæÈË·¢ÏÖ×Ô¼ºÊÇ»úÆ÷ÈË£¬ÄÇô¾Í˵Õâ¸ö»úÆ÷ÈËͨ¹ýÁËͼÁé²âÊÔ¡£µ±È»Ä¿Ç°µÄ¶Ô»°»úÆ÷È˼¼ÊõÀëÕâ¸öÄ¿±ê»¹ºÜÔ¶£¬µ«ÎÒÃÇÕýÔÚÖð½¥½Ó½üÕâ¸öÄ¿±ê¡£Ëæ×ÅÓïÒôʶ±ð£¬NLPµÈ¼¼ÊõµÄ²»¶Ï·¢Õ¹£¬Ëæ×ÅÍòÎﻥÁªÊ±´úµÄµ½À´£¬¶Ô»°»úÆ÷È˵ÄÎę̀½«»áÔ½À´Ô½´ó¡£ |