
Generative AI for Everyoneãããå€ã®NLPãšã³ãžãã¢ã®å¿ã«åºãã£ãããš8éž
ããã«ã¡ã¯ãIVRyã§AIãšã³ãžãã¢ããã£ãŠããã¹ããããã§ããä»åã¯ã¿ã€ãã«ã®éããAndrew Ngã®Generative AI for EveryoneãèŠãŠèªåã®å¿ã«åºãã£ãããšããããŠãããã«ã€ããŠã®å人çãªã³ã¡ã³ããæžããŠããããšæããŸãã
æ¬èšäºã¯IVRy Advent Calendar 2023ã®çœçµã®9æ¥ç®ã®èšäºã§ãã8æ¥ç®ã¯ç¥å±±ããã®ãAIãããã¯ãçèª!!PMFã«åãããããã¯ããããŒãžã£ãŒã®åãçµã¿ãã10æ¥ç®ã¯å®®åµãããã¿ã¹ã¯ãããžã¡ã³ãã«ã€ããŠæžããŸãã
Generative AI for Everyoneã«ã€ããŠ
ãã¡ãã®è¬çŸ©ã¯æ©æ¢°åŠç¿ãAIæè²ã«ã€ããŠã®ç¬¬äžäººè ãšèšã£ãŠãéèšã§ã¯ãªããAndrew Ngå çã®LLMã®å¿çšã«ã€ããŠã®è¬çŸ©ã«ãªããŸãã
ã¿ã€ãã«ã«ã¯Generative AIãšãããŸãããç»åçæAIãªã©ã¯ã»ãŒã»ãŒç»å Žãããåºæ¬çã«ã¯LLMãã©ã䜿ãã®ãã«ã€ããŠã®è¬çŸ©ãšãªã£ãŠããŸãããŸããEveryoneãšããããã«æ©æ¢°åŠç¿ã®å°éå®¶ããšã³ãžãã¢ä»¥å€ã§ãåããå 容ã«ãªã£ãŠããããšæããŸããAndrew Ngã¯èšèªåãéåžžã«äžæãã®ã§ãæ©æ¢°åŠç¿ã®å°éå®¶ãèŠãŠãç¥èãæŽçããäžã§æçšãªããããªãããšæããŸãã
å€ã®NLPãšã³ãžãã¢ïŒ
èªåãNLPãå§ããã®ã¯2013ïœ2014幎ãããã®ã¡ããã©æ·±å±€åŠç¿ãNLPæ¥çã«æ¬æ Œçã«å ¥ã£ãŠããææã§ãã10幎çšåºŠã§å€ã®NLPãšã³ãžãã¢ãåä¹ã£ãŠè¯ãã®ãã¯è«žèª¬ãããšæãã®ã§ããããã®èŸºã¯æž©ããç®ã§èŠãŠããã ãããšå¹žãã§ãã
å¿ã«åºãã£ãããš8éž
ãšããããã§ããã¡ããå¿ã«åºãã£ãããš8éžã§ãããçè ã³ã¡ã³ããã®éšåã«ããããã®é ç®ã«ã€ããŠèªåãæã£ãããšãè£è¶³äºé ãèšèŒããŠããŸãã
LLMã®ãŠãŒã¹ã±ãŒã¹ã®åé¡
LLMã®ãŠãŒã¹ã±ãŒã¹ã¯
 - ã©ã€ãã£ã³ã°ïŒã¢ã€ãã¢ã®çæãã¡ãŒã«ãªã©ã®ãã©ããã翻蚳ãªã©
 - èªè§£ïŒæç« ã®æ ¡æ£ãèŠçŽãææžåé¡ãæ å ±æœåºãªã©
 - ãã£ããïŒãã£ããããã
ã®3çš®é¡ã«åé¡ã§ããããŸããããšã¯å¥ã«ã
 - Web UIäžã§ã®ãŠãŒã¹ã±ãŒã¹ïŒChatGPTãBing ChatãBardãªã©ã䜿çš
 - ãœãããŠã§ã¢ã«çµã¿èŸŒããŠãŒã¹ã±ãŒã¹ïŒChatGPT APIãªã©ã䜿çš
ãšããåãå£ãããã
ïŒçè
ã³ã¡ã³ãïŒ
LLMã¯ãçæAIããšããŠãã©ã€ãã£ã³ã°ãã®åŽé¢ã匷調ãããã¡ã§ããããèªè§£ãã«äœ¿ãããšããããšã¯èŠããŠãããŠã»ããã§ãããèªåãLLMã䜿ã£ãŠå®ãµãŒãã¹ãäœãéã«ã¯ã»ãŒã»ãŒLLMãèªè§£ã«äœ¿ã£ãŠããŸãã
å人çã«ã¯ã©ã€ãã£ã³ã°ãšèªè§£ããããã®ãŠãŒã¹ã±ãŒã¹ã以äžã®ãããªæãã§æããŠããŸãã
ã©ã€ãã£ã³ã°ïŒç¿»èš³ãªã©ã®LLMãããªã粟床é«ãã§ããå¿çšãé€ããŠã¯åºæ¬çã«ã¯recalléèŠã人ã確èªããããšãåæãšãªãã®ã§precisionã¯ãããŸã§å¿ èŠãšããªãã
èªè§£ïŒãã¡ãã¯åºæ¬çã«ã¯LLMãããªãé«ã粟床ã§åºæ¥ãã®ã§ã人ã®ç¢ºèªã¯æå°éã§ã䜿ããããšãå€ããåŸã»ã©åºãŠããautomationãç®æãå Žåã¯ç²ŸåºŠãå¹ããŠããã®ã§ããã¡ãã®æ¹ã䜿ããããã
å®ç§ãªããã³ãããåŠã¶ãããããè¯ãããã³ããã«éçºããããã®ããã»ã¹ãåŠã¶
å šãŠã®äººããŠãŒã¹ã±ãŒã¹ã«ãšã£ãŠå®ç§ãªããã³ããã¯ååšããªãã®ã§ãè¯ãããã³ãããéçºããããã®ããã»ã¹ãåŠã¶ã®ãè¯ããè¯ãããã³ãããéçºããããã®äžã€ã®æ¹æ³ãšããŠæããããŠããã®ãã
 - æç¢ºãã€è©³çްãªããã³ãããæžã
   - LLMãã¿ã¹ã¯ãéè¡ããããã«ååãªã³ã³ãã¯ã¹ããäžãã
   - ã¿ã¹ã¯ã®è©³çްãäžãã
 - çµæãè©äŸ¡ããäœæ LLMãæãã éãã®åºåãããªãããèãã
 - ããã³ãããæ¹åãã
ãšããããã»ã¹ãäœåºŠãè¡ããšããããšã
ïŒçè
ã³ã¡ã³ãïŒ
Andrew Ngã¯æ©æ¢°åŠç¿ç³»ã®ãªã³ã©ã€ã³è¬åº§ã§ã䌌ããããªããšãèšã£ãŠãããæåã®ãããã¿ã€ãã¯æå°ã®åŽåã§äœããããããæ¹åã®ã€ãã¬ãŒã·ã§ã³ãç¹°ãè¿ããšããããšãèšã£ãŠããŸãã
ããšããäœæ LLMãæãã éãã®åºåãããªãããèãããéšåã«ã€ããŠã¯èªåã§èããã«LLMã«æããŠããã£ãŠãè¯ããšæã£ãŠããŠããã®ç¹ã«ã€ããŠéå»ã«æžããããã°èšäºãããã®ã§æ°ã«ãªãæ¹ã¯èªãã§ã¿ãŠãã ããã
LLMã®ã³ã¹ãã¯ïŒäººéãšæ¯ã¹ããšïŒéåžžã«å®ã
æ®éã®å€§äººã®èªè§£é床ã¯1å250èªçšåºŠãããã1æéç¶ãããš15000èªçšåºŠã«ãªããGPT-3.5-turboã«15000èªèªãŸããŠ15000èªåºåãããã³ã¹ãã¯8ã»ã³ãïŒ12åïŒçšåºŠãªã®ã§ãïŒããGPT-3.5-turboã人éãšåãããšãã§ããã®ã§ããã°ïŒäººéãšæ¯ã¹ãŠéåžžã«äœã³ã¹ãã«ãªãã
ïŒçè
ã³ã¡ã³ãïŒ
æ¬è¬çŸ©å
ã§ã¯ChatGPTãªã©ã®closedã¢ãã«ã®APIã«ã€ããŠããåäŒæ¥ãå®ãæšè«ããããã«ãããããªåªåãããŠããã®ã§ãæ¯èŒçå®äŸ¡ã§ããããšãè¿°ã¹ãããŠããŸãã
Closedã¢ãã«ã¯ãããªã«é«ããªãããéçšã«é¢ããæ§ã ãªããã©ãããããšããµãŒãã¹æäŸè ã«ã»ãšãã©äžžæãã§ããã®ã§ãåæã¯ãšããããclosedã¢ãã«äœ¿ãã®ãããããããªãããšæã£ãŠããŸãã
OSSã¢ãã«ã®éžã³æ¹
倧éæã«ã¯ãã©ã¡ãŒã¿ãŒæ°ã«ãã£ãŠã§ããããšãå€§äœæ±ºãŸãã
 - 10åãã©ã¡ãŒã¿ãŒïŒãã¿ãŒã³èªèãã§ãããäžçã«ã€ããŠã®åºç€çãªç¥èãæã£ãŠãããè§£ããåé¡ã®äŸãšããŠã¯ã¬ã¹ãã©ã³ã®ã¬ãã¥ãŒã®ææ åæãªã©
 - 100åãã©ã¡ãŒã¿ãŒïŒããå€ãã®ç¥èãæã¡ãåºç€çãªæç€ºã«åŸãããšãã§ãããè§£ããåé¡ã®äŸãšããŠã¯é£ã¹ç©ã泚æãããã£ããããããªã©
 - 1000å+ãã©ã¡ãŒã¿ãŒïŒåºç¯ãªç¥èãæã¡ãè€éãªæšè«ãã§ãããè§£ããåé¡ã®äŸãšããŠã¯ãã¬ã¹ãã®ããŒãããŒãªã©
ïŒçè
ã³ã¡ã³ãïŒ
æè¡ã®é²æ©ãšå
±ã«åãæ§èœã®ã¢ãã«ã¯ã©ãã©ãå°ãããªã£ãŠããã®ã§ããã®èŸºãã®ãåžžèããæéãšå
±ã«å€åããŠããŸãã2023幎12æçŸåšã§ãã7Bãããã§ãããªãã«è€éãªæšè«ãã§ããã¢ãã«ã¯ããã¯ããªã®ã§ãç¥èãéœåºŠã¢ããããŒãããŠããããã§ããã
æ¥æ¬èªæ§èœã®ãªãŒããŒããŒããšããŠã¯Nejumi LLMãªãŒããŒããŒããªã©ãæåã§ãæ¥æ¬èªã®ãã³ãããŒã¯ããŒã¿ã»ããã§ããJGLUEã§ã®ã¹ã³ã¢ã§ã©ã³ã¯ä»ããããŠããŸããJGLUEã«ããè©äŸ¡ã¯ãªãŒã¯ããŠãããããªãããšãããããåé¡ã¯ããã®ã§ããããããªãã«åèã«ã¯ãªãããããªãããšæããŸãã
Augmentation vs Automation
AIã®åœ¹å²ã¯å€§ãã以äžã®äºã€ã«åé¡ã§ããã
 - AugmentationïŒå¢åŒ·ïŒ: 人éãã¿ã¹ã¯ãéè¡ããæå©ãããããã³ãŒãã£ã³ã°è£å©ãã©ã€ãã£ã³ã°ã¢ã·ã¹ã¿ã³ããªã©ã
 - AutomationïŒèªååïŒ: 人éã®ä»£ããã«ã¿ã¹ã¯ãéè¡ãããïŒã¿ã¹ã¯æååã®ïŒãã£ããããããªã©ã
åãã¿ã¹ã¯ã«å¯ŸããŠãaugmentationãããautomationã®æ¹ãã§ããæã®ã€ã³ãã¯ãã倧ããäžæ¹ã§é£ããã®ã§ããŸãã¯augmentationããå§ããŠåŸã ã«automationã«ç§»è¡ããŠãããšãããã¶ã€ã³ãã¿ãŒã³ãããã
ïŒçè
ã³ã¡ã³ãïŒ
Automationã®æ¹ãé£ããããã©ãã€ã³ãã¯ãã倧ãããšããç¹ã§ãèªåã¯augmentationãããïŒæçµçã«ã¯ïŒïŒã¿ã¹ã¯ã®å€§éšåã®ïŒautomationãæãéããããšã«ãã ãã£ãŠããããã§ãã
LLMãããã³ããã ãã§ã¿ã¹ã¯ãéè¡ã§ãããã©ããã®å€ææ³
AIãLLMãã¿ã¹ã¯ãéè¡ã§ãããåŠãã®å€å®æ¹æ³ãšããŠã¯ã
ã倧åŠã®æ°åãããã³ããã«åŸã£ãŠã¿ã¹ã¯ãéè¡ã§ãããïŒã
ãèããŠã¿ãŠãã§ãããã ã£ãã倧æµAIãLLMãã§ãããšèããŠè¯ããšã®ããšã
äŸãã°ãã¡ãŒã«ãèªãã§ãããã¯ã¬ãŒã ã§ãããåŠããããã¯å€æã§ããããæ°ããCOOã®å°±ä»»ã®ãã¬ã¹ãªãªãŒã¹ãæžããšèšãããŠãããã®COOãäŒç€Ÿã®æ å ±ãç¡ããšè©³çްã®ãã¬ã¹ãªãªãŒã¹ã¯æžããªãïŒãã®ãããªå Žåãããã³ããã«COOãäŒç€Ÿã®æ å ±ãå ¥ããå¿ èŠãããïŒ
ïŒçè
ã³ã¡ã³ãïŒ
äžèšã®è©±ã®åŸã«Andrew Ngãèšã£ãŠããŸãããChatGPTã¯Web UIã§ç°¡åã«è©Šããã®ã§ããšããããããã³ããæžããŠã¿ãŠChatGPTããã®ã¿ã¹ã¯ãéè¡ã§ããã®ããå®éã«ç¢ºèªããŠã¿ãã®ãè¯ããšæããŸãã
LLMãµãŒãã¹ãäœãããã®ããŒã
äžè¬çã«ã¯ä»¥äžã®3ã€ã®è·çš®ãå¿ èŠã«ãªãã
 - ãœãããŠã§ã¢ãšã³ãžãã¢
   - ã§ããã°LLMãããã³ãããšã³ãžãã¢ãªã³ã°ã®åºç€ãç¥ã£ãŠããã®ãæãŸãã
 - æ©æ¢°åŠç¿ãšã³ãžãã¢
   - ããã³ãããšã³ãžãã¢ãªã³ã°ãRAGããã¡ã€ã³ãã¥ãŒãã³ã°ãªã©ãã§ããããšãæãŸãã
 - ãããã¯ããããŒãžã£ãŒ
   - äœãäœæ äœããã«ã€ããŠè²¬ä»»ãæã€
LLMã«ãã£ãŠAIãµãŒãã¹äœæã®åå ¥éå£ã¯äžãã£ãã®ã§ãäžäººãäºäººã®ããŒã ã§ãPoCãå§ããããããã«ãªã£ãã
ïŒçè
ã³ã¡ã³ãïŒ
äœããäœãã ããªããšã³ãžãã¢ã ãã§ãã§ããã®ã ããã©ããããã䜿ãããªãããšã«ã¯æå³ãç¡ãã®ã§ãã䜿ãããããšãã«å¯ŸããŠ
ãããã¯ããããŒãžã£ãŒ
ã䜿ãããããšãã«å¯Ÿããæèãé«ããšã³ãžãã¢
ã®ã©ã¡ããã責任ãæããªããšãããªãæ°ãããŠããŸãã
LLMã«ãã£ãŠåœ±é¿ãåããå¯èœæ§ãé«ãè·çš®
ãã¡ãã¯ãããã³ãŒãŒã®ã¬ããŒãããåŒçšãäžçªåœ±é¿ãåããããªã®ãæè²ç³»ã®è·çš®ã§ã次ãã§æ³åŸãããžãã¹ç³»è·çš®ãšSTEMç³»ïŒç§åŠãæè¡ç³»è·çš®ãç ç©¶è ããšã³ãžãã¢ãããã«å«ãŸããïŒã
äžèšã®è·çš®ã«å ±éããŠèšããã®ããç¥èåŽåè ãã§ãããšããããšããããã®è·ã¯ãããŸã§ã®AIã«ã¯ããŸã圱é¿ãåããŠããªãã£ãããLLMã®å°é ã«ãã圱é¿ãåããããã«ãªã£ãè·çš®ãéã«èäœåŽåè ã¯ãããªã«åœ±é¿ãåããªãã®ã§ã¯ãªãããšã®äºæ³ã
ïŒçè
ã³ã¡ã³ãïŒ
äžçªåœ±é¿ãåããããªã®ãæè²ç³»ãšããã®ã¯äœãšãªãèªåãããæã£ãŠããŠãããå¹çã®è¯ãæè²ã®ããã«AIã¯ãã«æŽ»çšãããã¹ãã ãšæã£ãŠããŸãã
æåŸã«
以äžãèªåãGenerative AI for EveryoneãèŠãŠå¿ã«æ®ã£ãããš8éžã§ããããããã¯ãããŸã§èªåã®å¿ã«æ®ã£ãããšã§ãããã以å€ã«ãè¬çŸ©ã®äžã§å€§äºãªæ å ±ã¯ãããããããšæãã®ã§ãLLMã«ã€ããŠåŠã³ããçããã¯ãã®èšäºãèªãã§æºè¶³ãããå®éã«ã³ãŒã¹ãåè¬ããŠã¿ãã®ãããããããªãããšæããŸãã
IVRyã§ã¯AIãšã³ãžãã¢ãçµ¶è³åéäžã§ãã
ä»åã¯LLMã®åºç€ç¥èã«ã€ããŠæžããããã§ãããIVRyã§ã¯è€æ°ã®LLMãããžã§ã¯ããèµ°ã£ãŠãããLLMããããåããšããæå³ã§ã¯æé«ãªç°å¢ãªããããªãããšæã£ãŠããŸããLLMã䜿ã£ããµãŒãã¹ã極ãããæ¹ã¯æ¯éå¿åããŠã¿ãŠãã ããïŒ