
ç¥èãŒãããå§ããïŒããžãã¹ãã³ã®ããã®ããŒã¿ãµã€ãšã³ã¹ã»AIå ¥é
ãããŒã¿ãµã€ãšã³ã¹ã¯ãèšå€§ãªæ å ±ã®äžããæç¢ºãªäŸ¡å€ãæŽå¯ãå°ãåºãåŠéçãªã¢ãããŒãã§ããããã«è¿å¹Žã¯ãLLMããšåŒã°ããæè¡ã®é²æ©ããããŸãããããžãã¹ãšåŠè¡ã®äž¡é¢ã§é©æ°ãé²ãã§ããŸãã
ãæ¬çš¿ã§ã¯ãããŒã¿ãµã€ãšã³ã¹ã®åºç€ããå¿çšãŸã§ãå¹ åºãåãäžãã€ã€ãLLMãã¯ãããšããææ°ã®ãã¬ã³ãã«ãè§ŠããããããåŠã³å§ããæ¹ãããæ·±ãæ¢æ±ãããæ¹ã«ãçè§£ããããå 容ãç®æããŸãã
ãŸããã
ãããŒã¿ãµã€ãšã³ã¹ã®äžçã¯ãäžèŠãããšè€éãªã¢ã«ãŽãªãºã ãå€§èŠæš¡ãªèšç®åºç€ãå¿ èŠãšæãããã¡ã§ããããããæ ¹æ¬ã«ããã®ã¯ãããŒã¿ãããšã«èª²é¡è§£æ±ºãæææ±ºå®ãè¡ãããšããã·ã³ãã«ãªå§¿å¢ã§ãã
ãè¿å¹Žã§ã¯ãæ©æ¢°åŠç¿æè¡ã®é²æ©ã«å ããLLMã®ãããªèªç¶èšèªåŠçåéã®é©æ°ã«ãã£ãŠãç§ãã¡ã®æ å ±æŽ»çšã®å¯èœæ§ãããã«åºãã£ãŠããŸããããããå ã¯ãããŒã¿ãµã€ãšã³ã¹ã®åºç€ããå 端ãããã¯ãŸã§ãäœç³»çã«æŽçããçè§£ãããã圢ã§ãäŒãããŸãã
ããŒã¿ãµã€ãšã³ã¹ãšã¯äœã
ãããŒã¿ãµã€ãšã³ã¹ã¯ãå€çš®å€æ§ãªæ å ±æºããåŸãããèšå€§ãªããŒã¿ããçµ±èšåŠãèšç®æ©ç§åŠã®ç¥èŠã掻çšããŠåæããæçãªç€ºåãåŒãåºãåŠéé åã§ããè¿å¹Žãããžãã¹ããåŠè¡ãŸã§å€æ¹é¢ã§æ³šç®ãéããŠãããããŒã¿ãé§äœ¿ããŠåé¡è§£æ±ºãè¡ãææ³ãšããŠæ¬ ãããªãååšãšãªã£ãŠããŸãã
ãäžäŸãæãããªããå°å£²æ¥ã«ããã賌買履æŽåæããå»çåéã§ã®èšºææ¯æŽã¢ãã«æ§ç¯ãSNSäžã®èšå€§ãªæçš¿ã掻çšãã顧客æºè¶³åºŠã®ææ¡ãªã©ã掻çšã®å¹ ã¯å¹Žã æ¡å€§ããŠããŸãã
ãããã«ãæè¿ã®ç ç©¶ååã§ã¯LLMãšã®é£æºã匷åãããèªç¶èšèªåŠçãèªååãããã¬ããŒãã£ã³ã°ãã«ã¹ã¿ããŒãµããŒãã®èªåå¿çãªã©ãããã¹ãã«é¢ããå Žé¢ã§ã®é£èºãç®èŠãŸããã§ãã
ãããŒã¿ãµã€ãšã³ã¹ã®åºçŸä»¥åããçµ±èšãã³ã³ãã¥ãŒã¿ãŒãçšããåæææ³ã¯ååšããŠããŸãããããããã€ã³ã¿ãŒããããã¯ã©ãŠãæè¡ã®çºå±ã«ãããããŒã¿ã®éãçš®é¡ãæ¿å¢ããçµæãåŸæ¥ã®æ çµã¿ã§ã¯åŠçãå°é£ãªèŠæš¡ã®ããŒã¿ãæ±ãããŒãºãçãŸããŸããã
ãããã«ç»å Žããã®ãæ©æ¢°åŠç¿ã忣åŠçæè¡ã§ãããããããç·åçã«çµã¿åãããŠåé¡è§£æ±ºã«åãçµãæŠå¿µãããŒã¿ãµã€ãšã³ã¹ãšæããããŠããŸãã
ããŒã¿ãµã€ãšã³ã¹ã®äž»èŠããã»ã¹
ãããŒã¿ãµã€ãšã³ã¹ã®ãããžã§ã¯ãã¯ããããŸãã«æ¬¡ã®ãããªã¹ããããèžãã§é²è¡ããŸãããããã¯ã²ãšã€ã®çŽç·çæµãã§ã¯ãªããå¿ èŠã«å¿ããŠåã®æ®µéãžæ»ãã詊è¡é¯èª€ãç¹°ãè¿ããªããæé©åããç¹ãç¹åŸŽã§ãã
課é¡å®çŸ©ã»ããžãã¹çè§£
ã解決ãããåé¡ãéæãããç®æšãæç¢ºåããŸããäŒæ¥å ã§ããã°çµå¶æŠç¥ãšã®æŽåæ§ãæèããåŠè¡ç ç©¶ã§ããã°å è¡ç ç©¶ã®ååã仮説ãèžãŸããŠãå ·äœçã«äœãæããã«ããã®ãæŽçããŸããããŒã¿åé
ããœãŒã·ã£ã«ã¡ãã£ã¢ãã»ã³ãµãŒããŒã¿ãäŒæ¥ã®åºå¹¹ã·ã¹ãã ãªã©ãç®çã«å¿ããŠããŒã¿ãéããŸããAPIãå©çšãããªã¢ã«ã¿ã€ã ååŸããå€éšã®å ¬éããŒã¿ã»ãããæŽ»çšããããšãçãããããŸãããããŒã¿ååŠçïŒã¯ã¬ã³ãžã³ã°ïŒ
ãéããçããŒã¿ã«ã¯æ¬ æå€ã誀èšãå«ãŸããããšãå€ãããã®ãŸãŸåæã«çšãããšèª€ã£ãçµæãå°ãæãããããŸããããã§ãäžèŠãªã¬ã³ãŒãã®é€å»ãæ°å€ãæååã®åœ¢åŒçµ±äžãæ¬ æå€ã®è£å®ãªã©ãè¡ã£ãŠæŽåæ§ãé«ããŸããæ¢çŽ¢çããŒã¿åæïŒEDAïŒ
ãçµ±èšçææšãå¯èŠåãçšããŠãããŒã¿ã®ååžãçžé¢é¢ä¿ãææ¡ããŸããå€ãå€ãç¹ç°ãªãã¿ãŒã³ãèŠã€ããã°ãåŸã®ã¢ãã«æ§ç¯ã®ãã³ãã«ãªããŸããã¢ãã«æ§ç¯ïŒæ©æ¢°åŠç¿ãªã©ïŒ
ãååž°ãåé¡ãã¯ã©ã¹ã¿ãªã³ã°ãªã©ã®ã¢ã«ãŽãªãºã ãé©çšããäºæž¬ãã°ã«ãŒãã³ã°ãè¡ãã¢ãã«ãäœæããŸããæ©æ¢°åŠç¿ã ãã§ãªãããããŠã«ãŒã«ããŒã¹ã䜵çšããã±ãŒã¹ããããç¶æ³ã«å¿ããŠé©åãªææ³ãéžã³ãŸããè©äŸ¡ãšæ¹å
ãæ§ç¯ããã¢ãã«ããã¹ãããŒã¿ã§è©äŸ¡ããæ§èœææšïŒæ£è§£çãRMSEãF1ã¹ã³ã¢ãªã©ïŒãèšæž¬ããŸããéåŠç¿ãé²ãããã«äº€å·®æ€èšŒãè¡ãããã€ããŒãã©ã¡ãŒã¿èª¿æŽãç¹°ãè¿ããŸããéçšãšå±é
ãèšèšããã¢ãã«ãå®éã®æ¥åãã·ã¹ãã ã«çµã¿èŸŒã¿ãç¶ç¶çã«ã¢ãã¿ãªã³ã°ããŠç²ŸåºŠãç¶æã»æ¹åããŸããMLOpsãšããæŠå¿µãæ®åãããã®éçšéšåãèªååã»å¹çåããåãçµã¿ãéèŠèŠãããŠããŸãã
ããŒã¿ãµã€ãšã³ã¹ã«å¿ èŠãªäž»èŠã¹ãã«
ããã°ã©ãã³ã°
ãããŒã¿ãµã€ãšã³ã¹ã§äž»æµãªã®ã¯PythonãšRã§ãã
ã»Python: è±å¯ãªã©ã€ãã©ãªïŒNumPyãpandasãscikit-learnãTensorFlowãPyTorchãªã©ïŒãæããããŒã¿ååŠçããå¯èŠåãæ©æ¢°åŠç¿ãããã«LLMãšã®é£æºãŸã§å¹ åºãçšéã«å¯Ÿå¿ã§ããŸãã
ã»R: çµ±èšè§£æã«åŒ·ã¿ãæã¡ãåŠè¡æ©é¢ãéèæ©é¢ã§ãæ ¹åŒ·ãå©çšãããŠããŸããå€çš®å€æ§ãªçµ±èšã¢ããªã³ã°ãããã±ãŒãžãšããŠæäŸãããããŒã¿å¯èŠåã«ãåªããŠããŸãã
ããããã®èšèªã¯ã³ãŒãã®æè»æ§ã ãã§ãªããã³ãã¥ããã£ã掻çºã§ããã¥ã¡ã³ãããµã³ãã«ãå å®ããŠããç¹ãé åã§ãããŸããSQLã«ããããŒã¿ããŒã¹æäœã¯äžå¯æ¬ ã§ãå€§èŠæš¡ããŒã¿ãæ±ãéã«ã¯Sparkãªã©ã®åæ£åŠçãã¬ãŒã ã¯ãŒã¯ãèŠéã«å ¥ããŸãã
çµ±èšåŠã»æ°åŠ
ãããŒã¿ãæ±ã以äžãçµ±èšåŠã®åºç€ç¥èããªããã°çµæã®ä¿¡é Œæ§ãæ£ããè©äŸ¡ã§ããŸãããå¹³åã忣ãšãã£ãåºæ¬çææšããã確çååžã仮説æ€å®ãååž°ã¢ãã«ããã€ãºçµ±èšãªã©ãäœç³»çã«åŠã¶ããšã§ãæ©æ¢°åŠç¿ã¢ãã«ã®æåãçè§£ãããããªããŸãããŸããæ©æ¢°åŠç¿ã®çè«çèæ¯ãæ·±ãæãäžããã«ã¯ãç·åœ¢ä»£æ°ã埮åç©åãæé©åçè«ã®ç¥èãå©ãã«ãªããŸãã
æ©æ¢°åŠç¿ã»AI
ãããŒã¿ãµã€ãšã³ã¹ã«ãããéèŠãªèŠçŽ ã®äžã€ã«æ©æ¢°åŠç¿ããããŸããæåž«ããåŠç¿ãæåž«ãªãåŠç¿ã匷ååŠç¿ãªã©ã課é¡ã®çš®é¡ã«å¿ããŠã¢ã«ãŽãªãºã ãéžæããŸãã
ã»æåž«ããåŠç¿: ã©ãã«ä»ãããŒã¿ãçšããŠãäºæž¬ã¢ãã«ãåé¡ã¢ãã«ãåŠç¿ããŸããååž°åæãæ±ºå®æšãã©ã³ãã ãã©ã¬ã¹ããXGBoostãªã©ã代衚çã§ãã
ã»æåž«ãªãåŠç¿: ã©ãã«ã®ãªãããŒã¿ãããã¿ãŒã³ãèŠã€ããŸããã¯ã©ã¹ã¿ãªã³ã°ã次å åæžãç°åžžæ€ç¥ãªã©ã«å¿çšãããŸãã
ã»åŒ·ååŠç¿: ãšãŒãžã§ã³ãïŒAIïŒãç°å¢ãšçžäºäœçšãè¡ããªããã詊è¡é¯èª€ã«ãã£ãŠæé©ãªè¡åãåŠç¿ããææ³ã§ããããããå¶åŸ¡ãã²ãŒã AIãªã©ã§æŽ»çšãããŠããŸãã
ãæ·±å±€åŠç¿ïŒãã£ãŒãã©ãŒãã³ã°ïŒã§ã¯ããã¥ãŒã©ã«ãããã¯ãŒã¯ãå€å±€åããããšã§è€éãªãã¿ãŒã³ãæããŸããã³ã³ãã¥ãŒã¿ããžã§ã³ãé³å£°èªèãLLMãæŽ»çšããèªç¶èšèªåŠçãªã©ãå€å²ã«ãããåéã§é«ãæ§èœã瀺ããŠããŸãã
ãã¡ã€ã³ç¥è
ãããŒã¿ãµã€ãšã³ãã£ã¹ãã¯åãªãåæè ã§ã¯ãªããçŸå Žãé åã«ç²ŸéããŠããå¿ èŠããããŸããå°å£²ãéèãå»çãè£œé æ¥ãªã©ãããããã®æ¥çã«ã¯ç¹æã®ããŒã¿æ§é ãèŠå¶ãããžãã¹ããžãã¯ãååšããŸãã
ãããããèæ¯ãçè§£ããäžã§åæãèšèšããªããšã掻çšãã§ãŒãºã§å®åã«éŠŽæãŸãææã倱ãããŠããŸããŸãããã¡ã€ã³ç¥èã¯ãç¹åŸŽéãšã³ãžãã¢ãªã³ã°ãã¢ãŠãã«ã ã®è§£éã«ã倧ãã圱é¿ããŸãã
ã³ãã¥ãã±ãŒã·ã§ã³ã»å¯èŠå
ãã©ãã»ã©åªããåæãã¢ãã«ãæ§ç¯ããŠãããã®äŸ¡å€ãçµç¹å ãå©å®³é¢ä¿è ã«äŒããããªããã°ææã«ã€ãªãããŸãããããã·ã¥ããŒããã°ã©ãã䜿ã£ãŠçŽæçã«ç€ºåã瀺ãããšãå®éçµæãå¹³æãªèšèã§èª¬æããããšãªã©ãã³ãã¥ãã±ãŒã·ã§ã³ã¹ãã«ãããããŠéèŠã§ãã
ãTableauãPower BIãªã©ã®BIããŒã«ã䜿ãããªããçžæãçè§£ãããã圢ã§ã¢ãŠããããããããšã§ãããžãã¹ã®çŸå Žã«æŽ»ããææ¡ãå¯èœã«ãªããŸãã
å 端ç ç©¶ãšãã¬ã³ã
ãããŒã¿ãµã€ãšã³ã¹ã®åéã§ã¯ãæµ·å€ã®ç ç©¶æ©é¢ãäŒæ¥ãçœåŒããå 端æè¡ããã¬ã³ããåžžã«ãŠã©ããããããšã倧åã§ããããã§ã¯ä»£è¡šçãªããŒã¯ãŒããåãäžããŸãã
LLMã®é²å
ãè¿å¹Žã®èªç¶èšèªåŠçåéã§ã¯ãLLMãšåŒã°ããå€§èŠæš¡ãªèšèªã¢ãã«ã倧ããªè©±é¡ãšãªã£ãŠããŸããOpenAIã®ChatGPTãã¯ãããGoogleãMetaãªã©ãåæ§ã®ã¢ãã«ãéçºããŠããŸãããããã®ã¢ãã«ã¯ãèšå€§ãªããã¹ãã³ãŒãã¹ãåŠç¿ããããšã§æèã®ææ¡ãè€éãªèšãåãã®çè§£ãå¯èœã«ããå€åœ©ãªã¿ã¹ã¯ã«å¿çšãããŠããŸãã
ãåŸæ¥ã®èªç¶èšèªåŠçã§ã¯ã¿ã¹ã¯ããšã«åå¥ã®ã¢ãã«ãæ§ç¯ããå¿ èŠããããŸããããLLMã«ãæç€ºïŒããã³ããïŒããäžãã圢ã§é«æ§èœãªçµæãåŸããããããäžè¬ãŠãŒã¶ã§ãé«åºŠãªAIæ©èœãå©çšã§ããç°å¢ãæŽãã€ã€ãããŸããããã«ãå€èšèªå¯Ÿå¿ãç»åçæãšã®çµã¿åãããªã©ãæ°ããªé åãžé©çšç¯å²ãæ¡ãã£ãŠããŸãã
Data-Centric AI
ãAIãé«ç²ŸåºŠã«ä»äžããã«ã¯ãå¿ ãããã¢ãã«æ§é ãã¢ã«ãŽãªãºã ãè€éåããã ããæ£è§£ãšã¯éããŸãããè¿å¹Žã§ã¯ãã¢ãã«ããããããŒã¿ãã®ãã®ã®è³ªã倿§æ§ãé«ãããããšã«çŠç¹ã眮ãData-Centric AIã®ã¢ãããŒããæ³šç®ãããŠããŸãããã€ãºããã€ã¢ã¹ãåãé€ããè¯è³ªãªããŒã¿ã»ãããæŽåããããšã§ãã¢ãã«ã®æ§èœãå€§å¹ ã«åäžããäºäŸãå€ãå ±åãããŠããŸãã
ããã®èãæ¹ã¯åŠè¡ç ç©¶ã ãã§ãªããããžãã¹ã®çŸå Žã§ãåãå ¥ããããŠããŸããäŸãã°ãèªåã©ããªã³ã°ããŒã«ãã¢ãããŒã·ã§ã³ãã©ãããã©ãŒã ã®æŽ»çšããã§ãã¬ãŒãããã©ãŒãã³ã°ãéããé£åããŒã¿ã®æŽ»çšãªã©ãããŒã¿ãè²ãŠã芳ç¹ããŸããŸãéèŠèŠãããŠããŸãã
ãã§ãã¬ãŒãããã©ãŒãã³ã°ãšãã©ã€ãã·ãŒ
ãããŒã¿ãäžå çã«éçŽããªããŠããå端æ«ãç°å¢ã§å±æçã«ã¢ãã«ãåŠç¿ãããã®åŠç¿çµæïŒã¢ãã«ãã©ã¡ãŒã¿ïŒã ããå ±æãããã§ãã¬ãŒãããã©ãŒãã³ã°ãèå ãæµŽã³ãŠããŸãã
ãå人æ å ±ãå«ãããŒã¿ãå€éšãµãŒãã«éããã«åæã§ããããããã©ã€ãã·ãŒä¿è·ã®èгç¹ããéåžžã«ææãšãããŸããå»çãéèãªã©ã»ã³ã·ãã£ããªããŒã¿ãæ±ãåéã§å®èšŒå®éšãé²ãã§ãããä»åŸããã«æ³šç®åºŠãé«ãŸãã§ãããã
ãäžæ¹ã§ãããŒã¿ã倧人æ°ãå ±æããããã®æè¡ãšããŠå·®åãã©ã€ãã·ãŒãç ç©¶ãããŠããŸããããã¯ãããåäººã®æ å ±ãçµ±èšçã«æšæž¬ããã«ãããªãããã«ãæå³çã«ãã€ãºãå ããææ³ã§ããEUãã¯ãããšããååœã®èŠå¶ã匷åãããäžãAIéçºäŒæ¥ãç ç©¶æ©é¢ã«ãšã£ãŠããã©ã€ãã·ãŒä¿è·æè¡ã¯é¿ããŠéããªã課é¡ã«ãªã£ãŠããŸãã
MLOpsã®æ®å
ãæ©æ¢°åŠç¿ãããžã§ã¯ããç¶ç¶çã«éçšã»ç®¡çããããã®æ çµã¿ãšããŠMLOpsãæ³šç®ãããŠããŸãããœãããŠã§ã¢éçºã§ã®DevOpsã®èãæ¹ãæ©æ¢°åŠç¿ã«å°å ¥ãããã®ã§ãã¢ãã«ã®åŠç¿ã»è©äŸ¡ã»ãããã€ãèªååããããŒãžã§ã³ç®¡çãåçŸæ§ã®ç¢ºä¿ãäœç³»çã«è¡ããŸãã
ãã¯ã©ãŠããã©ãããã©ãŒã å瀟ã¯ãMLOps察å¿ã®ãµãŒãã¹ãç«¶ãããã«æäŸããŠããŸããAWSã®SageMakerãAzure Machine LearningãGoogle Cloudã®Vertex AIãªã©ã¯ãããŒã¿ã®ãã€ãã©ã€ã³æ§ç¯ããã¢ãã«ç®¡çãŸã§å æ¬çã«ãµããŒãããä»çµã¿ãæã£ãŠããŸããããã«ãããã¢ãã«æŽæ°ãå¿ èŠãªã¿ã€ãã³ã°ã§ã®ååŠç¿ãå質ä¿èšŒãã¹ã ãŒãºã«é²ã¿ãããžãã¹ãµã€ã¯ã«ãæ¢ããã«é«åºŠãªåæç°å¢ãç¶æã§ããŸãã
ãªã¢ã«ã¿ã€ã åæãšãšããžAI
ãIoTããã€ã¹ãã»ã³ãµãŒãããã¯ãŒã¯ã®æ®åã«ããããªã¢ã«ã¿ã€ã ã§ããŒã¿ãåéãå³æã«æææ±ºå®ãè¡ãããŒãºãé«ãŸã£ãŠããŸããéèã®é«é »åºŠååŒãå·¥å Žã®ã©ã€ã³å¶åŸ¡ãé è»ãµãŒãã¹ã®éèŠäºæž¬ãªã©ãã¿ã€ã ã¯ãªãã£ã«ã«ãªé åã§ã®ããŒã¿åæãç«¶äºåãå·Šå³ããŸãã
ãã¯ã©ãŠãäžå¿ã®ã¢ãŒããã¯ãã£ã«å ããŠããšããžãµã€ãã§ã®AIåŠçïŒãšããžAIïŒãæ®åãå§ããŠããŸããããŒã¿ãã¯ã©ãŠããžéä¿¡ããããã€ã¹äžã§æšè«ãè¡ãããšã§ãé å»¶ãæå°éã«æãããšãšãã«éä¿¡ã³ã¹ããåæžãããã©ã€ãã·ãŒä¿è·ã«ãå¯äžããä»çµã¿ãæŽãã€ã€ãããŸããTinyMLã®ããã«è¶ å°åããã€ã¹äžã§ã¢ãã«ãåããåããæŽ»çºã§ãç£æ¥ããã«ã¹ã±ã¢åéã«æ°ããªå¯èœæ§ããããããŠããŸãã
䜿çšãããäž»èŠããŒã«ã»æè¡
ããã°ã©ãã³ã°èšèªã»éçºç°å¢
Python + Jupyter Notebook
ãããŒã¿ã®èªã¿èŸŒã¿ãååŠçããå¯èŠåãæ©æ¢°åŠç¿ã¢ãã«ã®éçºãŸã§ã«ããŒã§ããã€ã³ã¿ã©ã¯ãã£ãã«è©Šè¡é¯èª€ããããã®ãç¹é·ã§ããR + RStudio
ãåŠè¡ç ç©¶ããéèåæãŸã§ãçµ±èšã¢ãã«ãå¯èŠåãå€åœ©ã«è¡ããçµ±åéçºç°å¢ãæŽåãããŠããŸããSQL
ãããŒã¿ããŒã¹æäœã®åºç€ãšãªãèšèªã§ããå°ãªããšãåºæ¬çãªSELECTæãJOINãGROUP BYãªã©ã¯ããŒã¿ãµã€ãšã³ãã£ã¹ãã®å¿ é ã¹ãã«ã§ãã
æ©æ¢°åŠç¿ã©ã€ãã©ãª
scikit-learn
ãPythonã§ååž°ãåé¡ãã¯ã©ã¹ã¿ãªã³ã°ãªã©ãæè»œã«è©Šãã代衚çã©ã€ãã©ãªãåå¿è ã®åŠç¿ã«ãé©ããŠããŸããTensorFlow / Keras
ãGoogleãæäŸããæ·±å±€åŠç¿ãã¬ãŒã ã¯ãŒã¯ãKerasã¯é«ã¬ãã«APIã§ãå°ãªãã³ãŒãã§ãã¥ãŒã©ã«ãããã¯ãŒã¯ãæ§ç¯ã§ããŸããPyTorch
ãFacebookïŒçŸMetaïŒãäžå¿ãšãªã£ãŠéçºããæ·±å±€åŠç¿ã©ã€ãã©ãªãç ç©¶ã³ãã¥ããã£ã§ãåºãæ¡çšãããŠãããæè»æ§ã®é«ããé åã§ããXGBoost
ãåŸé ããŒã¹ãã£ã³ã°ã«ç¹åãã髿§èœã©ã€ãã©ãªãã³ã³ããã£ã·ã§ã³ãªã©ã§é«ç²ŸåºŠãæ±ããããå Žé¢ã§å€çšãããŸããHugging Face Transformers
ãLLMãªã©ã®å€§èŠæš¡èªç¶èšèªåŠçã¢ãã«ãç°¡åã«å©çšã§ããPythonã©ã€ãã©ãªããã£ãããããããèŠçŽã¢ãã«ãŸã§ãå€åœ©ãªäºååŠç¿æžã¿ã¢ãã«ãå ¬éãããŠããŸãã
ããã°ããŒã¿åŠçåºç€
Hadoop
ã忣ãã¡ã€ã«ã·ã¹ãã ïŒHDFSïŒãäžå¿ã«MapReduceã§å€§èŠæš¡ããŒã¿ãåŠçãããšã³ã·ã¹ãã ãäŒçµ±çã ãäŸç¶ãšããŠå©çšãããå Žé¢ã¯å€ãã§ããApache Spark
ãã¡ã¢ãªäžã§é«éåŠçãè¡ã忣åŠçãšã³ãžã³ãSQLã¯ãšãªãæ©æ¢°åŠç¿ã¿ã¹ã¯ã«ã察å¿ããããã°ããŒã¿åæã®äž»æµãšãªãã€ã€ãããŸããããŒã¿ãŠã§ã¢ããŠã¹ïŒDWHïŒãã¯ã©ãŠããµãŒãã¹
ãAWS RedshiftãGoogle BigQueryãªã©ãã¯ã©ãŠãäžã§ã®å€§èŠæš¡ããŒã¿æ ŒçŽã»åæã容æã«ãªãã€ã€ããããªã³ãã¬ãã¹ããã®ç§»è¡ãé²ãã§ããŸãã
å¯èŠåã»ããã·ã¥ããŒãããŒã«
Tableau
ããã©ãã°ïŒããããã§ã€ã³ã¿ã©ã¯ãã£ããªå¯èŠåãå¯èœãããžãã¹ããŒãœã³ã«ãæ±ãããããããŒã¿ããªãã³ãªã¬ããŒãã£ã³ã°ã«åŒ·ãã§ããPower BI
ãMicrosoft補ã®BIããŒã«ãExcelãAzureãµãŒãã¹ãšã®é£æºãå å®ããŠãããäŒæ¥ã®Officeç°å¢ã«éŠŽæããœãªã¥ãŒã·ã§ã³ãšããŠäººæ°ããããŸããPlotly / Seaborn / Matplotlib
ãPythonãŠãŒã¶åãã®ããžã¥ã¢ã«ã©ã€ãã©ãªãã«ã¹ã¿ãã€ãºæ§ãé«ãã现éšãŸã§äœã蟌ã¿ããå Žåã«éå®ããŸãã
ã¯ã©ãŠããã©ãããã©ãŒã ãšMLOpsæ¯æŽ
AWSïŒAmazon Web ServicesïŒ
ã忣ããŒã¿åŠçïŒEMRïŒãããŒã¿ãŠã§ã¢ããŠã¹ïŒRedshiftïŒãæ©æ¢°åŠç¿ãã©ãããã©ãŒã ïŒSageMakerïŒãªã©ãäžäœãšãªã£ãŠãããå æ¬çã«åæç°å¢ãæ§ç¯ã§ããŸããMicrosoft Azure
ãAzure Machine LearningãDatabricksãšã®é£æºã«ãããéçºããéçšãŸã§ã¹ã ãŒãºã«è¡ããŸããPower BIãšã®èŠªåæ§ãé«ããäŒæ¥ãŠãŒã¶ã«ãšã£ãŠå°å ¥ããããç¹ãç¹é·ã§ããGoogle Cloud PlatformïŒGCPïŒ
ãVertex AIãäžå¿ã«ãé«åºŠãªæ©æ¢°åŠç¿ã¢ãã«ãã¯ã©ãŠãäžã§éçºã»ãããã€ã§ããŸããBigQueryã«ããSQLè§£æãšã®çµã¿åããã匷åã§ãã
LLMãšã®é£æºãšå®åå¿çš
èªç¶èšèªã¯ãšãªã«ããããŒã¿åæ
ãLLMã®ç»å Žã«ãããããã°ã©ãã³ã°ãã¯ãšãªèšèªã«ç²ŸéããŠããªããŠãŒã¶ã§ãã売äžãæšå¹Žæ¯ã§äœïŒ å¢å ãããæããŠãã顧客æºè¶³åºŠãäžãã£ãåå ãæšå®ããŠããšãã£ãèªç¶èšèªã®åãããã§ããŒã¿ãåæã»å¯èŠåããåãçµã¿ã泚ç®ãããŠããŸããBIããŒã«ã®äžéšã«ã¯ãèªç¶èšèªã¯ãšãªå ¥åã«å¯Ÿå¿ããæ©èœãç»å Žããããžãã¹ã®æææ±ºå®ããã»ã¹ãå éãããå¯èœæ§ããããŸãã
ããã¥ã¡ã³ãèŠçŽãã¬ããŒãèªåçæ
ãèšå€§ãªããã¹ãæ å ±ãéãŸãçµç¹ã§ã¯ãLLMãæŽ»çšããèŠçŽæè¡ãã¬ããŒãèªåçæãæçšã§ããäŒè°è°äºé²ãè«æã顧客ããã®åãåãããã°ãªã©ãèªåã§èŠçŽããããŒãã€ã³ããæœåºããããšã§ãæ å ±ã®åæšéžæã«èŠããæéãå€§å¹ ã«åæžã§ããŸãããã ããLLMãçæããææžã«ã¯èª€ããå«ãŸãããªã¹ã¯ãããããã確èªããã»ã¹ãèšãããªã©ã®æ³šæãå¿ èŠã§ãã
ã«ã¹ã¿ããŒãµããŒãã®é«åºŠå
ããã£ãããããã«ããã«ã¹ã¿ããŒãµããŒãã¯æ¢ã«å€ãã®äŒæ¥ãå°å ¥ããŠããŸãããLLMã®æ§èœåäžã«ãã£ãŠãããèªç¶ãªå¯Ÿè©±ãšè€éãªåãåãããžã®å¯Ÿå¿ãå¯èœã«ãªã£ãŠããŸãã
ãFAQã®èªååçããã¯ã¬ãŒã 察å¿ãŸã§ãå®åçãªåãåãããAIãäžæ¬¡å¯Ÿå¿ããä»çµã¿ã¯ã倧éã®åãåãããæ±ãã顧客çªå£ã«ãšã£ãŠæå¹ã§ãããã ããæ©å¯æ å ±ã®åãæ±ãããµã€ããŒã»ãã¥ãªãã£é¢ã«ãé æ ®ããå°å ¥æã«ã¯ååãªãã¹ããæ±ããããŸãã
ããŒã¿ãµã€ãšã³ã¹ã®èª²é¡ãšä»åŸã®åå
人æäžè¶³ãšæè²
ãå€ãã®äŒæ¥ãããŒã¿ãµã€ãšã³ãã£ã¹ãã®ç¢ºä¿ã«èŠæ ®ããŠããŸããé«åºŠãªæ°åŠãããã°ã©ãã³ã°ã¹ãã«ã«å ããããžãã¹ã®æèçè§£ãã³ãã¥ãã±ãŒã·ã§ã³åãå Œãåãã人æã¯ããå€ããããŸããããªã³ã©ã€ã³åŠç¿ãã©ãããã©ãŒã ã倧åŠã§ã®ããŒã¿ãµã€ãšã³ã¹é¢é£ã³ãŒã¹ãæ¡å ãããŠããŸãããåŒãç¶ãéèŠã«è¿œãã€ããªãç¶æ³ã§ãã
ãè¿å¹Žã§ã¯ãå°éå®¶ã®åéã«äŸåããªããŠãããçšåºŠã®äºæž¬ã¢ãã«ãæ§ç¯ã§ãããAutoMLãããŒã«ãç»å ŽããŠããŸãããå®å šã«äººéã®ç¥èŠã眮ãæããããšã¯ã§ããŸãããããŒã«ãèªåã§æ§ç¯ããã¢ãã«ãæ€èšŒããããžãã¹äŸ¡å€ã«ã€ãªããã®ã¯äººéã®åœ¹å²ã§ããåºç€çãªãªãã©ã·ãŒæè²ãæ¡å ãããããŒã¿ã䜿ã£ãŠèãããæåãéžæããåãçµã¿ãéèŠã«ãªããŸãã
å«çãšèŠå¶
ãAIã®éææ§ã説æå¯èœæ§ã瀟äŒçã«åŒ·ãæ±ããããŠããŸããEUã§ã¯ãAI Actããæœè¡ãããäºå®ã§ããªã¹ã¯ã¬ãã«ã«å¿ãã峿 ŒãªèŠå¶ãå°å ¥ãããèŠèŸŒã¿ã§ããæ¥æ¬ãã¢ã¡ãªã«ã§ãé¡äŒŒã®è°è«ãé²ãã§ãããä»åŸã®æ³æŽåã«ãã£ãŠã¯AIãããžã§ã¯ãã®é²ãæ¹ã倧ããå€ããå¯èœæ§ããããŸãããã§ãã¬ãŒãããã©ãŒãã³ã°ãå·®åãã©ã€ãã·ãŒãšãã£ãæè¡é¢ã®å¯Ÿå¿ã ãã§ãªããããã»ã¹ç®¡çãã¬ããã³ã¹äœå¶ã®æŽåãæ¬ ãããŸããã
ãã«ãã¢ãŒãã«åæã®åºãã
ãããã¹ããæ°å€ããŒã¿ã ãã§ãªããç»åã»é³å£°ã»åç»ãå«ãããã«ãã¢ãŒãã«åæãæ¡å ããŠããããããªãããªæ å ±æºããç¥èŠãæœåºã§ããããã«ãªã£ãŠããŸããäŸãã°å°å£²åºèã®ç£èŠã«ã¡ã©æ åãšå£²äžããŒã¿ãçµã¿åãããŠã顧客ã®è³Œè²·è¡åãæ·±ãåæãããšãã£ãææ³ãçŸå®åããŠããŸããLLMãšç»åèªèã¢ãã«ãçµ±åãã圢ã§ã®å¿çšç ç©¶ãçãã§ãããå€è§çãªããŒã¿çµ±åã«ããæ°ããªäŸ¡å€åµé ãæåŸ ãããŸãã
åœéå調ãšãªãŒãã³ãµã€ãšã³ã¹
ãç ç©¶ã®äžçã§ã¯ããªãŒãã³ããŒã¿ããªãŒãã³ãœãŒã¹ãœãããŠã§ã¢ãéããåœéå調ãé²ãã§ããŸããLLMã®èšç·Žã«äœ¿ããã巚倧ãªããŒã¿ã»ããã¯ãç¹å®ã®äŒæ¥ãå£äœã«åãããäžçäžã®ç ç©¶è ãåå ã§ããæ çµã¿ã暡玢äžã§ããããŒã¿ãµã€ãšã³ã¹ãæ°èåœã®ç€ŸäŒèª²é¡è§£æ±ºã«ã掻ãããããããäœã³ã¹ãã§è§£æç°å¢ãæŽåããåãçµã¿ããããŸãã倿§ãªèŠç¹ãèåããããšã§ãç ç©¶æ°Žæºãããã«åŒãäžããå¯èœæ§ããããŸãã
ããŒã¿ãµã€ãšã³ã¹ãåŠã¶ããã®ã¹ããã
åºç€çãªçµ±èšåŠãšããã°ã©ãã³ã°ã®ç¿åŸ
ãæåã¯é«æ ¡ã¬ãã«ã®æ°åŠã確çã»çµ±èšãPythonãRã®åºæ¬æ§æããå§ãããšè¯ãã§ããå°èŠæš¡ããŒã¿ã§æ©æ¢°åŠç¿ãå®è·µ
ãscikit-learnãTensorFlowã®ãã¥ãŒããªã¢ã«ãåèã«ããµã³ãã«ããŒã¿ã§ã¢ãã«ãæ§ç¯ããç²ŸåºŠãæž¬å®ããããã»ã¹ãçµéšããŸããå¯èŠåãšã¹ããŒãªãŒããªã³ã°ã®ç·Žç¿
ãèªåãå°ãåºããçµæã第äžè ã«çè§£ããŠãããããã«ãå³è¡šäœæããã¬ãŒã³ææ³ã磚ããŸããã¯ã©ãŠãã忣åŠçåºç€ã®æŽ»çš
ãå€§èŠæš¡ããŒã¿ãå®çšã¬ãã«ã®åæã«é²ãéã«ã¯ãAWSãAzureãGCPã®ãµãŒãã¹æŽ»çšãèŠéã«å ¥ããŸããLLMãå ç«¯ææ³ãžã®æ¡åŒµ
ãããçšåºŠã®æ©æ¢°åŠç¿ã»æ·±å±€åŠç¿ã®çµéšãåŸãåŸãLLMããã«ãã¢ãŒãã«åæãMLOpsãªã©å°éæ§ã®é«ãé åãžèžã¿èŸŒã¿ãŸããç¶ç¶çãªåŠç¿ã³ãã¥ããã£ãžã®åå
ãKaggleãæè¡ã«ã³ãã¡ã¬ã³ã¹ãè«æèªã¿äŒãå匷äŒãªã©ã«åå ããŠç¥èŠãã¢ããããŒããç¶ããããšãéèŠã§ãã
ããšãã
ãæ¬çš¿ã§ã¯ãããŒã¿ãµã€ãšã³ã¹ã®åºç€ããå¿çšåéããããŠLLMãäžå¿ãšããå 端ãããã¯ãŸã§å¹ åºãåãäžããŸãããæè¡é²æ©ãšç€ŸäŒã®å€åãæ¿ããé åã®ãããåžžã«æ°ããææ³ããµãŒãã¹ãçãŸããŠããŸãã
ãããããæ ¹åºã«ããã®ã¯ãããŒã¿ãæ£ããçè§£ãã人ã ãçµç¹ã«åœ¹ç«ã€ç¥èŠãå°ãããšããå§¿å¢ã§ããåŠç¿ã®éã®ãã¯é·ãã§ãããæ®µéçã«ç¥èãç©ã¿éããããšã§ãããè¯ãæææ±ºå®ãšäŸ¡å€åµé ã«ã€ãªããããã§ãããã
æ¬çš¿ãéããŠåŸãããã¢ã€ãã¢ãç¥èããããªãã®ããžãã¹ã«å°ãã§ã圹ç«ã€ããšãé¡ã£ãŠããŸãããããæ¬çš¿ãåèã«ãªã£ããšæããŠããã ããŸãããããã²ããããããããã©ããŒããããŠããã ãããšå±ã¿ã«ãªããŸããä»åŸãå®è·µçãªããŠããŠãAIææ°ååãå ±æããŠãããŸãã®ã§ãåŒãç¶ããèªã¿ããã ãããšå¬ããã§ãã
â ïžãéèŠïŒChatGPTã䜿ãããªãã人ã¯å
šäœã®3å²ä»¥äž
ããªããïŒã質ååãã®å·®ã§ãã
ãå®ã¯ãAIãã10åã®äŸ¡å€ãåŒãåºããåãã®ç«ãŠæ¹ãã«ã¯ç§åŠçãªæ³åããããŸããGoogleã20%ã«ãŒã«ã§å®èšŒããAmazonã®ããŸã¹ãæšå¥šããæ¹æ³ãå
šãŠãAIæä»£ã®æåŒ·ã¹ãã«ã奜å¥å¿åããã§å
¬éäžã
ãAIãç¬æã«ãçãããè¿ãä»ãåè² ã®åããç®ã¯ãåããã«ããããã®ç§å¯ã𿿥ã®ä»äºã§äœ¿ãã13ã®å®è·µããŒã«ãåçž®ããæèãAIæä»£ã®æåŒ·ã¹ãã«ã奜å¥å¿åããããã²ãã§ãã¯ããŠã¿ãŠãã ããã
ãããŒã¿ãµã€ãšã³ã¹ã®æ±ºå®çæç§æžãåŸ æã®ç¬¬3çïŒçµ±èšåŠã®æš©åšã»ç«¹æåœ°éææãã¯ãããšããå·çé£ããAIæä»£ã«å¿ é ã®ããŒã¿ãµã€ãšã³ã¹ãåºç€ããäœç³»çã«è§£èª¬ããŸãã
ãæ¬æžã®ç¹åŸŽã¯ãæ°åŠçåºç€ããå®è·µçãªåæææ³ãŸã§ã段éçãã€å æ¬çã«ã«ããŒããŠããç¹ãçµ±èšåŠãæ©æ¢°åŠç¿ãããã°ããŒã¿åŠçãå¯èŠåæè¡ãªã©ãããŒã¿ãµã€ãšã³ãã£ã¹ãã«æ±ããããç¥èãšã¹ãã«ãå¹ççã«ç¿åŸã§ããŸãã
ã第3çã§ã¯ã深局åŠç¿ãçæAIãªã©ææ°ãããã¯ã¹ãå€§å¹ ã«è¿œå ãPythonãRã䜿ã£ãå®è·µçãªã³ãŒãäŸãè±å¯ã«æ²èŒããçè«ãšå®è·µããã©ã³ã¹ããåŠã¹ãæ§æã«ãªã£ãŠããŸãã
ã倧åŠçã»å€§åŠé¢çã¯ãã¡ãããããŒã¿åæãå§ãããããžãã¹ããŒãœã³ããã£ãªã¢ãã§ã³ãžãèãããšã³ãžãã¢ã«ãæé©ãããŒã¿ããªãã³ãªæææ±ºå®ãæ±ããããçŸä»£ã«ãããŠã確ããªåºç€åã身ã«ã€ããããã®å¿ æºæžã§ãã
ãããããã®æä»£ã®å¿ é æé€ãããŒã¿ãµã€ãšã³ã¹ãã®å šäœåããååéã®ç¬¬äžç·ã®å°éå®¶ãåããããã解説ãå€ãã®å€§åŠã§æç§æžãšããŠæ¡çšããã人æ°ã·ãªãŒãºã®ææ°çã§ãã
ãããŒã¿ÃAIããªãã³æä»£ã«å¿ èŠãªãªãã©ã·ãŒãããã«ã«ã©ãŒïŒèªã¿ããã解説ã§ããããç¶²çŸ ã2024幎æ¹èšã®ãæ°çã»ããŒã¿ãµã€ãšã³ã¹ã»AIã«ãªãã¥ã©ã ãã«æºæ ãã髿 ¡ãæ å ±1ããçæAIãŸã§å¯Ÿå¿ã瀟äŒãå¯èŠåãå«çãã¬ããã³ã¹ãå®å šæ§ãªã©9åã®å°éå®¶ã«ããç« ç«ãŠã¯ãæç³»çç³»åããååŠè ã«ãæé©ã§ãã
ãæ¬æžã¯ãæ°åŒã極å䜿ããã«ãããŒã¿ãµã€ãšã³ã¹ã®æ¬è³ªãåããããã解説ããå ¥éæžã®æ±ºå®çã§ããããžãã¹ã§ã®ããŒã¿æŽ»çšããã§ã€ã¯ãã¥ãŒã¹ã®èŠæãæ¹ãçµ±èšã®çœ ãªã©ãå®ç掻ã«çŽçµããç¥èãæºèŒãããŒã¿ã«æ¯ãåããããããŒã¿ã峿¹ã«ã§ãããããŒã¿ãªãã©ã·ãŒãã身ã«ã€ããŸãã
ãã¹ãŠã®åŠçã»ç€ŸäŒäººã«ããããæåã®æç§æžãã«æé©ãªäžåã§ãã