
ãåç»ã¬ãã[JAWS DAYS 2022 Track B]AIã®å°éå®¶ããªã¹ã¹ã¡ããããŒã¿ã¬ã€ã¯ãšãã€ãã©ã€ã³ã®å®ç³ã#jawsdays2022 #jawsug #jawsdays2022_b
ä»åã¯2022幎10æ8æ¥ã«éå¬ãããAWSã®ãŠãŒã¶ã³ãã¥ããã£JAWSã®å¹Žæ¬¡ã«ã³ãã¡ã¬ã³ã¹ãJAWS DAYS 2022ãã®å
¬éåç»ããããã¯ã¢ãããããã®ã玹ä»ããããšæããŸãã
ä»åã¯æè¿ä»äºã§ãåãçµãã§ããããŒã¿ã¬ã€ã¯ã®è©±ã§ãã
ïŒåç»ã¯ãã¡ãïŒ
ãã®ã»ãã·ã§ã³ã¯AIã®å°éå®¶éå£ã§ããæ¥æ å·é»ç®ã®å±±å£éœå¹³ããã«ãããã®ã§ãã
AI/MLéçºã®çå®

ã»çãäžã®å°ããé»ãéšåãæ³šç®ãããã¡ãªæ©æ¢°åŠç¿ã®ã³ãŒã
ã»åšèŸºã®ããŒã¿äœæãã¢ãã¿ãªã³ã°ããã£ãŒãããã¯ãå¯èŠåãªã©ã³ãŒã以å€ã®ãŠã§ã€ãããã®ããã倧ãã
ã»åšèŸºã®è²ã
ãªãã®ãäœããšã³ãžãã¢ãªã³ã°ãå¿
èŠ
ããŒã¿ã¬ã€ã¯ãšãã®äžã§ã®ããŒã¿åŠçãèŠãŠã¿ãã
ãŸãã¯å žåçãªAIã·ã¹ãã ã®ããŒã¿ã¬ã€ã¯ã®åããèŠãŠã¿ãŸããæ¥æ å·é»ç®ããã¯IoTãæ±ãããšãå€ãã®ã§ã»ã³ãµãŒãªã©ã®æ å ±ã䜿ãã¢ãã«ã«ãªã£ãŠããŸãã

ã»ãšããžåŽã®ã»ã³ãµãŒã§æ€ç¥ããŠã¯ã©ãŠãã«ã¢ãããã
ïŒã»ã³ãµãŒã§æ€ç¥ããŠç£èŠã«ã¡ã©ã®æ åãã¯ã©ãŠãã«éä¿¡ïŒ
ã»AIã§åæããŠå€å¥ãããïŒçãã©ãããå€å¥ïŒ
ã»éç¥ãªã©ã®ã¢ã¯ã·ã§ã³ãè¡ãïŒçãæ¥ããšããéç¥ïŒ
ãšããžåŽã§AIã䜿çšããŠããçšåºŠã®å€å¥ãããŠã¯ã©ãŠãã«éãããŒã¿ãçµãã±ãŒã¹ãããã
ã»å
ã®ã»ã³ãµãŒããŒã¿ãæ¶ããŠããŸãã®ã§AIã®éçºã«ç¹ãããªã
AIã®ã·ã¹ãã ãäœãæé

ã»ããŒã¿ã®åé
ãAIã®åŠç¿ã»è©äŸ¡ã«çšããããŒã¿ã調éããŠã¯ã©ãŠãã«æ ŒçŽ
ã»ããŒã¿å€æ
ãæ åã§ããã°ã©ãã«ä»ããã¹ããªãŒãã³ã°ãåºæ¥ãããã«å å·¥
ãã¢ãããŒã·ã§ã³ãæãããã«å å·¥ããŠãã
ãæ åããéªšæ Œã®ããŒã¿ããšãã ãã»ã»ã»ã»ãªã©
ã»ãµã³ããªã³ã°
ãåŠç¿çšãè©äŸ¡ããã«åå²ããã
ãç®çã«ãã£ãŠéãããŒã¿ã»ãããäœã
ã»ããŒã¿åæ
ãæ¬çªã®AIã®åŠç¿ãè©äŸ¡ã®ãã§ãŒãº
å žåçãªããŒã¿åé
ããŒã¿åéã¢ããªã«ããåé
ã»æš¡æ¬ç°å¢ã§çºçããã»ã³ãµãŒããŒã¿ãä¿åãã
ã»æ¬çªã·ã¹ãã ã®è² è·ãèæ
®ããŠã®å¯Ÿå¿
ã»æããã®ãåéããããåé¢ãæ¬çªãšç°ãªã
ããŒã¿åéã¯ãšãªã«ããåé
ã»æ¬çªç°å¢ã§çºçããããŒã¿ã®ãã¡ã¯ãšãªã§éžå¥ãããã®ã ããä¿å
ã»éçšæã«çºçããããŒã¿ãåŸããã
ã»åãã倧ããæããã®ãåéã§ããªãå Žåãããã
å žåçãªããŒã¿å€æ
圢åŒå€æ
ã»mp4ãã¹ããªãŒãã³ã°ã§ããm3u8ã«å€æãããªã©
ã»csvãåæè圢åŒã§ããperquetã«å€æãã
ã»é åããšã®ãã¡ã€ã«åå²ãè¡ã
ã¢ãããŒã·ã§ã³ïŒèªåoræåïŒ
ã»ããŒã¿ããæšæž¬ã§ãã屿§ãä»äžãã
ã»ããŒã¿ã»ããããã¢ãããŒã·ã§ã³çšã®ãžã§ããçæ
å žåçãªãµã³ããªã³ã°
ããŒã¿ã»ããïŒããŒã®å Žå
ã»ã»ã³ãµãŒããŒã¿ã®å Žåã¯åéç®çãåéåäœãæå»ãã»ã³ãµãŒçš®å¥ïŒããŒãšããŠç¹å®å¯èœïŒã«åçŽãããŠãã
ãµã³ããªã³ã°ïŒããŒéšåéåã®æœåº
ã»SQLãªã©ãçšããŠéšåéåãæœåºãã
ã»ã©ã³ãã ã«åéããããæå»ãäœçœ®ã§çééã«æœåºããããã
å žåçãªåæ
AIã®åŠç¿ã»è©äŸ¡
ã»åãããŒãå²ãåœãŠãããããŒã¿ãçµã¿åãããŠæåž«ããŒã¿ãçæãè€éãªIOã¯çºçããªã
ã»åæçµæã®å¯èŠåãã¬ããŒããåæã«è¡ããåºåã®ç²åºŠã现ããããªãéãã¯IOã®åé¡ã¯ãªã
ã»ã³ãµãŒããŒã¿ã«å¯ŸããAIéçºãªã次ã§ããããOK
ããŒã¿ã¬ã€ã¯
ã»S3
ãã€ãã©ã€ã³
ã»Amazon Athena
ã»AWS Batch on EC2 / Fargate
Amazon Athena
S3ã«ãããã¡ã€ã«ã«SQLã§åãåããã§ãã

ã»ãšããããããŒã¿ã¯S3ã«å
¥ããŠããã°è¯ããšããæè»œã
ã»ããŒããŒã·ã§ãã³ã°ãåæåã«ã察å¿
ã»ã¹ãã£ã³éã«ãã課éãããã®ã§éåžžã¯å®ã
ã»æ©æ¢°åŠç¿ããã®ããŒã¿ã¬ã€ã¯ã«åããŠãã
äœ¿ãæ¹
ã»ã¯ãŒã¯ã°ã«ãŒãã®äœæ
ã»ããŒã¿ã®ã€ã³ããŒã
ã»ããŒã¿ãžã®åãåãã
ã»ããŒãã«ã®ããŒãã£ã·ã§ã³
ã»ããŒã¿ãžã®åãåãã
ã¹ããŒãã®ç¢ºèª
ããŒãã«ã®ã¹ããŒãã¯ã¯ãšãª(DDL)ãšããŠç¢ºèªã§ãã
ããŒã¿ãžã®åãåãã
ã»åãåãããSQLã§èšè¿°å®è¡ãã
ã»äžæãªSQLã«ãããšãšãã§ããªãJoinã«ãªãã®ã§æ³šæ
åãåããçµæã®ç¢ºèª
ã»åãåããçµæã¯ã³ã³ãœãŒã«ãã確èª
倿å
ããŒãã«ã®äœæ
ã»å¹Žææ¥ã§ããŒããŒã·ã§ã³ãã倿ããŒãã«ãäœæãã
ã»æè¿ã¯Pathã®ããŒããŒã·ã§ã³ãã¿ãŒã³ãç»é²ããŠèªåååºæ¥ã
ã»ãšããããS3ã«å
¥ããããŒã¿ãæŽåœ¢ãã
ããããããŒã«ã¯ãããããšããããAmazon Athenaã§ããã®ã§ã¯ãšæã
AWSÂ Batch
ã³ã³ããããŒã¹ã®ãã€ãã©ã€ã³ãèšè¿°ã§ãã
ã»ã³ã³ãããšPythonã¹ã¯ãªãããçšæããŠããã°EC2ãªã©ã®äžã§åãããŠããã
ã»ãããã®åŠçããã¥ãŒãã³ã°ãã§ãã
å šäœã®ãŸãšã

ãšããããçŽ çŽã«S3ã«å ¥ããŠAmazon ArhenaãEC2ã§ã ããã倧äžå€«
<æ¬ã»ãã·ã§ã³ã®è³æã§ã>
ææ³
æè¿è²ã
ããŒã¿æŽ»çšã®è©±ãåºãŠããäžã§ã®ãã®ã»ãã·ã§ã³ã ã£ãã®ã§å€§å€å匷ã«ãªããŸãããä»ã¯ããªãåæãžã®ã€ã³ãã©çãªããŒãã«ã¯äœããªã£ãŠããŠããäºãããããŸããã
ããèãããšS3ã®å®åã¯èšãç¥ããªãã§ããã
JAWS-UGã®Youtubeãã£ã³ãã«ã§ã