
ãAI Challenge dayãã«åå ããŠããŸããïŒ
ããã«ã¡ã¯ããœããã¯ãªãšã€ãã®ïŒ«ã§ãã
2024幎4æ18æ¥-4æ19æ¥ã«ãããŠç¥æžã§è¡ããããAI Challenge dayããšããããã«ãœã³ã«æ ªåŒäŒç€Ÿãœããã¯ãªãšã€ããšæ ªåŒäŒç€Ÿecbeingã®2瀟ååããŒã ã§åå ããŠããŸããã
äºåæ
å ±ã¯éãããŠããŠããRAG ã¢ãŒããã¯ãã£ã®å®è£
ãç¹å®é¡æã«ã³ã³ãã¹ã圢åŒã§ç«¶ããåŠã³ããããšããããšããããã
ãã®ãããå
·äœçãªå
容ã課é¡ã¯ãåå ãããŸã§è¬ã«å
ãŸããŠããŸããã
æºåãšåæ¥ã®å€
äºåæºåãšããŠã¯ããRAGã®åç粟床ããç«¶ããããã€ã³ããšèŠèŸŒã¿ã
RAG粟床åäžã®ããã®ã¢ãããŒããè€æ°çšæããŠæã¿ãŸããã
忥ã«ç¥æžã«å°çããã®ã§ãå€ã«ã¯ããŒã ã¡ã³ããŒã§éãŸãã
çŸå³ãããŠãå§ããšããäžè¯åºã«è¡ããé€åãšç
®å¹²ãã©ãŒã¡ã³ãé£ã¹ãŸãããå³åã ããã€ããŠé£ã¹ãé€åããã¡ããã¡ãçŸå³ããã£ãã§ããã

ãŸããç¿æ¥ã®ãé¡ã«ã€ããŠæ³åãå·¡ããããã«ãã¢ãŒãã«RAGãå¿ èŠãšãªãå Žåã¯ãå šå¡æªçµéšã®ããäžççžã§ã¯ãããªãã ãããšãã話ãããŠããŸããã
ããã«ãœã³Day1ïŒãé¡ã®çºè¡šã»æ§ææ€èš
ãããŠè¿ããããã«ãœã³åœæ¥ã
ãé¡ã®ããŒãã¯ãäžçéºç£ãã©ãã«ã¢ã·ã¹ã¿ã³ããã§ããã
å
·äœçã«ã¯ãäºåã«éå¬è
ãããæºåãã
ãäžçéºç£ã«é¢ããããŒã¿ã»ãããïŒãå®éã«ã¯ååšããªãä»®æ³éºç£ã®ããŒã¿ã»ããã
ãããšã«ãRAGã¢ãŒããã¯ãã£ãŒã®ç²ŸåºŠãç«¶ããšããå
容ã§ããã
ããã«ãäºæ³ïŒãã©ã°ïŒéãããé¡ã«ã¯ãã«ãã¢ãŒãã«èŠçŽ ããã£ããçã蟌ãŸããŠããŸããã
ãé¡çºè¡šåŸã¯ãæ©ã
ãšã¡ã³ããŒå
šå¡ã§äŒè°å®€ã«ç§»åããã¢ãŒããã¯ãã£ãŒããããŒãæ€çŽ¢çšã€ã³ããã¯ã¹ã®æ§æã«ã€ããŠæ€èšãéå§ããŸããã
å
·äœçã«ã¯ã仿ãåºããšäžèšã®ãããªå
容ã話ãåã£ãŠããŸããã
ã»æç« å
¥åã»ç»åå
¥åæã®ãããŒ
ã»ã¢ãŒããã¯ãã£ãŒã®æ€èš
ã»æ€çŽ¢çšã€ã³ããã¯ã¹ã®æ§æ
ã»æ€çŽ¢çšã€ã³ããã¯ã¹äœæãããŒ
ã»æç« å
¥åã»ç»åå
¥åæã®æ€çŽ¢æ¹æ³
ã»ç»åã®ãã¯ãã«å(Vectorize Image API)
ã»ç»åã®èª¬ææã®äœæ(GPT-4 Turbo with Vision)
ã»ã€ã³ããã¯ã¹åæã®æç« ãšç»åã®äœçœ®æ
å ±çŽã¥ã
ã»PDFããã®æç« ãšç»åã®æœåº
ã»WordãPowerPointã®æç« æœåº
ã»ããã³ãã»APIåšãã®è©±
ãããŸã§ã§æ¢ã«Day1ã®å€æ¹ãããã«ãªã£ãŠããããšæããŸãã
Day2ã®ãæŒã«ã¯ææç©ãæåºããå¿
èŠãããããã
Day1äžã«ã¯ããçšåºŠå®æããŠããªããšå³ãããšããã®ãããã
äŒè°å®€ã18æãŸã§å©çšå¯èœãšã®è©±ã§ãããã20æãŸã§å»¶é·å¯èœãšã®ããšã§ããèšèã«çããŠå»¶é·ãããŠããã ããŸããã
ããã«ãœã³Day1ïŒè£œé
ãããã2åãã€åæ
ããŠäœæ¥ãè¡ãããšãšãªãã
ç§ã¯ãããŒã¿åšãïŒæç« ã»ç»åã€ã³ããã¯ã¹ã®äœæïŒãæ
åœããŸããã
課é¡ã®åçš®ããŒã¿ã»ãããããæç« ãšç»åã§åå²ããããŒã¿å å·¥ãå¿
èŠããŒã¿ã®çæã宿œããæç« ã€ã³ããã¯ã¹ãšç»åã€ã³ããã¯ã¹ãäœæããŸãã
PDFã®ãããªæç« ãšç»åãäž¡æ¹ååšããããŒã¿ã«ã€ããŠã¯ãããããæœåºãè¡ããæç« ã¯æç« ã€ã³ããã¯ã¹ãç»åã¯ç»åã€ã³ããã¯ã¹ã«åããŠæ ŒçŽããŸãã
ãŸããæç« ãšç»åã®çŽã¥ããè¡ãããã«ãåºçŸããããŒãžçªå·ãäžç·ã«ååŸããŸãã

æçµçãªã€ã³ããã¯ã¹ãäœæããããã«å¿
èŠãªã
以äžã®åŠçãPythonã§ãŽãªãŽãªäœæããŠãããŸãã
ã»PDFããã®æç« ãšãã®ããŒãžæ°æœåº
ã»PDFããã®ç»åãšãã®ããŒãžæ°æœåº
ã»æç« ã®ãã¯ãã«åïŒtext-embedding-3-largeïŒ
ã»ç»åã®ãã¯ãã«åïŒVectorize Image APIïŒ
ã»ç»åã®èª¬ææçæïŒGPT-4 Turbo with VisionïŒ
ã»æç« ã€ã³ããã¯ã¹çšã®ããŒã¿ãã¬ãŒã äœæ
ã»ç»åã€ã³ããã¯ã¹çšã®ããŒã¿ãã¬ãŒã äœæ
察å¿ããŠããäžã§ãPDFã®æç« ãšç»åã®æœåºãè¡ãéã«ã
以äžã®èª²é¡ãåºãŠããŸããã
ã»ã¹ãã£ã³ããŒã¿ã®PDFãååšããæç« ã»ç»åãæœåºã§ããªã
ã»å€§éã®ç»åã§æ§æãããPDFãååšããæç« ãæœåºã§ããªã
ïŒããŒã¿ã»ãããäžççžã§ã¯ãããªãããã«è²ã
ãšå·¥å€«ãããŠããããã«æããâŠïŒ
ãã®ããã以äžã®ããã«PDFã®åŠçãåå²ãããæç« éãå°ãªãPDFã«ã€ããŠã¯ãOCRïŒComputer Vision APIïŒãå©çšããããšã«ããŸããã

ãŸããVectorize Image API ã Computer Vision API ã¯åããŠå©çšãããããããã¥ã¡ã³ãã確èªãããŒã¿ã»ãããå ã«æ€èšŒããªããé²ããŠãããŸãã
现ãã仿§ãå
šå¡ã§ç¢ºèªãè©°ãã€ã€ãåŒãç¶ãããŒã¿å å·¥åŠçã®äœæãããŠãããšããã£ãšããéã«20æãšãªã£ãŠããŸããŸããã
ãã ãäŒè°å®€ã¯ããã«22æãŸã§å»¶é·å¯èœãšã®ããšã
å床ãèšèã«çããŠã22æãŸã§å»¶é·ãããŠããã ããŸããã
22ææç¹ãGPT-4 Turbo with Visionã§ã®èª¬ææçæããOCRåŠçéšåãæ€çŽ¢çšã€ã³ããã¯ã¹äœæçããŸã ãŸã å¿
èŠãªäœæ¥ã¯æ®ã£ãŠããŸããã
äžæŠããªãã£ã¹ã§ã®äœæ¥ã¯çµäºã§åèªããã«ã®èªå®€ã§äœæ¥ã察å¿ããããšãšããã³ã³ããã§å€ã飯ãè²·ã£ãŠåž°å®
ã
ãã®åŸãããŸããŸé£ã®éšå±ã ã£ãåæã®Måãšäžç·ã«éãŸãã
OCRåŠçéšåãæç« ã€ã³ããã¯ã¹ã®äœæã»ç»åã€ã³ããã¯ã¹ã«å¿
èŠãªããŒã¿æŽåã®éšåãŸã§ã²ããã察å¿ããŸããã
ãããŠåŸã¯GGPT-4 Turbo with Visionã§ã®ç»åã®èª¬ææçæãã
ç»åã€ã³ããã¯ã¹ãäœæããã°å®äºãšãããšãããŸã§æ¥ãŸããã
ç»åã¯æ°çŸæããã説ææçæãå®äºãããŸã§æéãããããšããã®ããããäºæããªããšã©ãŒã§äžæãããªãããšãç¥ããªãããå®è¡äžã«ç¡ç ããšãããšã«ããŸããã
ããã«ãœã³Day2
æèµ·ãããšæ°çŸæåã®ç»å説ææçæãå®äºããŠããïŒäžå®å¿...ïŒã
ç»åã€ã³ããã¯ã¹ãèªå®€ã§æ©éäœæããŠããããªãã£ã¹ã«æ8æé ã«åãããŸããã
ã¡ã³ããŒã§éãŸããã¢ããªã±ãŒã·ã§ã³ã«çµã¿èŸŒã¿ãè©äŸ¡ã¹ã¯ãªãããæµããšåæ¥ããïŒç¹ã»ã©é«ãã18.525ç¹ãã

ã¹ã³ã¢ãé«ãã®ãäœãã®ãåãããªãã£ãã§ããããã«ãã¢ãŒãã«ã®RAGãåºæ¥ããšããããšã§å人çã«ã¯ããªãå¬ããã£ãã§ãã
ææ³
ãé¡ã«å¯Ÿããæ§æãèããæ°ããªãµãŒãã¹ã«è§ŠããªããéçºããŠããã®ã¯æ¥œããã£ãã§ãããå€ããåŠã¶ããšãã§ããŸããã
ãŸããä»ç€Ÿæ§ã®çºè¡šããã¯ãããããç°ãªãèŠç¹ãããããããããåŠã³ããããŸããã
äºåã«æºåããŠããã粟床åäžã®ã¢ãããŒãããäžã€ã詊ããªãã£ãããšã¯æããã£ãã§ãããå€ãã®åŠã³ãšçºèŠããRAGã®å¯èœæ§æ¹ããŠæããŸããã
ãããŠãªã«ãããå®éã«ãã«ãã¢ãŒãã«RAGãæ©èœãããã®ã宿ããæã¯ãéææãšåã³ããšãŠã倧ããã£ãã§ãã
æ¿å¯ãª2æ¥éãAI Challenge dayãã«åå ã§ããŠããã£ãã§ãã
å
šãŠã®é¢ä¿è
ã®çæ§ãããããšãããããŸããïŒ
åè
åœæ¥ã®çºè¡šã¯ YouTube Live ã§é
ä¿¡ãããŸããã
ã¢ãŒã«ã€ããæ®ã£ãŠãŸãã®ã§æ¯éã芧ãã ããã
â æŸéæ
å ±
æŸéæ¥ïŒ2024幎4æ19æ¥(é)
çªçµãïŒçæ AI ã¯ã©ããŸã§ä¹ãããªããã®ã!?
ãããã ASCIIÃãã€ã¯ããœããçæ AI ã³ã³ãã¹ãäžç¶
*ãœããã¯ãªãšã€ãã®ãã¬ãŒã³éå§æéïŒ1:11:45âã(YouTubeã¢ãŒã«ã€ã)
https://youtu.be/AzhOi14CLTA
âŒASCIIèšäºã
https://ascii.jp/elem/000/004/194/4194225/?_fsi=QXjj7fhZ&_fsi=w7ZTNBrM&_fsi=IDSKphbY