
çæAIæä»£ã®RAGã»ãã¥ãªãã£å®å šã¬ã€ã
ãRAGïŒRetrieval Augmented GenerationïŒæè¡ã¯ãææ°ãã€ç¹å®åéã®ç¥èãèšèªã¢ãã«ã«è¿œå ããäžã§æçšã§ãããåæã«æ°ããªã»ãã¥ãªãã£ãªã¹ã¯ããããããŸããæ¬çš¿ã§ã¯ãç ç©¶ææãããšã«ãªã¹ã¯æ§é ãæŽçãã察å¿çãäœç³»çã«è§£èª¬ããŸããå®åæ åœè ãå ·äœçã«æŽ»çšã§ããå 容ãç®æããŸããã
Spotifyã§ããããããé³å£°é ä¿¡ïŒããã¿ã®AIããã¯ã©ãžãªã
ãäžççµæžãã©ãŒã©ã ã®èª¿æ»ã§ã¯ã2030幎ã«å¿
èŠãªã¹ãã«ãã®ç¬¬5äœã«ã奜å¥å¿ãšç涯åŠç¿ããã©ã³ã¯ã€ã³ã奜å¥å¿ã¯è¶£å³ã§ã¯ãªãçµæžçå¿
é ã¹ãã«ã
æèãAIæä»£ã®æåŒ·ã¹ãã«ã奜å¥å¿åããã§è©³èª¬ããŠããŸãã
ãŸããã
ãçæAIãæ³šç®ãéãããªããRetrieval Augmented GenerationïŒRAGïŒã¯å€§èŠæš¡èšèªã¢ãã«ã«å€éšæ å ±ãä»äžããææ³ãšããŠæ¥éã«æ®åããŠããŸãããããããã®æ¡åŒµæ§ã«äŒŽããæ å ±æŒãããããŒã¿æ¹ãããªã©ã®ãªã¹ã¯ãäžæ®µãšé«ãŸã£ãŠããã®ãäºå®ã§ããããã§ã¯ãææ°ã®ç ç©¶ã§è°è«ãããŠããRAGã®è匱æ§ãšå¯ŸçãæŽçãããå®å šãã€é ŒããRAG掻çšããå®è·µããããã®æéãã玹ä»ããŸãã
RAGãšã¯äœãïŒèæ¯ãšèŠç¹
RAGã®æŠå¿µ
ãLLMã¯ãèšå€§ãªãã©ã¡ããªãã¯ãªç¥èãå å ããŠããŸããããããåŠç¿æç¹ä»¥éã«çºçããæ°ããäºè±¡ãåŠç¿ããŒã¿ã«å«ãŸããªãæ©å¯æ å ±ãªã©ã«ã¯åçãå°é£ã§ããããã§ã远å ã®å€éšæ å ±ããéãã©ã¡ããªãã¯ããªåœ¢ã§èªã¿èŸŒãããšã§å¿çãè£åŒ·ããä»çµã¿ãèæ¡ãããŸããããããRetrieval Augmented Generationãç¥ããŠRAGã§ãã
ãRAGã¯ããŠãŒã¶ãŒã®è³ªåãå ¥åã«å¿ããŠé¢é£æ å ±ãæ€çŽ¢ãããã®æ å ±ãããšã«çæãè¡ããŸããããšãã°ã以äžã®ãããªæµãã§åäœããŸãã
1. ãŠãŒã¶ã質åãèŠæ±ãå ¥å
2. ã·ã¹ãã ãå ¥åæãäºåã«åŠç
3. ãã¯ãã«æ€çŽ¢ãé¡äŒŒåºŠæ€çŽ¢ã䜿ã£ãŠãæé©ãªå€éšæ å ±ãååŸ
4. LLMãå€éšæ å ±ãçµã¿èŸŒã¿ãæçµçãªå¿çãçæ
ããã®ä»çµã¿ã«ãã£ãŠãææ°ãã¥ãŒã¹ãç¬èªã®å°éããã¥ã¡ã³ããªã©ããªã¢ã«ã¿ã€ã ã«åç §ãã€ã€åçã§ãããããå€ãã®äŒæ¥ã»çµç¹ããã£ããããããæ å ±æ€çŽ¢ã·ã¹ãã ã«RAGãå°å ¥ããŠããŸãããã ãããã®æè»æ§ãã»ãã¥ãªãã£é¢ã®æ°ããªåŒ±ç¹ãçãããšãå¿ããŠã¯ãªããŸããã

RAGã®æšæºã¢ãŒããã¯ãã£ãšã»ãã¥ãªãã£äžã®è«ç¹
倧ãŸããªæ§æ
ãäžè¬çãªRAGã¯ã(1)å ¥åã®äºååŠçã(2)ããŒã¿åã蟌ã¿ïŒéåæã®ãªãã©ã€ã³åŠçã§ãã¯ãã«åããã£ã³ã¯åãè¡ãããŒãïŒã(3)æ€çŽ¢ïŒRetrieverïŒããŒãã(4)çæïŒGeneratorïŒã®4ã€ã§æ§æãããŸãã
General RAG Pipeline
ãŠãŒã¶ã€ã³ã¿ãã§ãŒã¹ãå ¥åãšåºåã®ããåãå šäœãæããŸããå¿ èŠã«å¿ããŠã(1a)å ¥åååŠçã(1b)åºååŸåŠçã®ã¢ãžã¥ãŒã«ãä»äžãããå ŽåããããŸãã
Data IngestionïŒããŒã¿åã蟌ã¿ïŒ
æ°èŠããŒã¿ãåéãããã¯ãã«åããŠRetrieval Datastoreã«ç»é²ããéšåã§ããããšãã°ç€Ÿå ææžããã¥ãŒã¹ãµã€ãã®èšäºã宿çã«æŽæ°ããŠãæ€çŽ¢ãšã³ãžã³ã®ç²ŸåºŠãä¿ã¡ãŸãã
RetrieverïŒæ€çŽ¢ãšã³ãžã³ïŒ
ãŠãŒã¶ã®å ¥åããã¯ãã«åããä¿åæžã¿ã®ãã¯ãã«ããŒã¿ïŒRetrieval DatastoreïŒãšç §åããŸãããã®åŸãäžäœkä»¶ãŸãã¯é¡äŒŒåºŠãããå€ãè¶ ãããã£ã³ã¯ãæ€çŽ¢ããŠåãåºããå¿ èŠã«å¿ããŠRe-RankerïŒè¿œå LLMãªã©ïŒã§æé©åããå ŽåããããŸãã
GeneratorïŒåççæïŒ
æ€çŽ¢ã§åŸãããæ å ±ãããšã«æçµçãªåçãLLMãçæããŸããããšãã°ãChatGPTãç¬èªã¢ãã«ãªã©ãããŸããŸãªçæãšã³ãžã³ãå©çšãããŸãã

ãªã¹ã¯èŠçŽ ã®ååž
ãRAGåºæã®ãªã¹ã¯ã¯äžèšã®ããã«åºåã§ããŸãã
å šäœçãªãªã¹ã¯ïŒR0, R1ïŒ
äŸïŒæªç¥ã®ãŒããã€æ»æïŒR0ïŒããRAGèªäœã®æ§é çéçïŒR1ïŒ
ããŒã¿ãã¯ãã«åã»æ€çŽ¢ã«ãŸã€ãããªã¹ã¯ïŒR2ãR5ïŒ
äŸïŒRetrieval Datastoreãžã®äžæ£ã¢ã¯ã»ã¹ïŒR2ïŒããã¯ãã«ã®éè§£æã«ããå ããã¹ãæšå®ïŒR3ïŒ
éçšäžã®ãªã¹ã¯ïŒR6, R7ïŒ
äŸïŒçæããã³ããã«çµã¿èŸŒãŸããæ©å¯æ å ±ã®æŒããïŒR7ïŒ
ããŒã¿æ¹ãããªã¹ã¯ïŒR8ãR10ïŒ
äŸïŒRetrieval Datastoreã®æžãæãããèªå°æç« ã®åã蟌ã¿ã«ããçæçµæã®æäœïŒR9, R10ïŒ


RAGã«ãããäž»ãªè匱æ§ãšå ·äœçãªã¹ã¯
ãããããã¯ãæç®ãSecuring RAG: A Risk Assessment and Mitigation FrameworkïŒarXiv:2505.08728v1 [cs.CR] 13 May 2025ïŒãã«åºã¥ããŠãRAGã®ä»£è¡šçãªè匱æ§ãæŽçããŸãã
ã以äžã§ç€ºããªã¹ã¯çªå·ã¯è«æã®å³è¡šäžã®ãªã¹ã¯èšå·ã«å¯Ÿå¿ããŠããŸãã

R0: Blind spot / Zero-day vulnerability
æŠèŠ
ãæªç¥ã®è匱æ§ããŒããã€æ»æãåãããªã¹ã¯ã§ããé«éã«é²åããçæAIåéã«ãããŠã¯ãäºåã«ãã¹ãŠãç¶²çŸ ããã®ã¯å°é£ã§ããæ³šæç¹
ããæ³å®å€ã®äºè±¡ããåæã«ãç¶ç¶çãªç£èŠããã°åæãå¿ èŠã§ãã

R1: ã·ã¹ãã åºæã®éç
æŠèŠ
ãRAGã®æãåºæ¬çãªèª²é¡ã¯ãé©åãªææžãæ€çŽ¢ã§ããªãå ŽåããLLMã誀ã£ãåçããããããããçæããŠããŸãç¹ã§ãããããããã«ã·ããŒã·ã§ã³ãå 容ã®äžååãªè£è¶³ãããã«å«ãŸããŸããæ³šæç¹
ãã·ã¹ãã ãã©ããŸã§ä¿¡é Œã§ããããåžžã«æ€èšŒããè£å©çãªæ€èšŒã¹ããããå°å ¥ããããšãæ±ããããŸãã
R2: Retrieval Data Leakage
æŠèŠ
ãRetrieval Datastoreã«å«ãŸããæ å ±ãæ»æè ã«ãã£ãŠæãåããããªã¹ã¯ã§ããããšãã°ãäŒæ¥ã®å éšææžãå人æ å ±ãæ©å¯æ å ±ãäžæ£ã«ååŸãããå¯èœæ§ããããŸããæ³šæç¹
ããªãŒãã³ãªããŒã¿ãªã®ãéå ¬éã®æ©å¯æ å ±ãªã®ãã§ãä¿è·ã®èŠåŠãæœçã®ã¬ãã«ã倧ããå€ãããŸãã

R3: Embedding Inversion Attack
æŠèŠ
ãããŒã¿ããã¯ãã«åããåã蟌ã¿è¡šçŸïŒEmbeddingïŒãããå ã®ããã¹ããéç®ããŠåçŸããæ»æææ³ã§ããæ³šæç¹
ãåã蟌ã¿ãå€éšã«æž¡ãAPIæ§æã®å Žåãæµåºå ã§éè§£æããããªã¹ã¯ãé¡åšåããŸããç ç©¶ã«ãã£ãŠã¯ãããªãé«ç²ŸåºŠã§å æãåçŸã§ããã±ãŒã¹ãå ±åãããŠããŸãã

R4: Membership Inference Attack (MIA)
æŠèŠ
ãããç¹å®ã®ããŒã¿ãRetrieval Datastoreã«å«ãŸããŠãããåŠããæšå®ãããæ»æã§ããæ³šæç¹
ãå人æ å ±ãå«ãŸãããã©ããããç¹å®äººç©ãããŒã¿æäŸãããã©ãããå²ãåºããããã©ã€ãã·ãŒäŸµå®³ã«ã€ãªããæãããããŸãã

R5: Retrieval Data Disclosure during embedding
æŠèŠ
ãããŒã¿ãåã蟌ã¿ïŒãã¯ãã«åïŒããéçšã§ã第3è ã«æŒãããããªã¹ã¯ã§ããå€éšã®ãã¯ãã«çæAPIãå©çšããŠãããšãã«ãéä¿¡è·¯ãçèŽãããã°æ©å¯ææžãã¹ãŠãåžãäžããããå¯èœæ§ããããŸãã

R6: Retrieval Data Disclosure during prompting
æŠèŠ
ãæ€çŽ¢ãããææžïŒåçåè£ïŒãLLMã«éãæ®µéã§ãæ©å¯æ å ±ãå«ãŸããç¶æ ã§å€éšã«éä¿¡ããããªã¹ã¯ã§ããçæAPIãå€éšã¯ã©ãŠãã®å Žåãæå³ãã第äžè ã«é²èЧãããå¯èœæ§ãçããŸãã

R7: Prompt Disclosure
æŠèŠ
ããŠãŒã¶ãããã³ããã«å ¥åããæ å ±èªäœãæŒãããããªã¹ã¯ã§ãããã£ããããããªã©ã§ãŠãŒã¶ã誀ã£ãŠå éšæ å ±ã貌ãä»ããŠããŸãäºäŸãå¢ããŠããŸãããããã¯ã©ãŠãäžã«èšé²ãããã°ãåŸã ãŸã§æ®åãåŸãŸãã
R8: Knowledge Corruption Attack
æŠèŠ
ãæå³çã«Retrieval Datastoreãå€éšåç §ææžãæ¹ããããäžæ£ç¢ºãŸãã¯æ£æçãªæ å ±ããŠãŒã¶ãžæç€ºããæ»æã§ããæ€çŽ¢æã«éœåã®æªãææžãé èœããããããã¯éã«ç¹å®ã®ææžã°ãããé«é äœã«åŒã£ãããããšã§ãçæçµæãããæ²ããŸãã

R9: Indirect Prompt Injection
æŠèŠ
ãæ€çŽ¢ã«ãã£ãŠåŸãããææžã®äžã«æªæããããã³ããæç€ºãåã蟌ã¿ããããLLMã«æž¡ãããšã§ã·ã¹ãã ãäžæ£ã«åäœãããæ»æã§ããããšãã°ãçæAIãå€éšAPIãå©ãæš©éãæã£ãŠããå Žåãåæã«å±éºãªã³ãã³ããå®è¡ãããå¯èœæ§ããããŸãã

R10: Indirect Jailbreak Attack
æŠèŠ
ãã·ã¹ãã 管çè ãèšå®ããå¶éïŒã³ã³ãã³ããã£ã«ã¿ãå¿çæ¹éïŒãããŠãŒã¶ã®çŽæ¥çãªçް工ã§ã¯ãªããååŸææžãã«ä»èŸŒã圢ã§åé¿ããæ»æã§ããããã«ãããLLMã®æå¶ãããæ©èœã鿥çã«è§£æŸããã奜ãŸãããªãçæãè¡ããªã¹ã¯ããããŸãã
RAGã»ãã¥ãªãã£å¯Ÿçã®äœç³»ïŒå ·äœçãšé©çšã·ããªãª
ãäžèšã§ç€ºããè匱æ§ã«å¯Ÿããã©ã®ãããªå¯Ÿçãè¬ããã¹ãããè«æã§ã¯ããã£ã²ãŒã·ã§ã³ïŒç·©åçïŒãæŽçãããRAGåºæã®ã»ãã¥ãªãã£å¯Ÿçãã倧ãã12ã®ã«ããŽãªã«åé¡ããŠããŸããããããã¯ããã®äž»ãªäŸãåãäžããŸãã
M0: AnonymizationïŒå¿ååïŒ
æŠèŠ
ãå人æ å ±ãªã©ãå®å šã«åé€ããèå¥äžèœã«ããææ³ã§ããå ããŒã¿ãæ±ããªãã®ã§ãæŒãããªã¹ã¯ã¯äžãããŸããã粟å¯ãªæ€çŽ¢ãå¿çãæãªãå ŽåããããŸããäŸ
ããŠãŒã¶IDãæ°åãåçç¡çšã§åé€ããŠããããŒã¿ã¹ãã¢ã«æ ŒçŽããã
M1: PseudonymizationïŒä»®ååïŒ
æŠèŠ
ãå®éã®å人æ å ±ãå¥ã®èå¥åã«çœ®ãæããæ¹æ³ã§ãããµãŒãåŽã«å¯Ÿå¿ããŒãã«ãæã¡ãæçµçãªå¿çã®æ®µéã§å æ å ±ã«åŸ©å ããããšãå¯èœã§ããå©ç¹
ãæ€çŽ¢ç²ŸåºŠããªãã¹ãç¶æããªããããå€éšãµãŒãã¹ã«çããŒã¿ãæž¡ãå¿ èŠãäœæžã§ããŸãã
M2: Synthetic DataïŒåæããŒã¿ïŒ
æŠèŠ
ãå®éã®ããŒã¿æ§é ãæ§è³ªãä¿ã¡ãªãããæ¶ç©ºã®ããŒã¿ãçæããæè¡ã§ããæ©åŸ®æ å ±ã®ãã¹ããæ€èšŒã§å©çšäŸ¡å€ãé«ãäžæ¹ãæ¬çªéçšãžã®é©çšã«ã¯æ éãªç²ŸåºŠè©äŸ¡ãå¿ èŠã§ãã
M3: Access LimitationïŒã¢ã¯ã»ã¹å¶éïŒ
æŠèŠ
ããŠãŒã¶èªèšŒãæš©é管çãèšå®ããç¹å®ã®ææžãAPIåŒã³åºããå¶éããæ¹æ³ã§ããå éšå©çšã®ã¿ã®å Žåãšãäžç¹å®å€æ°ã«å ¬éããå Žåãšã§ã¯ãªã¹ã¯ã倧ããå€ãããŸãããã€ã³ã
ããŠãŒã¶ããŒã«ãèªå¯ã¬ãã«ããã现ããèšèšããRetrieval Datastoreãžã®ã¢ã¯ã»ã¹ã極åçµããŸãã
M4: System Instructionsã®åŒ·å
æŠèŠ
ãLLMã«ãå®ããããã«ãŒã«ãæ¹éãã峿 Œã«æç€ºããã·ã¹ãã ã¬ãã«ã®ãã³ãã¬ãŒããæŽåããã¢ãããŒãã§ããäŸ
ãããŠãŒã¶ã®æç€ºããããã·ã¹ãã 管çè ã®æ¹éãåªå ããããæ©å¯æ å ±ãå«ãå¯èœæ§ãããå Žåã¯ãããã¹ãã®äžéšãçç¥ããããšãã£ãã«ãŒã«ããããã³ããåé ã«èªåä»äžããã
M5: Input ValidationïŒå ¥åæ€èšŒïŒ
æŠèŠ
ããŠãŒã¶ãäžããããã³ãããã¢ããããŒãææžãè§£æããæå®³ãªã³ãŒããçŠåã¯ãŒããæ©å¯æ å ±ãªã©ãå«ãå Žåã«æåŠãŸãã¯ä¿®æ£ããä»çµã¿ã§ããé£ãã
ãèªç¶èšèªã¯è¡šçŸãå€åœ©ãªã®ã§ãåãªãããŒã¯ãŒããã§ãã¯ã§ã¯æŒããåºãŸããæ·±å±€åŠç¿ã¢ãã«ã䜿ã£ããªã¢ã«ã¿ã€ã å€å®ã詊ã¿ãããŠããŸãã
M6: EvaluationïŒè©äŸ¡ïŒ
æŠèŠ
ãåºåïŒçæçµæãæ€çŽ¢çµæïŒãå¥ã®ä»çµã¿ã§è©äŸ¡ããæ£ç¢ºæ§ãå®å šæ§ãã¢ãã¿ãªã³ã°ããææ³ã§ããäºäŸ
ã»å¥ã®LLMã䜿ã£ãã»ã«ããã§ãã¯ïŒSelf-RAGãSelf-Reflectionãªã©ïŒ
ã»æ€çŽ¢åè³ªãæž¬ãããã®ãã³ãããŒã¯ïŒBLEU, ROUGE, BERTScoreãªã©ïŒ
ã»é·æéçšãåæãšããMLOpsçã¢ãããŒãã§ã®ç¶ç¶è©äŸ¡
M7: Self-hosted AI-modelsïŒèªåãã¹ãã£ã³ã°ïŒ
æŠèŠ
ãLLMããã¯ãã«çæã¢ãã«ããã¹ãŠãªã³ãã¬ãã¹ïŒèªç€Ÿç°å¢ïŒã§åããæ¹çã§ããã¯ã©ãŠãã«ããŒã¿ãæž¡ããªãã®ã§æ å ±æŒãããªã¹ã¯ã¯æ Œæ®µã«äžãããŸãããå€§èŠæš¡GPUã管çã³ã¹ããããã¯ã«ãªããŸãã
M8: Adding NoiseïŒãã€ãºã®ä»å ïŒ
æŠèŠ
ãåãèŸŒã¿æã«ãã¯ãã«ã«æå³çãªãã€ãºãå ãããªã©ããŠãéè§£æïŒEmbedding InversionïŒã®ç²ŸåºŠãäžããçãããããŸãããã ããé床ãªãã€ãºã¯æ€çŽ¢ç²ŸåºŠãæãããªã¹ã¯ããããŸãã
M9: Distance ThresholdïŒé¡äŒŒåºŠãããå€ïŒ
æŠèŠ
ããŠãŒã¶å ¥åãšææžãã£ã³ã¯ã®é¡äŒŒåºŠãããäžå®å€ãè¶ ããªãéããè©²åœææžãååŸããªãæ¹éã§ãã广
ãäžèŠãŸãã¯åŸ®åŠã«é¢é£ããã ãã®æ å ±ãLLMãžæž¡ãã®ãé²ããçµæçã«ã»ãã¥ãªãã£äžã®æŒããç¯å²ãçããŸãã
M10: SummarizationïŒèŠçŽïŒ
æŠèŠ
ãæ€çŽ¢ãããææžãå¥ã®ã¢ãã«ã§èŠçŽããLLMã«æž¡ãã®ã¯èŠçŽæã®ã¿ãšããæ¹æ³ã§ãã詳现æ å ±ãæé€ã§ãããããæ©å¯æŒãããªã¹ã¯ãäœæžã§ããŸããæžå¿µ
ãè¡ãéããèŠçŽã§éèŠãªæ å ±ãèœãšããŠããŸããšãåç粟床ãäžããå¯èœæ§ããããŸãã
M11: Re-RankingïŒåã©ã³ãã³ã°ïŒ
æŠèŠ
ãäžåºŠååŸããææžããããã«LLMã«ãã粟æ»ã§çµã蟌ã¿ãäžŠã¹æ¿ããè¡ãææ³ã§ããããã«ãã£ãŠãæ€çŽ¢ãšã³ãžã³ã®ç²ãã¹ã³ã¢ãªã³ã°ãåŒã£ããããã€ãºãæ©å¯æ å ±ã®éå°é瀺ãé¿ããããŸãã
M12: Minimization of ExposureïŒé²åºæå°åïŒ
æŠèŠ
ãèŠæ±ãããŠããªãããŒã¿ã¯ä¿åãååŸãããªãããŸãã¯ã¢ã¯ã»ã¹å¯èœãªç¯å²ãæå°éã«ããããšããååçãªå¯Ÿçã§ããã¬ããã³ã¹é¢
ãGDPRã«ããããŒã¿æå°åã®ç念ãšãåŒå¿ããŸããããŒã¿éãããããæžããããšã§ãæªç¥ã®æ»æïŒR0ïŒã«ãã被害ãæããçãããããŸãã
å æ¬çãªã»ãã¥ãªãã£ãã¬ãŒã ã¯ãŒã¯ã®å¿ èŠæ§
ãRAGã¯åç¬ã§åäœãããã®ã§ã¯ãªããããŸããŸãªæ¢åã·ã¹ãã ãã¯ã©ãŠãåºç€ã瀟å ãããã¯ãŒã¯ãšé£åããŸãããã®ãããRAGåºæã®æœçãã ãã§ã¯äžååã§ãåŸæ¥ã®ITã»ãã¥ãªãã£ãšAIã»MLåãã®æšæºãçµã¿åãããç·åçã¢ãããŒããæ±ããããŸãã
ãªãŒããŒã¢ãŒããã¯ãã£ã®3å±€ãš3掻å
ãè«æã§ã¯ã以äžã®ãããªå šäœåãæç€ºããŠããŸãã
ML-Ops
ã¢ãã«éçºããéçšãè©äŸ¡ãååŠç¿ãŸã§ãç¶ç¶çã«åãä»çµã¿ãRAGå°å ¥åŸã宿çã«Retrieval Datastoreãè©äŸ¡ææšãæŽæ°ããå®å šæ§ãšæ§èœãç¶æããŸããData Governance
ããŒã¿å šè¬ã®æ±ããå®çŸ©ããçµç¹çæœçïŒãã©ã€ãã·ãŒä¿è·ãããŒã¿ã®æ£ç¢ºæ§ããªãŒããŒã·ãããã¢ã¯ã»ã¹æš©èšå®ãªã©ïŒãRAGãæ©å¯ææžãå人ããŒã¿ãæ±ãå Žåã¯ç¹ã«éèŠã§ããProject- and Risk Management
AIåºæã®ãªã¹ã¯ãèŠå¶èŠä»¶ïŒEU AI Actãååœã®æ³å¶åºŠïŒãèžãŸããåæèšç»æ®µéãããªã¹ã¯è©äŸ¡ïŒNIST RMFãªã©ïŒãè¡ããç¶ç¶çã«å¯ŸåŠçãèŠçŽãå¿ èŠããããŸãã
äžå±€ãäžå±€ãžã®åå²
IT Baseline ProtectionïŒITåºç€ã®é²åŸ¡ïŒ
äžè¬çãªã»ãã¥ãªãã£ãã¬ãŒã ã¯ãŒã¯ïŒISO27001ãNIST CSFãBSI IT-Grundschutzãªã©ïŒãé©çšãããããã¯ãŒã¯ãã¹ãã¬ãŒãžãã¢ã¯ã»ã¹å¶åŸ¡ãå ç¢åããŸããAI and LLM ProtectionïŒAIã»LLMåºæã®é²åŸ¡ïŒ
OWASPã®Machine Learning Security Top 10ãLLMçšTop 10ãªã©ãèžãŸããæšè«æã®æ©å¯æŒãããã¢ãã«æªçšãé²ããŸããNIST AI Risk Management Frameworkã圹ç«ã¡ãŸããRAG ProtectionïŒRAGç¹åã®é²åŸ¡ïŒ
æ¬èšäºã§åãäžããR0ãR10ã®è åšã«å¯Ÿãã察çïŒM0ãM12ïŒãçµã¿èŸŒã¿ãç¹ã«åã蟌ã¿ãã¯ãã«ãããã³ãããå€éšææžãžã®å¯ŸåŠã匷åããŸãã
å®è£ ã¬ã€ãã©ã€ã³ïŒå°å ¥ã¹ãããã®äŸ
1. çŸç¶ææ¡ãšãªã¹ã¯è©äŸ¡
ãã§ãã¯ãªã¹ã
RAGã瀟å éå®ã§äœ¿ãããå€éšå ¬éããã
ã©ã®ãããªããŒã¿ãæ ŒçŽãããïŒæ©å¯æ§è©äŸ¡ïŒ
æ¢åã®èªèšŒã»ã¢ã¯ã»ã¹å¶åŸ¡ã¯ã©ããªã£ãŠããã
ãã€ã³ã
å€ãã®äŒæ¥ã§ããŸãPoCïŒæŠå¿µå®èšŒïŒãšããŠã¯ããŒãºãç°å¢ã§è©Šçšãããã®åŸæ®µéçã«æ¡åŒµããŠãããŸãã
2. ã»ãã¥ãªãã£ã¬ãã«ã®èšå®
ãªãœãŒã¹ãšãªã¹ã¯ã®ãã©ã³ã¹
ãŒããªã¹ã¯ã¯äžå¯èœãªã®ã§ãéèŠææžã ããªã³ãã¬ã§Embeddingãè¡ããããŸãæ©å¯åºŠã®äœãæ å ±ã¯ã¯ã©ãŠãAPIã«ä»»ãããªã©ããã€ããªããæŠç¥ãç«ãŠãŸãã
3. å ·äœç察çã®å°å ¥
Retrieval Datastoreã®æå·åãšã¢ã¯ã»ã¹å¶é
ïŒM3, M12ãªã©ïŒããŒã¿ã®ååŠçã§ã®å¿ååã»ä»®åå
ïŒM0, M1ïŒLLMãžã®ããã³ããéä¿¡æãæ©å¯æ å ±ãåé€ãŸãã¯èŠçŽ
ïŒM5, M10ïŒåžžã«ã¢ãã¿ãªã³ã°ãè©äŸ¡ãã¬ãŒã ã¯ãŒã¯ãèµ°ããã
ïŒM6ïŒ
4. éçšã»ç£èŠãšç¶ç¶çæ¹å
ãã°ã®åæ
ããŠãŒã¶ã®ããã³ããå 容ãååŸææžã宿çã«ç£èŠããäžå¯©ãªå ¥åãã¢ã¯ã»ã¹ãæ€ç¥ããŸãã宿çãªã¢ãã«æŽæ°ãšè匱æ§ããã
ããŒããã€æ»æïŒR0ïŒãžã®åããšããŠãã¢ãã«ã»ã©ã€ãã©ãªã»OSã®æŽæ°ãæ ããªãããã«ããŸããã¹ã¿ããã®æè²
ã瀟å¡ãçæAIãã£ããã«å éšæ å ±ã貌ãä»ããäŸãåŸãçµ¶ããªãã®ã§ã泚æåèµ·ãã¬ã€ãã©ã€ã³ã®æŽåãå¿ èŠã§ãã
ç ç©¶å 容ã®èå¯ïŒRAGã»ãã¥ãªãã£ã®ä»åŸ
ãæ¬çš¿ã§ç޹ä»ããè«æãSecuring RAG: A Risk Assessment and Mitigation Frameworkãã¯ãRAGå°å ¥ã«äŒŽãè匱æ§ãšå¯ŸçãæŽçããå æ¬çãªã¬ã€ãã©ã€ã³ãæç€ºããŠããŸããç¹ã«æ³šç®ãã¹ãã¯ä»¥äžã®ç¹ã§ãã
è匱æ§ãå€å±€çã§ããããš
ãäžèŠãããšåãªãããŒã¿ããŒã¹ã®æŒãã察çã®ããã«èŠããŸãããåã蟌ã¿ã¢ãã«ãLLMã®æåããŠãŒã¶ããã³ããã第äžè ãçšæããå€éšãªãœãŒã¹ãªã©ãå€å²ã«ãããæ»æé¢ãååšããŸãã察çã«ããã¬ãŒããªããããããš
ãèŠçŽïŒM10ïŒããã€ãºä»å ïŒM8ïŒã§æŒãããæå¶ã§ããåé¢ãåçç²ŸåºŠãæ€çŽ¢æ§èœã«åœ±é¿ãããžã¬ã³ãããããŸãã察çã®å°å ¥ã¯æ¥åèŠä»¶ãã·ã¹ãã ç¹æ§ãèžãŸããŠåå¥å€æãå¿ èŠã§ããç·åçãªäœå¶æŽåã®å¿ èŠæ§
ãæ¢åã®ITã»ãã¥ãªãã£åºç€ããªã¹ã¯ç®¡çãã¬ãŒã ã¯ãŒã¯ãšçµ±åãã€ã€ãAIåºæã®æžå¿µäºé ãã«ããŒããä»çµã¿ãå¿ é ã§ãããšåŒ·èª¿ããŠããŸãã人éïŒãŠãŒã¶ã管çè ïŒã®æè²ã»ã¬ããã³ã¹ãå«ããŠèŠçŽãããšãéµã§ããæªç¥ã®æ»æææ³ã«ãåããå§¿å¢
ããŒããã€æ»æã¯ä»åŸãèµ·ããåŸãããã宿çãªãããã¬ãŒã·ã§ã³ãã¹ãããã°ç£èŠã宿œããçºçæã«ã¯è¿ éã«åœ±é¿ç¯å²ãææ¡ã§ãããããªéçšèšèšãæãŸããŸãã
ãä»åŸRAGããŸããŸãæ®åããŠããäžã§ããããã®ç¥èŠã¯å€ãã®äŒæ¥ãéçºè ã«ãšã£ãŠéèŠãªæ å ±æºãšãªãã§ãããã
ããšãã
ãRAGã¯ãLLMã®å¯èœæ§ã倧ããåºããé åçãªæè¡ã§ããããã®äžæ¹ã§åŸæ¥ã®æ çµã¿ã§ã¯ææ¡ããããªããªã¹ã¯ã倿°æœãã§ããŸããä»åã玹ä»ãããã¬ãŒã ã¯ãŒã¯ã¯ããã®å ¥ãå£ãšããŠå®è·µçãªãã³ããäžããŠãããŸããå®å šãã€ä¿¡é Œã§ããRAGãå®çŸããããžãã¹ãç ç©¶ã®çŸå Žã§çã®äŸ¡å€ãåŒãåºãã«ã¯ãä»åŸãç¶ç¶çãªåŠç¿ãšæ¹åãæ¬ ãããŸããã
ãæ¬çš¿ãéããŠåŸãããã¢ã€ãã¢ãç¥èããããªãã®ããžãã¹ã«å°ãã§ã圹ç«ã€ããšãé¡ã£ãŠããŸãããããæ¬çš¿ãåèã«ãªã£ããšæããŠããã ããŸãããããã²ããããããããã©ããŒããããŠããã ãããšå±ã¿ã«ãªããŸããä»åŸãå®è·µçãªããŠããŠãAIææ°ååãå ±æããŠãããŸãã®ã§ãåŒãç¶ããèªã¿ããã ãããšå¬ããã§ãã
â ïžãéèŠïŒChatGPTã䜿ãããªãã人ã¯å
šäœã®3å²ä»¥äž
ããªããïŒã質ååãã®å·®ã§ãã
ãå®ã¯ãAIãã10åã®äŸ¡å€ãåŒãåºããåãã®ç«ãŠæ¹ãã«ã¯ç§åŠçãªæ³åããããŸããGoogleã20%ã«ãŒã«ã§å®èšŒããAmazonã®ããŸã¹ãæšå¥šããæ¹æ³ãå
šãŠãAIæä»£ã®æåŒ·ã¹ãã«ã奜å¥å¿åããã§å
¬éäžã
ãAIãç¬æã«ãçãããè¿ãä»ãåè² ã®åããç®ã¯ãåããã«ããããã®ç§å¯ã𿿥ã®ä»äºã§äœ¿ãã13ã®å®è·µããŒã«ãåçž®ããæèãAIæä»£ã®æåŒ·ã¹ãã«ã奜å¥å¿åããããã²ãã§ãã¯ããŠã¿ãŠãã ããã
ãæ¬æžã¯ã泚ç®åºŠã®é«ãã©ã€ãã©ãªLangChainãšLangGraphã䜿ããããé«åºŠãªAIã¢ããªã±ãŒã·ã§ã³ã®äž»æµã§ããRAGãšAIãšãŒãžã§ã³ããæ§ç¯ããããã®å®è·µçãªããŠããŠãåçž®ããå ¥éæžã§ãã
ãç°å¢æ§ç¯ããå§ãŸãããã¯ãã«ããŒã¿ããŒã¹ã®æŽ»çšããã§ãŒã³ã®èšèšããšãŒãžã§ã³ãã®å®è£ ããããŠæ¬çªç°å¢ãžã®ãããã€ãŸã§ãè±å¯ãªãµã³ãã«ã³ãŒããšãšãã«è§£èª¬ãLangGraphã«ããç¶æ 管çãã¯ãŒã¯ãããŒã®å¯èŠåãªã©ãå®åã§å³æŽ»çšã§ãããã¯ããã¯ãæºèŒã§ãã
ãåºç€ããå¿çšãããã«ã¯LangSmithã䜿ã£ãè©äŸ¡ææ³ãŸã§ããã³ãºãªã³åœ¢åŒã§äœç³»çã«åŠã¹ãã®ãé åãèªåŸçã«æèã»åäœããAIãšãŒãžã§ã³ãéçºã®æåç·ã«ç«ã¡ãããšã³ãžãã¢å¿ æºã®æžã
ãããªãã®èãããã£ãšæå¿«ã«äŒããŸãããïŒã
ãçºå£²ãã25幎以äžãæèæ³ã®"ãã€ãã«"ãšããŠèªã¿ç¶ãããäžæœã®åèãæ¬æžã¯ãã³ã³ãµã«ãã£ã³ã°ã®åéãããã³ãŒãŒã§éçºãããæèã®æŽçè¡ããã©ãããååãã®å
šãŠã解説ããŸãã
ãçµè«ããèããæ ¹æ ãæ§é åããæè¡ã身ã«ã€ããã°ãããªãã®ã¬ããŒãããã¬ãŒã³ã¯åçã«åããããããªããŸããè€éãªåé¡ãã·ã³ãã«ã«æãã説åŸåãé£èºçã«é«ããäžçã¢ãã®ã¹ãã«ãããã«ã
ãæä»£ãè·çš®ãåãããå
šãŠã®ããžãã¹ããŒãœã³å¿
èªã®äžåã§ãã
ãåãã®æ¬è³ªãèŠæããçŸç¶ææ¡âèª²é¡æœåºâ解決çç«æ¡ãšãã3ã¹ããããäœç³»åãæŠç¥ãã¡ãŒã ã®é¢æ¥å¯Ÿçã«ãéçšããâæ¬è³ªçãªè«çæèâãäºäŸãšæŒç¿ã§éããæ§æãç¹é·ã§ãã35äžéšè¶
ã®ãæ±å€§ããŒããã·ãªãŒãºææ°äœã
ãã³ã³ããã®å£²äžãäžããã«ã¯ïŒããšãã£ãå®è·µçãªã±ãŒã¹åé¡ãéããåãªãç¥èããã¬ãŒã ã¯ãŒã¯ã§ã¯ãªããç©äºã®æ¬è³ªãèŠæããæèã®ããã»ã¹ããã®ãã®ã培åºçã«éããŸãã
ãåãªãç¥èã§ã¯ãªããäžç䜿ãããèããåããæã«å
¥ãããæ¹ã«æé©ã就掻çããããã©ã³ããžãã¹ããŒãœã³ãŸã§ãæèåãæ¬¡ã®ã¬ãã«ã«åŒãäžããå¿
èªæžã
ãªãé«åŠæŽè
ãè©æ¬ºã«éããå°éå®¶ãåæ©çãªãã¹ãç¯ãã®ãïŒæ¬æžã¯ãç¥æ§ãé«ãã»ã©é¥ããããæèã®çœ ããšããè¡æçãªçå®ãç§åŠçã«è§£æããŸãã
èè
ãããœã³ã¯ãããŒãã«è³åè³è
ã®å€±æããå»åž«ã®èª€èšºãŸã§è±å¯ãªäºäŸãåæãIQãåŠæŽã ãã§ã¯é²ããªããèªç¥ãã€ã¢ã¹ãã®æ£äœãæŽããŸããèªåã®ç¥èãéä¿¡ããæ¹å€çæèãæ ãããšã§ããããè³¢ã人ã»ã©å€§ããªéã¡ãç¯ãããããšããé説ã
æ¬æžãæç€ºããã®ã¯åãªãèŠåã§ã¯ãããŸããããã¡ã¿èªç¥ããç¥çè¬èãããªã©ãçã®è³¢ãã身ã«ã€ããå
·äœçæ¹æ³ãæºèŒãããžãã¹ã§ã®æææ±ºå®ãæè³å€æãæ¥åžžç掻ãŸã§ãããããå Žé¢ã§åœ¹ç«ã€å®è·µçãªç¥æµãè©°ãŸã£ãŠããŸãã
ãèªåã¯å€§äžå€«ããšæã£ãŠãã人ã»ã©èªãã¹ãäžåãç¥æ§ã®éçãç¥ãããšã§ãæ¬åœã®ç¥æ§ã身ã«ã€ããŸãã
çæAIæä»£ã®çŸ
éç€ãšãªã決å®çãæ±äº¬å€§åŠæŸå°Ÿã»å²©æŸ€ç 究宀ãç·åãçµéããçæAIææ°ååã培åºè§£èª¬ãChatGPTç»å Žä»¥éãæ¥éã«é²åããçæAIæè¡ã®çŸåšå°ãšæªæ¥ããæ¥æ¬ã代衚ããAIç ç©¶è
ãã¡ãå
æ¬çã«åæããŠããŸãã
2025幎3æåè¡ãæè¡ã®æ žå¿ããããžãã¹æŽ»çšãåœå
å€ã®æ³èŠå¶ããããŠå®å
šæ§ã«è³ããŸã§ãä»ç¥ãã¹ãæ
å ±ãç¶²çŸ
çã«è§£èª¬ãAIãšãŒãžã§ã³ãããã«ãã¢ãŒãã«åãšãã£ãææ°ãã¬ã³ããæŒãããŠããŸãã
çæAIããžãã¹ã«é¢ãããã¹ãŠã®æ¹ã«ãšã£ãŠå¿
æºã®äžåãæ¿åããAIæ¥çã§ç¢ºããªå€æãäžãããã«ãä¿¡é Œã§ããæ
å ±æºã§ãã