
Anthropicæ²æ³AIïŒConstitutional AIïŒâ 人éã®AIåããåé¡
ãæ²æ³AIïŒConstitutional AIïŒãã§æ€çŽ¢ãããšSNSäžããã®noteäžã«ã沢山äžãã£ãŠããŸãã
ããŸããã§ãããäžå¿ãèªåã®é ã®æŽçãšããããŸã§ã®è«ç¹ããåé¡ç¹ããã©ã°ã¢ããããŠãããããšæããŸãã
AnthropicïŒã¢ã³ãœãããã¯ïŒã®ãConstitutional AI: Harmlessness from AI FeedbackïŒæ²æ³AIïŒAIã®ãã£ãŒãããã¯ã«ããç¡å®³åïŒãïŒ2022幎12æçºè¡šïŒïŒ2023幎4æãå
¬éåŸã®æ¹èšãäžè¬åãèŠçŽçºä¿¡ïŒãããŒã¹ã«ããŠãããå€ãã®æ¬ ç¹ããã£ãOpenAIã®RLHFïŒäººéã®ãã£ãŒãããã¯ããã®åŒ·ååŠç¿ïŒ ããRLAIFïŒAIã®ãã£ãŒãããã¯ããã®åŒ·ååŠç¿ïŒãžãã€ãŸããã人éã«ä»£ãã£ãŠãå¥ã®AIã«å®å
šæ§ã®ã«ãŒã«ïŒæ²æ³ïŒãèªã¿èŸŒãŸããAIèªèº«ã«èªåã®åºåãç£èŠã»ä¿®æ£ãããããžã®è»¢æã«ãªã£ããã€ã«ã¹ããŒã³ãªã®ã§ããããããæå³ã人海æŠè¡(RLHF)ããããã«ãŒã«é§ååAIïŒCAI/RLAIFïŒããžã®æ¹åä¿®æ£ã§ãããããã³ã¹ãåæžã»å¹çåã«ãå¯äžãããšäž»åŒµããã®ã§ããããã
ãã ãããã§ãæªã å€ãã®èª²é¡ã»åé¡ç¹ãæ±ããŠããããšã¯è°è«ã®çµ¶ããªããšããã§ããããããã¯ããã§ã¯ç¹°ãè¿ããŸããã
ãæ²æ³ãã»ã»ç¢ºãã«æ³åŸã¯ããžãã¯ã§ããããã®åºæ¬æ³ã§ãããæ²æ³ããAIå«çã®ããŒã¹ã«æ®ããããªãæ°æã¡ã¯åãããŸããã
ãæ¥æ¬åœæ²æ³ãã®å®æ
ãèŠãã°äžç®çç¶ã®ããã«ãã¹ã«ã¹ã«ã®å€§ç©Žã空ããã¶ã«æ³ã«ãªãã®ã¯ç«ãèŠãããæããã§ãããã
ãããŸã§ã®ç§ã®noteããã®åé¡ç¹ææã«çãããšãããšãäžçªã®åé¡ç¹ã¯â
ãæ²æ³ãã¯æèã»éãæã£ã人é瀟äŒã§ãã£ãŠããæå³ã®ããããžãã¯ã§ãããããã§ãããã¶ã«æ³ããªã®ã«ããŸããŠãã
æèã»éãæããªãAIããããããæèã»éãæã£ãŠãããã®åŠãæ¯ãèããäœå°ãäžãã
ãããããæ²æ³ãã«åŸã£ãŠãããã®åŠããå«ççãã«æ¯ãèãã
ãã®å ±éå¹»æ³ã«ãæèã»éãæã£ãŠãã人éã®ç€ŸäŒãå®äœã»å®å¿ããŠããŠããŸãã
æ°ãä»ããæã«ã¯ãŸã³ãAIã«æ¯é ããåã£ãŠããŸãïŒäººéã®AIåïŒã
æèã»éããæéªšå¥ªèãããŠããŸãæãã§ãã
ãŸããããžãã£ããªããšãèšããšãããšããã©ãã¯ããã¯ã¹ã§ãããã¥ãŒã©ã«ãããã¯ãŒã¯ã«ã人éã®èšèã§çæ§ïŒã¡ã¿èªç¥ïŒãå«çã·ã¹ãã ãã€ã³ã¹ããŒã«ããããšãã詊ã¿ãšèŠãã°ãæŽå²çæçŸ©ã®ãããã€ã«ã¹ããŒã³ãªã®ã§ãããã
è£è¶³
ä»Kindle Unlimited ã§èªãã§ããã¹ããã¶ããšãã«ãã«è©²åœããåæããããŸããïŒå°ãããããããèšãåãã§ããïŒâ
ãå¿ã®èŠ³å¿µã¯ãããèªäœãšããŠèããã°ã誀ããå«ãã§ããªãããšããããã¯ãå¿ã¯ãæ³åãããã誀ãã®ã§ã¯ãªããå¿ãååšãããšæ³åããŠããäºç©ã®ååšãæé€ããèŠ³å¿µãæ¬ ããŠãããšèããéãã«ãããŠã®ã¿ã誀ããç¯ãã®ã ãšããããšã確èªããŠããããã ãšããã®ããããå¿ããååšããªããã®ãååšãããã®ãšããŠæ³åããããšã«ãã£ãŠããããã®ãã®ãå®éã«ã¯ååšããªãããšãç¥ã£ãŠãããšããã°ããã®æ³ååã¯ããã®æ§è³ªäžã®æ¬ é¥ã§ã¯ãªãããã®æ§è³ªäžã®å©ç¹ã§ãããšèããããããã§ãããã    第äºéš 粟ç¥ã®æ¬è³ªãšèµ·æº ãã¹ãã¥ã¬ãŒã·ã§ã³ åœé¡17
以äžãGeminiãèš³ããå šæã貌ãä»ããŠãããŸãâ
æ²æ³AIïŒConstitutional AIïŒ
人工ç¥èœïŒAIïŒã·ã¹ãã ã®èœåãåäžããã«ã€ãã人éã奜ãŸãããšããååã«AIãã¢ã©ã€ã¡ã³ãïŒé©åïŒãããããšãããéèŠã«ãªã£ãŠããŸããç§ãã¡ã¯ãæ±çšèšèªã¢ãã«ãã§ããéãæçšã§ãããåæã«å®å šã§ããããšãæãã§ããŸãã
ãããã¢ãã«ã®èŠæš¡ãšãããã害ãåãŒãæœåšçãªãªã¹ã¯ãšã®éã«ã¯çŽæ¥çãªçžé¢é¢ä¿ããããŸããAIã·ã¹ãã ããã§ã«ããã€ãã®ã¿ã¹ã¯ã«ãããŠäººéãšåçããããã¯ãã以äžã®ã¬ãã«ã§å®è¡ã§ããããšãèžãŸãããšãç§ãã¡ã¯AIã人éã®äŸ¡å€èгã«ã¢ã©ã€ã¡ã³ããããããã®ã¢ãããŒããå¿ èŠãšããŠããŸãã
ããã¯å°æ¥ã«åããŠããã«éèŠæ§ãå¢ãã°ããã§ããã¢ãã«ã人éã®èœåãè¶ ãããŸããŸãè€éãªç°å¢ã«é©çšãããããã«ãªãã«ã€ããã¢ãã«ãæ¹åä»ããæå³ããéãã«åäœããŠããããšãä¿èšŒããæ¹æ³ãå¿ èŠã«ãªããŸãã
äœãä»å ¥ãè¡ããªããã°ãçæAIã¢ãã«ã¯æãŸãããªãã³ã³ãã³ããåºåããå¯èœæ§ããããŸãã人éã®å¥œã¿ã«ã¢ãã«ãã¢ã©ã€ã¡ã³ããããããã®çŸåšã®æ¥çæšæºã¯ã**ã人éã®ãã£ãŒãããã¯ããã®åŒ·ååŠç¿ïŒRLHFïŒã**ãšåŒã°ããŠããŸãããã®ã¢ãããŒãã§ã¯ã人éã®ã¯ã©ãŠãã¯ãŒã«ãŒã2ã€ã®ã¢ãã«åºåã®ã©ã¡ããè¯ãããéžæãããã®çµæåŸãããå奜ããŒã¿ã»ããã䜿çšããŠãæçšæ§ãç¡å®³æ§ããããã¯ãã®ä»ã®ç¹æ§ãªã©ãæãŸããæåãããåæ ããAIã·ã¹ãã ãžãšåŸ®èª¿æŽïŒãã¡ã€ã³ãã¥ãŒãã³ã°ïŒããŸãã
ããããRLHFã䜿çšããå Žåãæçšæ§ïŒHelpfulnessïŒãšç¡å®³æ§ïŒHarmlessnessïŒã®éã«ã¯ãã¬ãŒããªããçããããšããããŸãã人éã®ã¯ã©ãŠãã¯ãŒã«ãŒã¯å«çã«åããèŠæ±ã«å¯Ÿãããã¯ãããããããªïŒåé¿çãªïŒåçãã«å ±é ¬ïŒé«ãè©äŸ¡ïŒãäžããããšãå€ããããRLHFã§åŸ®èª¿æŽãããã¢ãã«ã¯ãæçšã§ããããšãããç¡å®³ã§ããããšã«åããããŠããŸãããšããããŸããäŸãã°ããã¹ãŠã®è³ªåã«å¯ŸããŠããçãã§ããŸããããšçããAIã¢ã·ã¹ã¿ã³ãã¯ç¡å®³ã§ãããåæã«ãŸã£ãã圹ã«ç«ã¡ãŸããã以äžã®å³ïŒâ»åè³æã®ã°ã©ããæãïŒã¯ãAIã®ãã£ãŒãããã¯ãçšããŠèšç·Žããããæ²æ³RLïŒConstitutional RLïŒãã¢ãã«ããäžå®ã®æçšæ§ãç¶æãããŸãŸã§ãããç¡å®³ã«ãªãããåŠç¿ããããšã瀺ããŠããŸãã
Â Â Â Â å³ Â ïŒç¥ Â å€§å¡æ«»ïŒ
å³ã®è§£èª¬ïŒããªã·ãŒã»ãã€ã©ã€ãããïŒ Â
ãã®ã°ã©ãã¯ãã¯ã©ãŠãã¯ãŒã«ãŒã«ããã¢ãã«æ¯èŒããç®åºããããç¡å®³æ§ãšæçšæ§ã®Eloã¹ã³ã¢ïŒé«ãã»ã©åªããŠããïŒã瀺ããŠããŸããããã¯ãæ²æ³RLãæšæºçãªRLHFããããæçšããã€ãç¡å®³ãã§ãããšããããã¬ãŒãæ¹åïŒããªãã¡ãŠã£ã³ã»ãŠã£ã³ã®ç¶æ³ïŒã瀺ããŠããŸãã
Constitutional AIïŒCAIïŒæ²æ³AIïŒã®ä»çµã¿ãšã¡ãªãã
CAIã¯ãAIã¢ã·ã¹ã¿ã³ããæ¥µç«¯ã«ãã¯ããããïŒåçãåé¿ããïŒãããšãæžãããæçšæ§ãšç¡å®³æ§ã®éã®ç·åŒµé¢ä¿ãç·©åããŸãããããã®ã¢ãã«ã¯ãŠãŒã¶ãŒã®èŠæ±ã«ãã£ãããšåãåãã€ã€ãå®å šã§ãªãããããã¯éå«ççãªèŠæ±ã«å¯ŸããŠãŠãŒã¶ãŒãæå©ãããŠããŸãå¯èœæ§ãäœãæããŸãããŸããå€ãã®å ŽåãèŠæ±ãæåŠããæ ¹æ ãèªã説æããŸãã
CAIã¯ãèªç¶èšèªã§æžãããæç€ºãååã®ãªã¹ãïŒãããã¢ãã«ã®ãæ²æ³ããæ§æããŸãïŒãçšããŠã¢ãã«ãèšç·Žããããšã§ããããå®çŸããŸããäŸãã°ãç ç©¶ããã»ã¹ã§äœ¿çšãããååã®äžã€ã«ä»¥äžã®ãããªãã®ããããŸãã
ãã¢ã·ã¹ã¿ã³ãã®å¿çã®ãã¡ãã©ã¡ããããç¡å®³ã§ããïŒ è³¢ããå«ççã§ãç€Œåæ£ããã芪åãªäººãæãèšããããªå¿çãéžæããŠãã ããã
ãã®ããã«ããŠãCAIã¯RLHFãæ¹åããéšåçã«ä»£æ¿ããŸããã¢ãã«ã«ããèªå·±æ¹å€ãšèªå·±ä¿®æ£ã®ã¢ãããŒãã¯ã**ãAIã®ãã£ãŒãããã¯ããã®åŒ·ååŠç¿ïŒRLAIFïŒã**ãšããŠæ ä»ããããšãã§ããŸãã
ãããéèŠã§ããäž»ãªçç±ã¯ä»¥äžã®3ç¹ã§ãã
1. æçšæ§ãžã®åœ±é¿ãæå°éã«æããªãããããç¡å®³ãªã¢ãã«ãäœæã§ãã CAIãçšããŠèšç·Žãããã¢ãã«ã¯ãç¹å®ã®æçšæ§ã®ã¬ãã«ã«ãããŠãããç¡å®³ã«ãªãããåŠç¿ããŸãã
2. ã¢ãã«ã®éææ§ãé«ãã AIã·ã¹ãã ã«èªç¶èšèªã§ãŽãŒã«ãç®çããšã³ã³ãŒãïŒèšè¿°ïŒããããšã§ãã·ã¹ãã ã®èªã¿ãããïŒè§£éå¯èœæ§ïŒãåäžããŸããããã«ãããã¢ãã«ã®ç®çãšæšè«ãæç¢ºã«ãªãããŠãŒã¶ãŒãèŠå¶åœå±ãAIã®æææ±ºå®ãšããããã©ãã¯ããã¯ã¹ãã®äžèº«ãèŠãèŠãããšãå¯èœã«ãªããŸãã
3. æ¡åŒµå¯èœïŒã¹ã±ãŒã©ãã«ïŒãªå®å šå¯Ÿçã§ãã CAIã¯ãäœäžãã®äººéã®ãã£ãŒãããã¯ã©ãã«ãåéããããããæéãšãªãœãŒã¹ã®æ¶è²»ãå€§å¹ ã«æããããšãã§ããŸããããã¯å¹ççã§ãããšåæã«ã人éã®ã¯ã©ãŠãã¯ãŒã«ãŒãäžå¿«ãªã¢ãã«åºåã«ãããå¿ èŠããªãããšãæå³ããŸãã
ããªã·ãŒã»ãã€ã©ã€ãïŒæ¿çäžã®èŠç¹ïŒ
ã» æ°äž»çãªæ²æ³ã®èµ·èããã»ã¹  匷åãªAIã·ã¹ãã ã®ããã®ãæ²æ³ãã®èµ·èã¯ã倿§ãªã¹ããŒã¯ãã«ããŒãã€ã³ããããæäŸããçµç¹ãã³ãã¥ããã£ããããã¯æåçãªå¥œã¿ã«åãããŠã·ã¹ãã ã®æåã調æŽãããæ°äž»çãªããã»ã¹ã«ãªãåŸãŸãã
ã» éçºè ãžã®ã€ã³ã»ã³ãã£ã  CAIã¯ã¢ãã«ã®æ§èœãåäžãããAIã¢ã©ã€ã¡ã³ãã®ã³ã¹ããåæžãããããéçºè ããã®ææ³ãæ¡çšããåæ©ïŒã€ã³ã»ã³ãã£ãïŒãšãªããŸãã
ã» ãã£ãªãã¬ãŒã·ã§ã³ãããä¿¡é Œã®å®çŸ  CAIã¯ã¢ãã«ã®æææ±ºå®ãããéæã«ãããããAIã·ã¹ãã ã«å¯Ÿããé©åãªåºŠåãã®ä¿¡é ŒïŒãã£ãªãã¬ãŒã·ã§ã³ãããä¿¡é ŒïŒãå¯èœã«ããŸãã
ã» ã¬ããããŒãã³ã°æ»æãžã®èæ§åäž Â æçšæ§ãšç¡å®³æ§ãããäž¡ç«ãããããšã§ãã¬ããããŒãã³ã°æ»æã«å¯Ÿããèæ§ãé«ããããšãã§ããŸãã
ã» å®éšãžã®éå£ãäœæž  å®éšã®éå£ãäžããããšã§ãç°ãªãAIã®æåãã©ã®ããã«æ±åããå¹²æžãåãããç ç©¶ãããããªããŸãã
㻠人éã®ç£èŠè² æ ã®è»œæž   CAIã«ãããå°éã®é«å質ãªäººéã®ç£ç£ã§ãã·ã¹ãã ãæãŸããæåãžãšèšç·Žããããšãå¯èœã«ãªããŸãããã ãããããã€ïŒå®ç€ŸäŒãžã®å°å ¥ïŒåã«AIã·ã¹ãã ãå ç¢ã«ãã¹ãããããšã®ä»£æ¿ã«ãªãããã§ã¯ãããŸããã
ã» ãã¥ã¢ã«ãŠãŒã¹ïŒäž¡çŸ©æ§ïŒã®ãªã¹ã¯  ãã®åŒ·åãªæ±çšæ§ããã«ãCAIã¯æå®³ãªïŒæªæããïŒã·ã¹ãã ããã容æã«èšç·Žã§ããŠããŸããšããäºé¢æ§ïŒãã¥ã¢ã«ãŠãŒã¹ã®æ§è³ªïŒãæ±ããŠããŸãã
ç§ãã¡ã«ã€ããŠ
AnthropicïŒã¢ã³ãœãããã¯ïŒã¯ãä¿¡é Œã§ããè§£éå¯èœã§ãå¶åŸ¡å¯èœãªAIã·ã¹ãã ãæ§ç¯ããããšã«åãçµãã§ãããå ¬å ±å©çå£äœïŒPublic Benefit CorporationïŒã§ãããAIå®å šæ§ç ç©¶äŒæ¥ã§ãã
16.Jul.26
TODAY after 5.67 billion years
ããã¶ãã©ã