
LLMïŒå€§èŠæš¡èšèªã¢ãã«ïŒã¯ãã©ã®ããã«æç« ãäœãã®ããããŒã¯ã³ã»åŠç¿ã®ïŒæ®µéã»ãã«ã·ããŒã·ã§ã³ãå³ã§æŽçãã
çæAIã®ãã£ããã«è³ªåãããšãäººãæžãããããªæç« ã§çããè¿ã£ãŠããŸãããã®äžå¿ã«ããæè¡ããLLMïŒLarge Language Modelãå€§èŠæš¡èšèªã¢ãã«ïŒã§ãã
ãã®èšäºã§ã¯ãLLM ãæç« ãäœãä»çµã¿ãåŠç¿ã®é²ãæ¹ãåŸæãªããšãšéçã䜿ããšãã«æ°ãã€ãããããšããé ã«æŽçããŸãã
æ¬æã®ïŒ»1ã®ãããªçªå·ã¯ãæŒããšåºå žã®ããŒãžãéããŸããè±èªã®è³æã®èš³ã¯çè ã«ãããã®ã§ããåºå žã«ã¯ãNDã·ã¹ãã ãºãæ¥åã§å©çšããŠãã Claude ã®éçºå ãAnthropic ã®å ¬åŒã®è³æãå«ã¿ãŸãã

LLMã»çæAIã»ãã£ããã®ãµãŒãã¹ã®é¢ä¿
çæAIã¯ãæç« ãç»åãäœã AI ã®ç·ç§°
ç·åçãšçµæžç£æ¥çã®ãAIäºæ¥è ã¬ã€ãã©ã€ã³ïŒç¬¬ïŒ.ïŒçïŒãã«ãããšãçæAIã¯ãæç« ãç»åãããã°ã©ã çãçæã§ãã AI ã¢ãã«ã«ããšã¥ã AI ã®ç·ç§°ã§ã1ãæç« ãäœããã®ããç»åãäœããã®ããçæAIã«å«ãŸããŸãã
LLM ã¯ãæç« ãæ±ãçæAIã®åå°
å ±åéä¿¡ãã¥ãŒã¹çšèªè§£èª¬ã«ãããšãå€§èŠæš¡èšèªã¢ãã«ã¯ãçæäººå·¥ç¥èœ(AI)ã®äžçš®ã§ãããŸããŸãªãµãŒãã¹ã®åºç€ãšãªããæè¡ã§ã2ãããžã¿ã«å€§èŸæ³ã¯ãèšå€§ãªæç« ããŒã¿ã§ããã£ãŒãã©ãŒãã³ã°ã«ããäºååŠç¿ãè¡ã£ãèšèªã¢ãã«ãšèª¬æããŠããŸã2ã
åãèŸå žã«ãããšãããããã人ãäžããèšèªèŠåã«åºã¥ãåŸæ¥ã®èªç¶èšèªåŠçãšç°ãªããããŸãã§äººéãæžãããã®ãããªèªç¶ãªæç« ã®çæãè¡ãããç¹ãç¹åŸŽã§ã2ïŒœãææ³ã®æ±ºãŸããäººãæžã蟌ãã®ã§ã¯ãªãã倧éã®æç« ããèšèã®äœ¿ããæ¹ãåŠã³åãç¹ããåŸæ¥ã®æ¹æ³ãšã®éãã«ãªããŸãã
ãã£ããã®ãµãŒãã¹ã¯ãLLM ã調æŽãããã®
ãµã ã䜿ããã£ããã®ãµãŒãã¹ã¯ãLLM ããã®ãŸãŸåãããŠããããã§ã¯ãããŸãããAnthropic ã®çšèªéã¯ãå瀟㮠Claude ã«ã€ããŠããã¡ã€ã³ãã¥ãŒãã³ã°ãš RLHF ã§èšç·Žãããå€§èŠæš¡èšèªã¢ãã«ã«ããšã¥ããšèª¬æããŠããŸã3ããã¡ã€ã³ãã¥ãŒãã³ã°ãš RLHF ã¯ãåŸã®ãåŠç¿ã®ïŒæ®µéãã®ç¯ã§èª¬æããŸãã

LLM ãããŠããããšïŒæ¬¡ã®èšèãäºæž¬ãã
ç¶ãèšèã®ç¢ºçãäºæž¬ããïŒã€ãã€ä»ãè¶³ã
å ±åéä¿¡ãã¥ãŒã¹çšèªè§£èª¬ã«ãããšãå€§èŠæš¡èšèªã¢ãã«ã¯ããããåèªã«ç¶ã次ã®åèªã®ç¢ºçãäºæž¬ããããªã©ããŠã人éãæžããããªèªç¶ãªæç« ãäœããŸã2ãAnthropic ã®çšèªéããäºååŠç¿ã§ã¯ãææžã®ãããŸã§ã®æèããæ¬¡ã®åèªãäºæž¬ããããèšç·Žãããšèª¬æããŠããŸã3ã
ããšãã°ã仿¥ã¯å€©æ°ãããŸã§æžãããšããã§ã次ã«ç¶ãèšèã®åè£ïŒãè¯ãããæªãããéšããªã©ïŒã«ãããããã®ç¢ºçãä»ããŸãããã®äžããïŒã€ãéžãã§æã«ä»ãè¶³ããä»ãè¶³ããåŸã®æããããŸã次ã®èšèãäºæž¬ããŸãããã®ç¹°ãè¿ãã§ãé·ãæç« ãã§ãããããŸãã


åè£ã®ç¹æ°ã確çã«å€ããèšç®ãšã確çããïŒã€ãéžã¶æ¹æ³ã¯ã以åã®èšäºã§æ±ããŸããã
ããŒã¯ã³ïŒæç« ãåºåã£ãåäœ
ãããŸã§ãèšèããšæžããŠããŸããããLLM ãå®éã«æ±ãåäœã¯ããŒã¯ã³ã§ããAnthropic ã®çšèªéã«ãããšãããŒã¯ã³ã¯èšèªã¢ãã«ãæ±ãæå°ã®åäœã§ãåèªãåèªã®äžéšãæåãå Žåã«ãã£ãŠã¯ãã€ãã«åœãããŸã3ã
LLM ã«æç« ãæž¡ããšãæåã®äžŠã³ã¯ããŸãããŒã¯ã³ã®äžŠã³ã«å€ããããŸã3ãïŒã€ã®ããŒã¯ã³ãäœæåã«åœãããã¯ãã¢ãã«ãšèšèªã«ãã£ãŠå€ãããŸã3ã

ããŒã¯ã³ã¯ãããã«æ°ã®äžŠã³ïŒãã¯ãã«ïŒã«çœ®ãæããããŠèšç®ãããŸããæç« ãæ°ã®äžŠã³ã§è¡šãèãæ¹ã¯ãembedding ã®èšäºã§æ±ããŸããã
ãå€§èŠæš¡ããšã¯ïŒãã©ã¡ãŒã¿ãŒã®æ°ãšãåŠç¿ã«äœ¿ãæç« ã®é
ãã©ã¡ãŒã¿ãŒã¯ãèšç®ã«äœ¿ãæ°
Anthropic ã®çšèªéã¯ãLLM ããå€ãã®ãã©ã¡ãŒã¿ãŒãæã€èšèªã¢ãã«ã§ãèšå€§ãªéã®æç« ããŒã¿ã§èšç·Žããããã®ãšèª¬æããŠããŸã3ããã©ã¡ãŒã¿ãŒã¯ãåŠç¿ã«ãã£ãŠå€ã決ãŸããèšç®ã«äœ¿ãæ°ã§ãããã¥ãŒã©ã«ãããã¯ãŒã¯ã®éã¿ãããã©ã¡ãŒã¿ãŒã®äžã€ã§ãã
éã¿ã䜿ã£ãæãç®ãšè¶³ãç®ãéã¿ã®æ°ãšã¡ã¢ãªã®éã®é¢ä¿ã¯ã以åã®èšäºã§æ±ããŸããã
ïŒïŒïŒïŒåã®ãã©ã¡ãŒã¿ãŒ
ç·åçã®ä»€åïŒå¹Žçæ å ±éä¿¡çœæžã«ãããšãOpenAI ã¯ïŒïŒïŒïŒå¹ŽïŒæãïŒïŒïŒïŒåã®ãã©ã¡ãŒã¿ãŒã䜿çšããå€§èŠæš¡èšèªã¢ãã«ãGPT-3ããå ¬è¡šããŸãã4ãGPT-3 ã®è«æã¯ãèšèªã¢ãã«ã®èŠæš¡ã倧ãããããšãç¹å®ã®äœæ¥ã«çµããªããå°æ°ã®äŸã瀺ãã ãã®äœ¿ãæ¹ã§ã®æ§èœã倧ããåäžããããšã瀺ããŸãã5ã
åãè«æã§ã¯ãGPT-3 ã¯ããã©ã¡ãŒã¿ãŒãæŽæ°ãçŽãããšãããã¡ã€ã³ãã¥ãŒãã³ã°ãããã«äœ¿ãããŠããŸã5ãäœæ¥ã®å 容ãšããã€ãã®äŸããæç« ã§ã¢ãã«ã«æž¡ãã ãã§ïŒ»5ã翻蚳ã質åãžã®åçã空æ¬ãåããåé¡ãªã©ã§é«ãæ§èœã瀺ããŸãã5ãäžæ¹ã§ãå°æ°ã®äŸã瀺ãã ãã§ã¯ããŸã æ§èœã®äŒžã³ã«ããããŒã¿ã»ããããããšãåãè«æã¯è¿°ã¹ãŠããŸã5ã

ä»çµã¿ã®äžå¿ïŒTransformer ãšã泚æã
ïŒïŒïŒïŒå¹Žã®è«æã§ææ¡ããã Transformer
ããŸã® LLM ã®å€ãã¯ãTransformerïŒãã©ã³ã¹ãã©ãŒããŒïŒãšåŒã°ããä»çµã¿ãåå°ã«ããŠããŸããTransformer ã¯ãïŒïŒïŒïŒå¹Žã®è«æãAttention Is All You Needãã§ææ¡ãããŸãã6ãè«æã«ãããšãTransformer ã¯ã泚æã®ä»çµã¿ïŒattention mechanismsïŒã ãã«ããšã¥ããæ°ãããããã¯ãŒã¯ã®æ§é ã§ã6ã
è«æã§ã¯ãè±èªãããã€ãèªãè±èªãããã©ã³ã¹èªãžã®æ©æ¢°ç¿»èš³ã§ããããŸã§ããé«ãæ§èœã瀺ããŸãã6ãããšã¯ç¿»èš³ã®ç ç©¶ãšããŠçºè¡šãããä»çµã¿ãããã®åŸã® LLM ã«åºã䜿ãããããã«ãªããŸããã
ãæ³šæãã¯ãæã®äžã®ã©ã®èšèã«æ³šç®ããã
泚æã®ä»çµã¿ã¯ãããèšèã®æå³ã決ãããšãã«ãæã®äžã®ã»ãã®ã©ã®èšèãã©ãã ãåèã«ãããããæ°ã§éã¿ä»ãããä»çµã¿ã§ããããšãã°ã梚ãå·ãããŠãããããããåã£ãŠåºãããããšããæã§ã¯ããããããäœãæãããæ±ºããããã«ãåã®æã®ã梚ãã匷ãåèã«ããå¿ èŠããããŸãã
泚æã®ä»çµã¿ã§ã¯ããã®ãããªèšèã©ããã®é¢ä¿ãæ°ã§è¡šããå€ãã®çµã¿åããã«ã€ããŠãŸãšããŠèšç®ããŸããé¢ããäœçœ®ã«ããèšèã©ããã®é¢ä¿ãæ±ããããšãç¹åŸŽã§ãã

åŠç¿ã®ïŒæ®µéïŒäºååŠç¿ã»ãã¡ã€ã³ãã¥ãŒãã³ã°ã»äººã®è©äŸ¡
LLM ã®åŠç¿ã¯ã倧ããïŒã€ã®æ®µéã«åããŠèª¬æãããŸããAnthropic ã®çšèªéããäºååŠç¿ãçµããã¢ãã«ãããã¡ã€ã³ãã¥ãŒãã³ã°ãš RLHF ã§æ¹è¯ãããšèª¬æããŠããŸã3ãåŠç¿ãšã¯ãçããæ£ãããªãããã«ããã©ã¡ãŒã¿ãŒïŒéã¿ïŒãå°ããã€çŽããŠããæ®µéã®ããšã§ãã
â äºååŠç¿ïŒå€§éã®æç« ã§ã次ã®èšèã®äºæž¬ãåŠã¶
Anthropic ã®çšèªéã«ãããšãäºååŠç¿ã¯ãã©ãã«ã®ä»ããŠããªã倧éã®æç« ã§ãèšèªã¢ãã«ãèšç·Žããæåã®æ®µéã§ã3ãåã®ç¯ã§èŠããæ¬¡ã®èšèã®äºæž¬ãã¯ããã®æ®µéã§åŠã³ãŸãã
ãã ããåãçšèªéã«ãããšãäºååŠç¿ãçµããã ãã®ã¢ãã«ã¯ã質åã«çããããšãæç€ºã«åŸãããšããããšããšåŸæã§ã¯ãããŸãã3ãããã§ãç¶ãïŒã€ã®æ®µéã§èª¿æŽããŸãã
â¡ ãã¡ã€ã³ãã¥ãŒãã³ã°ïŒææ¬ã®çãã§èª¿æŽãã
ãã¡ã€ã³ãã¥ãŒãã³ã°ã¯ãäºååŠç¿ãçµããèšèªã¢ãã«ãã远å ã®ããŒã¿ã§ããã«èšç·Žããããšã§ã3ã远å ããããŒã¿ã®ç¹åŸŽããã¢ãã«ããŸããããã«ãªããŸãã
OpenAI ã® InstructGPT ã®è«æïŒïŒïŒïŒïŒå¹ŽïŒã§ã¯ããŸããæãŸããçãæ¹ã®ææ¬ãäººãæžããããŒã¿ãéãããã®ããŒã¿ã§ GPT-3 ããã¡ã€ã³ãã¥ãŒãã³ã°ããŸãã7ã
⢠RLHFïŒäººã®è©äŸ¡ã§ã奜ãŸããçãã«è¿ã¥ãã
RLHFïŒReinforcement Learning from Human Feedbackã人éã®ãã£ãŒãããã¯ã«ãã匷ååŠç¿ïŒã¯ãèšèªã¢ãã«ã人ã®å¥œã¿ã«æ²¿ã£ãŠæ¯ãèãããã«èšç·Žããææ³ã§ã3ã人ãïŒã€ä»¥äžã®çãã®äŸã«é äœãä»ããé äœã®é«ãçãã«è¿ãåºåã奜ãããã«ãã¢ãã«ãèšç·ŽããŸã3ã
InstructGPT ã®è«æã¯ãèšèªã¢ãã«ã倧ããããã ãã§ã¯ã䜿ãäººã®æå³ã«æ²¿ãããšãäžæã«ãªããšã¯éããªããšè¿°ã¹ãŠããŸã7ãè«æã®ã人ã«ããè©äŸ¡ã§ã¯ããã©ã¡ãŒã¿ãŒïŒïŒåã® InstructGPT ã®åºåããïŒïŒïŒïŒåã® GPT-3 ã®åºåãã奜ãŸããŸãã7ã


䜿ããšãïŒäŒè©±ãèŠããŠããããã«èŠããä»çµã¿
ã³ã³ããã¹ããŠã£ã³ããŠïŒäžåºŠã«åç §ã§ããç¯å²
åŠç¿ãçµãã LLM ã«è³ªåãéããšãåŠç¿ã§æ±ºãŸã£ããã©ã¡ãŒã¿ãŒã䜿ã£ãŠçããäœããŸãããããæšè«ãšåŒã¶ããšã¯ãåã«æããåå°äœã®èšäºã§æ±ããŸããã
æšè«ã®ãšãã« LLM ãåç §ã§ããæç« ã®ç¯å²ããã³ã³ããã¹ããŠã£ã³ããŠãšãããŸããAnthropic ã®çšèªéã«ãããšãã³ã³ããã¹ããŠã£ã³ããŠã¯ãèšèªã¢ãã«ãæ°ããæç« ãäœããšãã«æ¯ãè¿ã£ãŠåç §ã§ããæç« ã®éã§ãåŠç¿ã«äœ¿ã£ã倧éã®ããŒã¿ãšã¯å¥ã®ãã¢ãã«ã«ãšã£ãŠã®ãäœæ¥çšã®èšæ¶ãã«åœãããŸã3ã
äŒè©±ã®å±¥æŽããæ¯åãŸãšããŠæž¡ããŠãã
ãã£ããã§åã®ããåããèŠããŠããããã«èŠããã®ã¯ããããŸã§ã®äŒè©±ãã³ã³ããã¹ããŠã£ã³ããŠã®äžã«ç©ã¿éãªã£ãŠããããã§ããAnthropic ã®è³æã«ãããšãå ¥åã«ã¯ããããŸã§ã®äŒè©±ã®å±¥æŽãã¹ãŠãšãä»åã®è³ªåãå«ãŸããŸã8ãäœãããçãããæ¬¡ã®ããåãã®å ¥åã®äžéšã«ãªããŸã8ã
ã€ãŸããäŒè©±ã®å 容ã¯ããã©ã¡ãŒã¿ãŒã«æžã蟌ãŸããŠèŠããããã®ã§ã¯ãªããããåãã®ãã³ã«ãå±¥æŽãšã㊠LLM ã«æž¡ãããŠããŸãã

LLM ã§ã§ããããš
Anthropic ã®çšèªéã¯ãLLM ãã§ããããšãšããŠãäººãæžãããããªæç« ãäœãããšã質åã«çããããšãæ å ±ãèŠçŽããããšãªã©ãæããŠããŸã3ãçæAIã®å®çŸ©ã«ãããšãããããã°ã©ã ãäœãããšãå«ãŸããŸãã
æç« ã®äžæžãïŒã¡ãŒã«ãæ¡å æãèšäºã®æ§ææ¡ãªã©
èŠçŽïŒé·ãææžã®èŠç¹ããŸãšãã
ç¿»èš³ïŒæ¥æ¬èªãšè±èªãªã©ãèšèªã®éã§èš³ã
質åãžã®åçïŒçšèªã®æå³ããæé ã®èª¬æãçãã
ããã°ã©ã ïŒã³ãŒãã®äŸãæžããã³ãŒãã®æå³ã説æãã
ãµãŒãã¹ãã¢ããªãã LLM ãåŒã³åºããšãã¯ãAPI ãšåŒã°ããçªå£ã䜿ããŸããAPI ã®ä»çµã¿ã¯ã以åã®èšäºã§æ±ããŸããã

LLM ã®éç
ãã«ã·ããŒã·ã§ã³ïŒãã£ãšãããã誀ã
ç·åçã®ä»€åïŒå¹Žçæ å ±éä¿¡çœæžã«ãããšãçæAIã¯ãäºå®ã«åºã¥ããªã誀ã£ãæ å ±ãããã£ãšããããçæããããšããããŸããããããã«ã·ããŒã·ã§ã³ïŒå¹»èŠïŒãšåŒã³ãŸã9ãAnthropic ã®è³æããæãé²ãã èšèªã¢ãã«ã§ããäºå®ãšç°ãªãæç« ããäžããããæèãšé£ãéãæç« ãäœãããšããããšè¿°ã¹ãŠããŸã10ã
LLM ã¯ã次ã«ç¶ãèšèã確çããéžãã§æç« ãäœããŸããæç« ãšããŠèªç¶ã§ããããšãšãå 容ãäºå®ãšããŠæ£ããããšã¯ãå¥ã®ããšã§ãã
ç¥èã«ã¯ãæéããã
LLM ã®ç¥èã¯ãåŠç¿ã«äœ¿ã£ãæç« ã«ããšã¥ããŸããAnthropic ã®ã¢ãã«ã®äžèЧã«ã¯ãã¢ãã«ããšã«ãReliable knowledge cutoffãïŒä¿¡é Œã§ããç¥èã®æéïŒã®æ¬ããããŸã11ããã®ææããåŸã®åºæ¥äºã¯ãæ€çŽ¢ãªã©ã§æ°ããæ å ±ãæž¡ããªãéããæ£ããçããããªãå ŽåããããŸãã
äžåºŠã«æ±ããéã«ãäžéããã
ã³ã³ããã¹ããŠã£ã³ããŠã«ã¯ãäžéããããŸããAnthropic ã®çšèªéã«ãããšãã³ã³ããã¹ããŠã£ã³ããŠã倧ããã»ã©ãé·ãè€éãªå ¥åãæ±ããŸããå°ãããšãé·ãå ¥åãæ±ãåããé·ãäŒè©±ã®äžè²«æ§ãä¿ã€åãéãããå ŽåããããŸã3ã
åã質åã§ããçããå€ãã
åã質åãäœåºŠãéããšãçãã®èšãåããäžèº«ãå€ããããšããããŸããAnthropic ã®çšèªéã«ãããšãtemperature ã¯ãæç« ãäœããšãã®äºæž¬ã®ã°ãã€ãã調æŽããèšå®å€ã§ã3ãåãçšèªéã¯ãtemperature ãïŒã«ããŠãçµæã¯å®å šã«ã¯äžå®ã«ãªãããåãå ¥åããéãåºåãè¿ãå Žåããããšãè¿°ã¹ãŠããŸã3ã

䜿ããšãã«æ°ãã€ãããããš
什åïŒå¹Žçæ å ±éä¿¡çœæžã¯ããã«ã·ããŒã·ã§ã³ã«ã€ããŠãæè¡çãªå¯Ÿçãæ€èšãããŠãããã®ã®ãå®å šã«æãããããã®ã§ã¯ãªããšããŠããŸã9ããã®ããã§ããã«ã·ããŒã·ã§ã³ãèµ·ããå¯èœæ§ã念é ã«çœ®ããæ€çŽ¢ã䜵çšãããªã©ã®å¯Ÿå¿ãšãåºåãããçããæ£ãããã©ãããå©çšè ã確èªããããšãæãŸãããšè¿°ã¹ãŠããŸã9ã
Anthropic ã®è³æã¯ããã«ã·ããŒã·ã§ã³ãæžããåºæ¬ã®æ¹æ³ãšããŠã次ã®ïŒã€ãæããŠããŸã10ã
ãåãããªãããšçããŠãããšäŒããïŒäžç¢ºããªãšãã¯ãããèªããŠãããšã¯ã£ããäŒãã
è³æã®æããã®ãŸãŸåŒçšãããïŒé·ãææžãæ±ããšãã¯ããŸãäžåäžå¥ã®åŒçšãåãåºãããŠãããäœæ¥ããã
åºå žã§ç¢ºãããïŒäž»åŒµããšã«åŒçšãšåºå žã瀺ãããçããæ€èšŒã§ãã圢ã«ãã
ã©ã®æ¹æ³ã§ããæåŸã«çãã確èªããã®ã¯äœ¿ã人ã§ããNDã·ã¹ãã ãºã§ããAI ã䜿ã£ãã·ã¹ãã ã®éçºã§ã人ã確èªããæé ãçµã¿èŸŒãã§ããŸãããã®ä»çµã¿ã¯ã以åã®èšäºã§ç޹ä»ããŸããã

LLM ã®æ©ã¿
ïŒïŒïŒïŒå¹ŽïŒè«æãAttention Is All You Needãã§ãTransformer ãææ¡ããã6
ïŒïŒïŒïŒå¹ŽïŒæïŒOpenAI ããïŒïŒïŒïŒåã®ãã©ã¡ãŒã¿ãŒã® GPT-3 ãå ¬è¡šãã4
ïŒïŒïŒïŒå¹ŽïŒæïŒäººã®è©äŸ¡ã§èª¿æŽãã InstructGPT ã®è«æãçºè¡šããã7
ïŒïŒïŒïŒå¹ŽïŒïŒæïŒOpenAI ãã察話åAIãChatGPTããå ¬è¡šãã4
ïŒïŒïŒïŒå¹ŽïŒæïŒOpenAI ããGPT-4ããå ¬è¡šãã4

ãŸãšã
LLM ã¯ãæç« ãæ±ãçæAIã®åå°ããã£ããã®ãµãŒãã¹ã¯ãLLM ã調æŽããŠäœãããŠãã
LLM ã¯ã次ã«ç¶ãèšèïŒããŒã¯ã³ïŒã®ç¢ºçãäºæž¬ããïŒã€ãã€ä»ãè¶³ããŠæç« ãäœã
ãå€§èŠæš¡ãã¯ããã©ã¡ãŒã¿ãŒã®æ°ãšãåŠç¿ã«äœ¿ãæç« ã®éã®å€§ãããæããGPT-3 ã¯ïŒïŒïŒïŒå
ä»çµã¿ã®äžå¿ã¯ãïŒïŒïŒïŒå¹Žã«ææ¡ããã Transformer ãšãèšèã©ããã®é¢ä¿ãéã¿ä»ãããæ³šæã®ä»çµã¿
åŠç¿ã¯ãäºååŠç¿ã»ãã¡ã€ã³ãã¥ãŒãã³ã°ã»RLHF ã®ïŒæ®µéã§èª¬æããã
ãã«ã·ããŒã·ã§ã³ãç¥èã®æéããããããåºå žã§ç¢ºãããæåŸã¯äººã確èªãã

LLM ã®ä»çµã¿ãç¥ã£ãŠãããšãçããèªç¶ãªæç« ã§ããããšãšãå å®¹ãæ£ããããšãåããŠèããããããã«ãªããŸããç»åãäœãçæAIã®ä»çµã¿ã¯ãä»åŸã®èšäºã§åãäžããäºå®ã§ãã
å 責äºé
ãã®èšäºã¯ãçè ãå人ãšããŠèª¿ã¹ãããšãããšã«ãå·çæç¹ïŒïŒïŒïŒïŒå¹ŽïŒïŒæïŒã®å 容ããŸãšãããã®ã§ããåããããããåªå ãã现ããæ¡ä»¶ãäŸå€ãçããŠããå ŽåããããŸããå³ã®äžã®ç¢ºçããããŒã¯ã³ã®åºåãæ¹ãæ³šæã®éã¿ã¯ã説æã®ããã®äŸã§ãã
LLM ã®ä»çµã¿ãæ©èœãåãµãŒãã¹ã®ä»æ§ã¯ãã¢ãã«ãããŒãžã§ã³ã«ãã£ãŠç°ãªããå€ããããšããããŸããå®éã«å©çšãããšãã¯ãåãµãŒãã¹ã®å ¬åŒã®è³æã§ææ°ã®å 容ã確èªããŠãã ããããã®èšäºã®å 容ãå©çšããŠçããæå®³ã«ã€ããŠã¯ã責任ãè² ããããŸãã
NDã·ã¹ãã ãºã«ã€ããŠ
NDã·ã¹ãã ãºã¯ãçŠå²¡çä¹ çç±³åžãæ ç¹ã«ãããŒã ããŒãžã®å¶äœãæ¥åã«åãããäºåã®ã·ã¹ãã ã®éçºãAIã»DXæ¯æŽãè¡ã£ãŠããŸãããŸãã¯ãæ°è»œã«ç¡æçžè«ã§ãçžè«ãã ããã
åèæç®
ç·åçã什å5å¹Žç æ å ±éä¿¡çœæžãçæAIãå·¡ãåå
Brown ã»ããLanguage Models are Few-Shot LearnersãïŒ2020幎ãarXivãè±èªïŒ
Vaswani ã»ããAttention Is All You NeedãïŒ2017幎ãarXivãè±èªïŒ
ç·åçã什å6å¹Žç æ å ±éä¿¡çœæžãçæAIãæ±ãã課é¡
AnthropicãReduce hallucinationsãïŒClaude Docsãè±èªïŒ
- #AI
- #çæAI
- #ChatGPT
- #AI掻çš
- #Claude
- #DX
- #ãã¯ãããžãŒ
- #人工ç¥èœ
- #ã¢ãã«
- #åŠã³çŽã
- #LLM
- #æ©æ¢°åŠç¿
- #Anthropic
- #çæAI掻çš
- #ãã£ãŒãã©ãŒãã³ã°
- #ããŒã¯ã³
- #GPT
- #ãã«ã·ããŒã·ã§ã³
- #å€§èŠæš¡èšèªã¢ãã«
- #深局åŠç¿
- #èªç¶èšèªåŠç
- #ãã©ã³ã¹ãã©ãŒããŒ
- #transformer
- #ãã¡ã€ã³ãã¥ãŒãã³ã°
- #äºååŠç¿
- #AIã®ä»çµã¿
- #ãã©ã¡ãŒã¿ãŒ
- #ã³ã³ããã¹ããŠã£ã³ããŠ
- #RLHF
- #NDã·ã¹ãã ãº
- #ITã®åºæ¬
- #ä»çµã¿ãå³è§£