
ãAIã®ãã©ã¡ãŒã¿ãåã¿ç ããŠèª¬æãããšãããã€ãŸã¿ãåãã€ãŸã¿ãæ¢ã
ã¯ããã«

ããšããAIã·ãªãŒãºã®ç¶ç·š9ããã€ããŒãã©ã¡ãŒã¿ç·šãã§ãã
ãã®ç©èªã¯ãã£ã¯ã·ã§ã³ã§ç»å Žäººç©ã¯æ¶ç©ºã§ããæè¡ã®èª¬æã¯ãå
¬éãããè«æãè³æã«åºã¥ããŠããŸãã
åäœã§AIã®äžã«ã¯äœåååãã®ã€ãŸã¿ããããåŠç¿ã§ãããåããŠãããšåãããŸãããã§ã¯ããã®åãæ¹ã¯èª°ã決ããŠããã®ããä»åã¯ãããæããŸãã人ãåãã£ãŠæ±ºããŠããèšå®ãããã€ããŒãã©ã¡ãŒã¿ãšåŒã³ãŸãã
話ã¯1958幎ã®ããŒã»ãããã³ããå§ãŸãã誀差éäŒææ³ãéã£ãŠãåŠç¿çãããããµã€ãºããããŠãã£ãããããã®temperatureãŸã§é²ã¿ãŸããæ°åŒã¯ã»ãšãã©åºãŠããŸããã

ç»å Žäººç©ã§ããããšããã¯å
ã¡ã€ã³ãã¬ãŒã ã®SEãJCLãšããã倧忩ã«ä»äºãæç€ºããèšèã®ãã©ã¡ãŒã¿ãªãç®ãã€ã¶ã£ãŠãæžããŸãã
å«ã®ãã«ãã¯ç 究宀ã§å°ããªã¢ãã«ãåŠç¿ãããŠããŠãåŠç¿çã®èšå®ã«æ¯é±æ³£ããããŠããŸãã
ãããããã¯åã
äœã«ãåºãŠãã瀟å
ãã£ãããããã®æ
åœè
ã§ããèšå®ç»é¢ã«äžŠã¶æ°åã®æ±ºãæ¹ãåããããããšããã«çžè«ã«æ¥ãŸããã
çžæ£ã¯ä»åãéããããåŽãšããŠç»å ŽããŸããèªåãã©ããªèšå®ã§éãããããã¯ãããèŠããŠããªãããã§ããJevã¯ä»åãããšããã®ç解床ãå€å®ããŸãã
ããããŒã°

ç©èªã¯ææã®å€æ¹ãããããããã瀟å
ãã£ãããããã®èšå®ç»é¢ãæã£ãŠããšããã蚪ããŠããŸãããtemperatureãtop_pãmax_tokensãåæå€ã®ãŸãŸåãããŠãããã瀟å¡ãããçããæ¯åã¡ããããšèšãããããã§ãã
èª¬ææžã«ã¯ããã€ããŒãã©ã¡ãŒã¿ããšãããŸããããšããã®é ã«æµ®ããã ã®ã¯ã1983幎ã«ã³ãããåºããã¢ãŒã±ãŒãã²ãŒã ããã€ããŒãªãªã³ããã¯ã§ããããã¿ã³ã飿ããŠèµ°ããã®ã²ãŒã ã§ãã
ãã«ãã«ãããšãAIã®ãã€ããŒãã©ã¡ãŒã¿ã¯ã人ãåãã£ãŠæ±ºããŠããèšå®ã®ããšããã€ããŒãšä»ããªãããã ã®ãã©ã¡ãŒã¿ããã£ãŠã話ã¯ãã¡ãããå§ãŸããŸããèå°ã¯1958幎ãŸã§ããã®ãŒããŸãã
Jevã®å€å®ã¯0.04ãåäœããäœããšããããã®ã¹ã¿ãŒãã§ãã
1. ã€ãŸã¿ãšãã€ãŸã¿ã®åãæ¹

第1ç« ãAIã®äžã«ã¯ãåäœã§èŠãéããäœååãäœååãšããã€ãŸã¿ããããŸããããããã©ã¡ãŒã¿ã§ãéã¿ãšãåŒã³ãŸããèšèã®çªå°ã®æ°åããQã»Kã»Vã®å€æããç¥èã®åŒãåºãã®äžèº«ããå
šéšãã®ã€ãŸã¿ã§ããã€ãŸã¿ãåãã®ã¯äººéã§ã¯ãããŸãããAIãåŠç¿ã®äžã§å°ããã€èªåã§çŽããŠãããŸãã
äžæ¹ããã€ããŒãã©ã¡ãŒã¿ã¯ããã®ã€ãŸã¿ã®åãæ¹ãæ±ºããèšå®ã§ããäžåã«ã©ãã ãåãããäœä»¶ãŸãšããŠçŽãããã€ãŸã¿ãäœæ®µã«äžŠã¹ããããã¡ãã¯äººããåŠç¿ãå§ããåã«æ±ºããŠãããŸããäž»ãªãã®ã¯æ°åããæ°ååã§ãã
ããšããã®ããšãã¯å·¥å Žã§ãã補åã®å¯žæ³ãåãããèªåè£æ£ããã©ã¡ãŒã¿ãéãé床ãå転æ°ã決ããè·äººã®æ®µåãããã€ããŒãã©ã¡ãŒã¿ããã€ããŒã¯è±èªã§ãäžæ®µäžã®ããããã®æå³ã§ãã
ã²ãšèšã§ããã°ããã©ã¡ãŒã¿ã¯ãAIãåŠç¿ã§æ±ºããäžèº«ã®æ°å€ãããã€ããŒãã©ã¡ãŒã¿ã¯ããã®åŠç¿ã®ããæ¹ãšåšã®å€§ããããäººãæ±ºããæ°å€ãã§ãã
2. 圹å¡äŒã®éã¿ã€ã倿°æ±º

第2ç« ã
AIã®ã€ãŸã¿ã®è©±ã¯ã1958幎ã®ããŒã»ãããã³ããå§ãŸããŸããã¢ã¡ãªã«ã®å¿çåŠè
ãã©ã³ã¯ã»ããŒãŒã³ãã©ãããçºè¡šãããè³ã®ç¥çµçްèããŸããä»çµã¿ã§ãã20ããã20ã400åã®å
ã»ã³ãµãŒãã€ãªãã§ãå³åœ¢ãèŠåããæ©æ¢°ãäœãããŸããã
ä»çµã¿ã¯åœ¹å¡äŒã®æ¡æ±ºã«äŒŒãŠããŸããå¶æ¥éšé·ãçµçéšé·ãå·¥å Žé·ãããããè³æãå察ããåºããããã«çºèšåãã€ãŸãéã¿ãæããŠè¶³ããŸããåèšãåºæºç¹ããããå€ãè¶
ãããæ¿èªãè¶
ããªããã°åŠæ±ºãã¹ã©ã€ãã®äŸã§ã¯1.1ã§ã1.0ãè¶
ããã®ã§æ¿èªã§ããæ°å€ã¯èª¬æçšã®äŸã§ãã
ãã®éã¿ãšãããå€ãããã©ã¡ãŒã¿ã§ããä»ã®AIã§ã¯ããããå€ã§ããã³ãšåãæ¿ãã代ããã«ãé£ç¶çã«å€ãã颿°ã䜿ããŸããæŽ»æ§å颿°ãšåŒã³ãããããŠãããšãããšã®ç« ã§åºãŠãã埮åãèšç®ã§ããŸãããã ãæããŠè¶³ããšãã骚çµã¿ã¯åãã§ããçžæ£ã®äžã«ãããã®æãç®ãšè¶³ãç®ãæ°ããããªãã»ã©å
¥ã£ãŠããŸãã
3. çæ¹ã ãã®è³æã®è°é¡

第3ç« ã
ããŒã»ãããã³ã¯ãäŸé¡ãè§£ããªããèªåã§éã¿ãçŽããŠãããŸããçããåºããæ£è§£ãšæ¯ã¹ãå€ããŠãããæ£è§£ã«è¿ã¥ãåãã«éã¿ãå°ãåããããã®ãå°ãããã©ãããããã¯ãäººãæ±ºããŠãããŸãããããåŠç¿çã§æ©ãããã€ããŒãã©ã¡ãŒã¿ãé¡ãåºããŸããã
ãšãããããŒã»ãããã³ã«ã¯è§£ããªãåé¡ããããŸããããå¶æ¥éšé·ãšçµçéšé·ã®ã©ã¡ããäžäººã ããè³æãªãæ¿èªãäºäººãšãè³æãäºäººãšãå察ãªãåŠæ±ºããšããæ±ºãæ¹ã§ããè«çæŒç®ã§ããæä»çè«çåãXORã§ããäžåã®éã¿ã€ã倿°æ±ºã§ã¯ãã©ãéã¿ãä»ããŠãããã¯äœããŸããã
1969幎ãããŒãã³ã»ãã³ã¹ããŒãšã·ãŒã¢ã¢ã»ãããŒãããããŒã»ãããã³ããšããæ¬ã§ãã®éçã瀺ããŸãããããããã¥ãŒã©ã«ãããã®ç ç©¶ãäžç«ã«ãªãäžå ã«ãªã£ãããšèšãããŠããŸãã
ããšããã®çãã¯ãæ ¹åãã®äŒè°ãäžæ®µã¯ããã°ãããããã®éãã§ã段ãéããã°è§£ããŸãããã ãæ®µãéãããšä»åºŠã¯ã©ã®éã¿ãã©ãçŽãã°ããã®ããåãããªããªããŸããã
4. ã©ã®å·¥çšãæªãã®ã

第4ç« ã
段ãéãããããã¯ãŒã¯ã§ã¯ãå
¥åãã1段ç®ã2段ç®ãšèšç®ãé²ã¿ãæåŸã«åºå£ã§çããåºãŸããçããå€ãããšãå°ã£ãããšãèµ·ããŸããéäžã®ã©ã®ç·ã®éã¿ãã©ãã ãçŽãã°ããã®ããåãããªãã®ã§ããå®éã®AIã§ã¯ããã®ç·ãäœå忬ããããŸãã
ããšããã®ããšãã¯å·¥å Žã®äžè¯åã§ããåºè·æ€æ»ã§äžè¯ãèŠã€ãã£ãããã©å·¥çšã¯äœåããããã©ãã®æ©æ¢°ã®èª¿æŽãã©ããããæªãã£ãã®ããããšããã®èšãéãå
šå·¥çšã®æ©æ¢°ãåœãŠãã£ãœãã«äžæã«ããã£ãããããã£ãŠæªããªããŸãã
ãã®åé¡ãè§£ããã®ããæ¬¡ã®ç« ã®èª€å·®éäŒææ³ã§ãã
5. ã¯ã¬ãŒã ãäžæµãžããã®ãŒã

第5ç« ã
誀差éäŒææ³ã¯ãè±èªã§ããã¯ãããã²ãŒã·ã§ã³ãåºå£ã§æž¬ã£ã誀差ããåºçºããŠãäžæ®µãã€éåãã«ãããããã®éã¿ã誀差ã«ã©ãã ãå¹ããããèšç®ããŠããæ¹æ³ã§ãã
ãã®ãã©ãã ãå¹ãããããåŸé
ãšåŒã³ãŸããåŸé
ã®æ£äœã¯ãæ°åŠã®åŸ®åã§ãã誀差ããã®éã¿ã§åŸ®åããå€ã§ãéã¿ãã»ãã®å°ãåããããšãã誀差ãã©ãã ãå¢ãããæžããã衚ããŸãã
ããšããã®ããšãã§ã¯ãå質ã¯ã¬ãŒã ãäžæµãžããã®ãŒãäœæ¥ã§ããåºè·æ€æ»ã§èŠã€ãã£ãããã«ã€ããŠãçµç«å·¥çšã¯ã©ãã ã責任ããããããã®åã®å 工工çšã¯ãææã¯ããšé ã«ãã©ããŸããåã®å·¥çšã®è²¬ä»»ã¯ãåŸãã®å·¥çšã®è²¬ä»»ã«å·¥çšã©ããã®ã€ãªããã®åŒ·ããæããŠæ±ããŸããæ°åŠã§ã¯é£éåŸãšåŒã¶åæé¢æ°ã®åŸ®åã®èŠåã§ã埮åã®æãç®ã®ãªã¬ãŒã§ãã
æ£ç¢ºã«ã¯ãããããã®æ®µã®é¢æ°ã®åŸãïŒæŽ»æ§å颿°ã®åŸ®åïŒãäžç·ã«æããŸãããèãæ¹ã¯åãã§ãã
ããšããã¯ãå
šå·¥çšã§äžæã«ãå²åä»ãã§ãããªããªãåæããšåŒã³ãŸããã
ãã®æ¹æ³ã¯1986幎ãããããã»ã©ã¡ã«ããŒãããžã§ããªãŒã»ãã³ãã³ãããã«ãã»ãŠã£ãªã¢ã ãºãNatureã«èŒããè«æã§åºãç¥ãããããã«ãªããŸãããèãæ¹èªäœã¯1970幎代ãããããŸããããã³ãã³ã¯2024幎ã«ããžã§ã³ã»ããããã£ãŒã«ããšãšãã«ããŒãã«ç©çåŠè³ãåããŠããŸãã
6. é§ã®å±±ãææ¢ãã§äžã

第6ç« ã
ãããŸã§ã®è©±ãã€ãªããšãAIã®åŠç¿ã®1ååã«ãªããŸãããŸãå
¥åããåºå£ãŸã§èšç®ããŠçããåºãããããé äŒæã§ããæ¬¡ã«æ£è§£ãšã®ãããæž¬ãããã®ãããæå€±ãšåŒã³ãŸãããããŠèª€å·®éäŒææ³ã§ãããããã®éã¿ã®è²¬ä»»ãåŸé
ãåºããåŸé
ã¯èª€å·®ãéã¿ã§åŸ®åããå€ã§ãå±±ã§ããã°è¶³å
ã®åŸãã§ããæåŸã«ã責任ã®åã ãéã¿ãå°ãåããã倧ããªã¢ãã«ã§ã¯ããããæ°äžåããæ°åäžåããè¿ããŸãã
ãã®æ¹æ³ãåŸé
éäžæ³ãšåŒã³ãŸããããšããã®ããšãã¯é§ã®äžã®äžå±±ã§ããæå€±ãæšé«ã§äœãã»ã©è¯ããé§ã§å
ã¯èŠãããåããã®ã¯è¶³å
ã®åŸãã ããã ããäžãåã®åãã«äžæ©ãã€é²ã¿ãŸãã
ãã®äžæ©ã®å€§ãããåŠç¿çã§ããããã§äººéã®åºçªããã€ããŒãã©ã¡ãŒã¿ã®åºçªã«ãªããŸãã
ããšããã®çåãè¶³å
ããèŠããã«è°·åºãŸã§è¡ããã®ãããã«ãã®èšãéãããã¡ã°ãæ·±ãè°·ã«çãä¿èšŒã¯ãããŸãããã倧ããªãããã¯ãŒã¯ã§ã¯ååäœãæãŸã§è¡ããã°ãå®çšäžã¯å°ããªãããšãå€ãã®ã§ãã
7. æ©å¹ ãæ±ºããã®ã¯äººé

第7ç« ã
åŠç¿çãã€ãŸãäžæ©ã®å€§ããã¯ããã€ããŒãã©ã¡ãŒã¿ã®äžã§ããŸãæåã«æ©ãèšå®ã§ãã倧ãããããšãè°·ãé£ã³è¶ããŠè¡ã£ããæ¥ããããŸããã²ã©ããšãã¯èª€å·®ãäžæ°ã«è·³ãäžãããåŠç¿ãå£ããŠããŸããŸãããããçºæ£ãšåŒã³ãŸããå°ãããããšãªããªãäžãããããèšç®ä»£ã°ããããããŸããã¡ããã©ããå€ã¯ãã¢ãã«ãããŒã¿ã«ãã£ãŠéãã詊ããŠã¿ãªããšåãããŸããã
ããã«ãåŠç¿çã¯éäžã§å€ããã®ãæ®éã§ããæåã¯ããå°ããå§ããŠå°ããã€äžããã®ããŠã©ãŒã ã¢ãããçµç€ã«ãããŠå°ããããŠããã®ãæžè¡°ã§ãã
ããšããã®ããšãã§ã¯ãææ©é転ãããŠããèåããæåŸã«ä»äžãåããæç€ã®äœæ¥ãšåãæµãã§ãã
å®äŸãæãããšGPT-3ã®æå€§ã®ã¢ãã«ã§ã¯ãåŠç¿çã®æå€§å€ã0.00006ã§ãããæåã«ãŠã©ãŒã ã¢ãããããã®ããšäœåŒŠãã³ãµã€ã³ã®åœ¢ã§ãæå€§ã®10%ãŸã§äžããŠããŸãã
ãã«ãã¯å
é±ãåŠç¿çãäžæ¡ãŸã¡ãããŠãäžæ¥åã®èšç®ãçºæ£ãããããã§ãã
8. äœä»¶ãã€è«Šããã®ã

第8ç« ã
次ã¯ããããµã€ãºã§ããäŸé¡ã1ä»¶è§£ããã³ã«éã¿ãçŽãã®ã§ã¯ãªããäœä»¶ããŸãšããŠæ¡ç¹ããŠããã®å¹³åã®åãã«1åçŽããŸãããã®äœä»¶ãããããµã€ãºãšåŒã³ãŸãã
倧ãããšçŽãåããå®å®ããŸããã1åã®èšç®ã¯éããªããŸããå°ãããšåãã¯ã¶ããŸãããå°åããå©ããŸããGPT-3ã®æå€§ã®ã¢ãã«ã§ã¯ã1åããã320äžããŒã¯ã³åããŸãšããŠããŸãããæåã¯3.2äžããŒã¯ã³ããå§ããŠãéäžã§å¢ãããŠããŸãã
ããšããã®ããšãã¯ç· ãåŠçã§ããäŒç¥šã1æãã€çŽããã1æ¥åããŸãšããŠå€éãããã§ç· ããããæ¬æ¥ã ã£ãããšããã«ã¯ãããäŒãããŸããã
ããã²ãšã€ããšããã¯æ°ããããŸããåŠç¿ããŒã¿ãäœåšããããã§ããå°ããªã¢ãã«ã§ã¯ãåãããŒã¿ãäœååšããããããšããããŸãããã ãåãåé¡éãäœååšããããšãåé¡ã®é çªãŸã§èŠããŠããŸããŸãã倧ããªLLMã®äºååŠç¿ã§ã¯ãããŒã¿ãèšå€§ãªã®ã§å€§éšåã®ããŒã¿ã1åšååŸããåããªãããšãå€ãã§ãã
9. éå»åã®äžžæèšãé²ã

第9ç« ã
åŠç¿ãç¶ãããšç·Žç¿åé¡ã«ã¯æºç¹ãåãã®ã«ãåããŠèŠãåé¡ã«ã¯åŒ±ããªãããšããããŸããéåŠç¿ãšåŒã³ãŸããããšããã«èšãããã°ãéå»åãäžžæèšããæ°äººã§ãããããé²ãèšå®ããã€ããŒãã©ã¡ãŒã¿ã§ãã
ã²ãšã€ç®ã¯æ€èšŒããŒã¿ãåŠç¿ã«ã¯äœ¿ããªãããŒã¿ãåã£ãŠããããšãã©ãè
åãæž¬ããŸããæãæã¡ã®æš¡æ¬è©Šéšã§ãã
ãµãã€ç®ã¯æ©æçµäºãæ€èšŒããŒã¿ã®æçžŸãäžããå§ããããããã§åŠç¿ãæã¡åããŸãã
äžã€ç®ã¯éã¿æžè¡°ãè±èªã§ãŠã§ã€ããã£ã±ã€ãæ¯åãéã¿ãå°ããã€å°ããããæ¹åã«åŒã£ã±ã£ãŠã極端ãªçãã€ããããŸãããGPT-3ã§ã¯0.1ãšããå€ã䜿ããŸããã
åã€ç®ã¯ããããã¢ãŠããç·Žç¿ã®ãã³ã«ãã©ã³ãã ã«äžéšã®éšåãäŒãŸããŸãã誰ãäŒãã§ãä»äºãåãããã«éããããã§ãããã ããããŒã¿ãèšå€§ãªå€§ããªLLMã®äºååŠç¿ã§ã¯ãéåŠç¿ãèµ·ãã«ããã®ã§ã䜿ããªãããšãå€ãã§ãã
ãããããã®éšçœ²ã¯ãäžäººäŒããšæ¢ãŸãããã§ãã
10. ããã©ã³é転æãšãã¬ãŒã«ãŒ

第10ç« ã
éã¿ãã©ãçŽããã®æµåããªããã£ãã€ã¶ãšåŒã³ãŸãããã¡ã°ãçŽ æŽãªã®ã¯ã責任ã®åã ããã®ãŸãŸåããæ¹æ³ã§ãããä»ã®äž»æµã¯2014幎ã«çºè¡šãããAdamãšãã®ä»²éã§ãã
Adamã¯ãçŽåãŸã§ã®å¢ããèŠããŠãããŠãæ¥ãã³ãã«ãåããŸããããŸããéã¿ããšã«æ©å¹
ãèªåã§èª¿æŽããŸãã
ããšããã®ããšãã¯ããã©ã³é転æãéãå°ãæ²ãã£ããããã§ã¯ãã³ãã«ãæ¥ã«åãããã¬ããã¿ã§ã¯èªç¶ãšã¢ã¯ã»ã«ãç·©ããŸããéå»ã®åŸé
ã®åããã©ããããæãŸã§èŠããŠããããæ±ºããã®ãβ1ãåŸé
ã®å€§ããã®ã»ããæ±ºããã®ãβ2ãšãããã€ããŒãã©ã¡ãŒã¿ã§ããGPT-3ã§ã¯0.9ãš0.95ã§ããã
ããã²ãšã€ã¯åŸé
ã¯ãªããã³ã°ãäœãã®æåã«è²¬ä»»ã®å€ãã€ãŸãåŸé
ïŒèª€å·®ã®åŸ®åã®å€ïŒãæ¥ã«å€§ãããªãããšããããŸãããã®ãŸãŸéã¿ãåãããšããããŸã§ã®åŠç¿ãå°ç¡ãã«ãªããããŸãããããã§ãäžéãè¶
ããããåãã¯ãã®ãŸãŸã§å€§ããã ãäžéãŸã§çž®ããŸããGPT-3ã§ã¯äžéã1.0ã«ããŠããŸãããããšããã®ããšãã¯ãã¬ãŒã«ãŒã§ãã
倧ããªã¢ãã«ã®åŠç¿ã¯ãäœé±éãäœãæãšç¶ããŸããéäžã§æŽãããšå€§æãªã®ã§ãããããå®å
šè£
çœ®ãæ¬ ãããŸããã
11. 建ç©ã®éæ°ãšéšå±ã®åºã

第11ç« ã
ãã€ããŒãã©ã¡ãŒã¿ã«ã¯ãåŠã³æ¹ã®èšå®ã®ã»ãã«ã¢ãã«ã®åœ¢ã決ãããã®ããããŸããåäœã§èŠãéšåã®æ°ã倧ããã§ãã
å±€ã®æ°ã¯ãåäœã®çšè°æžã®ãã³ã³ã®æ®µæ°ãGPT-3ã§ã¯96段ã§ãããçªå°ã®æ¡ãã€ãŸãèšèãè¡šãæ°åã®åæ°ã¯12,288ããããæ°ãæ€æ»ä¿ã®äººæ°ã¯96人ãæèçªãæºã®åºãã¯2,048ããŒã¯ã³ãèªåœæ°ãæŽ»åæ£ã®å€§ããã¯çŽ5äžã§ãã
ãããã¯åŠç¿ãå§ããåã«æ±ºããéäžã§ã¯åºæ¬çã«å€ããŸãããããšããã®ããšãã§ã¯ã建ç©ã建ãŠãåã«éæ°ãšéšå±ã®åºããæ±ºããã®ãšåãã§ããããšããéãè¶³ãã®ã¯å€§å·¥äºã§ãã
åœ¢ãæ±ºãŸããšããã©ã¡ãŒã¿ã®æ°ãã»ãŒæ±ºãŸããŸããGPT-3ã®å Žåã倧ãã£ã±ã«12Ãå±€ã®æ°Ãå¹
ã®2ä¹ã§èšç®ãããšãããã1740åãå®éã®1750åãšã»ãŒåããŸãã
12. 詊äœã©ã€ã³ã§æ¡ä»¶åºã

第12ç« ã
ãã€ããŒãã©ã¡ãŒã¿ã®å€ã¯ãåºæ¬çã«è©ŠããŠæ±ºãããããããŸããã
ç¢ç€ã®ç®ã®ããã«çµã¿åãããå
šéšè©Šãã®ãã°ãªãããµãŒãã確å®ã§ãããèšå®ãå¢ãããšçµã¿åããã®æ°ãççºããŸããããåŒãã®ããã«å€ãéžãã§è©Šãã®ãã©ã³ãã ãµãŒãã§ã2012幎ã®ç ç©¶ã§ãæå€ãšå¹çãããããšã瀺ãããŸããããããŸã§ã®çµæããæ¬¡ã«è©Šãå€ãèŠåœãã€ããŠéžã¶ããã€ãºæé©åãšããæ¹æ³ããããŸãã
倧ããªLLMã§ã¯äºæ
ãéããŸããæå
端ã®ã¢ãã«ã ãšãæ¬çªã®åŠç¿1åã®èšç®ä»£ãäœåååã«ããªãããã§ãäœåºŠãããçŽããŸãããããã§ãå°ããªã¢ãã«ã§ãããã詊ããŠæ¡ä»¶ãåºããèŠæš¡ã倧ãããããšãã®å€ãèŠç©ãã£ãŠããæ¬çªã«å
¥ããŸããããšããã®ããšãã§ã¯ã詊äœã©ã€ã³ã§æ¡ä»¶ãåºããŠããéç£ã©ã€ã³ã«ç§»ããå·¥å Žã®ããæ¹ãã®ãã®ã§ãã
èŠç©ããã®äŸãšããŠæåãªã®ãã2022幎ã«DeepMindãçºè¡šããChinchillaã®ç ç©¶ã§ããèšç®éãæ±ºãŸã£ãŠãããªãããã©ã¡ãŒã¿1åãããçŽ20ããŒã¯ã³ã®ããŒã¿ã§åŠã°ããã®ãããããšããç®å®ã瀺ããŸããã700åãã©ã¡ãŒã¿ã®Chinchillaã1.4å
ããŒã¯ã³ã§åŠã°ãããšãããåãèšç®éã§4å倧ããGopherãäžåããŸããã
13. 䜿ã人ãåãã€ãŸã¿

第13ç« ã
æåŸã¯ããããããã®èšå®ç»é¢ã«æ»ããŸããããã«äžŠã¶ã®ã¯ãåŠç¿ãšã¯é¢ä¿ãªããAIãçãããšãã ãå¹ãèšå®ã§ãããµãŒãã¹ã«ãã£ãŠã¯ãçæãã©ã¡ãŒã¿ããµã³ããªã³ã°èšå®ãšåŒã³ãŸãã
temperatureã¯åäœã®æž©åºŠãéžã³æ¹ã®ã°ãã€ãã§ããtop_pã¯ã確çã®é«ãé ã«åè£ãè¶³ããŠãããåèšãpã«å±ãããšãããŸã§ã®åè£ããã ãéžã¶èšå®ã§ãã2019幎ã®ç ç©¶ã§ææ¡ãããæ¹æ³ãããšã«ãªã£ãŠããŸããtop_kã¯ãäžäœkåããã ãéžã¶èšå®ãmax_tokensã¯çãã®é·ãã®äžéãfrequency_penaltyã¯ãåãèšèã®ããè¿ããæžããèšå®ã§ããååãç¯å²ã¯ãµãŒãã¹ããšã«éããæšè«ã¢ãã«ãªã©ãäžéšã®èšå®ãå€ããããªãã¢ãã«ããããŸãã
ãããããã®çµè«ã¯ã瀟å
èŠçšã®è³ªåã«ã¯æž©åºŠãäœãããã£ããã³ããŒæ¡ã«ã¯é«ãã
ããšããã¯ãçšéã§æ®µåããå€ãããããã§ãããã
ãŸãšã

ãŸãšãã§ãã
ããšããã®æ®µåã衚ãèŠãŠãã ããã
æ©ãæ¹ã®èšå®ããåŠç¿çãšãŠã©ãŒã ã¢ãããšæžè¡°ãç· ãæ¹ã®èšå®ããããããµã€ãºãšãšããã¯æ°ãçæ¢ãããéã¿æžè¡°ãããããã¢ãŠããæ©æçµäºãå®å
šè£
眮ãããªããã£ãã€ã¶ãšåŸé
ã¯ãªããã³ã°ããããŸã§ã¯åŠç¿ã®åã«æ±ºããŸãã
圢ã®èšå®ãå±€ã®æ°ãå¹
ããããæ°ãæèçªã¯ãèšèšã®æ®µéã§æ±ºããŸãããããŠäœ¿ãæ¹ã®èšå®ãtemperatureãtop_pã¯ãçãããšãã«äœ¿ãäººãæ±ºããŸãã
ãã©ã¡ãŒã¿ã¯ãAIã誀差éäŒææ³ã§èªåã§çŽããŠããããã€ããŒãã©ã¡ãŒã¿ã¯ããã®çŽãæ¹ã人ãåãã£ãŠæ±ºããŠãããåäœã®é
ç·å³ãšåãããŠãããšããã®æå
ã«é
ç·å³ã𿮵åã衚ãããããŸããã
ãšãããŒã°

ãšãããŒã°ã
äžé±éåŸãããšããã¯çµè«ãåºããŸãããããã©ã¡ãŒã¿ã¯çŸå Žãèªåã§çŽãããã€ããŒãã©ã¡ãŒã¿ã¯ããã®æ®µåãã ãã
æåã®çŸå Žã®èšèã§ããã°ã段åãå
«åãä»äºäºåãæ®µåããæªããã°ãã©ããªå人ã§ãä»äžãããŸããã
ãããããã¯ããããã®æž©åºŠã0.2ã«äžããŸããã瀟å¡ããã¯ãçããèœã¡çããããšå¥œè©ã ããã§ãã
Jevã®å€å®ã¯0.86ãæ®ãã®0.14ã«ã€ããŠããã«ãã¯ãèªåã§åŠç¿çãäžåãŸã¡ãããªããšåãããªããšããããçµéšè
ã¯èªããã§ãã
ããšããã®èŠãæžãã¯ããã©ã¡ãŒã¿ã¯AIã責任ã®åã ãèªåã§çŽãããã€ããŒãã©ã¡ãŒã¿ã¯çŽãæ¹ãšåœ¢ã人ãåãã£ãŠæ±ºããããããŠãå°ãã詊ããŠæ¡ä»¶ãåºããŠããæ¬çªã«å
¥ããã®äžã€ã§ããã

æåŸã«ãããšããã®èšèã§ãããã€ãŸã¿ã¯æ©æ¢°ã«åããããåãæ¹ã¯äººã決ãããæ®µåãå
«åãä»äºäºåãã
ã©ã¹ãã«ãããããšããã®æ°äœã¯ãåŠç¿çãäžããŠé£ã³è¶ããè°·ã®åºããåŠç¿çãäžããããŠãè°·åºãé£ã³è¶ããŠããŸãæ§åãè© ãã å¥ã§ããçžæ£ã¯ãåå¥ã§ãïŒããããšããããæž©åºŠãäžããŠãããäžåèšã£ãŠã¿ãããšèšããšãçžæ£ã¯ãâŠâŠå¡äœã§ããã
ãããŸãã
ä»é²

