
ãäœã£ãŠãããå€§èŠæš¡èšèªã¢ãã«ã®ä»çµã¿ããæžããŸãã
ãªãã§æžããã®ïŒ
ChatGPTãClaudeãGeminiãã¯ãããšããLLMïŒå€§èŠæš¡èšèªã¢ãã«ïŒããã¯ãæ¯æ¥äœ¿ã£ãŠããšãã人ãå€ããšæããŸããèªåããã®äžäººã§ãã
ãã ããäžã§äœãèµ·ããŠãã®ïŒããšèããããšãã¡ãããšçããããäººã¯æå€ãšå°ãªãããããªãã§ããããããTransformerã®ã¢ãã³ã·ã§ã³ããããšããRLHFã§ã¢ã©ã€ã³ã¡ã³ãããããšããåèªã¯èããããšãããã©èª¬æã§ããããšèšããããšæªããââãããªæèŠããããŸããã
ã§ãåãããã«æããŠãã人ã¯çµæ§ããã ãããªãšãæ®æ®µäœ¿ã£ãŠããLLMããçè«ãšå®è£
ã®äž¡é¢ããã¡ãããšçè§£ããããããããå±€ã«åããæ¬ãäœããããŠããã®æ¬ãæžããŸããã

ã©ããªæ¬ïŒ
äžèšã§èšããšãLLMããŒãããèªåã®æã§äœããªããä»çµã¿ãçè§£ããæ¬ã§ããPythonã®åºç€ãããã£ãŠããã°èªã¿é²ããããå
容ã«ãªã£ãŠããŸãã
å
š6ç« ã§ããããªæµãã«ãªã£ãŠããŸãã
第1ç« LLMã®æŽå²ãšå šäœå
第2ç« TransformerïŒLLMã®åºç€ãšãªãã¢ãã«æ§é ïŒãã¹ã¯ã©ããã§å®è£
第3ç« GPTã¢ãã«ã®æ§ç¯ãšåŠç¿
第4ç« å€§èŠæš¡ãªäºååŠç¿ïŒè€æ°GPUã§ã®åæ£åŠç¿ïŒ
第5ç« ã¢ã©ã€ã³ã¡ã³ãïŒã¢ãã«ã®åºåã人éã®æå³ã«æ²¿ããã調æŽïŒ
第6ç« æšè«ã¢ãã«
ãã€ã³ãã¯ãçè«âå®è£
âã¹ã±ãŒãªã³ã°ãšããæµãã§æ®µéçã«ã¹ãããã¢ããããŠãããšããã§ãã
第2ç« ã§ã¢ãã³ã·ã§ã³ïŒå
¥åã®ã©ãã«æ³šç®ãã¹ãããåŠç¿ããä»çµã¿ïŒãTransformerã1ããå®è£
ããŠããªãã»ã©ãããåãã®ãããäœæããŠãããã第3ç« ã§ãããGPTãšããŠçµã¿äžããŠå®éã«ããã¹ãçæãããã第4ç« ã§ã¯åæ£åŠç¿ãLoRAïŒå°ãªããã©ã¡ãŒã¿ã§å¹ççã«ã¢ãã«ã調æŽããææ³ïŒãšãã£ãå€§èŠæš¡åŠç¿ã®å®è·µãã¯ããã¯ã«èžã¿èŸŒã¿ã第5ç« ã§ã¢ã©ã€ã³ã¡ã³ããŸã§ã«ããŒããŠããŸãã
ãã ãã£ããšãã
åãã³ãŒãããã¹ãŠ
Jupyter NotebookããŒã¹ã§ãGoogle Colabã§åãããã«ããŠããŸãã
çè«ã®è§£èª¬ã ãèªãã§ãæ£çŽãã³ãšããªãããšã£ãŠå€ãã®ã§ãããšããããåãããŠãçµæãèŠãŠãã³ãŒããèªãã§çè§£ããããšãããµã€ã¯ã«ã倧äºã«ããŸããã
æ¥æ¬èªã³ãŒãã¹ã§åŠç¿ãã
åŠç¿ããŒã¿ã«ã¯å€ç®æŒ±ç³ã®äœåïŒé空æåº«ïŒã䜿ã£ãŠããŸãã
è±èªã®ããŒã¿ã»ããã§åŠç¿ããã®ãäžè¬çã§ãããèªåãèªããããã¹ããçæãããã»ãããã¢ãã«ã®æåãçŽæçã«ããããã§ãããã
ãããæŒ±ç³ã£ãœãæç« ãåºãŠããããšããã®ã¯ãè±èªããããã£ãŒãããã¯ãšããŠåŒ·ãã§ãã
Transformerããå§ããŠãã¢ã©ã€ã³ã¡ã³ããŸã§äžåã§
æ¢åã®LLMæ¬ã¯ãTransformerã®è§£èª¬ã§çµããããHugging Faceã®äœ¿ãæ¹ã«å¯ã£ãŠãããã®ãå€ãå°è±¡ã§ãã
ãã®æ¬ã§ã¯ãTransformerã®å
éšå®è£
ããå§ããŠã忣åŠç¿ãLoRAãDPOïŒäººéã®å¥œã¿ã«åãããã¢ãã«ãçŽæ¥æé©åããææ³ïŒãŸã§äžåã§éããŠæ±ã£ãŠããŸãã
ãLLMãã©ãäœãããã©ã調æŽãããããã®å
šäœåãæŽããããã«ãããã£ãããã§ãã
å®åã§äœ¿ãããæè¡ã¹ã¿ãã¯
PyTorchã ãã§ãªããDeepSpeedã»Accelerateã»PEFTãªã©ãå®éã®å€§èŠæš¡åŠç¿ã§äœ¿ãããããŒã«ããã£ããç»å ŽããŸãã
æç§æžçãªç¥èã ãã§ãªããçŸå Žã«æã¡åž°ããå®è·µåãæèããŸããã
èªãã åŸã«ãããªã£ãŠããŠã»ãã
LLMã®è«æãèªãã§ããããã®éšåã®è©±ã ãªããšãã³ãšãã
èªåã§ã¢ãã«ãåŠç¿ã»ãã¡ã€ã³ãã¥ãŒãã³ã°ïŒè¿œå åŠç¿ïŒã§ããããã«ãªã
LLMã䜿ãã ãã§ãªããäžèº«ãçè§£ããäžã§æŽ»çšã§ããããã«ãªã
ããã©ãã¯ããã¯ã¹ã®ãŸãŸäœ¿ãããããä»çµã¿ãããã£ãäžã§äœ¿ãããžã®ã¹ãããã¢ãããããã®æ¬ã§æå©ãã§ãããå¬ããã§ãã
ãäœã£ãŠãããå€§èŠæš¡èšèªã¢ãã«ã®ä»çµã¿ãã¯æ¥çµBPããçºå£²äžã§ãããµããŒããªããžããªã¯ãã¡ãã
ð GitHub: book-llm-from-scratch