
TTFTã£ãŠäœïŒããå§ããå€éããã â ããŒã«ã«LLM宿ž¬ã®åæ¥ã«ãæé ãšçšèªãå ã«ãããã
ããã«ã¡ã¯ïŒYaroTechã§ãã
æšæ¥ã®èšäºã®æåŸã«ããææ¥ã¯ã¡ã€ã³PCã§å€éããããäžæ©ãŸãããŸãããšæžããŸãããå ã«æ£çŽãªãšãããæžããšã宿ž¬ã¯ææ¥ã«å»¶ã°ããŸãã仿¥ã¯ãŸãšãŸã£ãå®è¡æéãåããŸããã§ããã
ãã ã宿ž¬ã®åã«ããããšãå±±ã»ã©ãããšåãã£ãã®ã§ã仿¥ã¯ãã®æºåã§æããå°å³ãšãéäžã«åºãŠããèšèãå ã«ããããåã«ããŸããææ¥ã®èšäºããæ°åã ã远ãã°èªããç¶æ ã«ããŠããããã®äžããããã§ãã
â»èŠåºãç»åã®ããã³ããã¯äžçªäžã«ããŸãã§å ¬éäžïŒ
ð¥ïž å®è¡ç°å¢
宿ž¬ããæ©æ¢°: ãã¹ã¯ãããPCïŒWindows 11 Pro / Core i9-12900T / RAM 128GB / RTX 3050ïŒ
ãããŸã§ã®èšæž¬æ©: ThinkPad X1 CarbonïŒWindows 11 Home / Core Ultra 7 258V / RAM 32GBïŒ
ã¢ãã«: Qwen3.8-27B ã®4bitçŽéååçïŒçŽ17GBïŒ
AI: Claude DesktopïŒæç§°: ã¯ãå©ïŒâ æé ã®æŽçãšçšèªã®èšãæããæ åœ
仿¥ã¯æ®µåããšè§£èª¬ã®åã§ããæ°ããèšæž¬ã¯ããŠããããåºãŠããæ°åã¯ãã¹ãŠéå»èšäºã§å ¬éæžã¿ã®ãã®ã ãã§ãã
ð¯ ãã®èšäºã§åŸãããããš
ããŒã«ã«LLMãäžæ©ãŸãããŸã§ã«ãå®éã©ããªæé ãèŠãã®ãã®å šäœå
ãGGUFããTTFTããéååããšãã£ã暪æåããåèŠã§ãèªããèšèã«çœ®ãæãã説æ
å€éãåããã®ã®æ£äœãšã人ããã¿ã³ãæŒãå Žæã®ç·åŒã
ðºïž å€éããã宿ž¬ã8æé ã®å°å³
ããããšã8ã€ã«å²ã£ãŠã¿ãããæã£ãŠããããé·ãéã®ãã§ããã
æé â ã¢ãã«ã®å± å Žæãæ¢ã
ã¢ãã«ã®æ¬äœã¯ãã§ã«ããŒãPCã®äžã«ãããŸãããã 眮ãããŠããå Žæãç¬ç¹ã§ããŸããã®ãã¡ã€ã«ã®ç¹å®ããã§ãã
æé â¡ 17GBãéã¶
èŠã€ãããã¡ã€ã«ããã¹ã¯ãããPCãžã³ããŒããæ¡åŒµåãä»ãæ¿ããŸããä»åãã¡ã°ãã®ç¯çŽãã€ã³ãã§ãçŽ17GBãèœãšãçŽããã«æžã¿ãŸãã
æé ⢠llama.cppã®ç¹åŒ
éã¶å ã®å®è¡ãœãããèµ·åã§ããç¶æ ãã確èªããŸããå°å ¥æžã¿ãªã®ã§ç¹åŒã ãã
æé ⣠ãµãŒããŒãèµ·ãããŠçé
å®è¡ãœãããè£æ¹ãšããŠç«ã¡äžãã1åã ã声ããããŠè¿äºãèŠãŸããããã§è¿äºãæ¥ãªããã°ä»¥éã¯å šéšããçŽãã§ãã
æé â€ å€æ¹ã®äºåèšæž¬
çãæç« ã§ãçæã®éããšåŸ ã¡æéãæ°åãã€æž¬ããŸããææ¥ã®èšäºã®è¡šã¯ãååãããã§åãŸããŸãã
æé ⥠ãããã®å®è£
å€ã®ããã åããä»çµã¿ã2ã€äœããŸããèŠçŽãé Œãã»ããšããããèµ·ããã»ããéäžã§èœã¡ãŠãç¿æ©ããçŽãããããæžãã ã¶ããé£ã°ãäœãã«ããŸãã
æé ⊠å€ãèµ·åããŠå¯ã
èµ·åã ãã¯èªåã®æã§ãããŸããããã¯èªåã«ããŸãããçç±ã¯åŸåã«æžããŸãã
æé â§ æã®ç®èŠ
äœæ¬ã¶ãçµãã£ãããæ°ããäžèº«ããããããªãããèŠãŸãããããŸã§ã§ããããã1åã®å®æž¬ã§ãã
ð éäžã«åºãŠããèšèã10å
ãããããæ¬é¡ã§ãã8æé ã説æããããšãããšæšªæåãæ¬¡ã åºãŠããã®ã§ãå ã«å šéšãããã§ãããŸãã
â å€éããã
決ããä»äºããŸãšããŠãç¡äººã§é çªã«åŠçãããããšã§ãã人ãåŸ ã£ãŠããªãæéåž¯ã«æŒã蟌ãããšããçºæ³ãæšæ¥ã®èšäºã§ãäœãé ŒããããŸã§æ±ºããŸããã
â¡ GGUF
llama.cppç³»ã®ãœããã§äœ¿ãã¢ãã«ãã¡ã€ã«ã®åœ¢åŒã§ãããåŒåœç®±ã ãšæã£ãŠãã ãããAIã®äžèº«ããæã¡éã¹ã圢ã«è©°ãããã®ãæ¡åŒµå㯠`.gguf` ã§ãã
⢠blob
Ollamaãšãããœãããã¢ãã«ãä¿åãããšãã®çœ®ãæ¹ã§ãæ¡åŒµåã®ãªããã¡ã€ã«ãããã£ãšäžŠã³ãŸãããšããããã®äžèº«ããã®ãŸãŸGGUFã§ãããã©ãã«ãå¥ãããã ãã®ãåŒåœç®±ã§ããDay397ã§ã¯ããã®ãããã§ã16.69GBã®æ¬äœãåããŠã³ããŒãããã«å¥ãœããããèªããŸãããæé â¡ã¯ãã®å®éçšçã§ãã
⣠éåå / Q4_K_XL
åçã®ç»è³ªèª¿æŽãšåãèãæ¹ã§ããå ã®ç²Ÿå¯ãªããŒã¿ãå°ãç²ãããŠå®¹éãæžããã27BçŽïŒïŒ270åãã©ã¡ãŒã¿çŽïŒãçŽ17GBã«åãŸã£ãŠããã®ã¯ããã®å å·¥ã®ããããQ4_K_XLã¯ãè³¢ãããªãã¹ãä¿ã¡ãªãã4bitçŽãŸã§èœãšãæ¹åŒã®ã²ãšã€ã§ãã
†llama.cpp / llama-server
llama.cppã¯ãæå ã®PCã§AIãåããå®è¡ãšã³ãžã³ãã¬ãŒã·ã³ã°ã«ãŒã®ãããªãã®ã§ãéããããã«èªåã§é転ãèŠããŸããllama-serverã¯ãã®å åŒåã§ããªã¯ãšã¹ããåããŠçããè¿ã絊ä»ä¿ãè£æ¹ãšããŠç«ãŠãŠãããšãããã°ã©ã ããæ³šæãåºããŸãã
⥠OpenAIäºæAPI
絊ä»ä¿ã«æž¡ã泚æç¥šã®ããšã§ãäžçå ±éã®æžåŒã«ãªã£ãŠããŸããäžã§åããŠããã®ãæå ã®AIã§ããæžãæ¹ã¯æåãªãµãŒãã¹ã«é ŒããšããšåããPythonã®ã³ãŒããäžžããšäœ¿ãåããŸãã
⊠tok/s
AIã®åãã¹ããŒãã§ãã1ç§ãããã«çæã§ããæåã®ãããŸãã®æ°ã§ãæ¥æ¬èªã§ã¯ã ããã1ããŒã¯ã³ïŒ1æåååŸãDay396ã§ã¯1.61 tok/sãå®è¡ãœãããæ¿ããDay397ã§ã¯2.56 tok/sã§ããã
â§ TTFTïŒæåã®ããŒã¯ã³ãŸã§ã®æéïŒ
ã¿ã€ãã«ã«ãå ¥ãããããã仿¥ãã¡ã°ãèŠããŠåž°ã£ãŠã»ããèšèã§ãã質åããŠãããæåã®äžæåãç»é¢ã«åºããŸã§ã®æéãåãã¯ãããŠããã®éãïŒâŠïŒãšã¯å¥ç©ã§ããDay397ã§9åæž¬ã£ããã¡ã1åç®ã ã51.73ç§ãšé£ã³æããŠé ãåºãŸãããå¥ã®æ¥ã«ã¯ã¢ãã«ã®èªã¿èŸŒã¿ã ãã§23.5ç§ãã©ã¡ããæ éã§ã¯ãªãããã®ç«ã¡äžããã¶ãã§ããæ¥äžã«äœ¿ãããã¯ãtok/sããTTFTã§æ±ºãŸããéã«å€éãããã§ã¯ã»ãŒç¡èŠã§ããŸããæãŸã§ã«çµãã£ãŠããã°åãã§ãããã
âš æèã¢ãŒãïŒenable_thinkingïŒ
çããåã«ãAIãèãäºãæžãåºãæ©èœãæèéçšãèŠããAIã®ããã®èŠããŠããéšåã§ãã質ãäžããå Žé¢ãããåé¢ãèŠããªããšããã§çæéãå¢ããã®ã§åŸ ã¡æéã䌞ã³ãŸããDay397ã§ã¯å¯Ÿè©±ç»é¢ããæ¢ããããã絊ä»ä¿çµç±ã§æ³šæç¥šã«äžè¡è¶³ããŠããããæ¢ãŸããŸããã
â© åéå®å šïŒã¬ãžã¥ãŒã ïŒ
åŠçæžã¿ã®ã¶ããé£ã°ããŠãéäžããç¶ããããäœãã®ããšãå€ã®ããã ã«äœããã£ãŠããç¿æ©ããäžåºŠèµ·åããã°ç¶ãããèµ°ããç¡äººã§åãããã®ã¯ããããå ¥ã£ãŠãããã©ããã§å®å¿æããŸãã§éããŸãã
ãæšªæåã¯ãå ã«å šéšãããã§ãããšæ¥œã ã¹ãã
ã¯ãå©ã®èšããšããã§ããææ¥ã¯ãã®10åãåæã«æžããã®ã§ãæ°åã®è©±ã«éäžã§ããŸãã
ð€ æ®µåãã¯AIã«ãèµ·åãã¿ã³ã¯äººã«
æé â¥ã®äœãæ¹ã«ãå°ãè§ŠããŠãããŸãã
ä»åã¯ãã¹ãã«ãšãã圢ã§ãç®æšããšãå®äºæ¡ä»¶ããå ã«æç« ã§æžããŠãããããããå ã®çµã¿ç«ãŠãAIåŽã«ãã£ãŠãããæ¹åŒã詊ããŠããŸãã1è¡ãã€æç€ºãåºãã®ã§ã¯ãªããã©ããŸã§ã§ãããçµããããæž¡ããå æ¥æžããçå®çªã®èãæ¹ã®å»¶é·ã§ã倿ã¯åºçºåã«æžãŸããŠããããšãã話ã§ããããŸãã
ãã ã誀解ãããããªãã®ã§ãã¯ã£ããæžããŸããå€éãåãã®ã¯ãPythonãšBATã§ãã£ãŠAIã§ã¯ãããŸãããæ®µåããŸã§ã¯AIãæäŒããŸãããå€äžã«èµ°ã£ãŠããã®ã¯æ±ºããããé çªã©ããã«åãæ®éã®ããã°ã©ã ã§ããèããŠããã®ã§ã¯ãªããç¹°ãè¿ããŠããã ãã
ãããŠããã²ãšã€ããããã®èµ·åçŽåã ãã¯ãäººã®æ¿èªã§æ¢ãŸãäœãã«ããŸããäžèº«ããã®æ¥ã®ãã¡ã«èªåã§ç¢ºèªããŠãèªåã§ãã¿ã³ãæŒãããããŸã§èªåã«ãããšãæã«ãªã£ãŠããªããäœãåºãŠããªãããå¯ãŒãçŒã§è¿œããããããšã«ãªããŸãã
ãæ®µåãã¯ä»»ããŠããã£ãŠãããã©ãæåŸã®ãã¿ã³ã ãã¯æŒããŠãããªã
ã¯ãå©ã«ãããèšãããŸãããæãæãå Žæãšæããªãå Žæã¯ãåããŠãããŸãã
ð é¢é£èšäº
ä»åã®å 容ã«é¢é£ããéå»èšäºããã²ã芧ãã ããïŒ
ð ãŸãšã
æšæ¥äºåãã宿ž¬ã¯ææ¥ãžã仿¥ã¯å°å³ãšèšèãããããåã«ãã
äžæ©ãŸãããŸã§ã®éã®ãã¯8æé ãæ¢ãã»éã¶ã»ç¹åŒã»çéã»äºåèšæž¬ã»å®è£ ã»èµ·åã»æã®ç®èŠ
çŽ17GBã¯éã¶ã ãã§æžããblobã®äžèº«ãGGUFãã®ãã®ã ã£ãããïŒDay397ã§å®èšŒæžã¿ïŒ
TTFTã¯ãæåã®äžæåãåºããŸã§ããæŒã®äœ¿ãåæã決ããã®ã¯ãã¡ãã§ãå€éãããã§ã¯ã»ãŒå¹ããªã
å€éãåãã®ã¯PythonãšBATãAIãããã®ã¯æ®µåããŸã§ã§ãèµ·åãã¿ã³ã¯äººãæŒã
å°å³ãšèšèãå ã«ãããšãææ¥ã¯æ°åã ãèŠãã°ãããªããŸããæºåã®æ¥ããããã1æ¬ã«ããã®ã¯ããã®ããã§ãã
æå ã§äœããäžæ©ãŸãããŠã¿ããæ¹ã¯ããŸãèªåã®èšèã§8æé ã¶ãã®å°å³ãæžããŠã¿ãŠãã ãããç§ã®å ŽåãæžããŠã¿ãŠåããŠæããŠããæé ã3ã€èŠã€ãããŸããã
ð æ¬¡åäºå
ææ¥ã¯ãããã宿ž¬æ¬çªãtok/sã»TTFTã»æèON/OFFå¥ã®æèŠæéã»äžæ©ã®åŠçæ¬æ°ã®4ç¹ãèšé²ããŸããã©ããªããã¯ææ¥ã®æ°åã§ããæ¥œãã¿ã«ïŒ
ðš ããŸãïŒèŠåºãç»åäœæããã³ãã
仿¥ã®èŠåºãç»åã®ããŒã¹ã¯ãžããŒïŒGeminiïŒã«äžèšããã³ããã§äœæããŠããããŸããïŒ
詳现ãªã¢ãã¡ã®çŸæèã®ç»åãäœæããŠãã ããã衚æ
è±ããªç³ããªããããªç¶²æãã»ã«ã®è²äœ¿ããã¯ã£ããããç·ç»ã䜿çšããŸããã¢ãã¡ã®ã·ãŒã³ã«å
žåçãªèº«ã¶ããšé°å²æ°ã§ãå¿æ
ãšç»å Žäººç©ã®ååšã匷調ããŠãã ããã
äžèšæ¡ä»¶ã®noteèŠåºãç»åããµã€ãºã¯æšªé·ã§äœæããŠãã ããããµã€ãºã¯å¿
ãæšªé·ã§äœæããŠãã ããã
ããã¶ã€ã³ã³ã³ã»ããã
- èæ¯: æãã倿¹ã®æžæãçªããäœãè§åºŠã®ããããã西æ¥ãå·®ã蟌ã¿ãå£ã𿬿£ãããããããããŒã€ãšããŒãæ·¡ãã»ãŒãžã°ãªãŒã³ã®ã°ã©ããŒã·ã§ã³ã§ç
§ãããŠãã
- ã¡ã€ã³ããžã¥ã¢ã«: 20代ååã®å¥³æ§ãã£ã©ã¯ã¿ãŒïŒã¯ãªãŒã è²ã®ã±ãŒãã«ãããã»äžžçŒé¡ã»ããŒã¯ãã©ãŠã³ã®ããããŠã§ãŒããã¢ïŒããå£ã«è²Œã£ã倧ããªææãã®ã«ãŒãå°å³ã®åã«ç«ã¡ãæšè£œã®æãæ£ã§å·Šãã2çªç®ã®å°ç¹ãæããŠããã衚æ
ã¯èœã¡çãããå°ãåŸæããªããããã埮ç¬ã¿
- å£ã®å°å³: 倧ããªçŽã«ææããããã«ãŒãå³ãäžžãå°ç¹ã8ã€ãããæ²ç·ã§ã²ãšç¶ãã«ã€ãªãããŠãããå°ç¹ã«ãçŽã«ãæåã»æ°åã»èšå·ã¯äžåæžããªã
- æºã®äž: éãããŸãŸã®åèªåž³é¢šã®å°ããªããŒãã1åã ããããŒãžã«ã¯ææžã颚ã®çްãç·ãããã ãã§ãèªããæåã¯æžããªã
- ã«ã©ãŒ: 倿¹ã®ãããŒã€ãšããŒãã¢ã³ããŒåºèª¿ã«ãå£ã®æ·¡ãã»ãŒãžã°ãªãŒã³ãåããããæãæ£ãæããŠãã2çªç®ã®å°ç¹ã«ã ããŽãŒã«ãã®å
ãåœãŠã
- è£
食: åºã«é·ã䌞ã³ãããããã圱ã空äžã«æŒã现ããå
ã®ç²ãã¹ããããŠã©ããã»ç æèšã»çœ®ãæèšã»ã¡ãžã£ãŒã»å°è»ã»ã³ã³ãã¥ãŒã¿ãŒãããã»ã¹ãŒãã±ãŒã¹ã»ã«ã¬ã³ããŒã»ææ¥ã«ãŒãã»ã¹ã¿ã³ãã«ãŒãã»ãã¢ã»è€æ°åã®ã©ã³ãã»è€æ°å°ã®PCã¯æããªããå®åšãã©ã³ãã®ããŽã¯æããªã
- ðš ç»é¢å
ã«æ°åã»tok/sã»ã°ã©ãã»é²æããŒã»ã²ãŒãžã»è¡šã®é¡ã¯äžåæããªã
- ðš ãã®ãã£ã©ã¯ã¿ãŒã¯å¥³æ§ã§ããé»ã®ãžããããŒã«ãŒã«ããããã©ã³ã®å°å¹Žãã£ã©ã¯ã¿ãŒã«ã¯ããªãããš
- ããã¹ã3段:
äžæ®µïŒãã¯ã€ãã»å€ªåã»30ã32ptïŒã宿ž¬ã®åã«ãå°å³ãæãã
äžæ®µïŒãŽãŒã«ãã»44ã48ptïŒãå€éãããã®8æé ã
äžæ®µïŒãã¯ã€ãã»çްåã»20ã22ptïŒãããŒã«ã«LLMã®å°éçšèªããå
ã«å
šéšããããã
ãäœææé ã
1. ã¹ã©ã€ããµã€ãºïŒ1536Ã1024pxïŒã®æšªé·ãã©ãŒããããèšå®ãã
2. æãã倿¹ã®æžæããããããããããŒã€ãšããŒãæ·¡ãã»ãŒãžã°ãªãŒã³ã®ãããããã°ã©ããŒã·ã§ã³èæ¯ã§èšå®ãã
3. ç»é¢å¥¥ãŸãã¯å³æã«çªãæããäœãè§åºŠã®ããããã西æ¥ã宀å
ã«å·®ã蟌ãŸããŠãå£ã𿬿£ããããããç
§ããã壿ãã«ã¬ã³ããŒã»ææ¥ã«ãŒãã»ã¹ã¿ã³ãã«ãŒãã»ãã¢ã¯æããªã
4. ç»é¢äžå€®ããå³ã®å£ã«ã倧ããªææãã®ã«ãŒãå°å³ã貌ããäžžãå°ç¹ã8ã€æããæ²ç·ã§ã²ãšç¶ãã«ã€ãªããå°ç¹ã«ãçŽã«ãæåã»æ°åã»èšå·ã¯äžåæžããªã
5. ç»é¢äžå€®ããå·Šã«ãã¡ã€ã³ããžã¥ã¢ã«ã®ãã£ã©ã¯ã¿ãŒïŒã¯ãªãŒã è²ã®ã±ãŒãã«ãããã»äžžçŒé¡ã»ããŒã¯ãã©ãŠã³ã®ããããŠã§ãŒããã¢ã»20代ååã®å¥³æ§ïŒãé
眮ããæšè£œã®æãæ£ã§å°å³ã®å·Šãã2çªç®ã®å°ç¹ãæããŠããããŒãºã«ããã衚æ
ã¯èœã¡çãããå°ãåŸæããªããããã埮ç¬ã¿ã«ããïŒæ·»ä»ç»åãšç
§åãé»ããŒã«ãŒã«ããããã©ã³ã®å°å¹Žã«ã¯ããªãïŒ
6. æåã®æºã«ãéãããŸãŸã®åèªåž³é¢šã®å°ããªããŒãã1åã ã眮ããããŒãžã«ã¯ææžã颚ã®çްãç·ã ããå
¥ããèªããæåã¯æžããªããã¹ããããŠã©ããã»ç æèšã»çœ®ãæèšã»ã¡ãžã£ãŒã»å°è»ã»ã³ã³ãã¥ãŒã¿ãŒãããã»ã¹ãŒãã±ãŒã¹ã»è€æ°åã®ã©ã³ãã»è€æ°å°ã®PCã¯æããªã
7. æãæ£ãæããŠãã2çªç®ã®å°ç¹ã«ã ããŽãŒã«ãã®å
ãåœãŠãåºã«é·ã䌞ã³ãããããã圱ãšã空äžã«æŒã现ããå
ã®ç²ãæ·»ãããç»é¢å
ã«æ°åã»ã°ã©ãã»é²æããŒã»ã²ãŒãžã»è¡šãäžåæãããå®åšãã©ã³ãã®ããŽãæããªããå
šäœãããããã倿¹ã®è²èª¿ã«æŽããããã¹ãã3æ®µæ§æã§è¿œå ããïŒäžæ®µ: çœã»å€ªåã»30ã32ptã宿ž¬ã®åã«ãå°å³ãæããïŒäžæ®µ: ç¹å€§ãŽãŒã«ãã»44ã48ptãå€éãããã®8æé ãïŒäžæ®µ: çœã»çްåã»20ã22ptãããŒã«ã«LLMã®å°éçšèªããå
ã«å
šéšãããããïŒãäžéšäžå€®å¯ãã«ãYaroTechãã®ããŽã12ptã§æ§ããã«é
眮ããïŒå³äžã§ã¯ãªãïŒ
8. å
šäœã®ãã©ã³ã¹ã確èªããŠå®æããã
9. ãã£ã©ã¯ã¿ãŒã®åèç»åïŒAIæ¬äººå\Gemini_Generated_Image_ã¯ãå©ïŒClaude DesktopïŒ.pngïŒã1ææ·»ä»ããŠã人ç©ã®äžè²«æ§ã確ä¿ãã#YaroTech #ClaudeDesktop #ããŒã«ã«LLM #çæAI #AIæŽ»çš #llamacpp #å€éããã #çšèªè§£èª¬ #AIåå¿è #æ¯æ¥note