
ä»ããã27Bãå€å€ã«åºããŸã â ããŒã«ã«LLMå€éãããæ€èšŒãéå§ã®åå³ã ãå ã«
ããã«ã¡ã¯ïŒYaroTechã§ãã
å ã«ãæãããŠãããŸãããã®èšäºã¯ãæ€èšŒéå§ã®åå³ã ãã§ããçµæã¯ãŸã äœããããŸãããæ°åã¯ææ¥ã®èšäºã§ã
æšæ¥ã¯ãæå ã®AIãäžæ©ãŸãããŸã§ã®éã®ãã8æé ã®å°å³ã«ããŸãããä»å€ãã®å°å³ã®2ã€ç®ãš3ã€ç®ã«ãã§ãã¯ãå ¥ãããããã4ã€ç®ä»¥éã«é²ã¿ãŸããèµ°ãåºãåã«ãåºçºã®èšé²ã ã眮ããŠãããŸãã
â»èŠåºãç»åã®ããã³ããã¯äžçªäžã«ããŸãã§å ¬éäžïŒ
ð¥ïž å®è¡ç°å¢
å®è¡ããæ©æ¢°: ãã¹ã¯ãããPCïŒWindows 11 Pro / Core i9-12900T / RAM 128GB / RTX 3050ïŒ
ã¢ãã«: Qwen3.8-27B ã®4bitçŽéååçïŒçŽ17GBïŒ
å®è¡ãœãã: llama.cpp
AI: ã¯ãå©ïŒClaude DesktopïŒâ 段åãã®æŽçæ åœ
ãããŸã§ã®èšæž¬ã¯ãã¹ãŠããŒãPCã§ãããä»å€ãããæºã®äžã®å€§ããã»ãã«ç§»ããŸãã
ðŠ ä»å€ããããŸã§æžãŸããŸãã
æé â¡ 17GBãéã¶
ããŒãPCåŽã®Ollamaãä¿åããŠãã16.69GBã®ãã¡ã€ã«ïŒæ¡åŒµåãªãã»äžèº«ã¯ãã®ãŸãŸGGUFïŒãããã¹ã¯ãããPCã®äœæ¥ãã©ã«ããžã³ããŒãã`.gguf` ã«ä»ãæ¿ããŸãããã³ããŒã®ååŸã§ãã€ãæ°ãäžèŽããããšãç¢ºèªæžã¿ã§ããçŽ17GBã®åããŠã³ããŒãã¯ãããã§åé¿ã§ããŸãããæšæ¥ããã¡ã°ãã®ç¯çŽãã€ã³ãããšæžããå·¥çšãããã®ãŸãŸå®éçšã«ä¹ã£ã圢ã§ãã
æé ⢠llama.cppã®ç¹åŒ
éã³å ã®å®è¡ãœãããèµ·åã§ããç¶æ ãã確èªããŸãããCUDA察å¿ã§ãã«ãããããã®ãå ¥ã£ãŠãããšãããŸã§ç¢ºèªæžã¿ã§ãã
å°å³ã®8å°ç¹ã®ãã¡ã2ã€ç®ãš3ã€ç®ã®ã©ã³ããç¹ããŸããã
ð ä»ãããããããããŸã
æ®ãã¯â£çéã»â€äºåèšæž¬ã»â¥ãããå®è£ ã»âŠèµ·åã»â§æã®ç®èŠãä»å€ã®ãã¡ã«â£ããâŠãŸã§é²ããŸãã
èšé²ããæ°åã¯4ç¹ã§ããtok/sïŒåãã¹ããŒãïŒãTTFTïŒæåã®äžæåãåºããŸã§ã®æéïŒãæèã¢ãŒãON/OFFå¥ã®æèŠæéããããŠäžæ©ã§åŠçã§ããæ¬æ°ã
æ¡ä»¶ãå ã«å®£èšããŠãããŸãã䞻軞ã¯CPUã®ã¿ã§åããŸããããŒãPCã§2.56 tok/sïŒDay397ïŒãåºãããšããšæ¡ä»¶ãããããŠãããªããšãå€ãã£ãã®ãæ©æ¢°ãªã®ãèšå®ãªã®ãåãããªããªãããã§ããGPUã¯ãäœåãããã°è¿œå ã§æž¬ããŸãã
ã©ããªããã¯ãæžããŠããä»ã®ç§ãç¥ããŸãããéããšãé ããšãæžããªãã®ã§ãæžããŸããã
ããã ã°ãå€å€ãè¡ã£ãŠããã¹ãæã«ã¯äœãæã£ãŠåž°ã£ãŠãããã¯ãã ã¹ãã
ã¯ãå©ã¯ããèšã£ãŠããŸããèµ·åãã¿ã³ã¯ãç§ãæŒããŸãã
ð é¢é£èšäº
ä»åã®å 容ã«é¢é£ããéå»èšäºããã²ã芧ãã ããïŒ
ð ãŸãšã
ä»å€ãã¢ãã«ã®ç§»éïŒãã€ãæ°äžèŽã確èªïŒãšå®è¡ãœããã®ç¹åŒãŸã§çµãã£ã
ããããæž¬ãã®ã¯tok/sã»TTFTã»æèON/OFFã»äžæ©ã®æ¬æ°ã®4ç¹ã䞻軞ã¯CPUã®ã¿ã§ãéå»ãšæ¡ä»¶ããããã
çµæã¯ãŸã æå ã«ãªããã ãã仿¥ã¯ãå§ããŸããã®å ±åã ãã«ãã
ããåã«ããããŸãããšæžããŠããŸããšãéãéããªããªããŸãã仿¥ã®1æ¬ã¯ããã®ããã®æã®ãããªãã®ã§ãã
ð æ¬¡åäºå
ææ¥ã¯æ°åãæã£ãŠæ»ããŸããtok/sã»TTFTã»æèON/OFFã»äžæ©ã®åŠçæ¬æ°ã®4ç¹ã§ãããæ¥œãã¿ã«ïŒ
ðš ããŸãïŒèŠåºãç»åäœæããã³ãã
仿¥ã®èŠåºãç»åã®ããŒã¹ã¯ãžããŒïŒGeminiïŒã«äžèšããã³ããã§äœæããŠããããŸããïŒ
詳现ãªã¢ãã¡ã®çŸæèã®ç»åãäœæããŠãã ããã衚æ
è±ããªç³ããªããããªç¶²æãã»ã«ã®è²äœ¿ããã¯ã£ããããç·ç»ã䜿çšããŸããã¢ãã¡ã®ã·ãŒã³ã«å
žåçãªèº«ã¶ããšé°å²æ°ã§ãå¿æ
ãšç»å Žäººç©ã®ååšã匷調ããŠãã ããã
äžèšæ¡ä»¶ã®noteèŠåºãç»åããµã€ãºã¯æšªé·ã§äœæããŠãã ããããµã€ãºã¯å¿
ãæšªé·ã§äœæããŠãã ããã
ããã¶ã€ã³ã³ã³ã»ããã
- èæ¯: å€ã®äœæ¥éšå±ããã¹ã¯ã©ã€ãã®ãããããã¢ã³ããŒã®å
ã ããæå
ãç
§ãããéšå±ã®å¥¥ã¯èœã¡çããèè²ã«æ²ãã§ãã
- ã¡ã€ã³ããžã¥ã¢ã«: 20代ååã®å¥³æ§ãã£ã©ã¯ã¿ãŒïŒã¯ãªãŒã è²ã®ã±ãŒãã«ãããã»äžžçŒé¡ã»ããŒã¯ãã©ãŠã³ã®ããããŠã§ãŒããã¢ïŒãã倧åã®ãã¹ã¯ãããPCã®åã«ç«ã¡ãå°ããªææã峿ã§é«ãæ²ããŠããã衚æ
ã¯ããããããããããåºçºããäººã®æãã颿ã¡
- æºã®äž: ææãã®ã«ãŒãå°å³ã1æåºããŠãããäžžãå°ç¹ã8ã€ãæ²ç·ã§ã²ãšç¶ãã«ã€ãªãããå·Šãã2çªç®ãš3çªç®ã®å°ç¹ã«ã ãææžãã®ãã§ãã¯ããŒã¯ãå
¥ã£ãŠãããå°ç¹ã«ãçŽã«ãæåã»æ°åã»èšå·ã¯äžåæžããªã
- ã«ã©ãŒ: å€ã®èè²ãèæ¯ã«ããã¹ã¯ã©ã€ãã®ã¢ã³ããŒãšãããŒã€ãšããŒãæå
ã«éãããæ²ããææãšããã§ãã¯ã®å
¥ã£ã2ã€ã®å°ç¹ã«ã ããŽãŒã«ãã®å
ãåœãŠã
- è£
食: PCã±ãŒã¹ããããããããããå
ã空äžã«æŒã现ããå
ã®ç²ãå€å€ã®æã»æšè£œã®æãæ£ã»ã¹ããããŠã©ããã»ç æèšã»çœ®ãæèšã»ã¡ãžã£ãŒã»å°è»ã»ã³ã³ãã¥ãŒã¿ãŒãããã»ã¹ãŒãã±ãŒã¹ã»ã«ã¬ã³ããŒã»ææ¥ã«ãŒãã»ã¹ã¿ã³ãã«ãŒãã»ãã¢ã»è€æ°åã®ã©ã³ãã»è€æ°å°ã®PCã¯æããªããå®åšãã©ã³ãã®ããŽã¯æããªã
- ðš ç»é¢å
ã«æ°åã»tok/sã»ã°ã©ãã»é²æããŒã»ã²ãŒãžã»è¡šã®é¡ã¯äžåæããªã
- ðš ãã®ãã£ã©ã¯ã¿ãŒã¯å¥³æ§ã§ããé»ã®ãžããããŒã«ãŒã«ããããã©ã³ã®å°å¹Žãã£ã©ã¯ã¿ãŒã«ã¯ããªãããš
- ããã¹ã3段:
äžæ®µïŒãã¯ã€ãã»å€ªåã»30ã32ptïŒãä»ãããå€å€ã«åºããŸãã
äžæ®µïŒãŽãŒã«ãã»44ã48ptïŒã27Bã®å€éããããéå§ã
äžæ®µïŒãã¯ã€ãã»çްåã»20ã22ptïŒãããŒã«ã«LLMã®å®æž¬ãçµæã¯ææ¥ã®èšäºã§ã
ãäœææé ã
1. ã¹ã©ã€ããµã€ãºïŒ1536Ã1024pxïŒã®æšªé·ãã©ãŒããããèšå®ãã
2. å€ã®äœæ¥éšå±ãã奥ã¯èœã¡çããèè²ãæå
ã¯ãããããã¢ã³ããŒãšãããããããã°ã©ããŒã·ã§ã³èæ¯ã§èšå®ãã
3. ç»é¢å³æã«ãã¹ã¯ã©ã€ããæãããããããå
ãæå
ã ãã«éãããçªã®å€ã¯æãå€ã«ããã壿ãã«ã¬ã³ããŒã»ææ¥ã«ãŒãã»ã¹ã¿ã³ãã«ãŒãã»ãã¢ã»å€å€ã®æã¯æããªã
4. ç»é¢äžå€®ããå³ã«å€§åã®ãã¹ã¯ãããPCã1å°ã ãé
眮ããã±ãŒã¹ããããããããããå
ãæ·»ãããè€æ°å°ã®PCã¯æããªã
5. ç»é¢äžå€®ããå·Šã«ãã¡ã€ã³ããžã¥ã¢ã«ã®ãã£ã©ã¯ã¿ãŒïŒã¯ãªãŒã è²ã®ã±ãŒãã«ãããã»äžžçŒé¡ã»ããŒã¯ãã©ãŠã³ã®ããããŠã§ãŒããã¢ã»20代ååã®å¥³æ§ïŒãé
眮ããå°ããªææã峿ã§é«ãæ²ããŠããããŒãºã«ããã衚æ
ã¯ãããããæãã颿ã¡ã«ããïŒæ·»ä»ç»åãšç
§åãé»ããŒã«ãŒã«ããããã©ã³ã®å°å¹Žã«ã¯ããªãïŒ
6. æåã®æºã«ãææãã®ã«ãŒãå°å³ã1æåºããŠçœ®ããäžžãå°ç¹ã8ã€æããŠæ²ç·ã§ã²ãšç¶ãã«ã€ãªããå·Šãã2çªç®ãš3çªç®ã®å°ç¹ã«ã ãææžãã®ãã§ãã¯ããŒã¯ãå
¥ãããå°ç¹ã«ãçŽã«ãæåã»æ°åã»èšå·ã¯äžåæžããªããæšè£œã®æãæ£ã»ã¹ããããŠã©ããã»ç æèšã»çœ®ãæèšã»ã¡ãžã£ãŒã»å°è»ã»ã³ã³ãã¥ãŒã¿ãŒãããã»ã¹ãŒãã±ãŒã¹ã¯æããªã
7. æ²ããææãšããã§ãã¯ã®å
¥ã£ã2ã€ã®å°ç¹ã«ã ããŽãŒã«ãã®å
ãåœãŠã空äžã«æŒã现ããå
ã®ç²ãæ·»ãããç»é¢å
ã«æ°åã»ã°ã©ãã»é²æããŒã»ã²ãŒãžã»è¡šãäžåæãããå®åšãã©ã³ãã®ããŽãæããªããå
šäœãå€ã®èè²ãšã¢ã³ããŒã®è²èª¿ã«æŽããããã¹ãã3æ®µæ§æã§è¿œå ããïŒäžæ®µ: çœã»å€ªåã»30ã32ptãä»ãããå€å€ã«åºããŸããïŒäžæ®µ: ç¹å€§ãŽãŒã«ãã»44ã48ptã27Bã®å€éããããéå§ãïŒäžæ®µ: çœã»çްåã»20ã22ptãããŒã«ã«LLMã®å®æž¬ãçµæã¯ææ¥ã®èšäºã§ãïŒãäžéšäžå€®å¯ãã«ãYaroTechãã®ããŽã12ptã§æ§ããã«é
眮ããïŒå³äžã§ã¯ãªãïŒ
8. å
šäœã®ãã©ã³ã¹ã確èªããŠå®æããã
9. ãã£ã©ã¯ã¿ãŒã®åèç»åïŒAIæ¬äººå\Gemini_Generated_Image_ã¯ãå©ïŒClaude DesktopïŒ.pngïŒã1ææ·»ä»ããŠã人ç©ã®äžè²«æ§ã確ä¿ãã#YaroTech #ClaudeDesktop #ããŒã«ã«LLM #çæAI #AIæŽ»çš #llamacpp #å€éããã #æ€èšŒéå§ #AIåå¿è #æ¯æ¥note