
ããŒã«ã«LLMã®ããã®ã¡ã¢ãªåºç€ç¥è
ããŒã«ã«LLMã®ããã®ã¡ã¢ãªåºç€ç¥èããŸãšããŸããã
1. CPUã»GPU ãšã¡ã¢ãª
1-1. CPUã»GPUã»RAMã»VRAMã®åœ¹å²
PCã®ã¹ããã¯ã§ã¯ã
CPU / GPU / RAM / VRAM
ãšãã4ã€ã®èšèãããåºãŠããŸãã
ãŸãæŒãããŠããããã®ã¯ããããã¯åãçš®é¡ã®éšåã§ã¯ãªããšããããšã§ãã
ã»CPUã»GPU â èšç®ãè¡ãè£ çœ®
ã»RAMã»VRAM â èšç®ã«äœ¿ãããŒã¿ãäžæçã«çœ®ãã¡ã¢ãª
äžè¬çãªPCã§ã¯ã
ã»CPU â RAMãäž»ã«å©çš
ã»GPU â VRAMãäž»ã«å©çš
ãšããé¢ä¿ã«ãªã£ãŠããŸãã
ããŒã«ã«LLMã§ã¯ãã¢ãã«ã®éã¿ãªã©ã®ããŒã¿ãRAMãVRAMã«çœ®ãããããCPUãGPUãèªã¿ãªããèšç®ããŸãã
ã€ãŸããCPUãGPUãèšç®ããããã«ã¯ããã®èšç®ã«å¿ èŠãªããŒã¿ã眮ããŠããã¡ã¢ãªãå¿ èŠãšããããšã§ãã
1-2. CPUã»GPU
ãCPUãïŒCentral Processing UnitïŒã¯ãOSãã¢ããªã®å®è¡ãªã©ãPCå
šäœã®å¹
åºãåŠçãæ
åœããããã»ããµã§ãã
äžæ¹ããGPUãïŒGraphics Processing UnitïŒã¯ãããšããšç»åã3Dã°ã©ãã£ãã¯ã¹ãåŠçããããã®ããã»ããµã§ããã倧éã®èšç®ã䞊åã«åŠçããããšãåŸæãšããŠããŸãã
LLMã§ã¯å€§èŠæš¡ãªè¡åèšç®ãç¹°ãè¿ããããäžè¬çã«ã¯CPUãããGPUãå©çšããæ¹ãé«éã«æšè«ã§ããŸãã
ãã®ãããããŒã«ã«LLMã§ã¯GPUãéèŠã«ãªããŸãã
ãã ããGPUã髿§èœã§ããã¢ãã«ã眮ãããã®ã¡ã¢ãªãäžè¶³ããŠããã°ããã®æ§èœãååã«æŽ»ãããŸããã
1-3. RAMã»VRAM
ãRAMãïŒRandom Access MemoryïŒã¯ãäž»ã«CPUãå©çšããã¡ã€ã³ã¡ã¢ãªã§ãã
PCã®ã¹ããã¯ã«ã
ã»ã¡ã¢ãª32GB
ã»ã¡ã¢ãª64GB
ã»ã¡ã¢ãª128GB
ãªã©ãšæžãããŠããå Žåãäžè¬çã«ã¯RAMãæããŸãã
äžæ¹ããVRAMãïŒVideo RAMïŒã¯ãäž»ã«GPUãå©çšããå°çšã¡ã¢ãªã§ãã
GPUã®ã¹ããã¯ã«ã
ã»VRAM 16GB
ã»VRAM 24GB
ã»VRAM 32GB
ãªã©ãšæžãããŠããå Žåããã®GPUãå©çšã§ããå°çšã¡ã¢ãªã®å®¹éã衚ããŠããŸãã
GPUã§LLMãåããå Žåãã¢ãã«ã®éã¿ãªã©ãåºæ¬çã«VRAMãžçœ®ããŸãã
ãã®ãããããŒã«ã«LLMçšGPUã§ã¯ãGPUã®æŒç®æ§èœã ãã§ãªãVRAM容éãéåžžã«éèŠã«ãªããŸãã
2. ãŠããã¡ã€ãã¡ã¢ãª
2-1. ãŠããã¡ã€ãã¡ã¢ãªãšã¯
æè¿ã¯ãCPUãšGPUãåãç©çã¡ã¢ãªãå
±æããã·ã¹ãã ãå¢ããŠããŸãã
ãã®ãããªä»çµã¿ã¯ããŠããã¡ã€ãã¡ã¢ãªãããå
±æã¡ã¢ãªããšåŒã°ããŸãã
äžè¬çãªGPUæèŒPCã§ã¯ãCPUçšã®RAMãšGPUçšã®VRAMãåãããŠããŸãã
ã»CPU â RAM
ã»GPU â VRAM
äžæ¹ããŠããã¡ã€ãã¡ã¢ãªã§ã¯ãCPUãšGPUãå ±éã¡ã¢ãªãå©çšããŸãã
ã»CPU / GPU â å ±éã®ãŠããã¡ã€ãã¡ã¢ãª
CPUãšGPUãåãã¡ã¢ãªäžã®ããŒã¿ãæ±ãããããRAMãšVRAMã®éã§ããŒã¿ãã³ããŒããå¿ èŠãæžãããŸãã
ãã ãããŠããã¡ã€ãã¡ã¢ãªã¯CPUã»GPUã»OSã»ã¢ããªãªã©ã§å ±æãããŸãããã®ãããã128GBãŠããã¡ã€ãã¡ã¢ãª = VRAM 128GBããšããæå³ã§ã¯ãªããæèŒã¡ã¢ãªã®ãã¹ãŠãLLMãå©çšã§ããããã§ã¯ãããŸããã
2-2. ãŠããã¡ã€ãã¡ã¢ãªãæ¡çšããPC
代衚çãªäŸãšããŠã次ã®ãããªè£œåããããŸãã
ã»Apple SiliconæèŒMac
CPUãšGPUããŠããã¡ã€ãã¡ã¢ãªãå ±æããŸããM3 UltraæèŒMac Studioã§ã¯æå€§512GBãŸã§æèŒã§ãã倧åLLMã®ããŒã«ã«æšè«ã«ãå©çšã§ããŸãã
ã»NVIDIA DGX Spark
GB10 Superchipãš128GBã®ãŠããã¡ã€ãã¡ã¢ãªãæèŒããŠããŸããCPUãšGPUã§å€§å®¹éã¡ã¢ãªãå ±æã§ãããããäžè¬çãªGPUã®VRAM容éãè¶ ããã¢ãã«ãæ±ãããããªã£ãŠããŸãã
ã»NVIDIA RTX Spark
Blackwell RTX GPUãšGrace CPUãçµ±åããæå€§128GBã®ãŠããã¡ã€ãã¡ã¢ãªãæèŒããŸããWindows PCã§ã倧容éã¡ã¢ãªã掻çšããããŒã«ã«LLMç°å¢ãæ§ç¯ã§ããŸãã
ãã®ãããªPCã§ã¯ãCPUãšGPUã§å ±æãã倧容éã¡ã¢ãªãLLMã«å©çšã§ãããããäžè¬çãªGPUã®VRAM容éãè¶ ãã倧åã¢ãã«ãæ±ãããããªããŸãã
3. LLMã䜿ãã¡ã¢ãªã®å èš³
LLMã®æšè«ã§ã¯ãäž»ã«æ¬¡ã®3ã€ã«ã¡ã¢ãªã䜿ããŸãã
ã»ã¢ãã«ã®éã¿
ã»KVãã£ãã·ã¥
ã»æšè«æã®äžæé å
ã¢ãã«ãã¡ã€ã«ã20GBã ããã20GBã®VRAMãããã°ååãšã¯éããŸãããå®éã«ã¯ãã¢ãã«ã®éã¿ + KVãã£ãã·ã¥ + æšè«æã®äžæé åãå«ããŠãäœè£ã®ããã¡ã¢ãªå®¹éãå¿ èŠã«ãªããŸãã
3-1. ã¢ãã«ã®éã¿
æã倧ããªå²åãå ããã®ããã¢ãã«ã®éã¿ãã§ãã
LLMã«ã¯ãåŠç¿ã«ãã£ãŠæ±ºãããã倧éã®ãã©ã¡ãŒã¿ããããæšè«æã«ã¯ããããã¡ã¢ãªäžã«çœ®ããŠèšç®ããŸãã
ãã®ãããåºæ¬çã«ã¯ãã©ã¡ãŒã¿æ°ãå€ãã¢ãã«ã»ã©ãå¿
èŠãªã¡ã¢ãªã倧ãããªããŸãã
ããšãã°ã8Bã¢ãã«ãã70Bã¢ãã«ã®æ¹ããã¢ãã«ã®éã¿ãä¿åããããã«å€ãã®ã¡ã¢ãªãå¿
èŠã§ãã4bitã8bitãªã©ãžã®ãéååãã䜿ããšããã®ã¢ãã«ã®éã¿ãå ããã¡ã¢ãªãæžãããŸãã
3-2. KVãã£ãã·ã¥
ãKVãã£ãã·ã¥ãïŒKey-Value CacheïŒã¯ããããŸã§å ¥åããããŒã¯ã³ã®èšç®çµæã®äžéšãä¿åããããã®é åã§ããæ°ããããŒã¯ã³ãçæãããã³ã«éå»ã®æç« ããã¹ãŠèšç®ãçŽããªããŠæžãããã«ããããã«äœ¿ãããŸãã
KVãã£ãã·ã¥ã¯ç¹ã«ã³ã³ããã¹ãé·ãé·ããªãã»ã©å¢ããã®ãç¹åŸŽã§ãã
ããšãã°åãã¢ãã«ã§ãã
8K â 32K â 128K
ãšæ±ãã³ã³ããã¹ããé·ããããšãKVãã£ãã·ã¥ã«å¿ èŠãªã¡ã¢ãªãå¢ããŠãããŸãã
ãŸããã¢ãã«ã®ã¬ã€ã€ãŒæ°ãAttentionã®æ§é ãªã©ã«ãå·Šå³ããããããåãã³ã³ããã¹ãé·ã§ãã¢ãã«ã«ãã£ãŠå¿ èŠéã¯ç°ãªããŸãã
3-3. æšè«æã®äžæé å
LLMã®æšè«ã§ã¯ãã¢ãã«ã®éã¿ãKVãã£ãã·ã¥ä»¥å€ã«ããèšç®éäžã®ããŒã¿ãæšè«ãšã³ãžã³ã䜿ãã¯ãŒã¯ã¹ããŒã¹ãªã©ã«ã¡ã¢ãªãå¿ èŠã§ãã
ãã®ãæšè«æã®äžæé åãã¯ã
ã»ã¢ãã«æ§é
ã»ããããµã€ãº
ã»ã³ã³ããã¹ãé·
ã»æšè«ãšã³ãžã³
ãªã©ã«ãã£ãŠå€ãããŸãã
4. ã¡ã¢ãªã«ã¢ãã«ãåãŸããªãå Žå
LLMãåããå Žåãçæ³ã¯ã¢ãã«å šäœãGPUã®VRAMããŠããã¡ã€ãã¡ã¢ãªã«åããããšã§ãããã ããã¢ãã«ãã¡ã¢ãªå®¹éãè¶ ããå Žåã§ããããã€ãã®æ¹æ³ã§å®è¡ã§ããŸãã
4-1. RAMã䜵çšãã
äžè¬çãªGPUæèŒPCã§ã¯ãã¢ãã«ã®äžéšãRAMåŽã«çœ®ããCPUãšGPUã§åŠçãåæ ããããšã§æšè«ã§ããŸãã
ããšãã°ã
ã»VRAM : 16GB
ã»RAM : 64GB
ãšããPCã§ããRAMã䜵çšããããšã§16GBãè¶ ããã¢ãã«ãåãããå ŽåããããŸããllama.cppãOllamaãªã©ã§ããCPUãšGPUãçµã¿åãããæšè«ãå©çšã§ããŸãã
ãã ããRAMãšVRAMã¯å¥ã ã®ã¡ã¢ãªãªã®ã§ãCPUåŽã§ã®èšç®ãPCIeãçµç±ããããŒã¿è»¢éãçºçããŸãããã®ãããRAMåŽã«çœ®ãå²åã倧ããã»ã©æšè«é床ã¯äœäžãããããªããŸãã
4-2. ã¡ã¢ãªäœ¿çšéãæžãã
ã¡ã¢ãªãäžè¶³ããå Žåã¯ãLLMãå¿ èŠãšããã¡ã¢ãªãã®ãã®ãæžããæ¹æ³ããããŸãã
代衚çãªã®ããéååãã§ããã¢ãã«ã®éã¿ãFP16ãªã©ãã8bitã4bitã«å€æããããšã§ãã¢ãã«ãå ããã¡ã¢ãªãå€§å¹ ã«æžãããŸãã
ã»éååãã â ã¢ãã«ã®éã¿ãå°ãããã
ã»å°ããã¢ãã«ã䜿ã â å¿ èŠãªã¡ã¢ãªå šäœãæžãã
ã»ã³ã³ããã¹ãé·ãçããã â KVãã£ãã·ã¥ãæžãã
ã»KVãã£ãã·ã¥ãéååãã â é·ãã³ã³ããã¹ãã§ã®ã¡ã¢ãªæ¶è²»ãæžãã
ããŒã«ã«LLMã§ã¯ã4bitéååã¢ãã«ãå©çšããã®ããéãããã¡ã¢ãªã§å€§åã¢ãã«ãåãã代衚çãªæ¹æ³ã§ãã
ãã ããéååã匷ãããã»ã©ç²ŸåºŠã«åœ±é¿ããå¯èœæ§ããããããã¡ã¢ãªäœ¿çšéãšå質ã®ãã©ã³ã¹ãèããå¿ èŠããããŸãã
4-3. è€æ°GPUã»è€æ°å°ã«åæ£ãã
ããã«å€§ããªã¢ãã«ã§ã¯ãè€æ°ã®GPUãè€æ°å°ã®ãã·ã³ã«ã¢ãã«ãåå²ããŠæšè«ããæ¹æ³ããããŸãã
1æã®GPUã«ã¯åãŸããªãã¢ãã«ã§ããè€æ°GPUã«åå²ããããšã§å®è¡ã§ããå ŽåããããŸãããŠããã¡ã€ãã¡ã¢ãªæèŒãã·ã³ã§ããè€æ°å°ãå©çšããŠ1å°ã®ã¡ã¢ãªå®¹éãè¶
ããã¢ãã«ãæ±ããŸãã
ãã ãã
128GB + 128GB = 256GBã®1ã€ã®ãŠããã¡ã€ãã¡ã¢ãª
ã«ãªãããã§ã¯ãããŸããã
ã¢ãã«ãè€æ°ã®GPUããã·ã³ã«åå²ããéä¿¡ããªããæšè«ãããããGPUéã»ãã·ã³éã®éä¿¡é床ããæšè«ãšã³ãžã³ã®åæ£æšè«ãžã®å¯Ÿå¿ãæ§èœã«å€§ãã圱é¿ããŸãã
5. LLMã®æšè«é床ãšã¡ã¢ãªåž¯å
ããŒã«ã«LLMã®æ§èœã¯ãã¡ã¢ãªå®¹éã ãã§ãªããã¡ã¢ãªåž¯åãã«ã倧ãã圱é¿ãããŸããã¡ã¢ãªå®¹éããã©ãã ã倧ããªã¢ãã«ã眮ãããããæ±ºããã®ã«å¯Ÿããã¡ã¢ãªåž¯åã¯ããã®ããŒã¿ãã©ãã ãéãèªã¿åºããããã«é¢ä¿ããŸãã
5-1. ã¡ã¢ãªåž¯å
ãã¡ã¢ãªåž¯åãïŒMemory BandwidthïŒã¯ãCPUãGPUãšã¡ã¢ãªã®éã§ã1ç§éã«ã©ãã ãã®ããŒã¿ãããåãã§ããããè¡šãææšã§ãã
äžè¬çã«ã¯ãGB/sãTB/sã§è¡šããŸãã
ã»128GB â ä¿åã§ããããŒã¿é
ã»300GB/s â 1ç§éã«è»¢éã§ããããŒã¿é
LLMã®æšè«ã§ã¯ãããŒã¯ã³ãçæãããã³ã«ã¢ãã«ã®éã¿ãã¡ã¢ãªããèªã¿åºããŸãããã®ãããGPUã髿§èœã§ããã¡ã¢ãªããååãªé床ã§ããŒã¿ãäŸçµŠã§ããªããã°æšè«é床ã¯äŒžã³ãŸããã
ç¹ã«1人ã§å¯Ÿè©±ãããããªæšè«ã§ã¯ãã¡ã¢ãªåž¯åãããã«ããã¯ã«ãªãããšãããããã®ç¶æ ããMemory BoundããšåŒã³ãŸãã
5-2. åãã¡ã¢ãªå®¹éã§ãé床ã¯ç°ãªã
åã128GBã®ã¡ã¢ãªãæèŒããŠããŠãã
ã»ã¡ã¢ãªåž¯å
ã»GPUã®æŒç®æ§èœ
ã»ã¢ãã«ã®åœ¢åŒ
ã»æšè«ãšã³ãžã³
ãªã©ã«ãã£ãŠæšè«é床ã¯å€ãããŸãã
ããŒã«ã«LLMçšPCãèŠããšãã¯ã
ã»ã¡ã¢ãªå®¹é â ã©ãããã倧ããªã¢ãã«ã眮ããã
ã»ã¡ã¢ãªåž¯å â ãã®ã¢ãã«ãã©ããããéãèªã¿åºããã
ãšããéããæèãããšåããããããªããŸãã