
M6 Mac miniã§ããŒã«ã«LLMã3æ¬æ¯ã¹ãïœé床ãããææžã®æž¡ãæ¹ã®ã»ããçµæãå·Šå³ãã
ã¯ããã«
ãããŒã«ã«LLMçšã®Macã«ã64GBã¯èŠããªãã£ãïŒ â ã¡ã¢ãªéžã³ã«ã¯ã空çœå°åž¯ãããããã§æžããããã«ãM6 Mac miniïŒ32GBïŒãè²·ã£ãŠãããŒã«ã«LLMã®ç°å¢ãçµã¿ãŸããã
ç®çã®ã²ãšã€ã«ãå ¬éã§ããªãææžãããŒã«ã«ã§åŠçããããããšããã®ããããŸããä»åŸã®èªåã®åãæ¹æ¬¡ç¬¬ãšãããšããã¯ãããã§ãããå¥çŽæžã®å 容確èªãã顧客ããé ãã£ãè³æã®æŽçãè³æã®èŠçŽãªã©ãã¯ã©ãŠãã«äžããã«æžããªããããã«è¶ããããšã¯ãããŸããã
å®éã«ã©ããŸã§äœ¿ããã®ãïŒ 3ã€ã®ã¢ãã«ã§éåºŠãæž¬ããåãææžãèŠçŽãããŠæ¯ã¹ãŸãããçµæãšããŠãã¢ãã«ã®å·®ãã倧ããã£ãã®ã¯ãææžãã©ãæž¡ãããã§ããã
詊ããç°å¢
Mac miniïŒM6 / 32GB / å èµ512GBïŒ
LM Studio
Qwen3.6-35B-A3BïŒMLXã4bitïŒ
Gemma 4 26B-A4BïŒMLXãQATçïŒ
LLM-jp-4.1-32B-A3B-thinkingïŒGGUFãQ4_K_MïŒ
3æ¬ãšãMoEåã§ãããã©ã¡ãŒã¿ã®ç·æ°ã¯26ã35Bã§ããã1ããŒã¯ã³ããšã«åãã®ã¯3ã3.8Bããã®æ§æã ãš32GBã§ãå®çšçãªé床ãåºãŸããå¯ïŒdenseïŒã¢ãã«ã¯åããµã€ãºã§ãå šãã©ã¡ãŒã¿ãåãã®ã§ãçæãæ°åã®äžã«èœã¡ãŸããéžã¶ãšãã¯ãã¡ã€ã«ãµã€ãºã§ã¯ãªãã¢ã¯ãã£ããã©ã¡ãŒã¿æ°ãèŠãããšããã®ãããã§ã®åºæºã«ãªããŸãã
ãªãã以éã®èŠçŽçµæã¯ãã¹ãŠãããã¹ããããã³ããæ¬ã«å šæè²Œãä»ããŠåŸããã®ã§ãããã®æž¡ãæ¹ã«è¡ãçããçç±ã¯åŸè¿°ããŸãã
é床ãšã¡ã¢ãª
èšæž¬ã¹ã¯ãªãããæžããŠãåãããã³ããã3æ¬ã«æµããŸãããæ°å€ã¯ Qwen3.6 / Gemma 4 / LLM-jp-4.1 ã®é ã§ãã
ãšã³ãžã³ïŒMLX / MLX / GGUF
çæé床ïŒçãå ¥åïŒïŒ67.7 / 50.5 / 51.7 t/s
çæé床ïŒé·æã®èªã¿èŸŒã¿åŸïŒïŒ58.5 / 41.2 / 27.8 t/s
ããã³ããåŠçïŒ1,215 / 1,098 / 408 t/s
ã¡ã¢ãªïŒ19.7 / 15.5 / 25.5 GB
Qwen3.6ãå šé ç®ã§æéã§ãããæèã䌞ã³ããšãã®èœã¡æ¹ãäžçªç©ããã§ãã
26,000åã®æ¥æ¬èªææžã貌ã£ãŠèŠçŽããããšãæåã®æåãåºããŸã§çŽ12ç§ããããã58 t/sãå šäœã§15ç§çšåºŠã§ãããããªãåŸ ãŠãŸãã
LLM-jpãé ãã®ã¯ãMLXçããªãGGUFïŒllama.cppïŒã§åãããŠãã圱é¿ã倧ãããšæããŸããã¢ãã«èªäœã®åªå£ãšãããããçŸæç¹ã®ãã«ãã®å·®ã§ãã
ã²ãšã€æã£ãŠãããšããé·æã®èªã¿èŸŒã¿åŸãã®è¡ã¯æ¡ä»¶ãæã£ãŠããŸãããåãææžãæž¡ããŠããŸãããããŒã¯ãã€ã¶ãéãã®ã§èªã¿èŸŒãã ããŒã¯ã³æ°ãå€ãããŸããQwen 14,319ãGemma 14,684ãLLM-jp 11,820ãLLM-jpã ã2å²ã»ã©çãæèã§ã®æž¬å®ãªã®ã§ããã®è¡ã¯LLM-jpã«ããæå©ã«åºãŠããŸãã
éã«èšããšãLLM-jpã¯åãæ¥æ¬èªææžã17%å°ãªãããŒã¯ã³æ°ã§èªããŠããããšããããšã§ããããŸããæ¥æ¬èªã§åŠç¿ããã¢ãã«ãªã®ã§åœç¶ã§ã¯ãããŸãããåãã³ã³ããã¹ãé·ã«ããå€ãã®æ¥æ¬èªãå ¥ããšããå®å©ããããŸããæåæ°ã§èšããšãQwenã1.83æå/ããŒã¯ã³ãLLM-jpã2.21æå/ããŒã¯ã³ã§ããã
KVãã£ãã·ã¥éååã¯ããªã³ã®ã»ããéã
LLM-jpã§ãKVãã£ãã·ã¥éååã®ãªã³ã»ãªããæ¯ã¹ãŸãããQwenãGemma 4ã¯èªåã®ç°å¢ã§ã¯ãªã³ã«ãããšããŒãã§ããŸãããMLXã®vision察å¿ã¢ãã«ã§ã¯KVãã£ãã·ã¥éååããŸã 䜿ããªããšããå¶çŽããããValueError: The mlx-vlm batched vision path does not support KV cache quantization yet ãšãããšã©ãŒã§æ¢ãŸããŸãã
çæé床ïŒãªã³ 51.7 t/s ïŒ ãªã 24.6 t/s
ããã³ããåŠçïŒãªã³ 408 t/s ïŒ ãªã 285 t/s
2å以äžéããŸããã¡ã¢ãªãç¯çŽãã代ããã«é床ãç ç²ã«ããèšå®ã ãšæã£ãŠããã®ã§ãæå€ã§ããã
ããããFlash Attentionãé£åããŠããããã§ããLM Studioã§ã¯ãKVãã£ãã·ã¥éååãæå¹ã«ãããšFlash Attentionãæå¹ã«ãªããŸããllama.cppã®Metalå®è£ ã§ã¯ããã®æç¡ãé床ã«å€§ããå¹ããŸããã€ãŸãæ¯èŒããŠããã®ã¯ãéååã®æç¡ãã§ã¯ãªããæé©åçµè·¯ãéããã©ãããã§ããã
ã€ãã§ã«åŒã£ããã£ããšãã
ããŒãç»é¢ã® Max Concurrent Predictions ã¯æ¢å®ã4ã§ããGGUFã®å Žåãèšå®ããæèé·ã¯ãã®æ¬æ°ã§åå²ãããŸããã³ã³ããã¹ãé·ã32,768ã«èšå®ããŠããŠãã1ãªã¯ãšã¹ãã§äœ¿ããã®ã¯8,192ãé·ãææžãå ¥ããªãåå ã«ãªããŸãã1ã«ããŠããã®ãç¡é£ã§ãã
èšå®ãåæ ãããŠãããã¯ã¿ãŒããã«äžã§ lms ps ã§ç¢ºèªã§ããŸããããŒãç»é¢ã§æå®ããå€ãå¹ãããMy ModelsåŽã®æ¢å®ãåªå ãããããšããããŸããã
è±èªã®ææžãèŠçŽããã
ãŠã§ãè§£æã®åéã§2008幎ã«åºããã¯ã€ãããŒããŒã䜿ããŸããã54ããŒãžãè±èªã2äžããŒã¯ã³ã»ã©ãClaude ã§ PDF ããããã¹ããæœåºããå 容ãåã¢ãã«ã«æž¡ããŸããã1,576è¡ã119,302æåã蚪åè ã®ãšã³ã²ãŒãžã¡ã³ãã7ã€ã®ææšã§æ°å€åãããšããå 容ã§ãã
3æ¬ãšããéªšæ Œã¯æ£ç¢ºã§ãããå®çŸ©ã7ã€ã®ææšãééããªãæŸããŠããŸãã
å·®ãåºãã®ã¯çްéšã§ããQwen3.6ã¯ãã¯ãªãã¯æ·±åºŠã®éŸå€ã®äŸïŒ4ããŒãžïŒããšã³ã²ãŒãžã¡ã³ãäžäœå±€ã®è³Œå ¥ç¢ºçã®æ°å€ãéŸå€ã®æ±ºãæ¹ã®æ¹æ³è«ãŸã§æŒãããŠããŸããã
LLM-jpã¯ããã®æ çµã¿ãGoogle Analyticsã§ã¯èšç®ã§ããªããšããå¶çŽãåç¬ã§æŸããŸãããå®åã§ãã¡ã°ãå¹ãäžæãªã®ã§ãããã¯äŸ¡å€ããããŸãã
Gemma 4ã¯æ£ãããã®ã®ãå ·äœçãªæ°å€ãä»é²ã®å 容ãåºãŠããŸããã§ããã
3æ¬ãšãæã£ãŠèœãšãããã®ããã²ãšã€ãããŸãã
åæã«ããã®ææ³ã¯äžäººåãã§ã¯ãªãã倧倿°ã®äŒæ¥ã¯åºæ¬çãªææšã䜿ãç¶ããã¹ãã ããšããèè èªèº«ã®çä¿ãæžãããŠããã®ã§ãããã©ã®ã¢ãã«ã®èŠçŽã«ãåºãŠããŸããã§ãããäž»åŒµã¯æŸãããèè ã®èªå·±éå®ã¯èœã¡ããã¢ãŒããã¯ãã£ã®éã3æ¬ãæã£ãŠèœãšããã®ã§ãåŸåãšããŠæ±ã£ãŠããããã§ãã
æ¥æ¬èªã®ææžãèŠçŽããã
次ã«ãèªåãéå»ã«noteã«æžããèšäº12æ¬ããŸãšããããã¹ãïŒ49,778æåïŒãæž¡ããŸãããèªåã§æžãããã®ãªã®ã§ãèŠçŽãæ£ãããã©ãããå³å¯ã«å€å®ã§ããŸãã
ãã¡ã°ã詳ããèŠããã®ã¯LLM-jpã§ããã12æ¬ãã¹ãŠã«è§Šãã衚ãŸã§äœã£ãŠããŸãããšãããåæãšç §åãããšãæžãããŠããªãããšãããªãæ··ãã£ãŠããŸããã
ãèªå® å Œã¬ã³ãŒãã£ã³ã°ã¹ã¿ãžãªãæŽåãããäž»ãªæ©æã¯Sennheiser HD3ãM-Audio BX8 D3-PKãâ åæã«ãã¹ã¿ãžãªãããSennheiserããäžåºŠãåºãŠããŸãã
ãçŽ14幎éå€åããäŒç€Ÿãéè·ãâ å€ç¶å¹Žæ°ã¯æžããŠããŸãã
è»ã®èšäºã®çµè«ããã·ãšã³ã¿ã«æ±ºå®ãâ åæã¯ããªãŒããéžãã§ããŸã
ãéå»84åã®Wæ¯ãâ åæã¯ã84ã®åœã»å°åãæ¬å€§äŒã«åºå Žããåºå Žåœæ°ãå€§äŒæ°ãšèªã¿éããŠããŸã
ãApple Sequoiaã§æäŸéå§ãããSpeechAnalyzerãâ Sequoiaãšããèªã¯åæã«ãããŸãã
åä»ãªã®ã¯ãã©ããèªç¶ã«èªããããšã§ããã¬ã³ãŒãã£ã³ã°ã¹ã¿ãžãªã®è©±ããã·ãšã³ã¿ãéžãã ãšããçµè«ããæç« ãšããŠç Žç¶»ããŠããŸãããèªåã®èšäºã ããããã«æ°ã¥ããŸããããä»äººããé ãã£ãææžãªããæ°ä»ããŸã§ã«æéãããã£ããšæããŸãã
Qwen3.6ã¯ã12æ¬ãã¹ãŠãæ±ã£ãŠæé ãªããèŠã€ãã£ã誀ãã¯ã軜èªåè»ä¹ãæããã®äžèªã ãã§ããïŒããªãŒãã¯è»œèªåè»ã§ã¯ãããŸããïŒã
Gemma 4ã¯3ã€ã®ããŒãã«æããã ãã§ãåå¥ã®çµè«ã«ã¯èžã¿èŸŒãã§ããŸãããæµ ãããã©ãééã£ãŠã¯ããŸããã§ããã
åºåã詳现ã§ããããšãšãä¿¡é Œã§ããããšã¯ãå¥ã®è©±ã§ããã
æ¬é¡ïŒææžãæ·»ä»ãããšRAGã«ãªã

ããããä»åããããã詊ããŠã¿ãŠãäžçªã®åç©«ã§ãã
æåãèšäº12æ¬ã®ããã¹ãããã¡ã€ã«ãšããŠãã£ããã«æ·»ä»ããŠèŠçŽãããŸãããçµæã¯æ£ã ã§ã12æ¬ã®ãã¡1æ¬ããè§ŠããŠããªãã3æ¬ã ãã5æ¬ã ãããšæ¯åéããããããèŠçŽããŠãã ããããšãæ¥æ¬èªã§èŠçŽããŠãã ãããã§ãŸã£ããéãçµæã«ãªããŸããã
ã¢ãã«ã®æ°ãŸããããšæã£ãã®ã§ãããåºåãããèªããšå šéšãããæç€ºããã ããåŒçšæãã§å§ãŸã£ãŠããŸããLLM-jpã®åºåã«ã¯ãCitation 1ããšãã衚èšãŸã§å ¥ã£ãŠããŸããã
LM Studioã®ããã¥ã¡ã³ãã«ããã®ãŸãŸæžãããŠããŸããã
if the document is short enough (i.e., if it fits in the model's context), LM Studio will add the file contents to the conversation in full
çããã°å šæãå ¥ãããé·ãå Žåã¯RAGã«åãæ¿ããŠãé¢é£ããæçã ããæŸã£ãŠæž¡ãã
ã€ãŸãã¢ãã«ã¯ãæž¡ãããæçãæ£çŽã«èŠçŽããŠããããã§ããããã³ããã®ããããªéãã§çµæãå€ãã£ãã®ããæèšãå€ããã°æ€çŽ¢ã¯ãšãªãå€ãããæŸãããæçãå€ããããã§ãããææã ã£ãã®ã¯ã¢ãã«ã§ã¯ãªããæ€çŽ¢ã®ã»ãã§ãã
åãææžããæ·»ä»ã§ã¯ãªãããã³ããæ¬ã«å šæè²Œãä»ããŠæãçŽããšã3æ¬ãšãå¥ç©ã«ãªããŸãããè±èªææžã®è©äŸ¡ã§ã3æ¬ãšãèœãšããŠããããšæã£ãŠããé ç®ã®ãã¡ã2ã€ã¯å šæãæž¡ãã°æŸããããã®ã§ãããæçããæž¡ããŠããªãã®ã ãããæžãããŠããªãéšåãèŠçŽã§ããã¯ãããããŸããã
ãªãéŸå€ã¯å ¬éãããŠããŸããããã¢ãã«ã®ã³ã³ããã¹ãã«åãŸããã©ããããšããæžãããŠããããå ·äœçãªæ°å€ã¯ãªããä»åã¯14,319ããŒã¯ã³ã®ææžã«å¯ŸããŠã³ã³ããã¹ãé·ã32,768ã«èšå®ããŠããã®ã§ãæé¢ã©ãããªãå šæãå ¥ãã¯ãã§ããããããã§ãRAGã«ãªããŸãããåãæ¿ããæ¡ä»¶ã¯ãå ¬è¡šãããŠãã説æããä¿å®çãªããã§ãã
ææžãèªãŸããã€ãããªã
åœåã®ç®çã«æ»ããŸãã
å ¬éã§ããªãææžãããŒã«ã«ã§æ±ãããããšããã®ãåæ©ã®äžã€ã§ãããã§ããã°ãæ·»ä»ã§ã¯ãªãããã³ããæ¬ã«å šæã貌ãã¹ãããšããã®ãçµè«ã«ãªããŸãã
çç±ã¯2ã€ãããŸãã
ã²ãšã€ã¯ãå šæãæž¡ã£ãŠããä¿èšŒãåŸãããããšã
æ·»ä»ã ãšãRAGã«åãæ¿ãã£ããã©ãããåºåãèªããŸã§åãããŸãããå¥çŽæžã®èŠçŽã§ãããŸããŸæŸãããªãã£ãæ¡é ãèœã¡ãŠããŠããåºåã¯èªç¶ã«èªããŠããŸããŸãã
ããã²ãšã€ã¯ãæ€èšŒã®åå°ã«ãªãããšã
貌ãä»ããªããæž¡ããæåæ°ãšããŒã¯ã³æ°ãèªåã§ææ¡ã§ããŸããAPIã䜿ãã°ãå¿çã«å®éã®å ¥åããŒã¯ã³æ°ãè¿ã£ãŠããã®ã§ãå šæãæž¡ã£ãããšãæ°åã§ç¢ºèªã§ããŸãã
ãã®ããã§ãåºåã詳现ã§ããããšãåè³ªã®ææšã«ããªãããããä»ååŠã³ãŸãããèŠçŽã«å ·äœçãªæ°å€ãåºæåè©ãããããå ¥ã£ãŠãããšãããèªããŠããããã«èŠããŸãããããä»åãã¡ã°ãæé ãå€ãã£ãã®ã¯ããã¡ã°ã詳ããèŠããåºåã§ããã
ããŒã«ã«ã§å®çµããããšèªäœã«ã¯äŸ¡å€ããããŸãããã ãããã¯ã¯ã©ãŠãåæ§ããå®å¿ããŠä»»ããããããšã¯å¥ã®è©±ãäžæ¬¡æŽçã«äœ¿ããæçµçãªå€æã¯åæã«åœãããã¯ã©ãŠããããŒã«ã«åãããåœé¢å¿ èŠã«ãªãããã§ãã