
ããŒã«ã«AIããã€ã®éã«ãããªã«é²åãããã ïŒ
ããšãšããGeminiã«ãRyzen 7 5700XãRadeon RX 6800ãã¡ã¢ãª32GBãWindows 11ãšããç°å¢ã§ãLM Studioã®Bionicã䜿ããªããã©ã®ã¢ãã«ãæé©ãªã®ãããšèããŠã¿ãã
ãããšãQwen2.5-14Bãå§ããããã®ã§ããã®ãŸãŸããŠã³ããŒãããŠäœ¿ã£ãŠã¿ãã
確ãã«ãæ®éã«äœ¿ããããªãšã¯æã£ãã®ã ããã©ããè³¢ããããŸã²ãšã€ãªæ°ãããã
ã€ãŸããçããæ·¡çœã§çŽç·çãšã§ãèšããŸãããã©ãã«ãé¢çœã¿ã«æ¬ ãããæäœ¿ã£ãŠããé ã®OpenAIã®ã¢ãã«ã®ãããªæãããšèšãã°ããã®ã ãããã
ãŸããããŒã«ã«AIãªããããªãã®ãªã®ããªãšæã£ãŠããã
ãšãããããããããããããšèª¿ã¹ãŠã¿ããšã
ãããïŒããŒã«ã«AIãããæè¿ã§ã¡ãã£ã¡ãã£é²åããšãããªãããïŒã
ããæã£ãŠãæ¹ããŠGeminiã«èããŠã¿ãã
ãããšã
ãQwen3.6-35B-A3Bã¯MoEïŒMixture of ExpertsïŒæ§é ã®ã¢ãã«ã§ãQ4éååãªãçŽ20GBååŸã«ãªããŸããVRAM 16GBã«åãŸããããªãåã¯ã¡ã€ã³ã¡ã¢ãªïŒRAMïŒã«ãªãããŒãããããšã«ãªããŸãããå®éã«èšç®ãããã©ã¡ãŒã¿ã¯çŽ3Bãªã®ã§ã35Bã¯ã©ã¹ã®è³¢ããçºæ®ã§ããŸãã
ãšã®ããšã
ã»ã»ã»ãããããæåã«æããããïŒ
ãšããããšã§ãQwen2.5-14Bãã¢ã³ã€ã³ã¹ããŒã«ããŠãQwen3.6-35B-A3BïŒQ4_K_MïŒã«å ¥ãæ¿ããã
䜿ã£ãŠã¿ãææ³ã ããæããã«è³¢ãæ°ãããã
ã¡ãã£ãšã¡ã¢ãªãŒã®äŸ¡æ Œã調ã¹ãŠããã£ãã ãã§ããéãããªããšãªãåããã
Geminiã«èããŠã¿ããšãQwen2.5-14Bãšæ¯ã¹ãŠãæ å ±æŽçãèŠçŽã®èœåãåäžããŠããããšã«å ããBionicãšã®çµã¿åãããè¯ããããã
ã€ãŸããåã«æ å ±ã䞊ã¹ãã ãã§ã¯ãªãããã¡ããäœãç¥ãããã®ããæ±²ã¿åã£ãŠã衚ãç®æ¡æžããªã©ã§æŽçããŠããããšããããšã ã
ãŸãã«ãããïŒ
ãããããªãQwen2.5-14Bãå§ãããïŒãšå°äžæéåãè©°ãããã
ãã ãQwen3.6-35B-A3Bã¯åçãé ãã
ãšã«ããèããæéãé·ãã®ã ãåŸ ãŠãªãã»ã©ã§ã¯ãªãããäœãã調ã¹ããããã£ããèããŠããã£ããããäœæ¥ã«åããŠããæããããã
Reasoning Budgetã¯ããšãããã1024ã«èšå®ããã
åæèšå®ã8192ã ã£ãã®ã§ãççã«é ãã£ãïŒç¬ïŒã
ããã§ãæ®æ®µã®ã¡ãã£ãšãã質åãªã©ããããšäœ¿ãããå Žåã«ã¯ãQwen3.5-9BïŒQ8_0ïŒã䜿ãããšã«ããããã¡ãã¯Reasoning Budgetã0ã«èšå®ããŠããã
ãšãããããããŒã«ã«LLMã¯ãã®2ã€ã䜿ãåããŠããããšæãã
ãšããããããã«èª¿ã¹ãŠãããšãæ°ã«ãªããã®ãåºãŠããã
Strataãšãããã®ã ã
LM Studioã®ããã«ããŒã«ã«AIãåããããã®ç°å¢ãªã®ã ããããããªããªãé¢çœãã
Strataã¯ãGPUãšCPUã§èšç®ãåæ ããVRAMãRAMãSSDãçµã¿åãããŠãå€§èŠæš¡ãªMoEã¢ãã«ãäžè¬çãªPCã§ãåãããããã«ããæšè«ãšã³ãžã³ãããã
çŸåšã¯ãQwen3.8-Flash-Nextããšããã¢ãã«ãåãããããã§ããã¡ãã¯ç·ãã©ã¡ãŒã¿æ°ã1,250åãšããããšãã§ããªã巚倧ãªã¢ãã«ã§ããã
ããããMoEæ§é ãªã®ã§ãå®éã«èšç®ã«äœ¿ãããã®ã¯çŽ60åãã©ã¡ãŒã¿ãšã®ããšã
MoEïŒMixture of ExpertsïŒãšããä»çµã¿ã«ã€ããŠãç§ã詳ããçè§£ããŠããããã§ã¯ãªãã
ç°¡åã«èšãã°ãããããã®å°éå®¶ãçšæããŠããã質åã«å¿ããŠå¿ èŠãªå°éå®¶ã ããéžãã§èšç®ããä»çµã¿ãããã
ããã«Strataã§ã¯ãGPUã«ã¯ãã䜿ãããéšåãå°éå®¶ã®ãã£ãã·ã¥ã眮ããRAMã«ã¯å°éå®¶ã®ããŒã¿ã眮ããSSDãæŽ»çšããã
ã€ãŸãã巚倧ãªAIã¢ãã«ãäžåºŠã«VRAMãžå šéšå ¥ããå¿ èŠããªããšããããšã ã
ãã¡ãããã¡ã¢ãªå®¹éãGPUã®å¯Ÿå¿ç¶æ³ãªã©ããããããšæ¡ä»¶ã¯ããããã ãããããªãäžè¬çãªã²ãŒãã³ã°PCã§ããããªã倧ããªã¢ãã«ãåãããå¯èœæ§ãããã
ç§ã®Ryzen 7 5700XãRadeon RX 6800ãã¡ã¢ãª32GBã«ãã32GBãè¶³ãã°äœ¿ããå¯èœæ§ããããããªã®ã§ãããã詊ããŠã¿ãããšæã£ãŠããã
ãã ããå®éã«åããããã©ããã¯ã察å¿ç¶æ³ãã¡ã¢ãªã®æ¡ä»¶ãããå°ã確èªããå¿ èŠãããããã ã
ããã«ããŠããããŒã«ã«AIã®é²åã¯ãããã
å°ãåãŸã§ã¯ãããŒã«ã«ã§åããAIãšããã°ãã¯ã©ãŠãã®AIã«ã¯å°åºåã°ãªããã®ãšããå°è±¡ã ã£ãã
ãããä»ã§ã¯ãæå ã®ã²ãŒãã³ã°PCã§ãããªãè³¢ãAIãåãããããã«ãªã£ãŠããã
ããœã³ã³ãè²·ãæ¿ããªããŠãããœãããŠã§ã¢ãã¢ãã«ã®é²åã ãã§ãã§ããããšãå¢ããŠããã
ããã¯ãªããªã楜ããã
ãšãããããä»ã®ãšããã¯Qwen3.6-35B-A3BïŒQ4_K_MïŒãšQwen3.5-9BïŒQ8_0ïŒã䜿ã£ãŠããããšæãã
ã»ã»ã»ãšæã£ãŠããã®ã ããStrataãæ°ã«ãªãã
ããŒã«ã«AIã®äžçã¯ããã°ããç®ãé¢ãããã«ãªãã