
ã驿ãgpt-ossã160äžã®Mac Studioã§åããããæªæ¥ããã£ãïœæ€èšŒã¬ããŒã
çãããããã«ã¡ã¯ãããã°ãã¯ïŒ
Techåäžå€ã§ãã
æä»£ã¯ããŒã«ã«LLMã
å
æ¥OpenAIãçºè¡šãããgpt-ossãããã£ã±ã話é¡ã§ããã
Techåäžå€ã§ãããããŸã§M4 MacBook AirïŒ16GBïŒãšARM Copilot+ PCïŒ32GBïŒã§æ€èšŒããŠããŸããã
ãããŠä»åã¯ãé廿éã»è¶
ãã€ãšã³ããª512GBã®Mac Studioã§æ€èšŒïŒ
ãã®é©ãã¹ãçµæããã²ã芧ãã ããã
ä»åã®èšäºã¯ãYouTubeã§å
¬éãããã¡ãã®åç»ãå
ã«æžããŸããã
å®éã®ã¹ããŒãæãèŠãããšããæ¹ã¯ããã²åç»ããã§ãã¯ããŠã¿ãŠãã ããð¬
gpt-ossã®ãããã
ãŸããgpt-ossã®åºæ¬çãªç¹åŸŽããã£ãšããããããŸãããã
⢠ãªãŒãã³ãŠã§ã€ãèšèªã¢ãã«
åŠç¿æžã¿ã¢ãã«ã®ãéã¿ïŒweightsïŒããå
¬éãããŠããŠã誰ã§ãããŠã³ããŒãããŠèªç±ã«äœ¿ããèšèªã¢ãã«ã
⢠120bïŒå·šå€§ãªã¢ãã«ïŒãš20bïŒæ¯èŒçå°ããªã¢ãã«ïŒã®2çš®é¡
⢠MoEïŒMixture of ExpertsïŒã¢ãŒããã¯ãã£
è€æ°ã®ãå°éå®¶ã¢ãã«ããçšæããŠããããã®äžããå
¥åã«å¿ããŠäžéšã ããéžãã§åããä»çµã¿ãæã€ãã¥ãŒã©ã«ãããã¯ãŒã¯ã®èšèšææ³ã
⢠Apache License 2.0
åçšå©çšãå¯èœãAIã§ç€ŸäŒèª²é¡è§£æ±ºãç®æãç§ãã¡ãšã«ããºã«ãšã£ãŠããå¿ãããããããååšã§ãã
⢠åäœç°å¢
120bã¢ãã«ã¯NVIDIA H100 GPUã§ã20bã¢ãã«ã¯16GBã¡ã¢ãªã®ãã·ã³ã§ãåäœãããšãããŠããŸãã
⢠æšè«ã«ç¹åããèšèšãæšçæ§èœããæ°åŠã®åé¡ãªã©ã§ã¯åŸæ¥ã®ã¢ãã«ãäžåãæ§èœãçºæ®ããŸãã
⢠å®å šã«ã¹ã¿ãã€ãºå¯èœãããŒã«ã«å®è¡å¯èœããã©ã€ãã·ãŒãã³ã¹ããã¬ã€ãã³ã·å®å šã³ã³ãããŒã«å¯èœ
ãããŸã§ã®æ€èšŒã®æ¯ãè¿ã
ãããŸã§ã«ã2çš®é¡ã®ãã·ã³ã§gpt-ossãåããæ€èšŒãè¡ããŸããã
⢠M4 MacBook AirïŒ16GBã¡ã¢ãªïŒ
æåã«æ€èšŒããã®ã¯M4 Macã
20bã¢ãã«ãåããããšãã§ããŸããã
ãã ããä»ã®å
šãŠã®ã¢ããªãéããŠã®ãªã®ãªåããšããç¶æ³ã§ãã
ïŒæ€èšŒåç»ã¯ãã¡ãïŒ
⢠Windows ARM Copilot+ PCïŒ32GBã¡ã¢ãªïŒ
ãã¡ãã¯20bã¢ãã«ããµã¯ãµã¯ãšåããŸããã
ããããè²ã
ã¢ããªãåãããšãã¯ãåãã¯é
ããªããŸãã
ïŒæ€èšŒåç»ã¯ãã¡ãïŒ
2ã€ã®ãã·ã³ã§æ€èšŒããçµæãã©ã¡ããå°ããæ¹ã¯åããã©ããŸããŸãããšããæãã§ãã
ããã§ããã£ãæ¯ãåã£ãŠè¶
髿§èœãªãã·ã³ã§åãããŠã¿ãããšæããŸããã
æ¡éãã®ã¹ããã¯ïŒ Mac Studioã®å°å ¥
ããã§ä»åå°å ¥ããã®ããMac Studioã§ãïŒ

ãããŸã§ã®8GBã16GBã32GBãšãã£ãã¡ã¢ãªã®åžžèãèŠãã512GBãã®ã¡ã¢ãªãæèŒã§ããã¢ãã«ã§ãã
SSD 4TBæ§æã§ãã倿®µã¯ãªããš164äžåïŒ
軜èªåè»ãè²·ããŠããŸãã»ã©ã®äŸ¡æ Œã§ãã
ãã®å§åçãªã¹ããã¯ã§äœãã§ããã®ããæåŸ
ãèšãã¿ãŸãïŒ
ããæ€èšŒïŒ Mac Studioã§ã®gpt-ossåäœ
20bã¢ãã«ã®åäœ
ãã¡ã€ã«ãµã€ãºã¯çŽ12GBã
ããŒãã¯æ¯èŒçéãã10ã15ç§çšåºŠã§ãããã«ã¡ã¯ã仿¥ã¯ã©ããªãèŠä»¶ã§ãããïŒããšããã«è¿çã
ãæ¥æ¬ã®éœéåºçãããã¢ãžã£ã€ã«éçºã«ã€ããŠããšãã£ã質åã«ããMacBook AirãCopilot+ PCãããæ Œæ®µã«éããæ£ç¢ºã«åçããŠãããŸããã



120bã¢ãã«ã®åäœ
ããããæ¬åœã®120bã¢ãã«ã§ãã
ãã¡ã€ã«ãµã€ãºã¯ãªããš60GBã«ããªããŸãã
ããŒãã«ã¯20ç§çšåºŠããããŸããããäžåºŠã¡ã¢ãªäžã«ããŒãããŠããŸãã°ã20bã¢ãã«ãšå€§å·®ãªãã¹ããŒãã§åäœããŸãã
ãæ¥æ¬ã®éœéåºçãã®è³ªåã«å¯ŸããŠã¯ãããŒãã«åœ¢åŒã§è©³çްã«åçã
æããã«20bãããåºåãè¯ãã§ããã

ããã«ãã¢ãžã£ã€ã«éçºãã«ã€ããŠããã¢ãžã£ã€ã«ãããã§ã¹ãã®ååãŸã§ãã£ãããšèª¬æããŠãããŸããã





åçã®è³ªãšã¹ããŒãã«æåããŸããâŠâŠïŒ
ãã®å§åçãªã¹ããŒããšåºåã¯ãMac Studioã®ãã€ã¹ããã¯ããšgpt-ossã®æ§èœãåããã£ãçµæã§ããã
Ollamaã®æŽ»çšæ³ã«ã€ããŠèããŠã¿ã
ä»åã®æ€èšŒã§ã¯ãOllamaã䜿çšããŠããŸãã
Ollamaã¯æè¿é »ç¹ã«ã¢ããããŒããæ¥ãã®ã§ãä»åã®æ€èšŒã§ãææ°ã®ç¶æ
ã«æŽæ°ããŸããã
ããã§ããOllamaãAPIã§å©ãããšãã§ããã®ãããšèããŠã¿ãŸããã
ã§ããããšã¯ç¥ã£ãŠããã®ã§ãããã©ããªåçãè¿ã£ãŠããã®ãèŠãŠã¿ãŸãããã




çµè«ãšããŠã¯ãOllamaã¯APIã§åŒã³åºãããšãã§ãããšããããšã§ãAWS BedrockãOpenAIã®APIã®ãããªæè»ãªé£æºãå¯èœã«ãªããŸãã
APIã§ã€ã³ã¿ãŒãã§ãŒã¹ãçµ±äžã§ãããè¯ãã§ãããã
ã¡ãªã¿ã«Ollamaã¯ã以åã®ChatGPTã®äžä»£ïŒo3 miniïŒãšã»ãŒåçã®æ§èœãæã€ãšèšãããŠããŸãã
ããã«ãåããããã¯ãŒã¯ã»ã°ã¡ã³ãå ã®å¥ã®ãã·ã³ããOllamaãåŒã³åºãããšãå¯èœã§ããããã«ããããAIãµãŒããŒãã®ãããªåœ¢ã§éçšã§ããå¯èœæ§ã瀺åãããŸããã



ãŸãšãïŒæªæ¥ãã€ãã«æ¥ã
ãããŸã§ã®gpt-ossæ€èšŒã®é倧æãšããŠãMac Studioã§ã®åäœã¯ãŸãã«æªæ¥ãæãããããã®ã§ããã
1åç®ã®æ€èšŒã§ã¯ã M4 MacBook Air ïŒ16GBïŒã§åããŠåããgpt-ossã«æåããããåäœã¯ã®ãªã®ãªã2åç®ã®æ€èšŒã§ã¯ãCopilot+ PCïŒ32GBïŒã§20bã¢ãã«ããµã¯ãµã¯åããŠæåããŸãããããã¯ãéçã¯ãããŸããã
ãããŠä»åãMac StudioïŒ512GBïŒã
160äžåãšããäŸ¡æ Œãæ¯ãåã£ãŠè©ŠããçµæããçŽ æŽããããã®äžèšã§ãïŒ
ãã®äŸ¡æ Œã«é©ãããæ¹ããããããããŸãããããããAPIå©çšæãæãå¿ èŠããªããªãããšããããŠãã®å§åçãªæ§èœãèããã°ã決ããŠé«ãã¯ãªããšæããŠããŸãã
æãããŒãPCãUNIXã¯ãŒã¯ã¹ããŒã·ã§ã³ãé«äŸ¡ã ã£ãæä»£ãæ¯ãè¿ããšã100äžåã300äžåãè¶
ãããã·ã³ãçãããããŸããã§ãããäŸãã°ã300äžåã§ããã©ãããã®ãããªããããã¯è²·ããŸããããã
çŸä»£ã«ãããŠããã®äŸ¡æ Œã§512GBã®ã¡ã¢ãªãšããã©ãããã®ãããªLLMã®åãæã«å
¥ãããããšèãããšããããä¿¡ããããªãã»ã©ã®äŸ¡å€ããããšæããŸãããïŒ
ããŒã«ã«ã§ããã ãã®æ§èœãåºããgpt-ossã®å¯èœæ§ããããŠãããApache License 2.0ã§æäŸããŠãããOpenAIã®æ¹ã
ã«ã¯ãæå€§éã®æ¬æã衚ããããšæããŸãã
ããã¯æ¬åœã«å
šäººé¡ã®ããã«ãªãæè¡ã§ã¯ãªãã§ããããã
çãããgpt-ossã§æªæ¥ãæããŠã¿ãŠãã ããð€
ãã®èšäºã奜è©ã ã£ãããgpt-ossæ€èšŒã·ãªãŒãºããã¹ã¯ãã¢ãŒãèšäºã«ããããšæããŸãã
YouTubeã«ã¯ãMac Studioåšãã®ç°å¢ã玹ä»ããåç»ãå
¬éããäºå®ã§ããæ°ã«ãªãæ¹ã¯YouTubeã®ãã£ã³ãã«ç»é²ãããŠãåŸ
ã¡ãã ããïŒ
ð»MacBook Airã®æ€èšŒåç»
ð»Copilot+ PCã®æ€èšŒåç»
ãã®èšäºãã圹ã«ç«ã£ãïŒãããããã£ãïŒããšæã£ããããã²ãã©ããŒã»ã¹ãããé¡ãããŸãïŒ
ãã²YouTubeãã£ã³ãã«ããã§ãã¯ããŠã¿ãŠãã ããã
ð¬åç»ãèŠãŠã¿ãã
ðYouTubeãèŠããŠã¿ã
ããã§ã¯çããããŸã次åã®èšäºã§ãäŒãããŸãããïŒ