
ãçäŒã¿ã®3æ¥éã§ãèªåã ãã®èšèªã¢ãã«ããäœãïŒMacBook 1å°ã»å®å šèªäœïŒ
ãç«ã«ã€ããŠæããŠããšèããããããè¿ã£ãŠããŸããã
ç«ã¯ç¬ã«ã€ããŠã®ç©èªã§ãã

ç«ã§ããç¬ã§ããªããç©èªãç倧ã«ééã£ãŠããŸãã
ã§ãããã®åã¯ç§ãäœããŸããã
Hugging FaceããåŠç¿æžã¿ã¢ãã«ãèœãšããŠããã®ã§ããAPIãå©ããŠããã®ã§ããããŸããã
Transformerãèªåã§æžããŠãæ¥æ¬èªã®ããŒã¿ã§30ååŠç¿ãããŠãåãããçµæã§ãã

ãã©ã¡ãŒã¿æ°ã¯1,153äžãGPT-4ã®10äžåã®1以äžã§ããç¥èããªããã°æšè«åããªãã
ããã§ããå©è©ã®äœ¿ãæ¹ããå¥èªç¹ã®äœçœ®ãããããšããŠãç§ã¯ãã§ãããšããèšãåããã
誰ãæããŠããªãã®ã«ã³ãŒãã¹ã®çµ±èšã ãããç«ã¡äžãã£ãŠããŸãã
ãã®èšäºã¯ããããèªåã®Macã§åçŸããããã®å šæé ã§ãã
泚èš: Macå°çšã§ããWindowsãŠãŒã¶ãŒåããå·çããŸããïŒ
ã·ãªãŒãºèšäºã§ãã ãåŸãªå šéšå ¥ãã»ããããããïŒ
ãã®èšäºãèªããšäœãã§ããããã«ãªãã
åŠç¿æžã¿ã¢ãã«ãäžå䜿ããã«ãTransformerããŒãããå®è£ ã§ãã
æ¥æ¬èªã®ã³ãŒãã¹ãèªåã§äœããèªåã®Macã®GPUã§åŠç¿ãåãã
CLIãšãã©ãŠã¶ã®äž¡æ¹ã§ãèªäœã¢ãã«ãšäŒè©±ã§ãã
ãLLMã£ãŠçµå±äœãããŠããã®ããããä»äººã®è§£èª¬ã§ã¯ãªãèªåã®æã§ç¢ºããããã
å¿ èŠãªãã®ã
Apple Silicon ã® MacïŒM1以éãã¡ã¢ãª16GBããã°ååã§ãïŒ
Pythonãæžããããããã¯èªããçšåºŠã®ç¥è
æ©æ¢°åŠç¿ã®ç¥èã¯äžèŠã§ããæ°åŒã¯1ã€ãåºããŸãã
å®äœæ¥3ã4æéããã¡åŠç¿ã®30åã¯åŸ ã€ã ããªã®ã§ãå®è³ª2ã3æé
ã¯ã©ãŠããGPUãµãŒããŒãAPIããŒãèŠããŸããããããæ¥ç¶ã¯ããŒã¿ã®ããŠã³ããŒãã®ãšãã ãã§ãã
å ã«ãæ£çŽã«æžããŠãããŸã
è²·ã£ãŠãããæã£ãŠããã®ãšéãããšãªãã®ãäžçªç³ãèš³ãªãã®ã§ãå ã«éçãæžããŸãã
ãã®èšäºã§äœãã¢ãã«ã¯ãéè«ãåã¿åããŸããã
æšæ¶ã¯è¿ã£ãŠããŸãããæ¥æ¬èªãšããŠæŽã£ãæãåããŸããã
質åã®å
容ãçè§£ããŠçããŠããããã§ã¯ãããŸãããäºå®ãå¹³æ°ã§ééããŸãã
åé ã®ãç«ã¯ç¬ã«ã€ããŠã®ç©èªã§ãããããã®å®åããã衚ããŠããŸãã
1,153äžãã©ã¡ãŒã¿ã»441äžæåãšããèŠæš¡ã§ã¯ããããéçã§ãã
ææããŒãã®åŸåã§ã¯ããªãåã¿åããªãã®ããåŠç¿æ²ç·ãã説æããããã§ã
ã©ããŸã§ããã°åã¿åãããã«ãªãã®ãããæœçããšã®æèŠæéã€ãã§æŽçããŠããŸãã
ã€ãŸãããã¯ãChatGPTã®ãããªãã®ãæå
ã«ã§ãããèšäºã§ã¯ãããŸããã
LLMã®äžèº«ããä»äººã®è§£èª¬ã§ã¯ãªãèªåã®æã§ç¢ºãããããã®èšäºã§ãã
ããã«ãéãæã䟡å€ãæããŠããã ãããªãããã£ãšæºè¶³ããŠãããããšæããŸãã
3æ¥éã®é²ãæ¹
ãçäŒã¿ãæ³å®ããŠã1æ¥1ã2æéã§åºåããããã«çµãã§ãããŸãã
ãŸãšããŠåæ¥ã§ãã£ãŠããŸã£ãŠãæ§ããŸããã
Day 1ïŒ1æéïŒ ââ ç°å¢æ§ç¯ãæ¥æ¬èªã³ãŒãã¹ãäœããããŒã¯ãã€ã¶ãæžã
Day 2ïŒ1.5æéïŒ ââ ã¢ãã«ãå®è£ ãããåŠç¿ãåãïŒãã¡30åã¯åŸ ã¡æéïŒ
Day 3ïŒ1æéïŒ ââ CLIã§äŒè©±ããã©ãŠã¶GUIãäœããèªåã®ããŒã¿ã§äœãçŽã
äœããã®ã®ä»æ§
ã¢ãã« ââ æåã¬ãã« ããGPTïŒãã³ãŒãã®ã¿ã®TransformerïŒ
æ§æ ââ 6å±€ / 384次å / 6ããã / æè256æå
ãã©ã¡ãŒã¿æ° ââ 11.53M
ãã¬ãŒã ã¯ãŒã¯ ââ MLXïŒAppleçŽæ£ïŒ
ããŒã¿ ââ æ¥æ¬èªäŒè©± 28,616ä»¶ã»441äžæåïŒApache-2.0ã®å ¬éããŒã¿ïŒ
åŠç¿ ââ M1 Maxã§çŽ30åã3,600ã¹ããã
ãæåã¬ãã«ããšããã®ããã€ã³ãã§ã1æåã1ããŒã¯ã³ãšããŠæ±ããŸãã
æ¥æ¬èªããµãã¯ãŒãã«åå²ããé¢åãªååŠçãèŠããªãã®ã§ã
ããŒã¯ãã€ã¶ãŸã§èªäœã§ãããããã1æ¥ã§å®èµ°ã§ããçç±ã§ãã
ããããèšèªã¢ãã«ã¯äœãããŠããã®ã
å ã«åçã ãæŒãããŸãããããè ã«èœã¡ãã°ãããšã¯äœæ¥ã§ãã
èšèªã¢ãã«ããã£ãŠããããšã¯ããã£ã1ã€ã
ãããŸã§ã®æååãèŠãŠãæ¬¡ã«æ¥ã1æåã®ç¢ºçãåºã
ãããã«ã¡ããŸã§å
¥åãããããæ¬¡ããã¯ãã§ãã確çã90%ããããã3%ããããã0.1%âŠâŠãšãããµãã«ã
èªåœã®å
šéšã«ç¢ºçãå²ãæ¯ããŸãããããã1æåéžãã§æ«å°Ÿã«è¶³ãããŸã次ã®1æåãäºæž¬ããã
ãã®ç¹°ãè¿ãããæç« çæãã®æ£äœã§ãã
ã§ã¯ããªããäŒè©±ãã«ãªãã®ããçãã¯åŠç¿ããŒã¿ã®åœ¢ã§ãã
<|user|>ããããã®æ¬ã¯ãããŸããïŒ<|assistant|>SFãã奜ããªã...<|end|>ãã䞊ã¹ãããã¹ãã倧éã«é£ããããšãã¢ãã«ã¯
ã<|assistant|> ã®åŸãã«ã¯è¿çãæ¥ãããšãããã¿ãŒã³ãèŠããŸãã
ã ããæšè«ã®ãšãã¯ããŠãŒã¶ãŒã®å
¥åã®åŸãã« <|assistant|> ãä»ããŠã
ãã®ç¶ããäºæž¬ãããã ãã
äŒè©±ã®åå²ããæå³å€å®ããifæãã1è¡ãæžããŸããã
ããã©ãŒããããåŠç¿ããããã ãã§äŒè©±ãæç«ããããããäžçªããããããšããã§ãã
Day 1-1: ç°å¢æ§ç¯ïŒ10åïŒ
ããã¯ç¡æããŒãã§æåŸãŸã§ããåã£ãŠãã ããã
MLXã§Macã®GPUãåããããèªäœãæã¡åž°ãã®äŸ¡å€ããããŸãã
æ¢åã®ç°å¢ãæ±ããªããããå°çšã®condaç°å¢ãäœããŸãã
CONDA_SUBDIR=osx-arm64 conda create -n 1lm python=3.11 -y
conda activate 1lm
conda config --env --set subdir osx-arm64CONDA_SUBDIR=osx-arm64 ã¯å¿
ãä»ããŠãã ããã
ãããå¿ãããšx86_64åãã®ããã±ãŒãžãæ··ãããåŸãã
ImportError: dlopen(...): mach-o, but wrong architectureãšãããåå ãåããã«ãããšã©ãŒã§è©°ã¿ãŸããRosettaçµç±ã§åããŠããŸãã¶ãã
æ°ã¥ããŸã§ã«æéãæº¶ãããããã«ããããã¡ãªçœ ã§ãã
ã€ã¥ããŠã©ã€ãã©ãªã
pip install mlx numpy fastapi "uvicorn[standard]" datasets確èªããŸãã
python -c "import mlx.core as mx; print(mx.default_device())"Device(gpu, 0)ããã ãã§ãã CUDA ToolkitããcuDNNãããã«ããèŠããŸããã
PyTorchã§Macã®GPUïŒMPSïŒã䜿ã£ãããšããã人ãªãããã®æè»œãã«é©ãã¯ãã§ãã
PYTORCH_ENABLE_MPS_FALLBACK=1 ãèšå®ãããã
PYTORCH_MPS_HIGH_WATERMARK_RATIO ã調æŽãããã
ããã®æŒç®ã¯MPSæªå¯Ÿå¿ã§ãããšæãããŠåé¿çãæ¢ãããââ
ããããæŠãããä»åã¯äžåºŠããããŸããã§ããã
MLXã¯Appleãèªç€Ÿãããå°çšã«äœã£ãŠããã®ã§ãåœããåãšèšãã°åœããåãªã®ã§ããã
èªäœLMãããããã§ããã¯çžåœã«å€§ããã¢ããã³ããŒãžã§ãã
ããŠãGPUãåãããã«ãªããŸããããããããæ¬çªã§ãã
ããããå
ã¯ææããŒãã§ãã
â» åäœç¢ºèªã¯çè
ç°å¢(Apple M1Max 64GB)ã§ã®ã¿è¡ããŸãããå
šãŠã®ç°å¢ã§ã®åäœãä¿èšŒãããã®ã§ã¯ãããŸããããçè§£ããã ããå Žåã®ã¿ã賌å
¥ãã ããã