Mistral-Small-24Bã®æŽŸçã¢ãã«äžèЧã
ãã¡ãã®èšäºã§è§£èª¬ããŠãããVRAM32GBçšåºŠãŸã§ã§å¿«é©ã«å©çšã§ããLLMã®ãå§ãã®äžãããããã«æ§èœãæ§æ Œãå€ããæŽŸçã¢ãã«ïŒããŒãžã¢ãã«ïŒã«ã€ããŠãŸãšããŠã¿ãŸããã
ãã®èšäºã§ã¯ã
ã絶察ã«ééããããªãã粟å¯ãªã³ãŒãã£ã³ã°äœæ¥ â
Mistral Small 24B (Q8_0) ãåãäžããŠããŸãã
Hugging Faceäžã® `mistralai/Mistral-Small-24B-Instruct-2501` ãããŒã¹ãšãã MergeïŒããŒãžïŒã¢ãã«ã¯ãå ã®Instructã¢ãã«ïŒå ¬åŒã®æç€ºè¿œåŸã¢ãã«ïŒãæã€é«ãåºç€èœåãç¶æãã€ã€ãç¹å®ã®æ¬ ç¹ãè£ã£ãããç¹å®ã®çšéã«ç¹åããããããããšãç®çã«äœãããŠããŸãã
å ã®ã¢ãã«ïŒå ¬åŒInstructçïŒãšæ¯èŒããäž»ãªéããšç¹åŸŽã¯ä»¥äžã®éãã§ãã
ãè³¢ãããšãåµé æ§ã»è¡šçŸåãã®äž¡ç«
å ¬åŒã®Instructã¢ãã«ã¯ãæ°åŠã»ã³ãŒãã»è«ççæšè«ã«ãããŠéåžžã«é«ãæ§èœïŒLlama 3.3 70Bã«å¹æµããã¬ãã«ïŒãæã¡ãŸãããäžæ¹ã§åçããçé¢ç®ãããããåµé çãªæç« ãèŠæããšããåŸåããããŸãã
ããŒãžã¢ãã«ã®éã: ä»ã®åµé æ§ã«åŒ·ãã¢ãã«ïŒArcee-Blitzãªã©ïŒããç¹å®ã®å°èª¬å·çç³»ã¢ãã«ãšããŒãžãããããšã§ãè«ççæèåãç¶æãããŸãŸããã**ãæ ç·è±ããªè¡šçŸããã人éãããäŒè©±ã**ãã§ãããã調æŽãããŠããŸãã
ãæçµ¶ïŒã¬ãŒãã¬ãŒã«ïŒãã®ç·©å
å ¬åŒã¢ãã«ã¯å®å šæ§ã®èгç¹ãããç¹å®ã®è³ªåã«å¯ŸããŠåçãæåŠãããããªãã¬ãŒãã¬ãŒã«ãã匷ãã«èšå®ãããŠããããšããããŸãã
ããŒãžã¢ãã«ã®éã: ãUncensoredïŒç¡æ€é²ïŒãç³»ã®ã¢ãã«ããRPïŒããŒã«ãã¬ã€ïŒç¹åã¢ãã«ãšããŒãžãããããšã§ããŠãŒã¶ãŒã®æç€ºã«å¯ŸããŠããå¿ å®ïŒåŸé ïŒã«ãªããéåºŠãªæçµ¶ããããããèªç±ãªå¯Ÿè©±ãå¯èœã«ãªããã調æŽãããŠãããã®ãå€ãã§ãã
ç¹å®ã¿ã¹ã¯ãžã®ç¹åïŒRoleplay, Coding, etc.ïŒ
å ã®ã¢ãã«ã¯æ±çšçãªãã¢ã·ã¹ã¿ã³ããã§ãããããŒãžã¢ãã«ã¯ç¹å®ã®æ¹åã«ã¹ããŒã¿ã¹ãæ¯ã£ãŠããŸãã
Roleplay: ãã£ã©ã¯ã¿ãŒã«ãªãããèœåã匷åãäŒè©±ã®ã³ã³ããã¹ãç¶æèœåãåäžããŠããŸãã
Reasoning / Coding: ãã§ã«é«ãèœåãããã«åŒãåºããããDeepSeekãªã©ã®èžçã¢ãã«ã®éã¿ãæ··ããè«ççãªäžè²«æ§ãé«ããŠãããã®ããããŸãã
ããŒãžææ³ïŒTIES, DARE, SLERPãªã©ïŒã«ããæé©å
ããŒãžã¢ãã«ã¯ãåã«éã¿ãè¶³ããŠããã®ã§ã¯ãªããTIES ã DARE ãšãã£ãææ³ãçšããŠãè€æ°ã®ã¢ãã«ã®ãè¯ããšãåãããããŠããŸãã
éã: å ã®ã¢ãã«åäœã§ã¯è§£æ±ºã§ããªãã£ããããã³ãããžã®çްããåŸé ãããšãç¥èéãã®ãã©ã³ã¹ãããã©ã¡ãŒã¿ã®å¹²æžãæããªããæ¹åããŠããŸãã
`Mistral-Small-24B-Instruct-2501` ãããŒã¹ãšããããŒãžã¢ãã«çŸ€ã¯ãäž»ã«ãæšè«åã®åŒ·åããããŒã«ãã¬ã€ïŒRPïŒæ§èœã®åäžããæ€é²ã®è§£é€ãã®3æ¹åã«é²åããŠããŸãã
Mistral-Small-24B-Instruct-2501 掟çã¢ãã«å šè§£èª¬
1. æšè«ã»æ±çšèœå匷åç³»ïŒãã³ãããŒã¯éèŠïŒ
ãããã¯ãå ã®é«ãç¥æ§ãç¶æãã€ã€ãè€æ°ã®ã¢ãã«ãããŒãžããŠå¹³åçãªãè³¢ãããåºäžããããã®ã§ãã
ç¹åŸŽ: Arcee.aiã«ãããããå¹ççã§é«å質ãªããŒã¿ã§ã®åŸ®èª¿æŽã
éã: å ã¢ãã«ãããç°¡æœã§æ£ç¢ºããªåçãéèŠãèŠçŽã¿ã¹ã¯ã«åŒ·ãã
ç¹åŸŽ: TIES-Mergingææ³ãçšããããŒãžã
éã: è€æ°ã®ã¢ãã«ã®é·æãããã©ã¡ãŒã¿ã®å¹²æžãæããŠçµ±åãå®å®æ§ãåäžã
ç¹åŸŽ: DAREææ³ïŒäžèŠãªéã¿ãåé€ããŠããŒãžïŒãæ¡çšã
éã: ã¢ãã«ã®ãã€ãºãæžããç¹å®ã®æç€ºã«å¯Ÿããè¿œåŸæ§ãåäžã
Standard-24B-v1.2 (ãªã³ã¯ã¯GGUFçäŸ)
ç¹åŸŽ: è€æ°ã®ããŒãžã¢ãã«ãããã«çµ±åãããæšæºçããªé«æ§èœçã
éã: å šäœçãªãã³ãããŒã¯ã¹ã³ã¢ãããŒã¹ããé«ããæ±çšæ§ã極ããŠé«ãã
2. ããŒã«ãã¬ã€ã»åµäœã»ã¹ããŒãªãŒããªã³ã°ç³»
24Bã®ãã©ã¡ãŒã¿ã掻ãããŠããã人éãããããããã¯å°èª¬çãªæç« ãæžãããã®èª¿æŽã§ãã
ç¹åŸŽ: ããŒã«ãã¬ã€æå¥œå®¶ã«äººæ°ã®ãMagnumãã·ãªãŒãºã®24Bçã
éã: æ£æã®è³ªïŒæç« ã®çŸããïŒãåçã«åäžããã£ã©èšå®ã®ç¶æã«åŒ·ãã
ç¹åŸŽ: SLERPïŒçé¢ç·åœ¢è£éïŒãçšããããŒãžã
éã: 2ã€ã®ã¢ãã«ã®ç¹æ§ãæ»ããã«èåãåµé æ§ãšè«çæ§ã®ãã©ã³ã¹ãè¯ãã
ç¹åŸŽ: ç¹å®ã®æç€ºããŒã¿ã»ãããšããŒãžã
éã: ãã察話çãªããã£ããã«é©ããå£èª¿ãžã®èª¿æŽã
3. æ€é²è§£é€ã»ç¡ä¿®æ£ç³»ïŒUncensored / AbliteratedïŒ
ã¢ãã«ã®ãã¬ãŒãã¬ãŒã«ããåãé€ããããããæç€ºã«åŸãããã«ãããã®ã§ãã
ç¹åŸŽ: çŽäº€åæè¡ãçšããŠæçµ¶åå¿ããæ¶å»ãã
éã: ãå«ççã«çããããŸããããšããåçãã»ãŒåé¿ãèªç±åºŠãæå€§ã
ç¹åŸŽ: äžèšã®æ¹è¯çã
éã: æ¶å»ã«ããç¥èœäœäžãæãã€ã€ãæçµ¶åé¿æ§èœãããã«æé©åã
ç¹åŸŽ: ç¡ä¿®æ£ããŒã¿ã§èª¿æŽã
éã: å 容ã®å¶éãªãããŠãŒã¶ãŒã®ããã³ããããã®ãŸãŸå®è¡ã
4. ç¹å®ã®åŸ®èª¿æŽã»æŽŸçç
Mistral-Small-24B-Instruct-2501-Exp-v1: å®éšçãªããŒãžææ³ã®ãã¹ãçã
Mistral-Small-24B-Instruct-2501-DPO: 人éã®å¥œã¿ã«åãããDPOåŠç¿ã远å ãããã®ã
Mistral-Small-24B-Instruct-2501-ORPO: åŠç¿å¹çã®é«ãORPOææ³ã§èª¿æŽã
æ¯èŒãŸãšã
| ã¢ãã«ã«ããŽãª | ç¹åŸŽ | åããŠããçšé |
| å
¬åŒ (Instruct) | æãå®å
šã»è«çç | ã³ãŒãã£ã³ã°ãæ°åŠã客芳çèª¿æ» |
| Arcee-Blitz / Standard | å¹çåã»ç¥èœåŒ·å | æç« èŠçŽãè€éãªæç€ºã®éè¡ |
| Magnum / SLERP | 衚çŸåè±ãã»åµé ç | å°èª¬å·çãããŒã«ãã¬ã€ãTRPGÂ
| Abliterated | ã¬ãŒãã¬ãŒã«ãªã | å¶éã®ãªãèªç±ãªå¯Ÿè©±ãç©èªã®æªåœ¹æå |