
ã#3-2ãOllamaÃGemma 2ïŒè€éãªæ¥æ¬èªå ¥åããçæ³ã®æ§å³ã»äœé¢šãå®çŸããã¢ãã«ãèªå決å®ãã
1. ã¯ããã«
ð æ¬ã·ãªãŒãºå
šäœã®ããŒããããïŒç®æ¬¡ïŒã¯ãã¡ã
ð ãããŒãããããããŒã«ã«AIã§ãæ¥æ¬èªã®ãã¥ã¢ã³ã¹ãããçæ³ã®ç»åãèªåçæããä»çµã¿ãäœã
ååã® #3-1 ã§ã¯ãQwen 2.5 ã§è€éãªæ¥æ¬èªãå
¥åãããšè±èªããã³ãããæœè±¡çã«ãªã£ããäžåœèªåããŠããŸãåé¡ã®è§£æ¶ãããGemma 2 ãå°å
¥ããŸããã
ãã®çµæãæ¥æ¬èªã®æå³ãæ±²ã¿åã£ãè±èš³ç²ŸåºŠã¯å€§å¹
ã«åäžãããã®ã®ããé ã®äžã®ã€ã¡ãŒãžããšãå®éã«çæãããç»åããšã®éã«ã¯ãŸã 倧ããªã®ã£ãããæ®ã£ãŠããŸããæ€èšŒãé²ããäžã§ããã®åå 㯠Checkpoint ã®éžå® ã LoRA ã®èªåéžå¥ããããŠç»åçæã¢ãã«ã®ç¹æ§ã«åãããããã³ããã®æ§é åãäžååã§ããç¹ã«ãããšåãã£ãŠããŸããã
ããã§ä»åã¯ãCheckpoint ãš LoRA ã®èªåéžå¥ããžãã¯ãèŠçŽããããã«ãéžæããã¢ãã«ã®ç¹æ§ã«åãããããã³ããçæããŸã§ãèªååããæ€èšŒãè¡ããŸãã
æ¥æ¬èªã®ãã¥ã¢ã³ã¹çè§£ããã¢ãã«éžå®ãããã³ããæ§ç¯ãŸã§ããããŸã§ä»¥äžã«å€ãã®åœ¹å²ã Gemma 2 ã«æ
ãããããšãšãªããŸãããæãããŠãã€ã¡ãŒãžéãã®æ§å³ããåçŸã§ããããã«ãªãã®ãââãããä»åã®æå€§ã®æ€èšŒãã€ã³ããšãªããŸãïŒ
2. Checkpoint ã®éžå®
ã§ã¯ãè€éãªæ¥æ¬èªæç€ºããã€ã¡ãŒãžéãã®ç»åãçæããããã«ã¯ãã©ã® CheckpointïŒç»åçæã¢ãã«ïŒãéžã¹ã°ããã§ããããïŒ ãã®ç¹ã«ã€ã㊠Gemini ã§å¯Ÿè©±ãéããŠæ€èšŒããçµæããŸãšããŸããã
ä»åã¯ããŒãPCç°å¢ã RTX 5070 ç³»ã®ææ°GPUïŒè©³ãã㯠ã#1ã æ¬æ€èšŒã®ç°å¢ïŒã¹ããã¯ïŒãåç
§ïŒã䜿çšããŠãããããã¢ãã«ã«ãã£ãŠã¯ãé»ç»åïŒNaNãšã©ãŒïŒããåºåãããããç»é¢å
šäœããç åµïŒãã€ãºïŒãã«ãªã£ãããšãå®å®ããŠåäœããã¢ãã«ãæ¢ãã ãã§ãäžèŠåŽã§ããã
â FLUX.1 ç³»ã®ã¢ãã«ïŒäžæ¡çšïŒ
ã¢ãã«ãµã€ãºèªäœãéåžžã«å€§ããããšã«å ãã軜éçãªã©ã®ã¢ãã«ã§ã¯ VAEïŒç»åã®å§çž®ã»åŸ©å
ãè¡ãæ©èœïŒ ã UNetïŒãã€ãºãé€å»ããŠçµµãæãã¡ã€ã³åŠçãšã³ãžã³ïŒ ã®æŒç®æã«æ¡ããµãïŒãªãŒããŒãããŒïŒã«ãã NaNïŒNot a NumberïŒèšç®äžèœãªç¡å¹å€ïŒãšã©ãŒãçºçããç»åãçã£é»ã«ãªã£ãŠããŸãçŸè±¡ãå€çºãããããä»åã¯æ¡çšãæå¿µããŸããã
â¡ playground-v2.5 ç³»ã®ã¢ãã«ïŒäžæ¡çšïŒ
以äžã®æšå¥šèšå®ã§æ€èšŒãããã®ã®ãçæçµæã¯ãã€ãºïŒç åµïŒã®ãŸãŸã§ããã
ã»CFG ScaleïŒããã³ãããžã®è¿œåŸåºŠïŒïŒ3.0
ã»Sampling MethodïŒæšæºçãªãã€ãºé€å»ã¢ã«ãŽãªãºã ïŒïŒEuler
ã»Schedule TypeïŒãã€ãºã®æžããæ¹ãå¶åŸ¡ããã¹ã±ãžã¥ãŒã©ãŒïŒïŒKarras
ã»StepsïŒç»åã®æã蟌ã¿åæ°ïŒïŒ30
æ¬æ¥ã¯ UNetïŒãã€ãºé€å»ãšã³ãžã³ïŒ ãç åµããå°ããã€çµµãæµ®ãäžããããŠç»åãäœããŸãããã¢ãã«å
éšã®ç¹å®ã®æŒç®ã fp16ïŒ16bitæµ®åå°æ°ç¹æ°ïŒã®è¡šçŸéçïŒèš±å®¹å€ïŒãè¶
ããŠããŸãããéæ°ïŒNaNïŒããžãšåããŠããŸã£ãçµæããã€ãºé€å»ã®åŠçãå®å
šã«ã¯ã©ãã·ã¥ããç»é¢ãç åµã®ãŸãŸåæ¢ããŠããŸã£ããšæšæž¬ãããŸãã
â¢Animagine XL V3.1ïŒæ¡çšïŒ
ãã®ã¢ãã«ã¯ VAE ãå
å
ããããªãŒã«ã€ã³ã¯ã³åã®ã¢ãã«ã§ãRTX 5070 ç³»ã®ææ° GPU ç°å¢ã§ããšã©ãŒãèµ·ããããæ£åžžãã€ã¹ã ãŒãºã«ç»åãçæã§ããŸããã
3. Forge ã« Animagine XL V3.1 ã®ã¢ãã«ãåã蟌ã
è€éãªæ¥æ¬èªå
¥åã®æ§æãçè§£ã§ããã¢ãã«ãšããŠãAnimagine XL V3.1 ãæ©éåã蟌ãã§ãããŸãã
ã¢ãã«ã®å
¥æå
ïŒ
ã»Animagine-xl-v31ïŒanimagineXLV31_v31ïŒ
animagineXLV31_v31
â ãDownloadããã¿ã³ãã¯ãªãã¯ïŒ6.46GBïŒ
é
çœ®å ŽæïŒ
ããŠã³ããŒããã animagineXLV31_v31.safetensors ãã¡ã€ã«ããForgeïŒStability MatrixïŒã® Checkpoint ãã©ã«ãïŒä»¥äžã®é
眮ãã¹ïŒã«é
眮ããŸãã
ðé
眮ãã¹ïŒ
StabilityMatrix-win-x64\Data\Models\StableDiffusion
ãã¡ã€ã«ãé
眮åŸãForge åŽã§ã¢ãã«äžèЧãåèªã¿èŸŒã¿ïŒæŽæ°ãã¿ã³ãã¯ãªãã¯ããŸã㯠WebUI ããªããŒãïŒããã°æºåå®äºã§ãã
4. èªåéžå¥ããã¢ãã«åãã®ããã³ããã§ç»åçæãã
ããã§ã¯ãè€éãªæ¥æ¬èªå ¥åããé©å㪠Checkpoint ãš LoRA ãå€å¥ãããã®ã¢ãã«ã«æé©åããã JSON 圢åŒã®è±èªããã³ãããçæããåŠçãå®è£ ããŠãããŸãã
#3-1 ã§äœæãããOllamaïŒGemma 2ïŒãçšããŠæ¥æ¬èªå ¥åãã Forge åãè±èªããã³ãããçæããããã°ã©ã ïŒollama_forge_create_picture_4.pyïŒãããŒã¹ã«ãä»åæ¡çšãã Animagine XL V3.1 ã«å¯Ÿå¿ã§ããããæ©èœãæ¡åŒµããŸãã
1.æ€èšŒããã°ã©ã ã®äœæ
Gemini ã«ä»¥äžã®æç€ºãåºããŠããã°ã©ã ãäœæã»æ¡åŒµããŸããã
Gemini ãžã®æç€ºæïŒããã³ããïŒ:
èªäœãã€ãã©ã€ã³ã¹ã¯ãªããïŒollama_forge_create_picture_4.pyïŒ ãããŒã¹ã«ãè€éãªæ¥æ¬èªå
¥åãã Checkpoint ãš LoRA ãèªåå€å®ããåã¢ãã«ã«å¯Ÿå¿ããæé©ãª JSON 圢åŒã®è±èªããã³ãããžãšå€æã㊠Forge ã«é£æºã§ããããã«æ¹ä¿®ããŠãã ããã
ãã®åçãåºã«äœæããã³ãŒãã ollama_gemma_forge_create_picture_1.pyãšããŠä¿åããŸããã
2.åäœç¢ºèª
äœæãã ollama_gemma_forge_create_picture_1.py ãå®éã«åããã#3-1ã§å
¥åããæ¥æ¬èªå
¥åãè¡ããã©ã®ãããªç»åãã§ããã確èªããŠã¿ãŸãã
ã»Stability Matrix ã®äºåèšå®
å·Šã¡ãã¥ãŒã®ãPackagesããã Stable Diffusion WebUI Forge - Neo ã®èšå®ãã¿ã³ãã¯ãªãã¯
â Extra Launch Arguments ã« --api ã远å
â Lanchãã¿ã³ãã¯ãªãã¯ããŠForgeèµ·å
ð¹å
¥åäŸïŒ#3-1ã®èšäºãšåæ§ïŒïŒ
ãnoteã®ããããŒçšïŒæšªé·ïŒã倧èå°ã®äžå€®ã«2人ã®è¥ãç·å¥³ïŒ17æ³ã®å°å¹Žãš16æ³ã®å°å¥³ïŒã䞊ãã§ç«ã€æ§å³ã圌ãã¯ããžãã¯ã®ã¢ã·ã¹ã¿ã³ãã§ãèæ¯ã«ã¯è±åºã€ãªã¥ãŒãžã§ã³çšã®å€§ããªç®±ãšããžãã¯ã®å°éå
·ã眮ãããŠããããã©ãããã¯ãªèå°ç
§æãã
C:XXX>python ollama_gemma_forge_create_picture_1.py
ãLLMã¢ãã«ã: gemma2
ãå
¥åããæ¥æ¬èªã: noteã®ããããŒçšïŒæšªé·ïŒã倧èå°ã®äžå€®ã«2人ã®è¥ãç·å¥³ïŒ17æ³ã®å°å¹Žãš16æ³ã®å°å¥³ïŒã䞊ãã§ç«ã€æ§å³ã圌ãã¯ããžãã¯ã®ã¢ã·ã¹ã¿ã³ãã§ãèæ¯ã«ã¯è±åºã€ãªã¥ãŒãžã§ã³çšã®å€§ããªç®±ãšããžãã¯ã®å°éå
·ã眮ãããŠããããã©ãããã¯ãªèå°ç
§æã
ãLLMææ¡ãµã€ãºã: 1216x684 â ãè£æ£åŸãµã€ãºã: 1216x704
ãå€å®ã¢ãã«ããŒã: animagine-xl-v31
ãå€å®LoRAããŒã : none
ãå€å®ãµã€ãºã : å¹
:1216 x é«ã:704
ãæçµããžãã£ãã: masterpiece, best quality, highly detailed, 1boy, 17_years_old_boy, 1girl, 16_years_old_girl, standing, side by side, magician's assistant costume, stage lighting, large magic box, illusion props, dramatic spotlight
ãæçµãã¬ãã£ãã: blurry, low quality, out of focus, distorted, smudged, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digits, fewer digits, cropped, worst quality, low quality
ð Forge ã®ã¢ãã«ã sd\animagineXLV31_v31.safetensors ã«å€æŽäž...
â
ã¢ãã«åãæ¿ãå®äº
ðš ç»åçæéå§ (Size: 1216x704)
[Prompt]: masterpiece, best quality, highly detailed, 1boy, 17_years_old_boy, 1girl, 16_years_old_girl, standing, side by side, magician's assistant costume, stage lighting, large magic box, illusion props, dramatic spotlight
[Negative Prompt]: blurry, low quality, out of focus, distorted, smudged, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digits, fewer digits, cropped, worst quality, low quality
ð ç»åãä¿åããŸãã: result.pngååã® #3-1 ã®åºåã«æ¯ã¹ããšãä»åã¯2人ã®äººç©ã®é 眮ããã€ãªã¥ãŒãžã§ã³çšã®ç®±ããã£ãããšæåãããããªãã€ã¡ãŒãžã«è¿ãç»åãçæãããããã«ãªããŸããã
泚ç®ãã¹ãã¯ãLLMïŒGemma 2ïŒãæ¥æ¬èªã®æèãåæãã以äžã®å€æããã¹ãŠèªåŸçã«è¡ã£ãŠããç¹ã§ãã
ã»ð¯ æé©ã¢ãã«ã®éžå®: æå³ãæ±²ã¿åããanimagine-xl-v31 ãç確ã«éžå®
ã»ð è§£å床ã®èªåèšç®: ãnoteã®ããããŒçšïŒæšªé·ïŒããšããæç€ºãã SDXL ã«é©ãã 1216Ã704 ãå°åº
ã»ð ããã³ããæ§æã®åçåãæ¿ã: éžãã ã¢ãã«ã«åãããJSON åºåå
ã®ããã³ãã圢åŒïŒDanbooruã¿ã°åœ¢åŒïŒãŸã§èªåæé©å
ð¡ è£è¶³ïŒãªãã1216 x 704ããæé©è§£ãªã®ãïŒ
äžèšã§æ¡çšããŠãã animagine-xl-v31 ãªã©ã®ãSDXLïŒStable Diffusion XLïŒãäžä»£ã®ã¢ãã«ã¯ãåŸæ¥ã®æ§äžä»£ã¢ãã«ïŒSD 1.5ïŒãšã¯ç°ãªããæåãããçŽ100äžç»çŽ ïŒ1024 X 1024 ååŸïŒããã€ã倿§ãªçžŠæšªæ¯ãã«å¯Ÿå¿ã§ããããèšèšãããŠããŸãã LLMïŒGemma 2ïŒã¯ã·ã¹ãã ããã³ããã«ä»èŸŒãŸãããã®ãã¢ãã«ã®ç©çéçã«ãŒã«ããå¿ å®ã«å®ããç·ç»çŽ æ°ãçŽ85äžç»çŽ ïŒ100äžç»çŽ ä»¥äžïŒã«åãŸãæ¯çãšããŠããã®çµ¶åŠãªè§£å床ãèªåŸçã«èšç®ããŠåºåããŠãããŠããŸãã
äžæ¹ã§ãèæ¯ã®ãè±åºã€ãªã¥ãŒãžã§ã³çšã®å€§ããªç®±ãã®ãã¶ã€ã³ãã人ç©ã®çްéšïŒç®å
ãªã©ïŒã®æåã«é¢ããŠã¯ãäŸç¶ãšããŠã¯ãªãªãã£ã®é¢ã§èª²é¡ãæ®ã£ãŠããŸãã
æ¥æ¬èªæç€ºããè±èªããã³ããã®çæã¯Gemma 2ã«å€ããŠããªãæ£ç¢ºã«è¡ãããŠãããã®ã®ãããã§ãçºçããŠããŸããã®ãç»åçæç¹æã®ãã£ããŒã«åŽ©ãïŒèæ¯ã®å€§ããªç®±ã®å€§ãããã人ç©ã®ç®å
ãªã©ã®æåïŒããã©ãå
æãããââã
ããã³ããã®æé©åã ãã§ã¯å±ããªããã®é åã¯ã次å以éã®ããŒããšããŠãã·ã¹ãã å
šäœã§è§£æ±ºããã¢ãããŒããæ·±ãæãäžããŠãããŸãã

5. Python ããã°ã©ã ã®åŠçæŠèŠ
ä»åã®æ€èšŒã§äœæãã ollama_gemma_forge_create_picture_1.py ã¯ãè€éãªæ¥æ¬èªããé©åãªè±èªããã³ãããèšå®ãäœããããååã® #3-1 ãã以äžã®åŠçãå€§å¹ ã«åŒ·åããŠèªååããŠããŸãã
ã»Ollama ãžã®åœ¹å²ä»äžãšæç€ºïŒLLMæç€ºæã®å®çŸ©ïŒ
OllamaïŒGemma 2ïŒã«å¯ŸããŠãããã³ãããšã³ãžã㢠å
Œ ããžã¥ã¢ã«ãã£ã¬ã¯ã¿ãŒããšããŠã®åœ¹å²ã峿 Œã«ä»äžãåãªãçŽèš³ã§ã¯ãªããæ¥æ¬èªã®ãªã¯ãšã¹ããåèªåäœã«åè§£ã»åæãããåªå
床ã®é«ãéèŠãªããžã§ã¯ãããããã³ããã®å
é åŽã«é
眮ããæç€ºæã«æ¹è¯ããæ§å³ãå®å®ãããŸããã
ã»ã³ã³ããã¹ãã«ãããæ°éã»åæ°ãã®èªåŸæšè«
LLMã«æ¥æ¬èªã®ãªã¯ãšã¹ãå
šäœã®æç« ãè§£éãããæé©ãªæ°éãšåæ°ãèªåŸçã«æšè«ããLLMæç€ºæãçµã¿èŸŒã¿ãŸãããããã«ãããã2人ã®ç·å¥³ïŒå°å¹Žãšå°å¥³ïŒããšãã衚çŸããæ£ç¢ºã« 1boy, 1girl ãå°ãåºããããæ°éãæžãããŠããªãã倧ããªç®±ããåžžèãã1åãšå€æã§ããããã«ãªããŸãã
ã»ããžãã£ã / ãã¬ãã£ãããã³ããã®å
šèªåçæ
ãç»é¢ã«æããŠã»ãããã®ããæç€ºããããžãã£ãããã³ããã ãã§ãªãããç»é¢ããæé€ããŠã»ãããã®ããæå®ãããã¬ãã£ãããã³ããã®ã»ãããããŠãŒã¶ãŒã®æ¥æ¬èªå
¥åãã1ã€ã®JSONããŒã¿ãšããŠå®å
šèªåçæããŸããããã«ãããAIçæã§çºçããããç»è³ªã®äœäžãéªšæ Œã®åŽ©ããäžèªç¶ãªæåïŒäœè§£å床åãäžèŠãªæåã®åã蟌ã¿ãªã©ïŒãå
åãããŠåŒ·åã«æã蟌ã¿ãçæå質ã®åºäžããå®çŸããŠããŸãã
ã»ã¢ãã«ç¹æ§ã«åããããè§£å床ã®èªåéžå®ã
LLMãéžãã æç»ã¢ãã«ã®èšèšéçïŒSD 1.5ç³»ããæ¬¡äžä»£ã®SDXLç³»ãïŒãèªåŸçã«å€æãããnoteã®ããããŒçšïŒæšªé·ïŒããšãã£ãææ§ãªæç€ºãããç»åãç Žç¶»ããªãæé©ãªããŒã¹è§£å床ïŒ1216x704ãªã©ïŒããã¯ã»ã«åäœã§èªåéžæããããžãã¯ãçµã¿èŸŒã¿ãŸããã
ã»ã¢ãã«ç¹æ§ã«åãããè±èªããã³ããã®çæ
éžæãããã¢ãã«ããSDXLç³»ïŒanimagine-xl-v31ïŒãã®å Žåã¯æ£ç¢ºãªDanbooruã¹ã¿ã€ã«ã®ã«ã³ãåºåãã¿ã°ïŒ1boy, 1girl, school uniform...ïŒã§æ§æãããSD 1.5ç³»ïŒchilloutmixãªã©ïŒãã®å Žåã¯èªç¶ã§æåã®çްããè±èªã®æç« ïŒA photo of a beautiful Japanese girl...ïŒã«åãæ¿ããæç€ºæãçµã¿èŸŒã¿ãŸããã
ããã«ãããã¢ãã«ããšã«æãæåæ§èœãåŒãåºããããã³ããæ§æãèªåçã«å®çŸããŠããŸãã
6. 次åäºåïŒ#3-3ïŒ
ä»åã®æ€èšŒã§ã¯ãè€éãªæ¥æ¬èªããã³ããããGemma 2ãé©åãªã¢ãã«ãéžã³ããã®ã¢ãã«ã«é©ããè±èªããã³ãããç»åãµã€ãºãæç»å¯Ÿè±¡ã®åªå
床決ããŸã§ãè¡ããé«åºŠãªç»åçæã®åºç€ã®ä»çµã¿ãäœæããããšãã§ããŸããã
ãã ãå®éã«åºæ¥äžãã£ãç»åïŒç®±ã®å€§ããã人ç©ã®è¡šæ
ãªã©ïŒãèŠããšãé ã®äžã®ã€ã¡ãŒãžãšã¯ãŸã ãºã¬ããããŸãããã®ã人éã®ã€ã¡ãŒãžãšAIã®åºåçµæã®ãºã¬ããã©ãç¡ãããŠãããââããã®éšåãæ¬¡å以éã®ããŒããšãªããŸãã
ããã§æ¬¡åã¯ãèšèã ãã§ã¯äŒããã«ããæœè±¡çãªã€ã¡ãŒãžãæ£ç¢ºã«çµµã«ããããããæ¥æ¬èªã®æç€ºæãAIãçè§£ããããæç»åäœã®æ§æèŠçŽ ãžèªååè§£ããä»çµã¿ããæ§ç¯ããŠãããŸãã
åã«è±èªã«çŽèš³ããã®ã§ã¯ãªãããŠãŒã¶ãŒã®å
¥åãããç»å Žäººç©ã®å±æ§ããèæ¯ã®ãªããžã§ã¯ãããç
§æãç©ºæ°æããã«ã¡ã©æ§å³ããªã©ãLLMãèªåŸçã«åæã»å±éããç Žç¶»ã®ãªãç·»å¯ãªããã³ãããžèœãšã蟌ãããžãã¯ãæ€èšŒããŠãããŸããæ¬¡åããæ¥œãã¿ã«ïŒ
ð æ¬¡ã®èšäºã¯ãã¡ã
ã#3-3ãOllamaÃGemma 3ïŒè€éãªæ¥æ¬èªå
¥åããç»é¢æ§ææ¡ãèµ·ããçæãã©ã¡ãŒã¿ã»Forge飿ºããã³ãããèªå決å®ãã
ð ãããžã§ã¯ãå
šäœã®ç®æ¬¡ã»éå»èšäºäžèЧã¯ãã¡ã
ãããŒãããããããŒã«ã«AIã§ãæ¥æ¬èªã®ãã¥ã¢ã³ã¹ãããçæ³ã®ç»åãèªåçæããä»çµã¿ãäœã
7. ð¡ èšäºã®åŒçšã»åèã«ã€ããŠ
æ¬èšäºã®å
容ãã³ãŒãã詊ããçµæãªã©ããèªèº«ã®ããã°ã SNSçã§ç޹ä»ã»åèãšãããå Žåã¯ãæ¬èšäºãžã®ãªã³ã¯ïŒURLïŒ ãèšèŒããŠããã ããã°äºåé£çµ¡ãªãã§èªç±ã«åŒçšã»åç
§ããã ããŠæ§ããŸããã
â»æç« ãç»åã®ç¡æè»¢èŒïŒå
šæã³ããçïŒã¯ãé æ
®ãã ããã