
ControlNetã§ããŒãºãæ§å³ãæå®ããŠAIã€ã©ã¹ããçæããæ¹æ³
ããã«ã¡ã¯ãã ã ã£ãã±ãã ã§ãã
ä»åã¯ãAIã€ã©ã¹ãçéã§æè¿è©±é¡ã®ControlNetã«ã€ããŠäœ¿ãæ¹ããã£ãã玹ä»ããŠãããŸãã
ã¢ãããç¶ãã°éææŽæ°ããŸãã
StableDiffusionWebUIã®ã€ã³ã¹ããŒã«
ä»åã¯StableDiffusionWebUIã®æ¡åŒµæ©èœã®ControlNetã䜿ããŸãã
WebUIã®ã€ã³ã¹ããŒã«ã«é¢ããŠã¯ãã§ã«ããããªè§£èª¬èšäºãåç»ããããšæãã®ã§ãã¡ãããåç
§ãã ããã
äžå¿åãäœã£ãç°¡åã«WebUIãèµ·åã§ãããœããã玹ä»ããŠãããŸãïŒããã§ãïŒ
ControlNetãšã¯
ã¡ãããã£ãã説æãããšãæ£äººéãç·ç»ã深床æ
å ±ããããã«åŸã£ãŠç»åãçæã§ããæ©èœã§ãã
ã€ãŸãæåŒ·ã§ãã
ãã¶ã€ã³ããŒã« -> openpose -> StableDiffusion
â ã ã ã£ãã±ãã ð (@ddPn08) February 14, 2023
ãã°ãã°ãããªãè¯ã pic.twitter.com/PRWGuQPOzH
絶察ééã£ãŠãControlNetã®äœ¿ãæ¹ã
â ã ã ã£ãã±ãã ð (@ddPn08) February 14, 2023
å²ãšå€ãªããŒãºã§ããããð
åµè¬ã¡ããããããªããããããããããã#AIArt #AIã€ã©ã¹ã pic.twitter.com/tONW9N5Pdg
äžã®ãã€ãŒãã®ãããªæãã§ãããŒãºãå®ç§ã«æå®ã§ãã¡ãã£ããããŸãã
ä»ã®äŸãèŠããæ¹ã¯ãã¡ãã®ãªã³ã¯ããããããèŠããŸãð
ã€ã³ã¹ããŒã«
è¶
ç°¡åã§ãã
WebUIãéããŠExtensionsã¿ãã«é£ã³ãŸãã
ãããããInstall from URLãã¯ãªãã¯ããŠäžçªäžã®ããã¹ãããã¯ã¹ã«
https://github.com/Mikubill/sd-webui-controlnet.gitãå ¥åããInstallãã¿ã³ãã¯ãªãã¯ããŸãã

ãããããWebUIãåèµ·åããŠã€ã³ã¹ããŒã«å®äºã§ãã
ã¢ãã«ãããŠã³ããŒã
次ã«ControlNetã®ã¢ãã«ãããŠã³ããŒãããŸãã
äžã®ãªã³ã¯ãããã¹ãŠã®ã¢ãã«ãããŠã³ããŒãã§ããŸãã
https://huggingface.co/lllyasviel/ControlNet/tree/main/models
ãã ã5GBè¶ ãã®ã¢ãã«ãå šéšã§ïŒåãããã®ã§ã䜿ããã®ã ãããŠã³ããŒãããã®ããå§ãããŸãããã®åŸãåææ³ã®èª¬æã§äœ¿çšããã¢ãã«ãäžç·ã«ç޹ä»ããŸãã
â» 2023/02/15 远èš
軜ãã¢ãã«ãåºãŸãã700MBã¬ãã«ãªã®ã§å
šç¶å
šéšå
¥ãããŸã
https://huggingface.co/webui/ControlNet-modules-safetensors/tree/main
ãšããããopenposeã§æ¯èŒ
â ã ã ã£ãã±ãã ð (@ddPn08) February 15, 2023
çµè«ãªããå€ããã
éçæ²ã¯ãªããé»ãã³ã https://t.co/PCs0mNBXTo pic.twitter.com/t09I5Fy3nH
ã¢ãã«ã®é 眮
ã¢ãã«ãããŠã³ããŒããããæ¡åŒµæ©èœã®ã¢ãã«ãã©ã«ãã«ã¢ãã«ãé 眮ããŸããæ¡åŒµæ©èœã®ãã£ã¬ã¯ããªã¯
<WebUIã®ãã©ã«ããŒ>\extensions\sd-webui-controlnetã§ãã
ãã®ãã©ã«ãã«ããmodelsãã©ã«ãã«ã¢ãã«ãé
眮ããŸãã

openpose | ãã¶ã€ã³ããŒã«ããããŒãºãæå®
ãŸãã¯åãããªãæ°ã«å
¥ã£ãŠããæ¹æ³ã玹ä»ããŸãã
ãã®æ¹æ³ã§ã¯ãã¶ã€ã³ããŒã«ãšãããœããã䜿ãã3Dã§ããŒãºãæå®ããæ¹æ³ã§ãã
䜿ãControlNetã¢ãã«ã¯control_sd15_openpose.pthã§ãã
ãã¶ã€ã³ããŒã«ãã€ã³ã¹ããŒã«
ç¡æçã§åå䜿ããŸãã以äžã®ãªã³ã¯ããããŠã³ããŒãããŠã€ã³ã¹ããŒã«ããŠãã ããã
èµ·åãããšãã®ãããªç»é¢ã«ãªããŸã

ããŠã¹ã«ãŒãœã«ã§æãè¶³ããã©ãã°ããŠå¥œããªããŒãºãäœããŸãããã

ããæãã®ããŒãºãã§ãããå·Šäžã®ãã¡ã€ã« > ç»åãæžãåºã ãã¯ãªãã¯ãä¿åããŸãã

è§£å床ã¯çæããç»åãšåã瞊暪æ¯ã§ããæ¹ãè¯ãã§ãã
ControlNetã«ç»åãã»ãã
ControlNetãã€ã³ã¹ããŒã«ããç¶æ ã§WebUIãèµ·åãããšäžã®ç»åã®ãããªã¢ã³ãŒãã£ãªã³ã衚瀺ãããŸãããããã¯ãªãã¯ããŠControlNetã®èšå®ãéããŸãã

Enableã«ãã§ãã¯ãã€ãã
preprocessor -> openpose
Model -> control_sd15_openpose
Canvas Width -> å
ã»ã©ã®ç»åã®æšªå¹
Canvas Height -> å
ã»ã©ã®ç»åã®çžŠå¹
Imageã«ç»åããã©ãã°ã¢ã³ãããããïŒãããã¯ã¯ãªãã¯ããŠç»åãéžæïŒ

ããã§èšå®ã¯å®äºã§ãã
æ©éçæããŠã¿ãŸãããã

negative prompt: worst quality, low quality, medium quality, deleted, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, jpeg artifacts, signature, watermark, username, blurry


ç¡äºãæå®éãã®ããŒãºã§ç»åãçæã§ããŸãããããã³ããã«ã¯ã¯ãªãªãã£ã¿ã°ãš1girl, jumping, airããå ¥ããŠããŸããã
çæç»åãšäžç·ã«åºãŠããã«ã©ãã«æ£äººéã¯ãã¶ã€ã³ããŒã«ã®ç»åããããŒãºãè§£æãããã®ã§ãããããããšã«ControlNetãç»åãçæããŸãã
ã«ã©ãã«æ£äººéããçæ
å¥ã®ææ³ã§ãã§ã«ã«ã©ãã«æ£äººéã®ç»åãæå ã«ããå Žåã¯ããã䜿çšããŠçæã§ããŸãã

èšå®ã¯ãããªæãããã€ã³ãã¯preprocessorãNoneã«ããããšã§ãã

ãããªæãã§çæã§ããŸãã
midas + depth | 深床æ å ±ããç»åãåºå
StableDiffusion v2ã§åºãŠããæ©èœãdepth2imgããšã»ãŒåãã§ãã
ãããv1ã¢ãã«ã§ã§ããŸãã
䜿ãã¢ãã«ã¯control_sd15_depth.pthã§ãã
çæããç»åã®ãã£ã©ãå ¥ãæ¿ãã
å ã»ã©çæããç»åã®ãã£ã©ãå ¥ãæ¿ããŠã¿ãŸããããïŒãšèšã£ãŠãç¹ã«ãã£ã©ãæèããããã§ã¯ãªãã®ã§ã€ã¡ãã§ã³çãªé°å²æ°ã§ãïŒ

negative prompt: worst quality, low quality, medium quality, deleted, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, jpeg artifacts, signature, watermark, username, blurry
èšå®ã¯ãããªæãã
preprocessor -> midas
model -> control_sd15_depth
â» 2023/02/15 远èš
midas 㯠depth ãšããååã«å€ãããŸããã
ãã®ç¶æ ã§çæãããšãããªãããã

çæç»åãšæ·±åºŠã®ç»åã衚瀺ãããŸãã
ãã ãã®ç¶æ
ã ãšäœãå€ãããªãã§ããã
å°ãããã³ãããããã£ãŠãã£ã©ãå€ããŠãããŸãããã®éWeightãšããå€ãããã£ãŠæ·±åºŠæ å ±ã«ã©ãã ãåŸããã調ç¯ããå¿ èŠããããŸãã

negative prompt:Â worst quality, low quality, medium quality, deleted, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, jpeg artifacts, signature, watermark, username, blurry
weight: 0.4
ãã¬ã¹ãçããŠãã³ã°ãã¢ãŒã«ããŠã¿ãŸãããããæãã«ãã£ã©ãå€ãããŸãããã

negative prompt:Â worst quality, low quality, medium quality, deleted, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, jpeg artifacts, signature, watermark, username, blurry
weight: 0.4
ç«è³åŠçæã®å¥³åã«ããŠã¿ãŸããã
ãããªæãã§ããŒãºãå€ããã«ç¹åŸŽãå€ããããšãã§ããŸãã
ãŸãšã
ã¡ããã€ãããããããã
ïŒã»ãã®æ©èœã¯ãã€ãæžããããããªãã§ãïŒ