
DrawThingsã§Illustriousã®LoRAäœæ
ðãæããã¡ããð»ãªãã±ã®ã«ãªã§ã
ãã¡ãã¯çŽ äººã«ããèªç±ç ç©¶ã«ãªããŸããèªåçšã¡ã¢ãå
ŒããŠã
ComfyUIãšãã©ããã®ãµãŒãã¹ãšã䜿ã£ãæ¹ãæ
å ±ãå€ããæ¥œã«ã§ãããšæãã飜ããŸã§DrawThingsã§ã®æ
å ±ã§ãã®ã§ã泚æã
DrawThingsã£ãŠïŒ
iphoneã§äœ¿ããç»åçæAIã¢ããªãMacã§ã䜿ããïŒã«ãªã¯Macã§ã®ã¿äœ¿ã£ãŠãŸãïŒLoRAåŠç¿ãã§ãããã©å€åæ¥æ¬äººãŠãŒã¶ãŒãå°ãªããŠããšã«ããæ¥æ¬èªã®æ å ±ãå°ãªããDiscordã§è³ªåããããšã¯ã§ãããã©ãå ã ç¥èããã£ããWikièªã¿è§£ãããããåæã£ãœãã®ã§è±èªåŒ±è ã§ã¬ãã®åå¿è ã ãšãããŸçè§£ã§ããªããäœãDTã®æçæ å ±ç¥ã£ãŠããæããŠãã ããïŒ
åŠç¿ã®ãã€ã©ãã«ããã®ïŒ
DrawThingséããšå·ŠåŽã«ãããŸããªã¡ãã¥ãŒããã£ãŠããã®äžçªäžã«ãããPEFTãã£ãŠãã€ãLoRAåŠç¿ã


chatGPTã«ãã解説
åŠç¿ç»é¢ã®å·Šã«ã©ã å
ãå
šéšã¹ã¯ã·ã§ããŠchatGPTã«ãã®çްããæåèªãã§ããã£ãŠãæãã解説ãããŠããã£ããåã£ãŠããã©ããã¯ããããŸãããDrawThingsã£ãŠãªããããŸãäžè¬çã§ãªãçšèªäœ¿ã£ãŠãã£ãœããŠæ€çŽ¢ããŠãé©åãªãã®ãèŠã€ãããªãããšå€ããã§ãããããã ã§ããããããªãã®ã«ãããã«æ··ä¹±ããã
æã£åãæ©ãäœãæ¹ãç¥ããã人ã¯ç®æ¬¡ã®ãIllustriousã§LoRAåŠç¿ãããããããŸã§é£ã¶ãšè¯ããã
ãAIãšãããã°ã©ãã³ã°ãšããªããããããŸããïŒåå¿è ã§ãïŒãã£ãŠèšã£ãŠãããDraw ThingsïœLoRAåŠç¿ïŒãã€ããŒãã©ã¡ãŒã¿ïŒå šææžãèµ·ããïŒåå¿è åã解説ïŒ
ããŒã¹ã¢ãã«
LoRAã¯å ç®åã¢ãã«ã§ããããŒã¹ã¢ãã«ãå¿ èŠã§ããããã埮調ããŸããåªããããŒã¹ã¢ãã«ã¯å¿ èŠãªã¹ãããæ°ãæžãããæçµçµæã®çŸãããåäžãããŸãã
ðã©ã®AIãåå°ã«ããŠèŠãããããïŒæ®æ®µäœ¿ã£ãŠããã¢ãã«ãšåãã«ãããšå€±æãã«ããã
åºåããLoRAã®åå
LoRAãªã¹ãã«è¡šç€ºãããååã§ãããã®ååã§ããã€ããŒãã©ã¡ãŒã¿ããã¬ãŒãã³ã°ããŒã¿ã»ããã®ãã£ãã·ã§ã³ãªã©ã®æ å ±ãä¿åãããåãååã䜿çšããã°ãããã®æ å ±ã埩瀺ã§ããŸãã
ð 宿ããLoRAã®ãã¡ã€ã«åãåŸã§èŠè¿ãããšãã«åããååã«ããã
ããªã¬ãŒã¯ãŒã
ããªã¬ãŒã¯ãŒãã¯ãã£ãã·ã§ã³ã«èªåå ¥åãããLORAã®è¯ãåºçºç¹ãšãªããŸããã¢ãã«ã«åŒ·ãæå³ãæããªãååšãéžãã§ãã ããããããªããšå ã®ã³ã³ã»ãããããŠããŸãå¯èœæ§ããããŸãã
ðããã®LoRAãåŒã³åºãåèšèããã£ã©LoRAã§ã¯å¿ é ã
ãããã¯ãŒã¯æ¬¡å
ããããã¯ãŒã¯æ¬¡å ãã¯LoRAãããã¯ãŒã¯ã®å®¹éãæ±ºå®ããŸãã倧ããå€ã¯ããå€ãã®ããŒã¿ã§ã®ãã¬ãŒãã³ã°ãå¿ èŠãšããŸãããããŒã¿ã®åŸ®åŠãªãã¥ã¢ã³ã¹ãæãããããªããŸãã
ð èŠããããæ å ±éãå°ãªããããšå¹ããªããå€ããããšéãã
ãããã¯ãŒã¯ã¹ã±ãŒã«
ããã¯ä»ã®ãã¬ãŒããŒã§ã®ãNetwork Alphaã ãŸãã¯ãNetwork Dimãã«çžåœããLORAãããã¯ãŒã¯å ã®ã©ã³ãã éã¿ã®åæåœ±é¿ã決å®ããŸããå°ããå€ã¯ãã¬ãŒãã³ã°ã®å®å®åã«å¯äžããå ŽåããããŸãã
ð LoRAã®å¹ãã®åŒ·ããåºæ¬ã¯1.0åºå®ã§OKã
UNetåŠç¿ç
ã¡ã€ã³è£ æ£ã¢ãã«ã®åŠç¿çã§ãããŠã©ãŒã ãªã¹ã¿ãŒãä»ãã³ãµã€ã³ã¢ããŒãªã³ã°ã§äžéãšäžéã®éãè£åããŸãã
ð å匷ã®ã¹ããŒããé«ããããšå£ããäœããããšèŠããªãã
ç»åãµã€ãº
çæãããç»åã®ãµã€ãºã§ããæè¯ã®çµæãåŸãã«ã¯ã1:1ãŸãã¯Normalã䜿çšããŠãã ããã
ð èŠããããç»åã®å€§ããã1024ã¯é«å質ã§ããããã
ã¢ã¹ãã¯ãæ¯ãšãã«ãã¹ã±ãŒã«
ãåœåã®ã¢ã¹ãã¯ãæ¯ã䜿çšãããªãã®å Žåãç»åã¯æå®ãµã€ãºã«ãªãµã€ãºåŸãã»ã³ã¿ãŒã¯ããããããŸãããªã³ã®å Žåãæå®ãµã€ãºãç·ãã¯ã»ã«æ°ãšããŠè¿äŒŒããå ç»åã®ã¢ã¹ãã¯ãæ¯ã䜿çšããŸãããŸãããã«ãã¹ã±ãŒã«ãã«ãããè€æ°ã®è§£å床ã§åäžç»åãåŠç¿ããæ§é ãšè©³çްã®äž¡æ¹ãæãããããªããŸãã
ð è²ããªãµã€ãºã»æ¯çã§èŠããããŠå®å®ãããæ©èœãONæšå¥šã
ã·ãŒã
ã·ãŒãå€ã¯ç»åçæã®éå§æ¹æ³ã決å®ããŸããåãã·ãŒãå€ã䜿çšãããšãåãç»åãçæãããŸãã
ð ã©ã³ãã ã®çš®ãåºæ¬ã¯æ°ã«ããªããŠããã
ãã¬ãŒãã³ã°ã¹ãããæ°
å®è¡ãããã¬ãŒãã³ã°ã¹ãããæ°ã§ããåŠç¿äºãšäœµããŠèª¿æŽããå¿ èŠããããŸããåŠç¿çãäœãå Žåãã¢ãã«å®¹éã倧ããå Žåã¯ãããå€ãã®ã¹ããããå¿ èŠã§ãã
ð äœå埩ç¿ããããå°ãªããšèŠããªããå€ããããšèŠããããã
Nã¹ãããããšã«ä¿å
Nã¹ãããããšã«LoRAãä¿åããã¢ãã«ã®åŠç¿ãé²ããŸãã
ð éäžã»ãŒããæ¯èŒã倱ææã®ä¿éºã
ãŠã©ãŒã ã¢ããã¹ãããæ°
ã©ã®ã¹ãããããå®å šãªåŠç¿çã䜿çšããããå¶åããŸãããŠã©ãŒã ã¢ããã¹ãããã¯åæäŸã«é床ã®éã¿ãããããªããããã¬ãŒãã³ã°ãå®å®åããŸãã
ð æºåéåãå°éããŒã¿ã§ã¯çããè¯ãã
åŸé èç©ã¹ãããæ°
ãããã¯ãŒã¯æŽæ°ãå®è¡ããã¿ã€ãã³ã°ã決å®ããŸããæŽæ°åã«ããå€ãã®
åŸé
ãèç©ãããšãé²ãã¹ãæ¹åã®çµ±èšãè¡ãããåŠç¿çãããã«åãããŠ
調ïŒäŸïŒ2åã®ã¹ãããã§ããã°åŠç¿çã2åïŒããå¿
èŠããããŸãã
ð å°åãåŠç¿ãäœã¹ããã¯ç°å¢åãã
ãã€ãºãªãã»ãã
ããã€ãºãªãã»ãããã¯ãã€ãºååžã«è¿œå ã®ãªãã»ãããå°å ¥ããŸããããã«ãããåžžã«äžéçºåºã«ãªãã®ã§ã¯ãªããæãã»æããç¶æ³ãããé©åã«è¡šçŸã§ããŸãã
ð ææã®å®å®åãåºæ¬ã¯0.05ã§OKã
ãã€ãºé€å»ã¹ã±ãžã¥ãŒã«
ãã€ãºé€å»ããã»ã¹ã®ã©ã®æ®µéã«çŠç¹ãåœãŠãŠåŸ®èª¿æŽããããæ±ºå®ããŸããäŸãã°ã70%ïœ100%ã®éã§ç»åãã粟緻åãããLORAãã0ïŒ ïœ50ïŒ ã§æ§å³ãçããLoRAãªã©ããããŸãã
ð åŠç¿ã®ã©ã®æ®µéãéèŠããããåå¿è ã¯è§Šããªãã
ãã£ãã·ã§ã³ããããã¢ãŠãç
空ã®ãã£ãã·ã§ã³ã䜿çšãããµã³ãã«ã®å²åãæ±ºå®ããŸããããã«ãã芳念ãäžè¬åãããŸãããæ ¹å¿µã®æµåºãèµ·ããå¯èœæ§ããããŸãã
ð 説ææãç¡èŠããå²åãå°éããŒã¿ã§ã¯0ãæ£è§£ã
åºå®æ£èŠçŽäº€LoRAããŠã³
LoRA ãã¬ãŒãã³ã°ã§ã¯ã掻æ§åãå°ããªéšå空åã«å°åœ±ããããŠã³ãããªãã¯ã¹ãšãå ã®æœåšç©ºåžã«æ»ãã¢ãããããªãã¯ã¹ã®2ã€ã®ãµããããªãã¯ã¹ã䜿ãããŸããããã§ããœ=ïŒWïŒWïŒâããœãïŒW +BAïŒ*ã«çœ®æããŸããããŠã³ãããªãã¯ã¹ãæ£èŠçŽäº€è¡åãšããŠåºå®ããããšã§ããã¹ãŠã®åŸ®èª¿æŽãBè¡åäžã§è¡ãããå®å šãªåŸ®èª¿æŽã«è¿ã¥ããããšãã§ããŸãã
ð æ°åŠãŽãªãŽãªã®äžçŽè åãå®å®åãåå¿è ã¯è§ŠããªããŠOKã
ãã¯ãŒãã¡ã³ã¯ã·ã§ã³EMA
EMAïŒææ°ç§»åå¹³åïŒã¯ãã¬ãŒãã³ã°çµè·¯äžã§ã¢ãã«ãå¹³ååãã广çãªææ³ã§ããææ°ã®ã¢ãã«ã§ã¯ãªãäžå®æéã®å¹³åã¢ãã«ãä¿åããããšã§ãããæ»ãããªçµæãåŸãããŸããKarrasã®æã«åºã¥ãããããã¡ã€ã«ãå®è£ ããŠããããã¬ãŒãã³ã°åŸã«ç°ãªãå¹³ååãã©ã¡ãŒã¿ãéžæã§ããŸãã
ð åŠç¿ã®ãã¬ãæããæãã¬è£æ£ãONæšå¥šã
ã¡ã¢ãªã»ãŒããŒ
ãã®ãªãã·ã§ã³ã¯LoRAãã¬ãŒãã³ã°æã«æ§ãšRAM䜿çšéã®ãã¬ãŒããªããå¯èœã«ããŸãããããã«ã¯æãé ããæå°ã¡ã¢ãªããã©ã³ã¹ã¯äžçšåºŠãã¹ããŒãã¯ãã©ã³ã¹ããéããå€ããã¿ãŒãã¯æéã§æå€§ã¡ã¢ãªã䜿çšããŸãã
ð ã¡ã¢ãªãšé床ã®ãã©ã³ã¹ããã©ã³ã¹æšå¥šã
éã¿ã®ã¡ã¢ãªç®¡ç
FLUX.1[dev]ãªã©ã®å€§èŠæš¡ã¢ãã«ã§ã¯ãéã¿ã倧éã®RAMãæ¶è²»ããŸãã Just-in-Timeã«ããå¿ èŠãªæã«éã¿ãèªã¿èŸŒã¿ãäžèŠã«ãªã£ãããªãããŒãããŠRAM䜿çšéãæããŸãã
ð éããæç§æžãå¿ èŠãªãšãã ãåºãä»çµã¿ãåºæ¬ã¯ããã©ã«ãã
TensorBoardã«ä¿å
ãã¬ãŒãã³ã°æã TensorBoardã§éçºå¯èœãªåœ¢åŒã§ä¿åããäžçŽãŠãŒã¶ãŒãããã»ã¹ã远跡ã§ããŸãã
ð åŠç¿ãã°ã®èšé²ãåå¿è
ã¯äžèŠã
Illustriousã§LoRAåŠç¿ããããã
wikiãè±èªã§ããããªããDiscordã§è³ªåããŠããwikièŠããããããããããããããããã£ãŠèšãããŠããŸã£ãã®ã§ä»¥äžã¯èªåã§æš¡çŽ¢ããããæ¹ã
åºæ¬çãªäœãæ¹
æåž«ç»åã100æä»¥äžããå Žåã®ããæ¹ãæåã¯ããã©ã«ãèšå®ã§OKããã£ã©ã¯ã¿ãŒã®èŠãããããéšåïŒç®ã®è²ã髪ã®è²ã髪åãç®ã€ããªã©ïŒããã£ãã·ã§ã³ãšããªã¬ãŒã¯ãŒãã«ãããã§ããããã
äžèšã§ãã¡ã ã£ãå Žå
ãã¬ãŒãã³ã°ã¹ãããæ°ã5000ãšã10000ãšãã«ãã
ãããã¯ãŒã¯æ¬¡å ã®æ°ãæžããïŒ2ãã€æžãããšãããããïŒ
ããã£ãããªããšããªãã
æåž«ç»åã2æãããªãå Žå
ãã€ã§ã100æããã°ãããã ãã©ãã ãããã®å Žåãæåž«ç»åã£ãŠãããå°ãªãã£ããããããã«ã¿ããã䜿ã£ãŠå°ææ°ãããã£ã©ã¯ã¿ãŒLoRAãäœã£ãŠã¿ããã
ãã«ã¿ããã£ãŠïŒ
AI ã«é¢é£ããå©çšã«éããç®çãåããèªç±ã«äœ¿ãããšãã§ãããã£ã©ã¯ã¿ãŒããã«ã¿ããã®ä»ã«ã¬ã³ããã£ãããŒã¿ããŒããšããåšããããç»åã¯çŸç¶äºé¢å³ã®ã¿ãããªãïŒå ¬åŒLoRAãé åžãããŠããŸããä»åã¯äœ¿ããŸããïŒ
ä»ãããããæ¹ã¯2éãããŸãã¯æåž«ç»åã«é¢ããŠã
1. Qwenãnanobananaã䜿ã£ãŠæåž«ç»åãå¢ãã
ãã®2ã€ã¯ç»åç·šéãåŸæãªAIã詳ããã¯ä»åã¯å²æãããã ããã©ããç·ç»ã«ãããè²ãå¡ã£ãããå¥ã®ããŒãºãããããå¥ã®è¡šæ
ãããããã§ããã
nanobananaã¯Geminiã§ã§ããç»åç·šéAIãã ãã©ãã¢ããããŒãããã®ã¯ã¡ãã£ãšããããªãããšãããã
ããã§ããŒã«ã«ã§ãDTã§ãã§ããã®ã¯Qwenãã ãã©ãã¡ããã¡ãéãã1æ10åãšã30åãšããããããçæããŠãéãä»ã®äœæ¥ã§ããªããããéãã
ããšäž¡æ¹ãšããªãã ãã©ãé¡ã€ããå€ãã£ãŠããŸããã¡ãäžæãããæ¹ãããããããªããã ãã©ä»ã®æç§ã¯ããŸãã§ããŠãªãã
ãã®2ã€ã䜿ã£ãŠæåž«ç»åã100æãããçšæã§ããããããäžçªããããããããããæåã«èšã£ãããæ¹ã§ã§ããããïŒâ»ã«ãªã¯ãŸã ãã£ãããšãªãã§ãïŒ
2. ç»åãæ°Žå¢ãããŠãåŠç¿ã®èšå®ãããã¡ãã£ãšåŒã
ãã«ã¿ããã®æåž«ç»åãå·Šå³å転ãããåãæãããåŸãããããã

è²ããªãšããã«å·®ã蟌ãã ã®ã§èŠã«ãããªã£ãŠãŸããnoteã®èšäºãè¿œèšæŽæ°ããŸããã
â 852話(hakoniwa) (@8co28) January 21, 2024
ãã«ã¿ããLoRAæ€èšŒ1ãšLoRAé åžïœ852話 @8co28 #note https://t.co/c7ISRQCBiE
ãã¡ãã®èšäºãåèã«ãããŠããã ããŸãããéã³ã©ããŠã¡ãã£ãšéãããŒãºã«ããã®ãšããäœã®äžéšã ãã¢ããã«ãããã€ã¯ä»åã¯äžæŠãããªãã£ãã
ã§ããã®æ°Žå¢ã25æã100æãããšããšåãèšå®ã§ãã£ãŠãããŸãè¡ããªãã£ããšãããã§ãŸãLoRAåŠç¿ç»é¢ãäžéãèªãã§ããã£ãchatGPTã«ã©ãããããããèããŠã¿ãã
ð 25æåãããããèšå®ãŸãšãïŒDrawThingsïŒ
ð¹ åºæ¬
⢠ãããã¯ãŒã¯æ¬¡å ïŒ8
⢠ãããã¯ãŒã¯ã¹ã±ãŒã«ïŒ1.0
ð¹ åŠç¿
⢠ãã¬ãŒãã³ã°ã¹ãããæ°ïŒ5000ååŸ
⢠UNetåŠç¿çïŒ0.00015ã0.0002
⢠ãŠã©ãŒã ã¢ããã¹ãããïŒ5ã10
ð¹ å®å®å
⢠EMAïŒON
⢠ãã€ãºãªãã»ããïŒ0.05ïŒãã®ãŸãŸïŒ

ãã®éãã«èšå®ãããããããæ°ã®LoRAãäœãããŠããŸã£ãã®ã ããã©ã
ïŒäœãèµ·ããã®ãçè§£ããªããŸãŸå®è¡ããŠãïŒããã§ããŸãè¡ããŸãããç¡å°5000ã§ããŸããã£ãã®ã§ãpEMA0.050ãšpEMA0.100ãšã¯å¥ã«ãããªããããEMAã¯OFFã§ããã£ãã®ããªïŒ
<deltamon>, 1girl, yellow-green hair, light blue eyes, cat ears, silver earrings, headband, white collar, yellow tie, light blue dress, shoulders, sides, white flared sleeves, yellow lines, white pockets, thighs, knee-high socks, robot joints, light pink boots, light pink backpack, cable tailalking
çµæèŠãã³ãããã¿ã€ã
ããŸããã£ããïŒæºè¶³



ãã ãã£ã±å
ã
ã®æåž«ç»åãããå°ãªãã®ã§ãããã«åããã¥ããã¯ãã
æã®åªæãåããšãããªã

ãã«ã¿ããã¯ã§ããå£èª¿ã ãããããã¬ã¹çãŠããã£ãããå
ã®ãã¬ã¹ãã¶ã€ã³ãåãå
¥ããããšããŠãŠããããã




ã¡ãªã¿ã«<deltamon>ã ãã ãšã©ããªãã®âŠïŒ

ãŸãšãããš
⢠æåž«ç»åãæ°Žå¢ããªã©ããŠ25æã»ã©çšæ
⢠ãã£ãã·ã§ã³ãšããªã¬ãŒã¯ãŒãïŒ<deltamon>, 1girl, yellow-green hair, light blue eyes, cat ears, silver earrings, headband, white collar, yellow tie, light blue dress, shoulders, sides, white flared sleeves, yellow lines, white pockets, thighs, knee-high socks, robot joints, light pink boots, light pink backpack, cable tail
⢠ãããã¯ãŒã¯æ¬¡å
ïŒ8
⢠ãããã¯ãŒã¯ã¹ã±ãŒã«ïŒ1.0
⢠ãã¬ãŒãã³ã°ã¹ãããæ°ïŒ5000
⢠UNetåŠç¿çïŒ0.00015
⢠ãŠã©ãŒã ã¢ããã¹ãããïŒ5
ã§ããããããšã¯æ°åããããã€ã€ãã©ã€ã¢ã³ããšã©ãŒïŒ
ãã£ãšééã£ãŠãéšåã¯ãããããããšæããŸããããããããªããŸãŸchatGPTã®èšããšããããŸãã¯èªåã§ãã¹ããéãããããçµæã«éããªãã®ã§ã
ãããªããã§ããä»åã¯ããã§ãããŸãã
以äžãªãã±ã®ã«ãªã§ããã
ðãæããã¡ããð»
远èš
ãã®èšå®ã§ã¿ãŒãã§åŠç¿ãããšPCãéããªãäžã«20æéãããããã£ãŠããã ãã©ã詊ãã«ãã©ã³ã¹ã§éå§ããŠã¿ãã12æéãšãèšã£ãŠãã
ãªãã§ãããã