Stable Diffusionã®ããã³ããããã§ãã¯ãããã¯ããã¯
Stable Diffusionã®ããã³ããã®éã®æ
Stable Diffusionã®ããã³ããã¯ãCLIPãšåŒã°ããAIã¢ãã«ã«å ¥åãããŠãåã蟌ã¿ãã¯ãã«ã«å€æãããŠãç»åãçæããDiffusion Modelã®ç»äœãã®ã¬ã€ããšããŠäœ¿çšãããŸãã
ãã®CLIPã§ãããå ¥åãããæç« ãããŒã¯ãã€ã¶ã§æå³ã®ããããŒã¯ã³ïŒåœ¢æ çŽ ãšèšã£ãŠããã®ããªïŒïŒã«åå²ããã®ã§ããããã®ããŒã¯ã³ã75åãŸã§ãšããéã®æããããŸãã75å以äžã¯ã©ããªãããšãããšåŸåã容赊ãªãæšãŠãããŸãã
èŠã¯ãStable Diffusionã«é 匵ã£ãŠ100ã200ã®åèªãè¶ ããé·æããã³ãããå ¥åããŠããæåã®75åå以éã®æç« ã¯ããããµãªæšãŠãããŠããŸããšããããšã§ãã
æšãŠãããããã£ãããªãã§ãããäºåã«ãã§ãã¯ããæ¹æ³ãèšèŒããããšæããŸãã
Google ColaboratoryïŒGoogle ColabïŒã§ããã³ããããã§ãã¯
ç°¡åã«Google Colabã§ãã§ãã¯ããæ¹æ³ã§ããæè»œã«ãã§ãã¯ã§ããããŒãããã¯ãäœæããŸããã
ããã«ã¯ãµããããã®ããã³ããé·ãã®éçãšèª¿ã¹æ¹ã«ã€ããŠ(StableDiffusion)èšäºããã¡ãåèã«ããŸãããæè¬ã§ãã
ç°¡åã«ãã£ãŠããããšã説æããŸãã以äžã§å¿ èŠãªã©ã€ãã©ãªãã€ã³ã¹ããŒã«ããŸãã
!pip -qq install transformers
!pip -qq install ftfy regex
CLIPã®ããŒã¯ãã€ã¶ã䜿ããããã«ããããã«ãã€ã³ããŒããšã¢ãã«ã®ããŠã³ããŒããè¡ããŸãã
from transformers import CLIPTokenizer
tokenizer = CLIPTokenizer.from_pretrained("openai/clip-vit-large-patch14")
ããã³ãããå ¥åããŸãã以äžã¯äŸæã§ãã
prompt = "This is an apple"
以äžã®ã³ãŒãã§ãµã€ãºããã§ãã¯ããŸããã
token_size = len(tokenizer.tokenize(prompt))
if token_size <= tokenizer.model_max_length - 2:
print('OK: token size is ' + str(token_size))
else:
print('NG: token size is ' + str(token_size))
äžèšã®äŸã ãšä»¥äžã®ããã«è¡šç€ºãããŸãããµã€ãºã¯4ã§75以äžãªã®ã§OKã§ãã
OK: token size is 4
ã©ã®ããã«ããŒã¯ã³ãåå²ããããã調ã¹ãŸãã
print(tokenizer.tokenize(prompt)[0:tokenizer.model_max_length-2])
以äžã®ããã«åå²ãããŠããŸãã
['this</w>', 'is</w>', 'an</w>', 'apple</w>']
å®éã®ç»åã§ãã§ãã¯
åçŽãªããã³ããã§ç¢ºèªããŸããããæ¬¡ã¯å®äŸã§ãã§ãã¯ããããšæããŸããæ£®çŸçŸ¹ãããçŽ æµãªçµµãçæã§ããããã³ãããå ¬éãããŠããã®ã§ãããã顿ã«ããããšæããŸãã
念ã®çºã§ãããåçŽã«çŽ æµãªç»åã ãšæã£ãã®ã§é¡æãšããŠããŸããé§ç®ãªäŸãšããŠãããæå³ã¯ãããŸããã®ã§ããäºæ¿ãã ããã
Twitterã®ALTæ å ±ã®ããã³ããã¯ä»¥äžã§ãã
prompt = "extremely detailed CG unity 8k wallpaper of a loli, alice, elementary school student girl with and white marble glowing skin and dot nose and perfect symmetrical pretty face with blush cheeks, pretty lively eyes, hair ornament, wearing standing in the wanderland with too many flowers, Genshin_Impact, azur_lane,blue_archive,arknights jewelry, glint, sparkle, light_rays lens_flare light_particles, hyper detailed, high detail, exquisite detail"
èªåãåãããã³ãã§ç»åãçæããŠã¿ãŸããã以äžã®èªäœã®ããŒãããã¯ã䜿ããŸãã
waifu-diffusionã§seedã¯100ã«åºå®ããŸãããã³ãããããšã以äžã®ç»åãåçŸã§ããã®ã§ã¯ãªãããšæããŸãã

ãããå šç¶æªããªãã§ããã
ããã§ããã³ããã®ããŒã¯ã³ã®ãµã€ãºããã§ãã¯ããŸãã
NG: token size is 96
75ããªãŒããŒããŠããŸããã
ããŒã¯ã³ã調ã¹ãŠã¿ãŸãã
['extremely</w>', 'detailed</w>', 'cg</w>', 'unity</w>', '8</w>', 'k</w>', 'wallpaper</w>', 'of</w>', 'a</w>', 'lo', 'li</w>', ',</w>', 'alice</w>', ',</w>', 'elementary</w>', 'school</w>', 'student</w>', 'girl</w>', 'with</w>', 'and</w>', 'white</w>', 'marble</w>', 'glowing</w>', 'skin</w>', 'and</w>', 'dot</w>', 'nose</w>', 'and</w>', 'perfect</w>', 'sym', 'metrical</w>', 'pretty</w>', 'face</w>', 'with</w>', 'blush</w>', 'cheeks</w>', ',</w>', 'pretty</w>', 'lively</w>', 'eyes</w>', ',</w>', 'hair</w>', 'ornament</w>', ',</w>', 'wearing</w>', 'standing</w>', 'in</w>', 'the</w>', 'wander', 'land</w>', 'with</w>', 'too</w>', 'many</w>', 'flowers</w>', ',</w>', 'gen', 'shin</w>', '_</w>', 'impact</w>', ',</w>', 'az', 'ur</w>', '_</w>', 'lane</w>', ',</w>', 'blue</w>', '_</w>', 'archive</w>', ',</w>', 'ar', 'knights</w>', 'jewelry</w>', ',</w>', 'gl', 'int</w>']
,ãšã _ãã«ãŠã³ããããŠããŠãåŸåã®light raysãšãlens flareãšãã£ãè¯ããããªããã³ãããå®å
šã«æ¶ããŠããŸã£ãŠããŸãããã£ãããªãæ°ãããŸããã
ãšãããã,ãš_ãåé€ããŠããã³ãããäœãçŽããŠã¿ãŸãã
prompt = "extremely detailed CG unity 8k wallpaper of a loli alice elementary school student girl with and white marble glowing skin and dot nose and perfect symmetrical pretty face with blush cheeks pretty lively eyes hair ornament wearing standing in the wanderland with too many flowers Genshin Impact azur lane blue archive arknights jewelry glint sparkle light rays lens flare light particles hyper detailed high detail exquisite detail"
ããã§ãã§ãã¯ãããšããã³ããã®ãµã€ãºã¯OK: token size is 75ãšãã®ãªã®ãªOKã«ãªããŸãããããã§åãSeedã§ç»åãçæããŠã¿ãŸãã

ãããŸãçŽ æµãªç»åãçæãããŸããã倿ŽååŸã§ãã©ã¡ããè¯ããšããã®ã¯äž»èгãããã®ã§é£ããã§ãããåŸã®æ¹ããlight raysãlens flareãšãã£ãããã³ããã®æå³ãããå ¥ã£ãç»åã«ãªã£ãŠããã®ã§ã¯ãªãããšæããŸãã
æŽã«è©³çŽ°ã®æ€èšŒ
ç§ã®èšäºãããŒã¹ã«ããã«æ·±ãæ€èšŒãããŠãã ãã£ãŠããèšäºã§ããç§ããµãã£ãŠãããªãã£ããšãããŸã§ã詳ããæ€èšŒã説æããããŠããŸãããã詳ããç¥ãããæ¹ã¯ããã®èšäºãšåãããŠã©ããã
75ããŒã¯ã³çªç Žæ¹æ³
AUTOMATIC1111çã®Stable Diffusionãã75ããŒã¯ã³ã®å¶éãçªç Žããå®è£ ãããŠããŸããã
AUTOMATIC1111ãéåžžã«å€æ©èœãªã®ã§ã倿Žéå€ãèŠããŸãããåºæ¬çã«ã¯åã蟌ã¿ãã¯ãã«ã®éã¿ä»ãããŠãè¶³ãåãããããšã§75ããŒã¯ã³ã®å¶éãçªç ŽããŠããããã§ãã
ãŸãšã
Stable Diffusionã®ããã³ããããã§ãã¯ããæ¹æ³ãèšèŒããŸãããçå±ãç¥ã£ãŠãããšãããããããã³ãããç·Žãããã§ãããTwitterãDiscordã§Stable Diffusionã«1000æãšãå ¥åããŠãã人ãã¿ãããŠåºŠèæãããã®ã§æããèšäºãæžããŠã¿ãŸããïŒç¬ïŒã
å°ãã§ããã®èšäºã§ããããStable Diffusionã©ã€ããéãã人ãå¢ããããšãé¡ã£ãŠãããŸãã
åèãªã³ã¯
é¢é£èšäº
倿Žå±¥æŽ
- 2022/10/18 75ããŒã¯ã³å¶éçªç Žã«é¢ããŠè¿œèš
Discussion