
æç« çæãšç»åçæã®éããèªå·±ååž°ãšæ¡æ£
æç« çæAIã«æç« ãé Œã¿ãç»åçæAIã«çµµãé Œããšãã©ã¡ããå ¥åæ¬ãžèšèãå ¥ããŠãã°ããåŸ ã€ã ãã§æ°ãããã®ãåºãŠããã®ã§ãè£åŽã§ã䌌ãåŠçãããŠããããã«æããŸãã
ãšããããæç« çæã§ãã䜿ããããèªå·±ååž°ããšãç»åçæã§ãã䜿ããããæ¡æ£ãã§ã¯ãçæéäžã«äœãæŽæ°ããŠããããéããŸãã
èªå·±ååž°åã¯ããã§ã«äžŠãã§ããæç« ããæ¬¡ã®äžçãäºæž¬ããåŸããžè¶³ããŸããæ¡æ£åã¯ããã€ãºããå§ããç»åå šäœã®è¡šçŸãäœåºŠãæŽæ°ããŸããçæ¹ã¯ç¶ããç©ã¿äžããããçæ¹ã¯å šäœãå°ããã€æŽããããã®éãããåè«æã«æžãããçææé ãã远ããŸãã
èªå·±ååž°ã¯ã確å®ããç¶ããäžã€ãã€è¶³ã
GPTç³»ã®æç« çæã¢ãã«ã§ã¯ãæç« ããããŒã¯ã³ããšããåäœãžåããŠæ±ããŸããããŒã¯ã³ã¯åèªãã®ãã®ãšã¯éãããäžã€ã®æŒ¢åãã²ãããªæ°æåãè±åèªã®äžéšãªã©ãã¢ãã«ãæç« ãåŠçããããã«åºåã£ãæçã§ãã
OpenAIã¯GPT-2ã®åŠç¿æ¹æ³ããåã«ããèšèãããšã«æ¬¡ã®èšèãäºæž¬ãããã®ã ãšèª¬æããŠãããGPT-3ã®è«æã§ããã¢ãã«ã¯ãèªå·±ååž°åã®èšèªã¢ãã«ããšèšãããŠããŸãã
ããšãã°ãéšãéã£ãŠããã®ã§ãåãããŸã§ãå ¥åãããŠãããšãã¢ãã«ã¯ããã®ç¶ãã«çœ®ããããªããŒã¯ã³ããšã®ç¢ºçãèšç®ãããã®äžããäžã€ãéžã³ãŸãããæã£ãŠããŸã§åºãã°ãä»åºŠã¯ãã®èªãå«ãå šæãæãããã«ãããã«æ¬¡ãäºæž¬ããŸãã
çæã®æµãã¯ã次ã®ããã«ãªããŸãã
ãéšãéã£ãŠããã®ã§ãåãã
ãéšãéã£ãŠããã®ã§ãåãæã£ãŠã
ãéšãéã£ãŠããã®ã§ãåãæã£ãŠåºããã
ãã®ããã«ããã§ã«åºããéšåãæ¡ä»¶ãžå ããªãããæç« ãå ãžäŒžã°ããŠãããŸãããã®çææ¹æ³ãèªå·±ååž°ã§ãããèªå·±ããšããèšèã¯ãèªåããããŸã§ã«åºããçµæããæ¬¡ã®äºæž¬ãžåã³äœ¿ãããšã衚ããŠããŸãã
éåžžã®çæã§ã¯ãäžåºŠåºåããããŒã¯ã³ã¯ç¢ºå®æžã¿ã®åãšããŠæ®ããæã®åŸåãžé²ãã§ãããåé ã®èšèãå éšã§æžãæããªããå šæãåæã«æŽããŠããããã§ã¯ãããŸãããã¢ããªãå¥ã®åŠçã§æšæ²ãããããšã¯ã§ããŸãããããã¯æåã®èªå·±ååž°çæãšã¯å¥ã®åã«ãªããŸãã

ãã£ããç»é¢ã§æç« ãå°ããã€äŒžã³ãŠèŠããã®ã¯ããã®çæé åºãšçžæ§ãããããã§ããç»é¢åŽã§è€æ°ã®ããŒã¯ã³ããŸãšããŠè¡šç€ºããå Žåã¯ãã£ãŠããã¢ãã«ã®åºæ¬åäœã¯ããããŸã§ã®åããæ¬¡ãäžã€éžã¶ããšã®å埩ã§ãã
æ¡æ£ã¯ããã€ãºã§å£ãéçšãéåãã«ãã©ã
æ¡æ£ã¢ãã«ã®åè«æã§ããDDPMã«ã¯ãäºã€ã®åããåºãŠããŸãã
äžã€ã¯ãåŠç¿çšã®ç»åãžå°ããã€ãã€ãºãå ãããé æ¹åãã§ãå ã®ç»åã«å°ããªãã€ãºãè¶³ããŠäœåºŠãé²ãããšãæåŸã¯å ã®çµµãåãããªãã©ã³ãã ãªãã€ãºã«è¿ã¥ããŸãããã®ããã«ããŒã¿ãåŸã ã«å£ãéçšããæ¡æ£éçšã§ãã
ããäžã€ã¯ãå£ãé åºãéã«ãããéæ¹åãã§ãã¢ãã«ã¯ãããæ®µéãŸã§ãã€ãºãå ãã£ãããŒã¿ãåãåããããã«æ··ãã£ãŠãããã€ãºãäºæž¬ããããã«åŠã³ãŸããçæãããšãã¯å®æç»åãçšæãããã©ã³ãã ãªãã€ãºããå§ããŸããäºæž¬ãããã€ãºãæãããã«äžæ®µéæŽæ°ãããŸãäºæž¬ããããã®å埩ã§ããã€ãºã ã£ãç¶æ ãç»åãžè¿ã¥ããŸãã
DDPMã®2020幎ã®åè«æã§ã¯ããã®å埩ã1,000段éã«èšå®ããŠããŸãããããã¯è«æã®å®éšæ¡ä»¶ã§ãããçŸåšã®ç»åçæãµãŒãã¹ããã¹ãŠ1,000ååŠçãããšããæå³ã§ã¯ãããŸãããå°ãªãåæ°ã§çæããææ³ãéçºããã補åããšã®èšå®ãç°ãªããŸãã
çŸåšããç¥ãããŠããç»åçæã§ã¯ãç»é¢ã«åºããã¯ã»ã«ãçŽæ¥æŽæ°ããæ¹åŒã ãã䜿ãããŠããããã§ããªããStable Diffusionã«ã€ãªãããæœåšæ¡æ£ã¢ãã«ãã¯ããŸãç»åãå°ããªæ°å€è¡šçŸãžå§çž®ããŸãããã®å§çž®ããã空éã§ãã€ãºé€å»ãç¹°ãè¿ããæåŸã«ãã³ãŒããŒã§ç»åãžæ»ããŸãã
ããã§æŽæ°ãããã®ã¯ãç»åã®èšèšå³ã«ããããããªå šäœã®è¡šçŸã§ããæç« ã®ããã«å·Šäžã®1ãã¯ã»ã«ã確å®ããæ¬¡ã®1ãã¯ã»ã«ãžé²ãããã§ã¯ãããŸãããäžåã®æŽæ°ã§å šäœã®æ°å€ãåãããããäœæ®µéãç¹°ãè¿ããŸãã
ã§ã¯ãå ¥åããæç« ã¯ã©ããžå ¥ãã®ã§ãããããæœåšæ¡æ£ã¢ãã«ã§ã¯ãããã³ãããæ°å€è¡šçŸãžå€æãããŸããåè«æã§ã¯ãã¯ãã¹ã¢ãã³ã·ã§ã³ããšããä»çµã¿ã䜿ãããã€ãºãé€ãåæ®µéã§ãç»ååŽãæç« ã®ã©ããæãããã«ããããèšç®ããŠããŸãã
æç« ã¯ç»åãã®ãã®ãžå€æãããã®ã§ã¯ãªãããã€ãºããã©ã®æ¹åãžç»åãæŽããããæ¡ä»¶ã¥ããŠããŸãã

äºã€ãšãå埩ããããéäžã«æ®ã£ãŠãããã®ãéã
èªå·±ååž°ãšæ¡æ£ã¯ãã©ã¡ããã¢ãã«ãäžåºŠã ãåãããŠå®æåãåºãããã§ã¯ãããŸãããäºæž¬ãšæŽæ°ãäœåºŠãç¹°ãè¿ããŸããéãã®ã¯ãå埩ã®éäžã«äœãæ®ã£ãŠãããã§ãã
èªå·±ååž°åã®éäžã«ã¯ããã§ã«ç¢ºå®ããæç« ã®å é éšåããããæ¬¡ã®ããŒã¯ã³ã決ãããã³ã«åãé·ããªã£ãŠããã®åå šäœã次ã®äºæž¬æ¡ä»¶ã«ãªããŸããçæãæ¢ããã°ãéäžãŸã§ã§ãæç« ãšããŠèªããããšããããŸãã
æ¡æ£åã®éäžã«ããã®ã¯ç»ååè£ã®å šäœè¡šçŸã§ãåãã¯ã»ãŒãã€ãºã§ãããå埩ãããã¡ã«å€§ãŸããªé 眮ã圢ãçãŸãã现éšãæŽã£ãŠãããŸããåæ®µéã¯åã®ç¶æ ãåãåããŸãããã宿ããå·Šååã®åŸãã«å³ååãè¶³ãããšããé²ã¿æ¹ã§ã¯ãããŸããã
çµäºæ¡ä»¶ãéããèªå·±ååž°åã¯æç« ã®çµããã瀺ãããŒã¯ã³ãåºãããèšå®ãããé·ããžéãããŸã§ç¶ããã®ã«å¯Ÿããæ¡æ£åã¯ããããããæ±ºããçæã¹ãããããã©ãçµãããšãæåŸã®è¡šçŸãç»åãžæ»ããŸãã
ãã ãããèªå·±ååž°ã¯äžåãã€èããããæ¡æ£ã¯äžŠåã ããäžç¬ã§çµããããšããçè§£ãæ£ç¢ºã§ã¯ãããŸãããæ¡æ£åããåã®æ®µéãåããŠæ¬¡ã®æ®µéãžé²ãå埩åŠçã§ããäžåã®æ®µéã§ç»åå šäœãæ±ããããšãšããã®æ®µéãé çªã«ç¹°ãè¿ãããšã¯äž¡ç«ããŸãã

ãã®éãã¯ãã©ã¡ããè³¢ãããæ±ºããç©å·®ãã§ããããŸãããèªå·±ååž°ãæ¡æ£ãã¯ãçæéäžã®ããŒã¿ãã©ã眮ããæ¬¡ã®ç¶æ ãã©ãäºæž¬ããããšããèšèšã®éãã§ããåºåã®æ£ç¢ºããéãã¯ãã¢ãã«ã®å€§ãããåŠç¿ããŒã¿ãçæã¹ããããåšèŸºã®ä»çµã¿ã«ãå·Šå³ãããŸãã
æç« ãšç»åã§åãããŠããã®ã¯ã決ãŸãã§ã¯ãªã
ãããŸã§æç« ã«ã¯èªå·±ååž°ãç»åã«ã¯æ¡æ£ãšããçµã¿åãããæ¯ã¹ãŠããŸããããã®çµã¿åãããå€ãã®ã«ã¯ãæ±ãããŒã¿ã®åœ¢ãé¢ä¿ããŠããŸãã
æç« ã«ã¯ãå é ããæ«å°Ÿãžç¶ãèªç¶ãªé åºããããŸãããããŸã§ã®åããæ¬¡ãäºæž¬ããèªå·±ååž°ãšçµã³ã€ããããããŒã¿ã§ããäžæ¹ãç»åã«ã¯çžŠãšæšªã®åºããããããé¢ããå Žæãäžã€ã®æ§å³ãšããŠé¢ä¿ããŸããç»åå šäœã®è¡šçŸãååŸ©æŽæ°ããæ¡æ£ã¢ãã«ã¯ããã®äºæ¬¡å ã®æ§é ãæ±ããŸãã
ããããããã¯è¶ããããªãå¢çã§ã¯ãããŸããã
å代DALL-Eã¯ã256Ã256ãã¯ã»ã«ã®ç»åã32Ã32ãåèš1,024åã®ç»åããŒã¯ã³ãžå§çž®ããæå€§256åã®æç« ããŒã¯ã³ãšäžæ¬ã®åãžã€ãªãã§ãèªå·±ååž°åã®Transformerã§é çªã«çæããŸãããèªå·±ååž°ã¢ãã«ã§ãç»åã¯äœããŸãã
éã®äŸããããŸãã2022幎ã®Diffusion-LMã¯ãã€ãºã®ãã¯ãã«åãå埩ããŠåèªã®ãã¯ãã«åãžå€æãã2025幎ã«çºè¡šãããLLaDAã¯ãæç« äžã®ããŒã¯ã³ãåŸã ã«ãã¹ã¯ããŠããé æ¹åãšããã¹ã¯ãããéšåãäºæž¬ããŠæ»ãéæ¹åã䜿ããŸããç»åã®ç åµã«ããã圹å²ããæç« ã§ã¯ãé ãããããŒã¯ã³ããæ ããŸããæ¡æ£ã¢ãã«ã§ãæç« ã¯çæã§ããŸãã
ããã«ãè¿å¹Žã®ç»åçæã«ã¯ãRectified FlowããšåŒã°ããæ¹åŒããããŸããStable Diffusion 3ã®ç ç©¶è«æã§ã¯ãããŒã¿ãšãã€ãºãçŽç·çãªçµè·¯ã§çµã¶ãã®æ¹åŒããåŸæ¥ã®æ¡æ£æ¹åŒãšæ¯èŒããŠããŸãããã€ãºããç»åãžå埩ããŠè¿ã¥ãç¹ã¯äŒŒãŠããŸãããæ°åŠçã«ã¯åããã®ã§ã¯ãããŸããã
ãã®ããã補ååããç»åçæAIããšããåŒã³æ¹ã ããããå éšæ¹åŒãæå®ããããšã¯ã§ããŸãããå éšæ§é ãå ¬éããŠããªããµãŒãã¹ããããŸããããã§æ¯ã¹ãã®ã¯ãæç« çæãšç»åçæã§åºã䜿ãããŠãã代衚çãªçµã¿åããã§ãã

åŠç¿ã«äœ¿ãããŒã¿ã®çš®é¡ãèäœæš©ã®åé¡ããçææé ãšã¯å¥ã§ããAIãã©ãããããŒã¿ãéããã©ã®æ®µéã§æ³çãªè«ç¹ãçãããã¯ãåŠç¿ããŒã¿ã«ã€ããŠã®èšäºã§åããŠæ±ããŸãããåãããŒã¿ããåŠãã§ããçææ¹æ³ãåãã«ãªããšã¯éããŸããã
èªå·±ååž°åã¯ãä»ããåããæ¬¡ã®ããŒã¯ã³ãäºæž¬ããç¶ããè¶³ããŠãããŸããæ¡æ£åã¯ãå£ããããŒã¿ãæ»ãæ¹æ³ãåŠã³ããã€ãºããå šäœã®è¡šçŸãå埩ããŠæŽæ°ããŸãã
æç« ãç»åãã¯ãäœãåºãã¢ãã«ãªã®ããèªå·±ååž°ãæ¡æ£ãã¯ãã©ã®ãããªéäžçµéãéã£ãŠåºãã®ãããã䜿ãããçµã¿åããã¯ãããŸããããã®äºã€ãåããŠãããšãåããçæAIããšããèšèã®äžã«ããä»çµã¿ã®éãã説æã§ããŸãã
ãã®çšèªããAIã®å šäœåã®ã©ãã«ããã
ãç¶ããå°ããã€è¶³ããŠããããšããæç« çæã®ããã¿ã¯ããã®ããšã®åŠç¿ã»è»œéåã»éå ·ã®å©çšã®è©±ãã¹ãŠã®åå°ã«ãªããŸããããããå ãé çªã«ãã©ã£ããã®ã ãAIçšèªã®ä¿åçã ã§ããåé 7ç« ã¯ç¡æã§èªããŸãã
åºå ž
OpenAIãBetter language models and their implicationsã https://openai.com/index/better-language-models/
Tom B. Brownã»ããLanguage Models are Few-Shot Learnersã https://arxiv.org/abs/2005.14165
Jonathan Hoã»ããDenoising Diffusion Probabilistic Modelsã https://arxiv.org/abs/2006.11239
Robin Rombachã»ããHigh-Resolution Image Synthesis with Latent Diffusion Modelsã https://arxiv.org/abs/2112.10752
Aditya Rameshã»ããZero-Shot Text-to-Image Generationã https://arxiv.org/abs/2102.12092
Xiang Lisa Liã»ããDiffusion-LM Improves Controllable Text Generationã https://arxiv.org/abs/2205.14217
Jacob Austinã»ããStructured Denoising Diffusion Models in Discrete State-Spacesã https://arxiv.org/abs/2107.03006
Shen Nieã»ããLarge Language Diffusion Modelsã https://arxiv.org/abs/2502.09992
Patrick Esserã»ããScaling Rectified Flow Transformers for High-Resolution Image Synthesisã https://arxiv.org/abs/2403.03206