
PyTorchã§MLPãå®è£ ããæŒç¿ïœåé¡ãšååž°ãåã骚çµã¿ã§æžããåºç€ç·šâ ã»ç¡æããŒãããã¯ã
ã3åã§åŠã¶PyTorchãã®èšäºãèªãã§æžãæ¹ã¯åãã£ããããã©èªåã§1ããæžããããšãããšèªä¿¡ããªãããããåããããã®æŒç¿ããŒãããã¯ãé ããŸããç¡æã§ãã
ãã®å㯠MLPïŒå€å±€ããŒã»ãããã³ïŒ ã§ããPyTorchã§æåã«æžãã¹ãããã¡ã°ãåºæ¬ã®åœ¢ãã€ãããŸãã
ãã®ææã§æžããããã«ãªãããš
nn.Module ãç¶æ¿ããŠãèªåã®ãããã¯ãŒã¯ã¯ã©ã¹ãå®çŸ©ãã
èª€å·®é¢æ°ãšæé©ååšã宣èšããŠãåŠç¿ã«ãŒããåã
åé¡åé¡ãšååž°åé¡ããåã骚çµã¿ã§æžãåãã
GPUã䜿ãïŒããã€ã¹ã®å®£èšãTensorã®åãæž¡ãïŒ
æåŸã®GPUã®ãšããã¯ãèšäºã§èªãã§ããã§ãã©ãã«äœãæžãã®ãããåããã«ããéšåã ãšæããŸããå®éã«èªåã®æã§æžããšäžåºŠã§å ¥ããŸãã
ææã®æ§æ
第1åïŒsec01ïŒïŒçèã®æ Œä»ããšå€æ®µæ±ºã
äŸé¡ã¯åé¡åé¡ãçèãæ Œä»ããããããã¯ãŒã¯ãæžããŸã
æŒç¿ã¯ååž°åé¡ãåãçèã®ããŒã¿ã§ãä»åºŠã¯å€æ®µãäºæž¬ããŸã
åé¡ãšååž°ã䞊ã¹ãã®ã¯æå³ããããŸããå€ããã®ã¯åºåå±€ãšèª€å·®é¢æ°ã ãã§ã骚çµã¿ã¯åããšããããšãã2ã€æžããšäœã§åããããã§ãã
第2åïŒsec02ïŒïŒMNIST
ææžãæ°åã®åé¡ã§ããããã§GPUã®äœ¿ãæ¹ãå ¥ããŸãã
ããã€ã¹ã€ã³ã¹ã¿ã³ã¹ã宣èšãã
Tensorå倿°ãGPUã«æž¡ã
ã¢ãã«ãGPUã«èŒãã
ãã®3ã€ãæžãå¿ãããšãšã©ãŒã«ãªãããCPUã§é ããŸãŸåããŸããäž¡æ¹ãå®éã«çµéšã§ããããã«ããŠãããŸãã
穎åã圢åŒã§ã
ããŒãããã¯ã¯2çš®é¡ãããŸãã
taskïŒãTASKã ãšæžãããç®æã空ããŠããŸãããããåããŠå®è¡ããŸã
ansïŒçãã§ããè©°ãŸã£ããšãã ãèŠãŠãã ãã
å ã« ans ãèŠãªãã»ããããã§ãã èªãã§åãã£ãæ°ã«ãªãéšåãšãæžããªãéšåã¯å¥ãªã®ã§ãäžåºŠè©°ãŸã£ãã»ããæ©ãé²ã¿ãŸãã
åããæ¹
Google Colab ãããã°ç°å¢æ§ç¯ã¯èŠããŸããã
äžã®ãªã³ã¯ãæŒãïŒColab ããã®ãŸãŸéããŸãïŒ
ãTASKã ãšæžãããç®æãåãã
sec02 ã§ã¯ãã©ã³ã¿ã€ã ãâãã©ã³ã¿ã€ã ã®ã¿ã€ãã倿Žãâ GPU ãéžã¶
ããŒã«ã«ã®Pythonã§ãåããŸãããGPUã詊ããªãColabã®ã»ããæ©ãã§ãã
ã€ãŸããããããšãã
.to(device) ã®æžãå¿ãã ã¢ãã«ãšããŒã¿ã®äž¡æ¹ãæž¡ãå¿ èŠããããŸããçæ¹ã ãã ãšãšã©ãŒã«ãªããŸã
å ¥åã®åœ¢ã MLPã«ç»åãå ¥ãããšã㯠view() ã§å¹³åŠã«ããŸããããã®æ°åãããããšæ¬¡å ãšã©ãŒãåºãŸã
ååž°ã®èª€å·®é¢æ°ã åé¡ãšåããã®ã䜿ããšåŠç¿ãé²ã¿ãŸãããæŒç¿ã§å¿ ãäžåºŠã¯èžã¿ãŸã
ããŠã³ããŒã
ãªã³ã¯ãæŒããš Colab ããã®ãŸãŸéããŸããããŠã³ããŒãã¯èŠããŸããã
æžãæãããã®ãæ®ããããšãã¯ãColab ã®ã¡ãã¥ãŒããããã©ã€ãã«ã³ããŒãä¿åããéžãã§ãã ããã
Section 1
Section 2
è§£çã¯è©°ãŸã£ããšãã ãèŠãŠãã ããã èªãã§åãã£ãæ°ã«ãªãéšåãšãèªåã§æžããéšåã¯å¥ç©ãªã®ã§ãäžåºŠè©°ãŸã£ãã»ããçµå±ã¯æ©ãé²ã¿ãŸãã
4ããŒãåããŸãšããŠèŠããæ¹ã¯ãã¡ãããã©ããã
https://github.com/akh1r0ck/pytorch-by-hand
次ã®äžæ®µ
åºç€ç·šã§ãåãMLPãæžãããããã«ãªã£ãããæ¬¡ã¯å®åã§äœ¿ããMLPã§ãã
åŠç¿çã¹ã±ãžã¥ãŒã©ãæ··å粟床ã«ããé«éåãtorch.compile ãšãã£ããå®éã®ç ç©¶ãéçºã§å¿
ãåºãŠããéå
·ããåã骚çµã¿ã«è¶³ããŠãããŸãã
⌠çºå±ç·šâ ïŒææã»1,000åã»æŒç¿ããŒãããã¯ä»ãïŒ
ãåãMLPãæžããããããå®åã§äœ¿ããMLPãæžããããžïœPyTorch çºå±ãã¯ããã¯æŒç¿
ããã®ã·ãªãŒãºã«ã€ããŠã
ã3åã§åŠã¶PyTorchãã¯ãPyTorchã®APIã1å1ã€ã3åã§èªã¿åãã圢ã§è§£èª¬ããé£èŒã§ããæã»æ°Žã»éã«æŽæ°ãå š32æ¬ãäºå®ããŠããŸãã
⌠ãã¬ãžã³ããã©ããŒãããšæ°çãå±ããŸã
3åã§åŠã¶PyTorch
https://note.com/technosend/m/m84d841b6d067