以åãTwitter ã®ã¿ã€ã ã©ã€ã³ã«æµããŠæ¥ãŠæ°ã«ãªã£ãã以äžã® Node-REDçšã®ããŒãã詊ããŠã¿ãããšããèšäºã§ãã
ãâ https://flows.nodered.org/node/node-red-contrib-teachable-machine

以äžã§èª¬æãªã©ãæžããŠãããŸããããå眮ãã¯ãªããŠè¯ããããæ©ã詊ãããïŒããšããæ¹ã¯ããNode-RED ã§ Teachable Machine ã䜿ããã®ãšããããã芧ãã ããã
ã¯ããã«
Teachable Machine ã«ã€ããŠ
Teachable Machine ã¯ãGoogleãããæäŸããŠããããã©ãŠã¶äžã§æ©æ¢°åŠç¿ãã§ããä»çµã¿ã§ããåŠç¿ã ãã§ãªãæšè«ã®åŠçããåŠç¿ã¢ãã«ãäœã£ãåãããŒãžäžã§è¡ããŸãã
2020幎4æ25æ¥çŸåšããImage Projectãã»ãAudio Projectãã»ãPose Projectãã® 3ã€ãæäŸãããŠããŸãã
èªåã¯ä»¥åãäžèšã®äžã®ãAudio Projectãã䜿ã£ãŠèªåã®å£°ã楜åšã®é³è²ãåŠç¿ãããŠã¿ãããé³è²ãåŠç¿ãããåŠç¿ã¢ãã«ã掻çšããŠãããããã€ïŒtoioïŒãç¬èªæ¡åŒµçã® Scratch ãšé£æºãããããããã«ãŒïŒMicro: MaqueenïŒãå¶åŸ¡ãããããå 容ã Qiita ã®èšäºã«æžãããããŸããã
- Teachable Machineé¢é£ã§æžããèšäº 3ã€
- Teachable Machine ã䜿ã£ãé³å£°ããã®ä»»æã®ããŒã¯ãŒãã®æ€åºïŒãã©ãŠã¶äžã§æ©æ¢°åŠç¿ïŒ
- toio ãé³ã§å¶åŸ¡ããŠã¿ãïŒAudioçšã® Teachable Machine ã§ãã«ãã¿ã³ããªã³ã®é³ãæ©æ¢°åŠç¿ïŒ
- ç¬èªæ¡åŒµç Scratch ã§ Teachable Machineæ¡åŒµã䜿ã£ãé³ïŒç°ãªãé³éïŒã§ã®ããããã«ãŒæäœ
ãã®ãšãåŠç¿ã®éçšã§ã¯ã³ãŒããæžãããšããªããWebãµã€ãäžã§ãã¿ã³ãæäœããªããåŠç¿ããããé³ãé²é³ãããŠããã®åŸãç°¡åã«åŠç¿ã¢ãã«ãäœæããããšãã§ããŸããã
äžèšã®èšäºãæžãããšãã¯ãChromeäžã§åã JavaScript ã®ããã°ã©ã ã§ Web Bluetooth API ãšçµã¿åãããããScratch ã®ãããã¯ããã°ã©ãã³ã°ã§åŠç¿ã¢ãã«ãå©çšãããããŸããããä»åã¯ããã® Teachable Machine ã Node-RED ãšçµã¿åãããŠäœ¿ã£ãŠã¿ãŸãã
Node-RED ã«ã€ããŠ
Node-RED ã¯ããããŒããŒã¹ã§ããã°ã©ã ãéçºãããããžã¥ã¢ã«ããã°ã©ãã³ã°ããŒã«ã§ãã
以åãIoTLT ãšããã€ãã³ãã§ç»å£ããéã«ãããžã¥ã¢ã«ããã°ã©ãã³ã°ã®ã¿ã§ IoT ã®ä»çµã¿ãäœã話ã玹ä»ããã®ã§ããããã®éã«**ãmicro:bit ãš PC ã®éã§ã·ãªã¢ã«éä¿¡ã§ããŒã¿ã®åãæž¡ãããããã»ãPCäžã§ MQTTãããŒã«ãŒãåãããã»ãMQTT ã§ããŒã¿ã®éåä¿¡ãããã**ãšããä»çµã¿ã§å©çšããŸããïŒã¡ãªã¿ã«ãäžèšããã®éã®ç»å£ã¹ã©ã€ãã®ãªã³ã¯ã§ãïŒã
â https://speakerdeck.com/you/iotlt-vol-dot-61

äžèšã® MQTT ãªã© IoT ãªä»çµã¿ä»¥å€ã®è©±ã§ããäŸãã°ïŒãŸã èªåã¯å©çšã§ããŠãªãã§ããïŒRaspberry Piäžã§åäœãããŠé»åå·¥äœçãªããšãã§ãããããŠã掻çšã§ããç¯å²ãåºãã§ãã
Node-RED ã®è©³çްã«ã€ããŠãäœ¿ãæ¹ã¯ã以äžã®ãµã€ããªã©ãã芧ãã ããã
Node-RED ã§ Teachable Machine ã䜿ã
Node-RED ã®ã»ããã¢ãããšå©çš
èªåãä»åã®èšäºã®å 容ã詊ããŠããç°å¢ã® OS ã¯ãmacOS Mojaveãã§ããNode.js ã®ããã±ãŒãžç®¡çããŒã«ïŒnpmïŒããå©çšå¯èœã«ãªã£ãŠããç¶æ ã§ãã
äžèšã®ã³ãã³ãã§ã€ã³ã¹ããŒã«ããèµ·åãããŠããŸãïŒâ» ããŒã«ã«ã«ã€ã³ã¹ããŒã«ããŠãããŒã«ã«ã«ã€ã³ã¹ããŒã«ãã npmããã±ãŒãžãç°¡åã«å©çšã§ãã npxã³ãã³ãã䜿ã圢ïŒã
$ npm install node-red
$ npx node-red
äžèšã®èµ·ååŸã¯ããã©ãŠã¶ã§ãlocalhost:1880ããã127.0.0.1:1880ãã«ã¢ã¯ã»ã¹ããŠããã©ãŠã¶äžã§ä»¥äžã®æé ãé²ããŠè¡ããŸãã
Teachable Machineçšã®ããŒãã®æŠèŠ
åé ã«èšèŒãããªã³ã¯å ã®èª¬æãèŠããšã以äžã®ããã«æžããŠãããŸãã
A Node-RED node based in tensorflow.js that enables to run custom image classification trained models using Teachable Machine tool.
Teachable Machine ã§äœæå¯èœãªåŠç¿ã¢ãã«ã¯ Image Projectã»Audio Projectã»Pose Project ã® 3ã€ããããŸããããã®ãã¡**ãImage Projectãã®ã¿ã«å¯Ÿå¿ããŠãã**ããã§ãã
ãŸããããŒãã«ä»å±ã®ãµã³ãã«ãããããã§ãããã詊ããŠã¿ãã®ãä»åã®ãŽãŒã«ã«ãªããŸãã
ãªããTeachable Machineèªäœã® Image Project ã®åŠç¿ã«ã€ããŠã®æ
å ±ã¯ãè±èªã§ã®èª¬æã«ãªããŸããã以äžã®å
¬åŒã®ãã¥ãŒããªã¢ã«ãæäŸãããŠããŸããç»åã»åç»ããããã説æã«çšããããŠããŸãã®ã§ãããããèŠãŠã¿ãã ãã§ãæ§åãåãããããããŸããã
ãâTeachable Machine Tutorial: Bananameter - Barron Webster - Medium
ããhttps://medium.com/@warronbebster/teachable-machine-tutorial-bananameter-4bfffa765866
Teachable Machineçšã®ããŒãã远å ãã
ããã§ã¯ãäžèšã«ã§ãŠããããŒãã Node-RED ã§å©çšã§ããããã远å ããŠãããŸãã
ãŸããç»é¢å³äžã®ã¡ãã¥ãŒãéãéšåïŒä»¥äžã®èµ€æ ã§ç€ºããéšåïŒãã¯ãªãã¯ããŠãã ããã

ãããŠãã¡ãã¥ãŒã衚瀺ãããŸããããã®äžã®ããã¬ããã®ç®¡çããéžæããŸãã

ãã®åŸã®ç»é¢ã§ãã¿ãã§è¡šç€ºãããŠãããããŒãã®è¿œå ããéžæããŠãã ããã

以äžã®ç»åã®èµ€æ ã§ç€ºããéšåã«ãteachableããšããŒãã®åç§°ã®äžéšãå
¥åããŠãããšã以äžã®ç·ã®æ ã§ç€ºããéšåã«ä»åå©çšããããŒãã衚瀺ãããç¶æ
ã«ãªããŸãã以äžã®ç·ã®æ å
ã®ç·ç¢å°ã§ç€ºãããããŒãã远å ãã®ãã¿ã³ãæŒããŠãããŒãã远å ããŸãããã

ããŒãã®è¿œå ãè¡ã£ãåŸãç»é¢å·ŠåŽã®éšåãäžãžã¹ã¯ããŒã«ãããŠãããšãåæãã®ã«ããŽãªã®äžã«ãTeachable Machine ã®ããŒãã远å ãããŠããã®ã確èªã§ããŸãã

Teachable Machineçšã®ããŒãã®ãµã³ãã«ãåãã
ããŒãã®è¿œå ãã§ãããšããã§ãããŒãã«ä»å±ã®ãµã³ãã«ãåãããŠã¿ãŸãã
å
ã»ã©ããã¬ããã®ç®¡çããã¡ãã¥ãŒããéžã³ãŸããããä»åºŠã¯åãã¡ãã¥ãŒå
ã«ãããèªã¿èŸŒã¿ããéžæããããã«ããŠãã ããã

ãã®åŸè¡šç€ºãããç»é¢ã®å·ŠåŽã®ã¡ãã¥ãŒã§ããµã³ãã«ããéžãã§ãã ããã

ãããããšãnode-red-contrib-teachable-machineããšããé
ç®ã衚瀺ããããã®é
ç®ãã¯ãªãã¯ãããšçŽäžã«ãbasicããšãã衚瀺ïŒä»¥äžã®ç»åã®äžéšã§èµ€ç¢å°ã§ç€ºããéšåïŒãã§ãŠããã®ã§ããããã¯ãªãã¯ããåŸã«å³äžã®ãèªã¿èŸŒã¿ããã¿ã³ïŒä»¥äžã®ç»åã®å³äžéšåã§èµ€ç¢å°ã§ç€ºããéšåïŒãæŒããŠãã ããã

ãããããšããµã³ãã«ã®ãããŒãèªã¿èŸŒãŸããŸããããããããããèªèã§ããªãåãèªã¿èŸŒãŸããŸããããšãã衚瀺ãåºãŠãããããããŸããããããŠããšã©ãŒãã§ãéã¯ããããŒã®äžéšãç¹ç·è¡šç€ºã«ãªã£ãŠãããšæããŸãïŒä»¥äžã®ãunknown: imageããšããéšåïŒã

以äžã§ããã®ãšã©ãŒè¡šç€ºãã§ãå Žåã®å¯ŸåŠæ³ãè£è¶³ããŸãã
å¯ŸåŠæ³ãšããŠã¯ããŒãã®è¿œå ãè¡ã圢ã§ããäžèšã§ Teachable Machine ã®ããŒãã远å ããã®ãšåãæµãã§ããå³äžã®ã¡ãã¥ãŒ â ãã¬ããã®ç®¡ç â ããŒãã®è¿œå ããšéžãã§ããã以äžã®èµ€æ ã§ç€ºããéšåã«ãimage-outããšå
¥åããŠãã£ãŠãã ããã
éäžã§ã以äžã®ç»åã®ç·ã®æ ã§ç€ºããŠããéšåã®ããã«ãnode-red-contrib-image-outputããšããããŒãã衚瀺ãããã®ã§ã以äžã®ç»åã®ç·ç¢å°ã§ç€ºãããããŒãã远å ãã®ãã¿ã³ãæŒããŠãã ããã

ãããããšããšã©ãŒè¡šç€ºããããéã«ç¹ç·è¡šç€ºã«ãªã£ãŠããéšåãã以äžã®ç»åã®ããã«ç·è²ã§è¡šç€ºãããç¶æ
ã«ãªããŸãã
ããšã¯ãç»é¢å³äžã®ããããã€ããã¿ã³ïŒä»¥äžã§ç·ã®æ ã§ç€ºããéšåïŒãæŒããŸãããã

ãããã€ãå®äºãããšããã¡ãã»ãŒãžãã§ãåŸã«ã以äžã®ç»åã®èµ€æ ã§ç€ºããéšåãã¯ãªãã¯ããŠãã ããã

ãããŒãå®è¡ãããŠã以äžã®ãããªç¶æ
ã«ãªãããšæããŸãïŒä»¥äžã®ç»åå
ã§äžå€®äžãããã«è¡šç€ºãããŠãããç»ååºåããããéšåã¯ä»¥äžãšç°ãªããã®ã衚瀺ããããããããŸããïŒã
ãã®åŸã以äžã®ç»åã®å³äžãããã§èµ€æ ã§ç€ºããéšåãæŒããŠã¿ãŸãããã

ãããããšã以äžã®ç»åã®å³ç«¯ã®ã»ãã«åºãŠããããã«ããããã°çšæ
å ±ã衚瀺ãããŸãã以äžã®ç»åã®ãããŒå
ãšãããã°æ
å ±ã§ãèµ€æ ã§å²ãã éšåã¯ãå
¥åç»åã®å
容ããå
¥åç»åã«å¯ŸããŠè¡ã£ãæšè«ã®çµæããªã©ã衚瀺ãããŸãããŸãããããã°æ
å ±ã§ä»¥äžã®ç·ã§å²ãã éšåã¯ãTeachable Machine ã§åŠç¿ããããéãåŠç¿ã¢ãã«ã®äœæè
ãæ±ºããã¯ã©ã¹ã®è¡šç€ºãããŠããããã§ãïŒä»¥äžã®äŸã§ã¯ãhappyãsadãangryãneutralãsurpriseãã® 5ã€ïŒã

ãŸãããããŒã®äžã§ãrandom imageããšæžãããéšåã®äžèº«ãèŠãŠã¿ããšã https://loremflickr.com/320/240/sport ããšãã URL ãæå®ããŠç»åãååŸããŠããããã§ãããç»åã®ååŸå
ã¯ã以äžã®ãµãŒãã¹ã®ããã§ãã
ãâLoremFlickr: free placeholder images
ããhttps://loremflickr.com/
äœåºŠããäžèšã®ãããŒãåãããŠã¿ãŸããããããã§ååŸããç»åãšæ©æ¢°åŠç¿ã§æšè«ãè¡ã£ãŠåºåãã 5ã€ã®ã¯ã©ã¹ã®å
容ããå人çã«ã¯ãã¹ããããªæãã¯ããŸããããäžé£ã®åŠçã®æµãã¯åããŠããããã§ããã
ãããã«
ä»åã®èšäºã§ãNode-REDã§ Teachable Machine ã䜿ãããã®ããŒããã詊ããŠã¿ãŸããã
ãšãããããããŒãã®èªã¿èŸŒã¿ãããµã³ãã«ãåäœããããŸã§ããã£ãŠã¿ãŸããããæ¬¡ã¯ Teachable Machine ã§ã®åŠç¿ã¢ãã«ã®äœæããèªåã§äœæããåŠç¿ã¢ãã«ã䜿ã£ãåŠçã詊ããŠã¿ãããã°ãšæããŸãã