
CloudWatch Logsãå人æ å ±ä¿è·ã®ç²ç¹ã«ãªã£ãŠããŸãããïŒ
ãã£ã³ãµãŒã¹ãã£ã³ã§SREå
Œã€ã³ãã©æ
åœãããŠããä¿åãšç³ããŸãã
å
æ¥JAWS-UG SREæ¯éš #6ã§LTããŠããŸãã ãJAWS-UGã¯AWSã®ãŠãŒã¶ãŒã°ã«ãŒãã§ãè²ã
ãªããŒãã§ç¥èŠã®å
±æãªã©ãè¡ãããŠãããŸãããã£ãããªã®ã§LTã§ã¯äŒããããªãã£ãéšåã解説ããŠã¿ãããšæããŸãããããŸã§noteã§ã¯ããŸãæè¡çãªããšã«ã¯è§ŠããŠããŸããã§ãããããã£ã³ãµãŒã¹ãã£ã³ã®ããšããã£ãšç¥ã£ãŠãããã€ã€ã誰ãã®åèã«ãªãèšäºãæžããããšæãä»åã¯èšäºã«ããŸããã
çºè¡šè³æã¯äžèšã§å
¬éããŠãããŸãã
JAWSUG SREæ¯éš #6ãCloudWatch ã©ããŸã§è¡ãããéžææš©ã LTçºè¡šè³æ
ãã®èšäºã®èŠçŽ
ãã°ãå«ããããŒã¿ã®ã©ã€ããµã€ã¯ã«ãææ¡ããŸãããã
ãã°ãæ©å¯æ å ±ä¿è·å¯ŸçãããŸãããã
æ¡1: data protectionæ©èœã§ããŒã¿ããã¹ãã³ã°ããã
æ¡2: Subscription Filterã䜿ã£ãŠãS3ã«ãã°ã転éããªããæ©å¯æ å ±ãåé€ããŠä¿åããã
æ¡3: ãµãŒãããŒãã£ãŒãµãŒãã¹ãS3ã«åºåããŠããå å·¥ããã
ãã®ä»ã®å¯Ÿç: ãã°ã°ã«ãŒãåäœã§KMSæå·åããŠãæå·ååé€ããŸãããã
ãã°ãå«ããããŒã¿ã©ã€ããµã€ã¯ã«ã®ææ¡
ä»åã®çºè¡šã®è¶£æšã¯ããã°ãå«ããŠæ©å¯æ
å ±ä¿è·ã®å¯Ÿè±¡ã«ãããšãã«ãã©ã®ããã«å¯ŸçãããããšããããŒãã§ããã
ããã§ãŸãå¿
èŠãªã®ã¯ãããŒã¿ã®ã©ã€ããµã€ã¯ã«ã®æŽçã§ããããèªäœã¯æ©å¯æ
å ±ã®ä¿è·ãèããéã«æåã«çæããããšã®äžã€ã§ãã®ã§ãå€ãã®æ¹ãåãçµãŸããŠãããšæããŸãã
ä»åã®ãã€ã³ãã¯ãæŽçã®äžã«CloudWatchãå ããŠæ€èšããŠãã©ãããŠããã°ã«æ©å¯æ
å ±ãåºåãããŠããŸãå Žåã«æ£ãã察çããšãå¿
èŠãããç¹ã§ãã
CloudWatch Logsãæ©å¯æ å ±ä¿è·ã®å¯Ÿçããã
ããããã®è©±ãã¢ããªã±ãŒã·ã§ã³åŽã§å¯Ÿå¿ããã°æ©å¯æ
å ±ãåºåããªãããã«ããããšãã§ããŸããäžæ¹ã§äŸãã°Sagemakerã䜿ã£ãŠããŒã¿ãæ¢çŽ¢ããããæ©æ¢°åŠç¿ã®ã¢ãã«ãäœæãããªã©ãæè»ãªåæãããããã«ã¯éã«ãã°ã«æ
å ±ãããçšåºŠåºããšããããšãåæã«ãªãã±ãŒã¹ãåºãŠããŸãã
ããããå Žåã¯ãã°ãé©åã«ç®¡çããŠãåé€ãããªã©ã®å¯Ÿçãå¿
èŠãšãªãããã§ãããåæã«ç£æ»ãã°ãšããŠé·æä¿åããããšããèŠæãåºãŠããŸãã
ãã®ãããã°ã«æ©å¯æ
å ±ä¿è·ã®å¯Ÿçãã€ã€ä¿åããããšããèŠä»¶ãçãŸããŸãã
åŒç€Ÿã¯ããæ°å¹Žã§åçš®åºç€ããµãŒãã¹ãAWSäžã«ç§»è¡ãé²ããŠãããå®éã«äžéšã®ãµãŒãã¹ã«ã€ããŠã¢ããªã±ãŒã·ã§ã³ã§ã¯å¶åŸ¡ä»åããªãäŸãåºãŠãŸãããä»åCloudWatch Logsã«çç®ããæ©å¯æ
å ±ã®ä¿è·ãããŒãã«ããã®ã¯ããããã£ãèæ¯ããããŸãã
ã¡ãªã¿ã«åŒç€Ÿã¯Sagemakerã䜿ã£ãæè»ãªããŒã¿åæããã·ã¹ãã åãããããŒã¿åŠçãECSã䜿ã£ãè¡åå€å®¹ãä¿ããããªWebãµãŒãã¹(äŸãã°SMSã䜿ã£ããœãŒã·ã£ã«ããŒã±ãã£ã³ã°ãµãŒãã¹)ãªã©å¹
åºããµãŒãã¹ãAWSäžã§éçšããŠãããŸãã
ããããèŠä»¶ã䜿ããµãŒãã¹ãç°ãªãããã倿§ãªéçšãæ¯ããåºç€æ§ç¯ãSRE掻åãããã®ã楜ããã®äžã€ã§ããããŒã¿åæã®çµæã瀟äŒå®è£
ããŠããäžé£ã®æµãã¯èããããšãå€ãã®ã§ãå¹
åºãç¥èãã€ããªããã人ãšç€ŸäŒãå¥åº·ã«ããããšãããŽãŒã«ããŒã¹ã®ä»äºã«é¢ããããæ¹ãåŒç€Ÿã¯ãåŸ
ã¡ããŠãããŸãïŒ

æ¡1: data protectionã§ããŒã¿ããã¹ãã³ã°

å眮ããé·ããªããŸããããæ©å¯æ
å ±ä¿è·ã®æ¹æ³ãèŠãŠãããŸãããã
ãŸããCloudWatch Logsã«ã¯æ©å¯æ
å ±ä¿è·ã®data protectionæ©èœããããŸãã2022幎ã®re:inventã§çºè¡šãããæ¯èŒçæ°ããæ©èœã§ããã°ã°ã«ãŒãåäœã§æå¹åãããšãåºåããããã°ã®äžã§æ©å¯æ
å ±ã*(ã¢ã¹ã¿ãªã¹ã¯)ã«çœ®æããŠãã¹ã¯ããŠãããŸãã
ãã ããã®æ©èœã¯æ¥æ¬èªé察å¿ã§ããã¯ã¬ã«ã®çªå·ãªã©ã°ããŒãã«ã§åã圢åŒã®ããŒã¿ã¯å¯Ÿå¿ã§ããŸãããäœæãååçã¯ãã¹ã¯ããŠãããŸããã
åŒç€ŸãSagemakerã§ä¿åããŠããããŒã¿ã®äžã«ã¯æ¥æ¬èªã®æ©å¯æ
å ±ãå«ãŸããå Žåããããããããã¯æ©èœããŸããã§ããã
(äœè«ã§ãããã®æ©èœã®ååšèªäœããã°ã®ãã¹ãã³ã°ã®éèŠã瀺ããŠããã®ã§ããã®ãã¡æ¥æ¬èªå¯Ÿå¿ããŠãããªãããªâŠãšåæã«æåŸ
ããŠãããŸãã)
æ¡2: Subscription filterã§æ©å¯æ å ±ä»¥å€ãS3ã«è»¢éããŠä¿åãã

CloudWatch Logsã«ãã°ãåºåããéšåã§ã®å¯Ÿçãé£ããããšãããã£ãã®ã§ãä»åºŠã¯åºååŸã®ããŒã¿ãå å·¥ããŠä¿åããæ¹æ³ã詊ããŠã¿ãŸãã
CloudWatch Logsã«ã¯Subscription Filterãšããæ©èœãããããã°ã°ã«ãŒãã«åºåããããã°ããã£ã«ã¿ããäžã§Kinesis Data Firehoseãªã©ã«ã¹ããªãŒã ããããšãã§ããŸããFirehoseã®åºåå
S3ãæå®ããããšã§ãCloudWatch Logsãããã°ã転éã§ããŸãã
CloudWatch Logsã¯é·æä¿åãããšé«ãã€ãã®ã§ãS3ã«è»¢éããäžã§CloudWatch LogsåŽã¯ã©ã€ããµã€ã¯ã«ãèšå®ããŠåé€ããŠããŸãã®ã«ãã䜿ãããŸãã
ãã€ã³ãã¯Subscription Filterã¯èšèéããã£ã«ã¿ããããšãã§ããããšã§ããç¹å®ã®æååãå«ãå Žåã«ã®ã¿ã¹ããªãŒã ãããªã©ã®æ¡ä»¶èšå®ãå¯èœã§ãããã®ããæ©å¯æ
å ±ããã°ã«ã©ã®ããã«åºåããããããããã°ããã£ã«ã¿ããããããšã§æ©å¯æ
å ±ä»¥å€ã®ãã°ã転éããããšãå¯èœã§ãã
ãã ãäžèšã®æ¡ä»¶ããããè€éãªæ¡ä»¶ã¯èšå®ã§ããªããªã©ã®èª²é¡ããããŸãã
Subscription Filterã¯ç°¡åãªæ¡ä»¶ããèšå®ã§ãããæ£èŠè¡šçŸçã¯äœ¿ããªãã
ãã°ã¹ããªãŒã åäœã§ãã£ã«ã¿ããããããäžè¡ã®ãã°ã®äžéšã ãããã¹ã¯ãããšãã£ãäœ¿ãæ¹ã¯ã§ããªãã
äžã€ã®ãã°ã°ã«ãŒãã«æå€§2ã€ã®Subscription Filterããèšå®ã§ããªãã
æ¡3: ãµãŒãããŒãã£ãŒãµãŒãã¹ãS3ã«åºåããŠãã奜ãã«å å·¥ãã

æ¡1ã§ãæ¡2ã§ã察å¿ã§ããªãå Žåãæ®ãææ®µã¯çµæ§ã³ã¹ãããããé¢åãªè©±ã«ãªããŸããäžæŠS3ã«è»¢éããåŸã«ããªãããã®æ¹æ³ã§ããã«å å·¥ããŠå¥ã®ãã±ããã«ä¿åçšã®ãã°ãåºåããæ¹æ³ã§ãã
AWSã®ãµãŒãã¹ãšããŠã¯GlueãLamdbaãããããµãŒãããŒãã£ãŒã§ãããã€ãéžæè¢ãæããŸããããããã«ããéçºãé¢åã ã£ããå°å
¥ã«ã³ã¹ããããã£ãŠãããããŸãã
ãã®æ¹æ³ã¯ãããã§ã察å¿ãã䟡å€ãããå Žåã¯èããŠã¿ããšããæ¡ã«ãªã£ãŠããŸããå€ãã®å Žåã¯ãæ¡1ã»2ã§éçšããã®ãçŸå®çãªéžæè¢ã«ãªããæ¡3ãèŠéã«å
¥ãå Žåã¯ããããæ©å¯æ
å ±ããã°ã«åºåããªãããã«ã³ãŒããã¢ããªã±ãŒã·ã§ã³ã倿Žããããšã«ãªãããšæããŸãã
ãã°ã°ã«ãŒããKMSæå·åããŠãæå·åæ¶å»ã«å¯Ÿå¿ãã
å°ã話ãå€ããããŒã¿ã®ãã¹ãã³ã°ã«ã¯é¢ä¿ãããŸããããããŒã¿ã®å³æ Œãªæ¶å»ã«å¯Ÿå¿ããå¿ èŠãããå Žåã¯ãæå·åæ¶å»ãæ€èšããæããããŸãã

æå·åæ¶å»ãšã¯ãããŒã¿ãæå·åããåŸã§ãæå·éµãæ¶å»ããããšã§ããŒã¿ã®åŸ©å·ãäžå¯èœã«ããããšã§ãç©ççãªåé€ãšåã¬ãã«ã®ããŒã¿åé€ãå®çŸããããšã§ãã
ãã®å逿¹æ³ã¯ç±³åœåœç«æšæºæè¡ç ç©¶æ(NIST)ãå
¬éããŠããNIST-SP-800-88ãšããææžã§èŠå®ãããŠãããã®ã§ããæ¥æ¬èªèš³ãIPAãå
¬éããŠããã®ã§ã詳现ã¯äžèšãã芧ãã ããã
https://www.ipa.go.jp/security/reports/oversea/nist/about.html
CloudWatch Logsã§ã¯ãã°ã°ã«ãŒãåäœã§KMSã®æå·åã«å¯Ÿå¿ããŠããã®ã§ãKMSã§äœæããéµã䜿ã£ãŠæå·åããŠãããŠããŒã¿åé€ã®ã¿ã€ãã³ã°ã§éµããšæ¶ããšãæå·åæ¶å»ããç¶æ
ãå®çŸã§ããŸãã
ãªãäžèšã®ããã«ããã€ãã®ãã€ã³ããããã®ã§ã泚æãã ããã
æå·éµãåé€ãããšããã®éµã§æå·åãããã¹ãŠã®ããŒã¿ã埩å ã§ããªããªãã®ã§ãã©ã€ããµã€ã¯ã«ã«åãããŠéµãäœæããå¿ èŠãããã
æå·åã®å¯Ÿè±¡ãšãªãã®ã¯ãéµãæå®ããã¿ã€ãã³ã°ä»¥éã«æžã蟌ãŸããããŒã¿ã®ã¿ãšãªããæ¢åã®ãã°ã°ã«ãŒãã«éµããããå Žåããã®æç¹ã§æžã蟌ãŸããŠãããã°ã€ãã³ãã¯æå·åã®å¯Ÿè±¡å€ãšãªãã
Terraformãªã©ã§ãã°ã°ã«ãŒããäœæããŠãã®æ©èœãæå¹ã«ããå Žåã/aws/ã§å§ãŸããã°ã°ã«ãŒãã¯AWSåŽã§äºçŽãããŠãããã°ã°ã«ãŒããšãªããããäœææã«ãšã©ãŒãåºãŠããŸãããã®ããäžåºŠäœæããããã°ã°ã«ãŒããimportããå¿ èŠãããã
3ç¹ç®ã ãç°¡åã«è£è¶³ãããšãäŸãã°Sagemakerãªã©ã®ãããŒãžããµãŒãã¹ãªã©ã®ãã°ã¯ããã°ã°ã«ãŒãã®åºåå
ãéžã¹ãããã©ã«ãã®AWS管çã®ãã°ã°ã«ãŒãã«åºåãããŸãããããå
åãããŠterraformãAPIçµç±ã§äœæããããšãããšãäºçŽãããŠããããäœããªããšãããšã©ãŒãçºçããŸãã
ãã®ããé¢åã§ãããäžåºŠäœããã®åœ¢ã§ãã°ã°ã«ãŒãããããŒãžããµãŒãã¹åŽããäœæããŠãããŠãimportããããšãå¿
èŠãšãªããŸããããããããšã§åããŠKMSæå·åãSubscription Filterãªã©ãã³ãŒã管çããããšãã§ããããã«ãªããŸããã¡ãã£ãšãšããããããªãé¢åã§ããåé¿æ¹æ³ã¯èŠã€ããããŸããã§ããâŠã
åŒç€Ÿã¯AWSãGCPããããSREã»ã€ã³ãã©ãšã³ãžãã¢ãåéããŠãããŸãïŒ
åããŠã®èšäºã§åãã§ããŸããŸããããèšäºã¯ä»¥äžãšãªããŸãã
æ¹ããŸããŠãåŒç€Ÿã¯ã¯ã©ãŠãäžã§SRE掻åãã€ã³ãã©æ§ç¯ã«åãçµããšã³ãžãã¢ãåéããŠãããŸãïŒåŒç€Ÿã¯å¹
åºããããã¯ããã¯ã©ãŠãäžã§æ±ã£ãŠãããåãçµãããŒãã¯å€å²ã«ããããŸããåŒç€Ÿã®ããã·ã§ã³ãéæããã«ã¯ãŸã 解決ãã¹ã課é¡ãçãã ãããã§ãã
ã¯ã©ãŠãã®åã§èª²é¡è§£æ±ºã«é¢ãããããæè¡åãé«ããŠæé·ããããšããæ¹ããåŸ
ã¡ããŠãããŸããã«ãžã¥ã¢ã«ãªã話ã®å Žãç©æ¥µçã«äœã£ãŠãããŸãã®ã§ããæ°è»œã«ãé£çµ¡ãã ããïŒ
(å·çïŒä¿åå°å¹³)