Sử dụng CloudWatch Events để thông báo tình trạng ECS Task tới Slack

Thứ Bảy, 15/08/2020

Tram Ho

Chào các bạn hôm nay mình xin giới thiệu bài về sử dụng Cloudwatch Events để thông báo về Slack khi AWS ECS task gặp sự cố

CloudWatch Events là gì ?
Khi sử dụng CloudWatch Events, bạn sẽ định nghĩa một event pattern cho một AWS resources. Theo đó khi mà resources đó có hành động giống như trong pattern mình đã định nghĩa thì trigger sẽ được kích hoạt.
Hôm nay mình sẽ giới thiệu sử dụng Lambda để gửi tin nhắn đến Slack thông báo khi mà ECS task bị Stopped vì một lý do nào đó (Có thể healthcheck Load Balancer failed, do user cố ý stop ECS task, …)
Cấu trúc tổng quát

handler.js

<span class="token keyword">const</span> axios <span class="token operator">=</span> <span class="token function">require</span><span class="token punctuation">(</span><span class="token string">'axios'</span><span class="token punctuation">)</span><span class="token punctuation">;</span>
<span class="token comment">// Search GG để lấy webhook url</span>
<span class="token keyword">const</span> <span class="token constant">SLACK_WEBHOOK</span> <span class="token operator">=</span> process<span class="token punctuation">.</span>env<span class="token punctuation">.</span><span class="token constant">SLACK_WEBHOOK</span><span class="token punctuation">;</span> 
<span class="token keyword">const</span> <span class="token constant">AWS_REGION</span> <span class="token operator">=</span> process<span class="token punctuation">.</span>env<span class="token punctuation">.</span><span class="token constant">AWS_REGION</span><span class="token punctuation">;</span>

module<span class="token punctuation">.</span>exports<span class="token punctuation">.</span><span class="token function-variable function">notification</span> <span class="token operator">=</span> <span class="token parameter">event</span> <span class="token operator">=&gt;</span> <span class="token punctuation">{</span>

  <span class="token keyword">if</span><span class="token punctuation">(</span>event<span class="token punctuation">[</span><span class="token string">'source'</span><span class="token punctuation">]</span> <span class="token operator">&amp;&amp;</span> event<span class="token punctuation">[</span><span class="token string">'source'</span><span class="token punctuation">]</span> <span class="token operator">===</span> <span class="token string">'aws.ecs'</span><span class="token punctuation">)</span> <span class="token punctuation">{</span>
    <span class="token keyword">const</span> detail <span class="token operator">=</span> event<span class="token punctuation">[</span><span class="token string">'detail'</span><span class="token punctuation">]</span><span class="token punctuation">;</span>
    <span class="token keyword">const</span> header <span class="token operator">=</span> <span class="token string">'ECS task bị stop rồi đại ca ơi!!!'</span><span class="token punctuation">;</span>

    <span class="token keyword">let</span> clusterName <span class="token operator">=</span> detail<span class="token punctuation">[</span><span class="token string">'clusterArn'</span><span class="token punctuation">]</span><span class="token punctuation">.</span><span class="token function">split</span><span class="token punctuation">(</span><span class="token string">'/'</span><span class="token punctuation">)</span><span class="token punctuation">[</span><span class="token number">1</span><span class="token punctuation">]</span><span class="token punctuation">;</span>
    <span class="token keyword">let</span> taskId <span class="token operator">=</span> detail<span class="token punctuation">[</span><span class="token string">'taskArn'</span><span class="token punctuation">]</span><span class="token punctuation">.</span><span class="token function">split</span><span class="token punctuation">(</span><span class="token string">'/'</span><span class="token punctuation">)</span><span class="token punctuation">[</span><span class="token number">1</span><span class="token punctuation">]</span><span class="token punctuation">;</span>
    <span class="token keyword">let</span> taskDefinition <span class="token operator">=</span> detail<span class="token punctuation">[</span><span class="token string">'taskDefinitionArn'</span><span class="token punctuation">]</span><span class="token punctuation">.</span><span class="token function">split</span><span class="token punctuation">(</span><span class="token string">'/'</span><span class="token punctuation">)</span><span class="token punctuation">[</span><span class="token number">1</span><span class="token punctuation">]</span><span class="token punctuation">;</span>

    <span class="token keyword">let</span> detailJson <span class="token operator">=</span> <span class="token constant">JSON</span><span class="token punctuation">.</span><span class="token function">stringify</span><span class="token punctuation">(</span>detail<span class="token punctuation">,</span> <span class="token keyword">null</span><span class="token punctuation">,</span> <span class="token number">2</span><span class="token punctuation">)</span><span class="token punctuation">;</span>
    <span class="token keyword">let</span> url <span class="token operator">=</span> <span class="token template-string"><span class="token template-punctuation string">`</span><span class="token string">https://</span><span class="token interpolation"><span class="token interpolation-punctuation punctuation">${</span><span class="token constant">AWS_REGION</span><span class="token interpolation-punctuation punctuation">}</span></span><span class="token string">.console.aws.amazon.com/ecs/home?region=</span><span class="token interpolation"><span class="token interpolation-punctuation punctuation">${</span><span class="token constant">AWS_REGION</span><span class="token interpolation-punctuation punctuation">}</span></span><span class="token string">#/clusters/</span><span class="token interpolation"><span class="token interpolation-punctuation punctuation">${</span>clusterName<span class="token interpolation-punctuation punctuation">}</span></span><span class="token string">/tasks/</span><span class="token interpolation"><span class="token interpolation-punctuation punctuation">${</span>taskId<span class="token interpolation-punctuation punctuation">}</span></span><span class="token string">/details</span><span class="token template-punctuation string">`</span></span><span class="token punctuation">;</span>

    <span class="token keyword">let</span> attachments <span class="token operator">=</span> <span class="token punctuation">{</span>
      <span class="token string">'text'</span><span class="token operator">:</span> <span class="token template-string"><span class="token template-punctuation string">`</span><span class="token interpolation"><span class="token interpolation-punctuation punctuation">${</span>header<span class="token interpolation-punctuation punctuation">}</span></span><span class="token string"> n Cluster: *</span><span class="token interpolation"><span class="token interpolation-punctuation punctuation">${</span>clusterName<span class="token interpolation-punctuation punctuation">}</span></span><span class="token string">* n Task Definition: *</span><span class="token interpolation"><span class="token interpolation-punctuation punctuation">${</span>taskDefinition<span class="token interpolation-punctuation punctuation">}</span></span><span class="token string">* n </span><span class="token interpolation"><span class="token interpolation-punctuation punctuation">${</span>url<span class="token interpolation-punctuation punctuation">}</span></span><span class="token string">n </span><span class="token template-punctuation string">`</span></span> <span class="token operator">+</span> <span class="token string">"```"</span> <span class="token operator">+</span> <span class="token template-string"><span class="token template-punctuation string">`</span><span class="token interpolation"><span class="token interpolation-punctuation punctuation">${</span>detailJson<span class="token interpolation-punctuation punctuation">}</span></span><span class="token template-punctuation string">`</span></span> <span class="token operator">+</span> <span class="token string">"```"</span><span class="token punctuation">,</span>
      <span class="token string">'color'</span><span class="token operator">:</span> <span class="token string">'danger'</span>
    <span class="token punctuation">}</span><span class="token punctuation">;</span>
    axios<span class="token punctuation">.</span><span class="token function">post</span><span class="token punctuation">(</span><span class="token constant">SLACK_WEBHOOK</span><span class="token punctuation">,</span> <span class="token punctuation">{</span>attachments<span class="token operator">:</span> <span class="token punctuation">[</span>attachments<span class="token punctuation">]</span><span class="token punctuation">}</span><span class="token punctuation">)</span><span class="token punctuation">;</span>
  <span class="token punctuation">}</span>
<span class="token punctuation">}</span><span class="token punctuation">;</span>

const axios = require('axios');

// Search GG để lấy webhook url

const SLACK_WEBHOOK = process.env.SLACK_WEBHOOK;

const AWS_REGION = process.env.AWS_REGION;

module.exports.notification = event => {

if(event['source'] && event['source'] === 'aws.ecs') {

const detail = event['detail'];

const header = 'ECS task bị stop rồi đại ca ơi!!!';

let clusterName = detail['clusterArn'].split('/')[1];

let taskId = detail['taskArn'].split('/')[1];

let taskDefinition = detail['taskDefinitionArn'].split('/')[1];

let detailJson = JSON.stringify(detail, null, 2);

let url = `https://${AWS_REGION}.console.aws.amazon.com/ecs/home?region=${AWS_REGION}#/clusters/${clusterName}/tasks/${taskId}/details`;

let attachments = {

'text': `${header} n Cluster: *${clusterName}* n Task Definition: *${taskDefinition}* n ${url}n ` + "```" + `${detailJson}` + "```",

'color': 'danger'

};

axios.post(SLACK_WEBHOOK, {attachments: [attachments]});

}

};

serverless.yml

<span class="token key atrule">service</span><span class="token punctuation">:</span> notification<span class="token punctuation">-</span>ecs

<span class="token key atrule">provider</span><span class="token punctuation">:</span>
  <span class="token key atrule">name</span><span class="token punctuation">:</span> aws
  <span class="token key atrule">stackName</span><span class="token punctuation">:</span> ecs<span class="token punctuation">-</span>$<span class="token punctuation">{</span>self<span class="token punctuation">:</span>provider.stageName<span class="token punctuation">}</span><span class="token punctuation">-</span>notification<span class="token punctuation">-</span>lambda
  <span class="token key atrule">runtime</span><span class="token punctuation">:</span> nodejs12.x
  <span class="token key atrule">region</span><span class="token punctuation">:</span> ap<span class="token punctuation">-</span>northeast<span class="token punctuation">-</span><span class="token number">1</span>
  <span class="token key atrule">stageName</span><span class="token punctuation">:</span> $<span class="token punctuation">{</span>opt<span class="token punctuation">:</span>stageName<span class="token punctuation">,</span>self<span class="token punctuation">:</span>custom.stageName<span class="token punctuation">}</span>
  <span class="token key atrule">timeout</span><span class="token punctuation">:</span> <span class="token number">30</span>
  <span class="token key atrule">memorySize</span><span class="token punctuation">:</span> <span class="token number">128</span>
  
  <span class="token key atrule">custom</span><span class="token punctuation">:</span>
      <span class="token key atrule">stageName</span><span class="token punctuation">:</span> dev
      <span class="token key atrule">accounts</span><span class="token punctuation">:</span> XXXXXXXXX
      
<span class="token key atrule">resources</span><span class="token punctuation">:</span>
  <span class="token key atrule">Resources</span><span class="token punctuation">:</span>
    <span class="token key atrule">IamRoleLambdaExecution</span><span class="token punctuation">:</span>
      <span class="token key atrule">Type</span><span class="token punctuation">:</span> AWS<span class="token punctuation">:</span><span class="token punctuation">:</span>IAM<span class="token punctuation">:</span><span class="token punctuation">:</span>Role
      <span class="token key atrule">Properties</span><span class="token punctuation">:</span>
        <span class="token key atrule">RoleName</span><span class="token punctuation">:</span> EcsNotificationRole
        <span class="token key atrule">AssumeRolePolicyDocument</span><span class="token punctuation">:</span>
          <span class="token key atrule">Version</span><span class="token punctuation">:</span> <span class="token string">'2012-10-17'</span>
          <span class="token key atrule">Statement</span><span class="token punctuation">:</span>
            <span class="token punctuation">-</span> <span class="token key atrule">Effect</span><span class="token punctuation">:</span> Allow
              <span class="token key atrule">Principal</span><span class="token punctuation">:</span>
                <span class="token key atrule">Service</span><span class="token punctuation">:</span>
                  <span class="token punctuation">-</span> lambda.amazonaws.com
              <span class="token key atrule">Action</span><span class="token punctuation">:</span> sts<span class="token punctuation">:</span>AssumeRole
        <span class="token key atrule">Policies</span><span class="token punctuation">:</span>
          <span class="token punctuation">-</span> <span class="token key atrule">PolicyName</span><span class="token punctuation">:</span> myPolicyName
            <span class="token key atrule">PolicyDocument</span><span class="token punctuation">:</span>
              <span class="token key atrule">Version</span><span class="token punctuation">:</span> <span class="token string">'2012-10-17'</span>
              <span class="token key atrule">Statement</span><span class="token punctuation">:</span>
              <span class="token punctuation">-</span> <span class="token key atrule">Effect</span><span class="token punctuation">:</span> <span class="token string">"Allow"</span>
                <span class="token key atrule">Action</span><span class="token punctuation">:</span>
                  <span class="token punctuation">-</span> <span class="token string">"s3:*"</span>
                  <span class="token punctuation">-</span> <span class="token string">"logs:CreateLogGroup"</span>
                  <span class="token punctuation">-</span> <span class="token string">"logs:CreateLogStream"</span>
                  <span class="token punctuation">-</span> <span class="token string">"logs:PutLogEvents"</span>
                <span class="token key atrule">Resource</span><span class="token punctuation">:</span> <span class="token string">"*"</span>
<span class="token key atrule">functions</span><span class="token punctuation">:</span>
    <span class="token key atrule">notificationECS</span><span class="token punctuation">:</span>
    <span class="token key atrule">handler</span><span class="token punctuation">:</span> handler.notification
    <span class="token key atrule">environment</span><span class="token punctuation">:</span>
      <span class="token key atrule">SLACK_WEBHOOK</span><span class="token punctuation">:</span> <span class="token string">'https://hooks.slack.com/services/XXXXXXXX/YYYYYYYYY/VVVVVVVVVVVVVVVVVVVVVVVV'</span>
    <span class="token key atrule">events</span><span class="token punctuation">:</span>
      <span class="token punctuation">-</span> <span class="token key atrule">eventBridge</span><span class="token punctuation">:</span>
          <span class="token key atrule">pattern</span><span class="token punctuation">:</span>
            <span class="token key atrule">source</span><span class="token punctuation">:</span>
              <span class="token punctuation">-</span> <span class="token string">"aws.ecs"</span>
            <span class="token key atrule">detail-type</span><span class="token punctuation">:</span>
              <span class="token punctuation">-</span> <span class="token string">"ECS Task State Change"</span>
            <span class="token key atrule">detail</span><span class="token punctuation">:</span>
              <span class="token key atrule">clusterArn</span><span class="token punctuation">:</span>
                  <span class="token punctuation">-</span> <span class="token tag">!Sub</span> <span class="token string">"arn:aws:ecs:${self:provider.region}:${self:custom.accounts.${self:provider.stageName}}:cluster/ecs-${self:provider.stageName}-cluster"</span>
              <span class="token key atrule">lastStatus</span><span class="token punctuation">:</span>
                <span class="token punctuation">-</span> <span class="token string">"STOPPED"</span>

service: notification-ecs

provider:

name: aws

stackName: ecs-${self:provider.stageName}-notification-lambda

runtime: nodejs12.x

region: ap-northeast-1

stageName: ${opt:stageName,self:custom.stageName}

timeout: 30

memorySize: 128

custom:

stageName: dev

accounts: XXXXXXXXX

resources:

Resources:

IamRoleLambdaExecution:

Type: AWS::IAM::Role

Properties:

RoleName: EcsNotificationRole

AssumeRolePolicyDocument:

Version: '2012-10-17'

Statement:

- Effect: Allow

Principal:

Service:

- lambda.amazonaws.com

Action: sts:AssumeRole

Policies:

- PolicyName: myPolicyName

PolicyDocument:

Version: '2012-10-17'

Statement:

- Effect: "Allow"

Action:

- "s3:*"

- "logs:CreateLogGroup"

- "logs:CreateLogStream"

- "logs:PutLogEvents"

Resource: "*"

functions:

notificationECS:

handler: handler.notification

environment:

SLACK_WEBHOOK: 'https://hooks.slack.com/services/XXXXXXXX/YYYYYYYYY/VVVVVVVVVVVVVVVVVVVVVVVV'

events:

- eventBridge:

pattern:

source:

- "aws.ecs"

detail-type:

- "ECS Task State Change"

detail:

clusterArn:

- !Sub "arn:aws:ecs:${self:provider.region}:${self:custom.accounts.${self:provider.stageName}}:cluster/ecs-${self:provider.stageName}-cluster"

lastStatus:

- "STOPPED"

Deploy
$ sls deploy --profile xxxxxx --region aa-bbbbbb-Z
1
2
$ sls deploy --profile xxxxxx --region aa-bbbbbb-Z
Test
Thử stop ECS task để xem tin nhắn đã về chưa !!

Cảm ơn các bạn đã đọc tới đây. Nếu có gì thắc mắc hãy comment dưới bài mình sẽ trả lời trong tầm hiểu biết của mình.
Hẹn gặp lại các bạn ở bài tiếp theo!!!

Chia sẻ bài viết ngay

Nguồn bài viết : Viblo

Sử dụng CloudWatch Events để thông báo tình trạng ECS Task tới Slack

Chào các bạn hôm nay mình xin giới thiệu bài về sử dụng Cloudwatch Events để thông báo về Slack khi AWS ECS task gặp sự cố

TikTok trở thành nền tảng mảng xã hội lớn thứ hai ở Nam Phi

Mất giá nhanh nhất sau 9 tháng ra mắt, iPhone 14 Pro Max tiếp tục phá đáy tại Việt Nam

Hướng dẫn sử dụng ngôn ngữ R cho người mới bắt đầu

10 plugin cần thiết của SublimeText dành cho các lập trình viên JavaScript