I have an issue where I've set up an alarm which measures ApproximateNumberOfMessagesVisible on an SQS-queue. When it reaches 1, it spins up an EC2 instance, and when it goes to 0 it should trigger AutoScaling group to downscale it. However, even though I have 0 messages on SQS queue, my alarm remains at 1 message with the state Ok, it's like it doesn't recognize the change. I know it's an 'approximate number of messages', but this can go on for days with the value of messages 0, and the actual value on alarm as 1. Is there any clue on why is this happening?
Is it normal for AWS CloudWatch alarms metrics to be stuck at some value?
31 Views Asked by Miloš Milutinov At
1
There are 1 best solutions below
Related Questions in AMAZON-WEB-SERVICES
- S3 integration testing
- How to get content of BLOCK types LAYOUT_TITLE, LAYOUT_SECTION_HEADER and LAYOUT_xx in Textract
- Error **net::ERR_CONNECTION_RESET** error while uploading files to AWS S3 using multipart upload and Pre-Signed URL
- Failed to connect to your instance after deploying mern app on aws ec2 instance when i try to access frontend
- AWS - Tab Schema Conversion don't show up after creating a Migration Project
- Unable to run Bash Script using AWS Custom Lambda Runtime
- Using Amazon managed Prometheus to get EC2 metrics data in Grafana
- AWS Dns record A not navigate to elb
- Connection timed out error with smtp.gmail.com
- AWS Cognito Multi-tenant Integration | Ok to use Client’s Idp?
- Elasticbeanstalk FastAPI application is intermittently not responding to https requests
- Call an External API from AWS Lambda
- Why my mail service api spring isnt working?
- export 'AWSIoTProvider' (imported as 'AWSIoTProvider') was not found in '@aws-amplify/pubsub'
- How to take first x seconds of Audio from a wav file read from AWS S3 as binary stream using Python?
Related Questions in AMAZON-CLOUDWATCH
- Setting up alarms for Cloudwatch Insight Queries
- Sending metrics data from on-premise Linux server to Cloudwatch
- Log retation setting for ECS
- How to configure CPU utilized metric for ECS in AWS for Alarm?
- How to get ECS task to communicate with cloudwatch agent?
- eb CLI won't download logs files from /var/log after setup amazon cloudwatch agent
- Step scaling option disabled for ECS Fargate service
- Log ruby on rails application running in phusion passenger to aws cloudwatch
- AWS CloudWatch parsing logs
- How can I set the log_stream_prefix to get the cloudwatch data from lambda
- Does Vercel has any features to moniter static asset response time?
- Custom metrics script on window instances in two different regions in two different account
- Can you parse then query on the parse value in CloudWatch Insights?
- Cloudwatch Alarm 4xx Errors API Gateway Terraform
- A way to get sum of continous points in cloudwatch for a sparse graph
Related Questions in CLOUDWATCH-ALARMS
- Setting up alarms for Cloudwatch Insight Queries
- how to create composite CloudWatch alarm for Sum of two metrics in terraform
- Is it normal for AWS CloudWatch alarms metrics to be stuck at some value?
- how we can create metric filter for cloudwatch log filter for sagemaker training job failure
- Can CloudWatch Query SQL Servers?
- How to create cloud watch alarm using x-ray traces response time
- Terraform aws retrieve target group and associated load balancer arn suffix
- CloudWatch Alarm to catch consecutive failures
- AWS Cloudwatch + alarm period less than 10 seconds?
- Error: Missing required key 'Id' when creating a CloudWatch alarm using 'pod_status_ready' metric
- INSUFFICIENT_DATA for Cloudwatch Alarm
- How Can I setup Cloudwatch Alarms on SNS Retry and DLQ Entry?
- How can I set up alarm in CloudWatch for SMSMonthToDateSpentUSD?
- CloudWatch alarm in alarm state when it shouldn't be
- Heartbeat for autoscaled service
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular # Hahtags
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
I have also observed that Amazon SQS does not send "zero" metrics to Amazon CloudWatch. My personal theory is that this reduces the amount of 'chatter' that SQS needs to send to CloudWatch because there must be a huge number of empty queues.
Fortunately, you can cater for this by going to the Additional Configuration in the CloudWatch Alarm and setting Missing data treatment to Treat missing data as bad. This will trigger the alarm in the same manner as if you set it to trigger on a zero value.
When configuration scaling based on SQS queue sizes, remember the golden rule to Scale-out quickly but scale-in slowly. That is, turn on resources reasonably quickly to respond to incoming messages but don't be too hasty to scale-in. Set the Alarm to only trigger after a reasonable period of time relative to how long it takes to launch new resources. So, if you are launching EC2 instances and an instance takes 2 minutes to launch, wait at least 5 minutes to scale-in.