AWS In Practice
Courses
  • Welcome to AWS In Practice by IT Assist Labs!
  • Courses
    • AWS Powered E-commerce Application: A Guided Tour
      • Lesson Learning Paths
        • Lesson Learning Paths - Certification Prep
        • Lesson Learning Paths - Interview Prep
      • Lesson Summaries
        • Introduction
          • E-commerce Application Architecture
        • Multi-Account Strategy
          • Multi-Account Strategy Overview
          • Organization Units
          • Core Accounts
        • Core Microservices
          • Services Overview
          • AWS Well-Architected design framework application
          • Site Reliability Engineering Application
          • DevOps Application
          • Monitoring, Logging and Observability Application
        • AWS Service By Layer
          • AWS Service By Layer Overview
          • Presentation Layer
          • Business Logic Layer
          • Data Layer
        • E-commerce Application Use Cases
          • E-commerce Application Use Cases
          • Roles
      • Lesson Content Navigation Demonstration
    • Explore a Live AWS Environment Powering an E-commerce Application
  • Resources
    • AWS Certification Guide
      • Concepts
        • Security, Identity & Compliance
          • AWS IAM-Related Concepts in Certification Exams
        • Design High-Performing Architectures
          • Designing a high-performing architecture with EC2 and Auto Scaling Groups (ASGs)
    • Insights
      • Zero Trust Architecture (ZTA)
      • Implementing a Zero Trust Architecture(ZTA) with AWS
      • The Modern Application Development Lifecycle - Blue/Green Deployments
      • Microservices Communication Patterns
    • Interview Preparation
      • AWS Solutions Archictect
  • AWS Exploration
    • Use Cases
      • Multi-Region Resiliency with Active-Active Setup
        • Exploration Summary
    • Foundational Solutions Architect Use Cases
    • Security Engineer / Cloud Security Architect Use Cases
    • DevOps / Site Reliability Engineer (SRE) Use Cases
    • Cloud Engineer / Cloud Developer
    • Data Engineer Use Cases
    • Machine Learning Engineer / AI Practitioner Use Cases
    • Network Engineer (Cloud) Use Cases
    • Cost Optimization / FinOps Practitioner Use Cases
    • IT Operations / Systems Administrator Use Cases
  • Study Group
    • AWS Certified Solutions Architect - Associate
      • Study Guide Introduction
      • Domain 1: Design Secure Architectures
        • Task Statement 1.1: Design secure access to AWS resources
          • SecureCart's Journey
          • AWS Identity & Access Management (IAM) Fundamentals
          • AWS Security Token Service (STS)
          • AWS Organization
          • IAM Identity Center
          • AWS Policies
          • Federated Access
          • Directory Service
          • Managing Access Across Multiple Accounts
          • Authorization Models in IAM
          • AWS Control Tower
          • AWS Service Control Policies (SCPs)
          • Use Cases
            • Using IAM Policies and Tags for Access Control in AWS
        • Task Statement 1.2: Design Secure Workloads and Applications
          • SecureCart Journey
          • Application Configuration & Credential Security
          • Copy of Application Configuration & Credential Security
          • Network Segmentation Strategies & Traffic Control
          • Securing Network Traffic & AWS Service Endpoints
          • Protecting Applications from External Threats
          • Securing External Network Connections
          • AWS Network Firewall
          • AWS Firewall Manager
          • IAM Authentication Works with Databases
          • AWS WAF (Web Application Firewall)
          • Use Cases
            • AWS Endpoint Policy for Trusted S3 Buckets
            • Increasing Fault Tolerance for AWS Direct Connect in SecureCart’s Multi-VPC Network
            • Securing Multi-Domain SSL with ALB in SecureCart Using SNI-Based SSL
            • Configuring a Custom Domain Name for API Gateway with AWS Certificate Manager and Route 53
            • Application Load Balancer (ALB) – Redirecting HTTP to HTTPS
            • Security Considerations in ALB Logging & Monitoring
          • Amazon CloudFront and Different Origin Use Cases
          • Security Group
          • CloudFront
          • NACL
          • Amazon Cognito
          • VPC Endpoint
        • Task Statement 1.3: Determine appropriate data security controls
          • SecureCart Journey
          • Data Access & Governance
          • Data Encryption & Key Management
          • Data Retention, Classification & Compliance
          • Data Backup, Replication & Recovery
          • Managing Data Lifecycle & Protection Policies
          • KMS
          • S3 Security Measures
          • KMS Use Cases
          • Use Cases
            • Safely Storing Sensitive Data on EBS and S3
            • Managing Compliance & Security with AWS Config
            • Preventing Sensitive Data Exposure in Amazon S3
            • Encrypting EBS Volumes for HIPAA Compliance
            • EBS Encryption Behavior
            • Using EBS Volume While Snapshot is in Progress
          • Compliance
          • Implementing Access Policies for Encryption Keys
          • Rotating Encryption Keys and Renewing Certificates
          • Implementing Policies for Data Access, Lifecycle, and Protection
          • Rotating encryption keys and renewing certificates
          • Instance Store
          • AWS License Manager
          • Glacier
          • AWS CloudHSM Key Management & Zeroization Protection
          • EBS
        • AWS Security Services
        • Use Cases
          • IAM Policy & Directory Setup for S3 Access via Single Sign-On (SSO)
          • Federating AWS Access with Active Directory (AD FS) for Hybrid Cloud Access
      • Domain 2
        • Task Statement 2.1: Design Scalable and Loosely Coupled Architectures
          • SecureCart Journey
          • API Creation & Management
          • Microservices & Event-Driven Architectures
          • Load Balancing & Scaling Strategies
          • Caching Strategies & Edge Acceleration
          • Serverless & Containerization
          • Workflow Orchestration & Multi-Tier Architectures
        • Task Statement 2.2: Design highly available and/or fault-tolerant architectures
          • SecureCart Journey
          • AWS Global Infrastructure & Distributed Design
          • Load Balancing & Failover Strategies
          • Disaster Recovery (DR) Strategies & Business Continuity
          • Automation & Immutable Infrastructure
          • Monitoring & Workload Visibility
          • Use Cases
            • Amazon RDS Failover Events & Automatic Failover Mechanism
      • Domain 3
        • Task Statement 3.1: Determine high-performing and/or scalable storage solutions
          • SecureCart Journey
          • Understanding AWS Storage Types & Use Cases
          • Storage Performance & Configuration Best Practices
          • Scalable & High-Performance Storage Architectures
          • Hybrid & Multi-Cloud Storage Solutions
          • Storage Optimization & Cost Efficiency
          • Hands-on Labs & Final Challenge
        • Task Statement 3.2: Design High-Performing and Elastic Compute Solutions
          • SecureCart
          • AWS Compute Services & Use Cases
          • Elastic & Auto-Scaling Compute Architectures
          • Decoupling Workloads for Performance
          • Serverless & Containerized Compute Solutions
          • Compute Optimization & Cost Efficiency
        • Task Statement 3.3: Determine High-Performing Database Solutions
          • SecureCart Journey
          • AWS Database Types & Use Cases
          • Database Performance Optimization
          • Caching Strategies for High-Performance Applications
          • Database Scaling & Replication
          • High Availability & Disaster Recovery for Databases
        • Task Statement 3.4: Determine High-Performing and/or Scalable Network Architectures
          • SecureCart Journey
          • AWS Networking Fundamentals & Edge Services
          • Network Architecture & Routing Strategies
          • Load Balancing for Scalability & High Availability
          • Hybrid & Private Network Connectivity
          • Optimizing Network Performance
          • Site-to-Site VPN Integration for SAP HANA in AWS
        • Task Statement 3.5: Determine High-Performing Data Ingestion and Transformation Solutions
          • SecureCart Journey
          • Data Ingestion Strategies & Patterns
          • Data Transformation & ETL Pipelines
          • Secure & Scalable Data Transfer
          • Building & Managing Data Lakes
          • Data Visualization & Analytics
      • Domain 4
        • Task Statement 4.1: Design Cost-Optimized Storage Solutions
          • SecureCart Journey
          • AWS Storage Services & Cost Optimization
          • Storage Tiering & Auto Scaling
          • Data Lifecycle Management & Archival Strategies
          • Hybrid Storage & Data Migration Cost Optimization
          • Cost-Optimized Backup & Disaster Recovery
        • Task Statement 4.2: Design Cost-Optimized Compute Solutions
          • SecureCart Journey
          • AWS Compute Options & Cost Management Tools
          • Compute Purchasing Models & Optimization
          • Scaling Strategies for Cost Efficiency
          • Serverless & Container-Based Cost Optimization
          • Hybrid & Edge Compute Cost Strategies
          • AWS License Manager
        • Task Statement 4.3: Design cost-optimized database solutions
          • SecureCart Journey
          • AWS Database Services & Cost Optimization Tools
          • Database Sizing, Scaling & Capacity Planning
          • Caching Strategies for Cost Efficiency
          • Backup, Retention & Disaster Recovery
          • Cost-Optimized Database Migration Strategies
        • Task Statement 4.4: Design Cost-Optimized Network Architectures
          • SecureCart Journey
          • AWS Network Cost Management & Monitoring
          • Load Balancing & NAT Gateway Cost Optimization
          • Network Connectivity & Peering Strategies
          • Optimizing Data Transfer & Network Routing Costs
          • Content Delivery Network & Edge Caching
      • Week Nine
        • Final Review Session
        • Final Practice Test
Powered by GitBook

@ 2024 IT Assist LLC

On this page
  • Queue Depth
  • User-Driven Traffic
  • Application Latency
  • Database Performance
  • Cache Performance
  • Stream Processing Load
  • Custom Business Metrics
  • Storage or I/O Pressure
  • Error Rates
  • Event-Driven Scaling
  • Reframing the Mindset
  • The Takeaway
  • Subscribe To Our Mailing List
  1. Resources
  2. AWS Certification Guide
  3. Concepts
  4. Design High-Performing Architectures

Designing a high-performing architecture with EC2 and Auto Scaling Groups (ASGs)

PreviousDesign High-Performing ArchitecturesNextInsights

Last updated 5 months ago

| |

When designing a high-performing architecture with EC2 and Auto Scaling Groups (ASGs), thinking beyond traditional EC2-based metrics like CPU utilization or memory is essential. Instead, consider the business-driven data points that indicate when you need more compute power or when it’s safe to scale down. These could include application-specific metrics, service-level indicators, or workflow-related triggers that truly reflect your workload demands.

Here are some examples of non-EC2 metrics that can drive Auto Scaling decisions:


Queue Depth

  • Metric: ApproximateNumberOfMessages (from Amazon SQS)

  • Scenario: You’re processing messages from an SQS queue. When the queue grows beyond a certain threshold (e.g., 100 messages), it signals the need for more workers to handle the load. Similarly, when the queue is nearly empty, you can safely reduce the number of EC2 instances.


User-Driven Traffic

  • Metric: RequestCountPerTarget (from Application Load Balancer)

  • Scenario: Scale out your instances when incoming HTTP requests to your backend services exceed, say, 1,000 requests per second. Scale in when traffic drops below 500 requests per second.


Application Latency

  • Metric: TargetResponseTime (from Application Load Balancer or custom metrics)

  • Scenario: If your backend application takes too long to respond (e.g., average latency exceeds 300 ms), it might indicate a need for additional capacity to meet demand.


Database Performance

  • Metric: WriteThroughput or ReadThroughput (from Amazon RDS or DynamoDB)

  • Scenario: Scale out compute when database write operations spike beyond the normal threshold (e.g., 1,000 writes per second) and scale in when activity normalizes.


Cache Performance

  • Metric: CacheMissCount (from Amazon ElastiCache)

  • Scenario: If your cache misses increase, it might indicate that the backend application is under pressure, requiring additional compute resources to handle the increased database lookups or recomputation of cached values.


Stream Processing Load

  • Metric: GetRecords.IteratorAgeMilliseconds (from Amazon Kinesis Data Streams)

  • Scenario: If the age of records in the Kinesis stream increases, it indicates your processing application is lagging, and you need to add more compute instances.


Custom Business Metrics

  • Metric: OrdersProcessedPerMinute or ActiveSessions

  • Scenario: You might track the number of orders being processed or active user sessions in real-time. If these numbers exceed your defined thresholds, scale out your compute to ensure a smooth user experience.


Storage or I/O Pressure

  • Metric: DiskReadOps or DiskWriteOps (from EC2 or EBS)

  • Scenario: For applications with heavy I/O workloads, high disk read/write operations might require scaling out instances to distribute the workload.


Error Rates

  • Metric: 4XXErrorCount or 5XXErrorCount (from Application Load Balancer or API Gateway)

  • Scenario: A sudden spike in error rates could indicate that your application instances are overloaded. Scaling out can help alleviate the pressure and reduce errors.


Event-Driven Scaling

  • Metric: Custom event counters (e.g., TasksInProgress or TransactionsPending)

  • Scenario: Scale-out when the number of pending tasks or unprocessed transactions exceeds a set threshold, ensuring critical workflows remain on schedule.


Reframing the Mindset

When thinking about Auto Scaling Groups, the key is to align scaling decisions with the data points that best represent your workload's behavior—not just the underlying infrastructure. By focusing on meaningful metrics like application performance, user activity, or workflow-specific indicators, you ensure that your scaling strategy directly supports your business objectives.


The Takeaway

Don’t limit yourself to EC2-centric metrics. Look at your application as a whole and identify metrics that truly reflect the demand on your system. Whether it’s queue depth, database throughput, cache misses, or custom business metrics, these are the indicators that drive intelligent scaling decisions. With this broader perspective, you’ll design an architecture that not only performs well but also adapts dynamically to real-world demands.

Subscribe To Our Mailing List

Subscribe to our mailing list to stay updated on recommendations to prepare effectively for your certifications. Receive valuable content, including explanations of certification concepts, scenario-based question breakdowns, study tips, and curated recommendations to support your AWS certification journey. Don’t miss out—sign up today!


📚 Ready to elevate your AWS skills? Explore content tailored to help you build, deploy, and manage cloud-native applications like a pro.

Facebook
Linkedln
X (Twitter)
AWS Powered E-commerce Application: A Guided Tour
Page cover image