Design Patterns for Global Traffic Management: AWS Global Accelerator
Design patterns for global traffic management (for example, AWS Global Accelerator)
Design Patterns for Global Traffic Management: AWS Global Accelerator
This study guide focuses on optimizing global application performance and availability by leveraging the AWS global network backbone. It specifically examines the architecture, use cases, and design patterns associated with AWS Global Accelerator.
Learning Objectives
After studying this guide, you should be able to:
- Explain the mechanism of IP Anycast in global traffic routing.
- Differentiate between AWS Global Accelerator and Amazon CloudFront.
- Design multi-region architectures using Standard and Custom Routing accelerators.
- Implement traffic engineering using traffic dials and endpoint weights.
- Evaluate health check configurations for global failover scenarios.
Key Terms & Glossary
- Anycast IP: A routing methodology where multiple endpoints share the same IP address. Traffic is routed to the "closest" endpoint from the perspective of the network topology.
- AWS Global Backbone: The private, high-speed fiber-optic network connecting AWS Regions and Edge Locations, bypassing the public internet.
- Endpoint Group: A collection of endpoints (Load Balancers, EC2 instances, or EIPs) within a specific AWS Region.
- Traffic Dial: A percentage-based setting used to control the volume of traffic directed to an entire endpoint group (Region).
- Static Mapping: In Custom Routing accelerators, the deterministic mapping of a specific accelerator port to a specific destination (EC2 instance IP and port).
The "Big Idea"
[!IMPORTANT] The core philosophy of Global Accelerator is to on-ramp user traffic onto the AWS private network as close to the user as possible. By minimizing the distance traffic travels over the congested and jittery public internet, AWS can provide a deterministic, high-performance path to the application.
Formula / Concept Box
| Feature | Standard Accelerator | Custom Routing Accelerator |
|---|---|---|
| Traffic Type | Any TCP/UDP | Any TCP/UDP |
| Target Selection | Automatic (based on health/load) | Manual (Port-to-Endpoint mapping) |
| Endpoints | ALBs, NLBs, EC2, Elastic IPs | VPC Subnets (EC2 Instances) |
| Use Case | Multi-region HA, Blue/Green | Gaming, VoIP, Specialized Apps |
| Redundancy | 2 Static Anycast IPs | 2 Static Anycast IPs |
Hierarchical Outline
- I. Global Accelerator Architecture
- Edge Locations: Entry points using Anycast IPs.
- Congestion Management: Bypassing internet hop-counts.
- Redundancy: Provisioning of two distinct IPv4 addresses from separate network zones.
- II. Traffic Engineering Components
- Listeners: Process incoming connections based on protocol and port ranges.
- Endpoint Groups: Regional groupings; support for Traffic Dials (0–100%).
- Endpoints: Specific resources; support for Weights for fine-grained routing.
- III. Security and Integration
- AWS Shield: Standard DDoS protection included at the edge.
- BYOIP: Ability to bring existing /24 IPv4 ranges to AWS.
- Health Checks: TCP, HTTP, or HTTPS probes to trigger automatic failover.
Visual Anchors
Traffic Flow Architecture
Anycast vs. Unicast Visualization
\begin{tikzpicture} % Nodes \draw[fill=blue!10] (0,0) circle (0.5cm) node {User}; \draw[fill=red!10] (4,2) rectangle (6,3) node[midway] {Edge A}; \draw[fill=red!10] (4,-2) rectangle (6,-1) node[midway] {Edge B}; \draw[dashed] (1,-3) -- (1,3) node[above] {Public Internet}; \draw[thick] (7,-3) -- (7,3) node[above] {AWS Backbone};
% Traffic Lines
\draw[->, thick, blue] (0.5,0) -- (4,1.5) node[midway, sloped, above] {Anycast IP 1.1.1.1};
\draw[->, thick, red] (6,2.5) -- (7,2.5);
\draw[->, thick, red] (6,-1.5) -- (7,-1.5);
% Annotation
\node[text width=4cm] at (3,-4) {\small Traffic enters the closest Edge Location using the same IP address.};\end{tikzpicture}
Definition-Example Pairs
- Anycast Routing
- Definition: A network addressing and routing method where a single destination IP address is shared by multiple device endpoints.
- Example: A user in Tokyo and a user in New York both hit
1.2.3.4. The Tokyo user is routed to a Tokyo edge location, and the NY user to an NY edge location.
- Traffic Dial
- Definition: A configuration setting that allows you to limit the percentage of traffic that an accelerator directs to an endpoint group.
- Example: During a migration, you set the Traffic Dial for a new region to 10% to perform a canary test of the global infrastructure.
Worked Examples
Scenario: Multi-Region High Availability
Problem: A banking application requires < 100ms latency globally and must survive a total region failure.
- Deploy Resources: Deploy Application Load Balancers (ALBs) in
us-east-1andeu-central-1. - Create Accelerator: Provision a Standard Global Accelerator. AWS provides two Anycast IPs.
- Configure Listeners: Set up a listener for port 443 (TCP).
- Add Endpoint Groups: Create two groups, one for each region.
- Set Health Checks: Configure the accelerator to monitor the ALBs.
- Result: If
us-east-1fails health checks, Global Accelerator automatically shifts 100% of traffic toeu-central-1via the AWS backbone within seconds.
Checkpoint Questions
- What layer of the OSI model does AWS Global Accelerator primarily operate on?
- How many Anycast IP addresses does an accelerator provide for redundancy?
- True/False: Global Accelerator caches static content at the edge like CloudFront.
- What is the main difference between a Standard and a Custom Routing accelerator?
▶Click to see answers
- Layer 4 (TCP/UDP).
- Two.
- False (it is a network-layer transport service, not a CDN).
- Standard routes to the best regional endpoint automatically; Custom routes to specific EC2 instances based on listener ports.
Muddy Points & Cross-Refs
- CloudFront vs. Global Accelerator: Use CloudFront for caching (HTTP/S). Use Global Accelerator for connection optimization (TCP/UDP/Gaming/VoIP).
- Route 53 Latency Routing vs. Global Accelerator: Route 53 relies on the client's DNS resolver and the public internet. Global Accelerator uses Anycast to pull traffic onto the AWS backbone immediately, which is faster and more reliable.
Comparison Tables
Global Traffic Management Options
| Feature | Route 53 (Latency) | Amazon CloudFront | AWS Global Accelerator |
|---|---|---|---|
| Mechanism | DNS Resolution | Edge Caching | Anycast/IP Transport |
| Protocol Support | Any (DNS based) | HTTP/HTTPS/RTMP | TCP/UDP |
| Primary Goal | Resolve to closest IP | Reduce latency via cache | Rapid AWS Backbone entry |
| IP Address | Dynamic/Multiple | Dynamic/DNS Name | Static Anycast (2) |