PUBLIC INCIDENT INDEX · ANSWERS PROTECTED

Cloud troubleshooting practice built around the evidence.

Browse the failure symptoms and known-good baselines Google can index. The decisive evidence, choices, diagnosis, recovery, and postmortem stay inside the simulator.

10 PRACTICE TRACKS

Choose the system that usually breaks first.

Each track contains five public briefs and links into the complete 500-incident library.

05 BRIEFS

AWS networking incident practice

Practice isolating failures across VPC routes, NACLs, security groups, load balancers, DNS, NAT gateways, and private endpoints.

Open track →
05 BRIEFS

AWS EC2 and Auto Scaling incident practice

Work through EC2, Auto Scaling, launch-template, cloud-init, IMDSv2, burst-credit, and EBS attachment failures.

Open track →
05 BRIEFS

AWS storage incident practice

Practice S3, KMS, EBS, lifecycle, versioning, and storage-cost investigations through production-style incident briefs.

Open track →
05 BRIEFS

AWS IAM and identity incident practice

Train on IAM policy evaluation, SCPs, permissions boundaries, KMS policies, STS sessions, and secret rotation failures.

Open track →
05 BRIEFS

Terraform incident practice

Practice remote-state, provider, resource-address, dependency-graph, and refactor incidents without risking a real cloud account.

Open track →
05 BRIEFS

Linux production incident practice

Investigate filesystem, memory, systemd, permissions, and time-synchronization failures in realistic service contexts.

Open track →
05 BRIEFS

Docker and ECS incident practice

Practice registry, health-check, CPU quota, read-only filesystem, and image-architecture failures across Docker and ECS.

Open track →
05 BRIEFS

Kubernetes and EKS incident practice

Train on CrashLoopBackOff, ImagePullBackOff, storage claims, Service selectors, and disruption-budget failures.

Open track →
05 BRIEFS

CI/CD and GitOps incident practice

Practice artifact integrity, OIDC federation, GitOps reconciliation, Helm rendering, and database-aware rollback decisions.

Open track →
05 BRIEFS

SRE and data incident practice

Investigate replica lag, cache churn, dead-letter queues, alert silences, and retry storms through evidence-led scenarios.

Open track →

SEARCHABLE FIELD INDEX

50 production-style incident briefs.

Every page gives you enough context to judge relevance without disclosing the answer.

INC-008Intermediate

Return traffic disappears

VPC · NACL

intermittent HTTPS timeouts from public clients
INC-009Intermediate

DNS points to yesterday

Route 53 · ALB

some clients reach a retired load balancer
INC-010Intermediate

The one-way load balancer

ALB · Security Groups

load-balancer requests time out although instances answer locally
INC-011Advanced

The NAT runs out of sockets

NAT Gateway · VPC

private workloads intermittently fail outbound dependency calls
INC-012Advanced

The endpoint black hole

VPC Endpoint · S3

private subnets lose access to S3 while other AWS APIs still work
INC-013Intermediate

The launch template references a ghost

EC2 · Auto Scaling

an Auto Scaling group cannot replace unhealthy instances
INC-014Foundational

Bootstrap never finishes

EC2 · cloud-init

new instances launch but never join the service
INC-015Intermediate

Burst credits hit zero

EC2 · CloudWatch

latency climbs while CPU appears pinned at a low ceiling
INC-016Intermediate

Metadata hardening breaks startup

EC2 · IMDSv2

new instances cannot retrieve startup credentials
INC-017Intermediate

The volume changes its name

EC2 · EBS

an application starts with an empty data directory after instance replacement
INC-018Advanced

KMS allows the bucket, not the reader

S3 · KMS

authorized users can list objects but cannot download encrypted content
INC-019Foundational

Deleted but still there

S3 · Versioning

a previously available object now returns 404 after cleanup
INC-020Intermediate

Lifecycle freezes hot data

S3 · Glacier

a batch job cannot immediately read recently archived objects
INC-021Advanced

The EBS burst bucket empties

EBS · EC2

disk latency spikes during sustained writes without a volume failure
INC-022Intermediate

Multipart uploads never leave

S3 · Cost

storage charges rise even though visible object count is stable
INC-023Advanced

The invisible organization deny

IAM · Organizations

an administrator role is denied a newly required API action
INC-024Advanced

The boundary wins

IAM · Permissions Boundary

a role receives AccessDenied despite a newly attached allow policy
INC-025Intermediate

The token expires mid-deploy

STS · CI/CD

a long deployment succeeds initially and then receives ExpiredToken
INC-026Advanced

The key policy veto

KMS · IAM

a role with kms:Decrypt in IAM still cannot use the key
INC-027Advanced

Rotation changes half the system

Secrets Manager · Application

new connections authenticate while pooled connections begin failing unpredictably
INC-028Intermediate

The lock outlives the job

Terraform · Remote State

every Terraform plan fails with a state-lock acquisition error
INC-029Intermediate

The provider changes the plan

Terraform · Provider

an unchanged configuration suddenly proposes broad replacements
INC-030Advanced

Count shifts every address

Terraform · AWS

removing one list item causes Terraform to replace unrelated resources
INC-031Advanced

The dependency circle

Terraform · Modules

Terraform cannot construct a plan because resources form a cycle
INC-032Intermediate

Refactor becomes replacement

Terraform · State

a code-only resource rename proposes destroy and create
INC-033Intermediate

Free space, no files

Linux · Filesystems

writes fail with no space left although disk capacity remains
INC-034Intermediate

The kernel chooses a victim

Linux · Memory

a service disappears without a normal application shutdown
INC-035Foundational

The variable systemd never saw

Linux · systemd

a service works in an interactive shell but fails under systemd
INC-036Foundational

Deploy changes the owner

Linux · Permissions

the application receives permission denied on its own runtime directory
INC-037Intermediate

Time breaks trust

Linux · NTP

signed API requests and TLS validations fail only on one host
INC-038Intermediate

The registry rejects the node

ECR · ECS

new tasks remain in image-pull failure while old tasks run
INC-039Intermediate

Health check calls a missing tool

Docker · ECS

containers serve traffic briefly but are repeatedly marked unhealthy
INC-040Advanced

CPU quota becomes latency

Containers · Linux

container latency spikes while host CPU still has idle capacity
INC-041Intermediate

Read-only means read-only

Docker · Security

a hardened container exits when creating a temporary file
INC-042Intermediate

The image speaks the wrong architecture

Docker · EC2

a container exits immediately with exec format error
INC-043Intermediate

ConfigMap triggers a crash loop

Kubernetes · ConfigMap

new Pods cycle through CrashLoopBackOff after a configuration rollout
INC-044Foundational

The image cannot be pulled

Kubernetes · Registry

Pods remain in ImagePullBackOff after a release
INC-045Advanced

The claim waits for storage

Kubernetes · EBS CSI

stateful Pods remain Pending with unbound persistent-volume claims
INC-046Foundational

The Service selects nobody

Kubernetes · Service

a Service has no endpoints although Pods report Ready
INC-047Advanced

The disruption budget blocks maintenance

Kubernetes · PDB

node drain stalls because healthy Pods cannot be evicted
INC-048Intermediate

The pipeline deploys an old artifact

CI/CD · Artifacts

a successful deployment runs code from a previous commit
INC-049Advanced

OIDC presents the wrong audience

CI/CD · OIDC

a CI job cannot exchange its OIDC token for cloud credentials
INC-050Advanced

GitOps keeps undoing the fix

Argo CD · Kubernetes

an emergency cluster edit is reverted within minutes
INC-051Intermediate

Helm turns a number into a string

Helm · Kubernetes

a release fails validation despite apparently correct values
INC-052Advanced

Rollback meets an irreversible migration

CI/CD · Database

application rollback fails after a database schema deployment
INC-053Advanced

Replica lag serves stale truth

RDS · Replication

users read stale data immediately after successful writes
INC-054Advanced

The cache evicts the hot set

Redis · Application

database load and latency surge while cache availability remains green
INC-055Intermediate

Messages flood the dead-letter queue

SQS · Lambda

the primary queue drains while failed messages accumulate rapidly
INC-056Intermediate

The silence hides the outage

Alerting · SRE

customers report an outage before the on-call receives any page
INC-057Advanced

Retries become the outage

SRE · Distributed Systems

a small dependency slowdown grows into fleet-wide saturation

READING IS NOT RESPONDING

Make the call before the answer appears.

Start with three free simulations, then unlock 100 or 500 incidents for lifetime practice.

Enter the simulator →