BrainyBeeBrainyBee
ExploreBlogStart Studying
HomeDesigning and Implementing Microsoft DevOps Solutions (AZ-400)Comprehensive testing strategy
Lesson283 words

Comprehensive testing strategy

Design a comprehensive testing strategy

The shape

Loading Diagram...
Figure 1 — Mermaid diagram
LevelScopeSpeedWhere it runs
LocalDeveloper's machine, pre-commitFastestBefore push
UnitOne component, dependencies fakedFastEvery PR
IntegrationComponents together, real dependenciesSlowerPR or main
Load / performanceSystem under expected and peak trafficSlowestScheduled or pre-release

Choosing where a test belongs

The economics are simple: a defect caught locally costs a developer minutes, in a PR costs a build, in production costs an incident. Push tests as early as they can meaningfully run — but no earlier. A test that needs a real database is not a unit test just because you would like it to be fast.

Load testing is a different question

Unit and integration tests ask is it correct? Load tests ask does it still behave correctly under expected and peak traffic? They need a production-like environment and their results are statistical, so they usually run on a schedule or before a release rather than on every commit.

Flaky tests

A test that fails intermittently without a code change is worse than no test: it trains the team to re-run rather than investigate, and it hides real regressions. Track flakiness explicitly — pipeline health metrics include flaky test rate for exactly this reason — and quarantine or fix rather than retry blindly.

Primary sources

  • https://learn.microsoft.com/en-us/azure/devops/pipelines/test/review-continuous-test-results-after-build
All Designing and Implementing Microsoft DevOps Solutions (AZ-400) Study Resources

Related Notes

  • Agent and runner infrastructure421 words
  • Agent and runner infrastructure — quick notes150 words
  • Alerting on pipeline events255 words
  • Alerting on pipeline events — quick notes94 words
  • Analyzing usage and application performance241 words
  • Analyzing usage and application performance — quick notes73 words
  • Appropriate access levels217 words
  • Appropriate access levels — quick notes85 words
  • Automating container scanning277 words
  • Automating container scanning — quick notes96 words
  • Automating documentation from Git history191 words
  • Automating documentation from Git history — quick notes55 words

Ready to study Designing and Implementing Microsoft DevOps Solutions (AZ-400)?

Practice tests, flashcards, and all study notes — free, no sign-up.

Start Studying

Ready to study Designing and Implementing Microsoft DevOps Solutions (AZ-400)?

Practice tests, flashcards, and all study notes — free, no sign-up needed.

Start Studying — Free
Designing and Implementing Microsoft DevOps Solutions (AZ-400) ResourcesExplore All HivesBlogHome

© 2026 BrainyBee. Free AI-powered exam prep.

Loading Diagram...
Flowchart, top to bottom. Unit — many, fast, isolated connects to Integration — fewer, real dependencies. I connects to End-to-end — fewest, slowest, most brittle.