[AZ-563] Decompose blackbox tests into AZ-564..574 task specs

Step 5 of autodev existing-code flow. Epic AZ-563 plus 11 atomic
tasks covering all 67 test scenarios from
_docs/02_document/tests/* exactly once:

- AZ-564 test infrastructure (xUnit + Docker + mock JWKS + dataseed)
- AZ-565..568 functional positive (FT-P-01..22)
- AZ-569..570 functional negative (FT-N-01..16)
- AZ-571 security (NFT-SEC-01..10)
- AZ-572 resilience (NFT-RES-01..06)
- AZ-573 resource limits (NFT-RES-LIM-01..06)
- AZ-574 performance (NFT-PERF-*)

_dependencies_table.md records the cross-check vs traceability
matrix (22 + 16 + 29 = 67 scenarios, no overlaps, no gaps; deferred
items remain deferred per matrix). All task headers carry their
Jira IDs (tracker: jira). Autodev state advanced to Step 6
(Implement Tests).

Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
Oleksandr Bezdieniezhnykh
2026-05-14 21:13:53 +03:00
parent 637f41c51c
commit cf632d9e2e
13 changed files with 703 additions and 2 deletions
+26
View File
@@ -11,6 +11,32 @@ Tracks ordering and inter-task dependencies for all task specs in `_docs/02_task
Tasks AZ-561 and AZ-562 touch disjoint files and were implemented as a single batch.
## Open — Step 5: Blackbox Tests (epic AZ-563)
All test tasks below land their xUnit code in a single new test project rooted at `e2e/Azaion.Annotations.E2E/` (per `AZ-564`). The infrastructure task is a hard prerequisite for every other test task.
| Task | Title | Scope | Scenarios | Complexity | Depends on |
|------|-------|-------|-----------|-----------|------------|
| [AZ-564](https://denyspopov.atlassian.net/browse/AZ-564) | Test infrastructure (Annotations e2e) | `e2e/Azaion.Annotations.E2E/`, `e2e/docker-compose.test.yml`, mock JWKS issuer, dataseed, runner script | n/a — bootstrap | 5 | None |
| [AZ-565](https://denyspopov.atlassian.net/browse/AZ-565) | Annotations REST positive | `Tests/AnnotationsRest/` | FT-P-01..06 (6) | 5 | AZ-564 |
| [AZ-566](https://denyspopov.atlassian.net/browse/AZ-566) | Realtime + outbox positive | `Tests/Realtime/`, `Tests/Outbox/` | FT-P-07,08,09 + FT-P-21,22 (skipped: RB-01) (5) | 5 | AZ-564 |
| [AZ-567](https://denyspopov.atlassian.net/browse/AZ-567) | Media + Dataset positive | `Tests/Media/`, `Tests/Settings/`, `Tests/Dataset/` | FT-P-10,11,14,15,16,17,18 (7) | 5 | AZ-564 |
| [AZ-568](https://denyspopov.atlassian.net/browse/AZ-568) | Auth + Health + Migrator positive | `Tests/Auth/`, `Tests/Health/`, `Tests/Migrator/` | FT-P-12,13,19,20 (4) | 2 | AZ-564 |
| [AZ-569](https://denyspopov.atlassian.net/browse/AZ-569) | Validation + envelope negative | `Tests/Validation/` | FT-N-01,02,05,06,07,14,16 (7) | 3 | AZ-564 |
| [AZ-570](https://denyspopov.atlassian.net/browse/AZ-570) | Authorization negative | `Tests/Authorization/` | FT-N-03,04,08,09,10,11,12,13,15 (9) | 3 | AZ-564 |
| [AZ-571](https://denyspopov.atlassian.net/browse/AZ-571) | Security tests | `Tests/Security/` (+ Production-env xUnit collection) | NFT-SEC-01..10 (10) | 5 | AZ-564 |
| [AZ-572](https://denyspopov.atlassian.net/browse/AZ-572) | Resilience tests | `Tests/Resilience/` (broker / DB outage fixtures) | NFT-RES-01..06 (6) | 5 | AZ-564 |
| [AZ-573](https://denyspopov.atlassian.net/browse/AZ-573) | Resource-limit tests | `Tests/ResourceLimit/` (profile-gated nightly variants) | NFT-RES-LIM-01..06 (6) | 3 | AZ-564 |
| [AZ-574](https://denyspopov.atlassian.net/browse/AZ-574) | Performance tests | `Tests/Performance/` (perf profile + dataseed-loaded DB) | NFT-PERF-* (7) | 3 | AZ-564 (incl. dataseed) |
### Coverage cross-check vs `_docs/02_document/tests/traceability-matrix.md`
- **Functional positive**: FT-P-01..22 = 22 scenarios → covered exactly once across AZ-565 (6) + AZ-566 (5) + AZ-567 (7) + AZ-568 (4).
- **Functional negative**: FT-N-01..16 = 16 scenarios → covered exactly once across AZ-569 (7) + AZ-570 (9).
- **Non-functional**: 10 + 6 + 6 + 7 = 29 scenarios → covered exactly once across AZ-571..574.
- **Total decomposed**: 22 + 16 + 29 = **67 scenarios**, no overlaps, no gaps.
- **Deferred items** (RB-01 gated FT-P-21/22, RB-02/06/08/09 follow-ups, AC-F-13, ENV-04/05, OP-02 multi-instance) remain marked deferred per the traceability matrix and will be re-decomposed in cycle-update once the gating refactor tasks land.
## Tracker Status
`tracker: jira` (per `_docs/_autodev_state.md`). All task headers carry their Jira issue key. The deferred-write leftover at `_docs/_process_leftovers/2026-05-14_testability-tracker.md` was replayed on 2026-05-14 and removed.