mirror of
https://github.com/azaion/gps-denied-onboard.git
synced 2026-06-22 19:11:14 +00:00
Update demo replay validation and testing documentation
ci/woodpecker/push/02-build-push Pipeline failed
ci/woodpecker/push/02-build-push Pipeline failed
- Modified the autodev state to reflect the current testing phase and details of the new `jetson-e2e` tests. - Enhanced the "How to Test" documentation to provide clearer instructions on the demo replay validation process, including video and tlog alignment steps. - Updated architectural documentation to include the new demo replay operator flow and its dependencies. - Documented the removal of deprecated auto-sync features and clarified the operator-facing UI for replay validation. - Added new entries in the dependencies table for upcoming tasks related to the demo replay flow. These changes improve clarity and usability for operators and developers working with the demo replay system.
This commit is contained in:
@@ -146,14 +146,14 @@ short-circuit each other (preserves AC-5's two-runs-diff guarantee).
|
||||
|
||||
| AC | Test | State |
|
||||
|----|------|-------|
|
||||
| AC-1: exit 0 + JSONL count match | `test_ac1_exits_0_jsonl_count_match` | Tier-2 (Jetson only) |
|
||||
| AC-1: exit 0 + JSONL count match | `test_ac1_exits_0_jsonl_count_match` | `xfail` (AZ-963 — open-loop ESKF) |
|
||||
| AC-2: JSONL schema match | `test_ac2_jsonl_schema_match` | Tier-2 (Jetson only) |
|
||||
| AC-3: ≤ 100 m for 80 % of ticks | `test_ac3_within_100m_80pct_of_ticks` | Tier-2 (Jetson only) |
|
||||
| AC-3: ≤ 100 m for 80 % of ticks | `test_ac3_within_100m_80pct_of_ticks` | `xfail` (AZ-963 — open-loop ESKF) |
|
||||
| AC-4a: mode-agnosticism AST scan | `test_ac4_mode_agnosticism_ast_scan` | unconditional |
|
||||
| AC-4b: encoder byte-equality | `test_ac4_encoder_byte_equality` | `skip` (waiting on AZ-558) |
|
||||
| AC-5: determinism | `test_ac5_determinism_two_runs_diff` | Tier-2 (Jetson only) |
|
||||
| AC-6a: realtime 60 s ± 5 % | `test_ac6_pace_realtime_60s_within_5pct` | Tier-2 (Jetson only) |
|
||||
| AC-6b: asap ≤ 30 s | `test_ac6_pace_asap_under_30s` | Tier-2 (Jetson only) |
|
||||
| AC-5: determinism | `test_ac5_determinism_two_runs_diff` | `xfail` (AZ-963 — open-loop ESKF) |
|
||||
| AC-6a: realtime 60 s ± 5 % | `test_ac6_pace_realtime_60s_within_5pct` | `xfail` (AZ-963 — open-loop ESKF) |
|
||||
| AC-6b: asap ≤ 30 s | `test_ac6_pace_asap_under_30s` | `xfail` (AZ-963 — open-loop ESKF) |
|
||||
| AC-7: skip-gate self-check | `test_ac7_skip_gate_consistent_with_env_var` | unconditional |
|
||||
| AC-8: operator workflow rehearsal | `test_ac8_operator_workflow` | `skip` (waiting on D-PROJ-2 mock) |
|
||||
| AC-9: helper L2 correctness | `test_helpers.py::test_ac9_l2_*` | unconditional |
|
||||
@@ -187,9 +187,9 @@ tests/e2e/replay/
|
||||
|
||||
## Follow-up work
|
||||
|
||||
* **AZ-777** — DONE (Phases 1+2 shipped cycle 3). C11 contract adapted,
|
||||
e2e-runner wired against real satellite-provider. Phases 3-5 superseded
|
||||
by Epic AZ-835 children (AZ-839, AZ-840, AZ-841).
|
||||
* **AZ-963** — five Derkachi ACs (`AC-1`, `AC-3`, `AC-5`, `AC-6a`, `AC-6b`)
|
||||
are `xfail` until a reference C6 tile cache exists (resolution path:
|
||||
AZ-777 / AZ-974).
|
||||
* **Real Topotek KHP20S30 calibration** — needed for AC-3 accuracy even
|
||||
after AZ-777 lands (the threshold is ≤100 m for 80 % of ticks).
|
||||
* **AZ-558** — closes AC-4b (route C8 encoders through `MavlinkTransport`).
|
||||
|
||||
Reference in New Issue
Block a user