add tests

gen_tests updated
solution.md updated
This commit is contained in:
Oleksandr Bezdieniezhnykh
2025-11-24 22:57:46 +02:00
parent f50006d100
commit 4f8c18a066
49 changed files with 7209 additions and 3 deletions
@@ -0,0 +1,28 @@
# Cross-Cutting Acceptance Test: Degraded Satellite Data
## Summary
Validate system robustness with outdated or lower-quality satellite imagery per operational constraints.
## Test Description
Test system performance when satellite data is:
- Outdated (2+ years old)
- Lower resolution (Zoom 17-18 instead of 19)
- Partially missing (some areas without coverage)
- From different season (winter satellite, summer flight)
## Test Steps
1. Use deliberately outdated satellite tiles
2. Process AD000001-030
3. Measure accuracy degradation
4. Verify L2 (DINOv2) still matches despite appearance changes
## Success Criteria
- System continues to operate (no crash)
- L2 retrieval still works (top-5 recall > 70%)
- Accuracy degrades gracefully (may not meet AC-2, but should meet relaxed threshold)
- Clear error/warning messages about data quality
## Pass/Fail
**Passes**: System operational with degraded data, graceful degradation
**Fails**: Complete failure, crashes, or no indication of data quality issues