Mondo Diaz
55a38ad850
Add deduplication design doc, file size limits, and validation tests
- Add max_file_size (10GB) and min_file_size (1 byte) config options
- Add file size validation to regular and resumable upload endpoints
- Create comprehensive deduplication design document covering:
- SHA256 algorithm selection rationale and migration path
- Content-addressable storage model
- S3 key derivation and prefix sharding
- Duplicate detection workflow
- Reference counting lifecycle
- Edge cases and error handling
- Collision detection strategy
- Performance considerations
- Operations runbook
- Add tests for empty file rejection and file size validation