3 Commits

Author	SHA1	Message	Date
Mondo Diaz	3bdeade7ca	Fix nested dependency depth tracking in PyPI cache worker ... When the cache worker downloaded a package through the proxy, dependencies were always queued with depth=0 instead of depth+1. This meant depth limits weren't properly enforced for nested dependencies. Changes: - Add cache-depth query parameter to pypi_download_file endpoint - Worker now passes its current depth when fetching packages - Dependencies are queued at cache_depth+1 instead of hardcoded 0 - Add tests for depth tracking behavior	2026-02-02 13:47:22 -06:00
Mondo Diaz	97b39d000b	Add security fixes and code cleanup for PyPI cache ... - Add require_admin authentication to cache management endpoints - Add limit validation (1-500) on failed tasks query - Add thread lock for worker pool thread safety - Fix exception handling with separate recovery DB session - Remove obsolete design doc	2026-02-02 11:37:25 -06:00
Mondo Diaz	d274f3f375	Add robust PyPI dependency caching with task queue ... Replace unbounded thread spawning with managed worker pool: - New pypi_cache_tasks table tracks caching jobs - Thread pool with 5 workers (configurable via ORCHARD_PYPI_CACHE_WORKERS) - Automatic retries with exponential backoff (30s, 60s, then fail) - Deduplication to prevent duplicate caching attempts New API endpoints for visibility and control: - GET /pypi/cache/status - queue health summary - GET /pypi/cache/failed - list failed tasks with errors - POST /pypi/cache/retry/{package} - retry single package - POST /pypi/cache/retry-all - retry all failed packages This fixes silent failures in background dependency caching where packages would fail to cache without any tracking or retry mechanism.	2026-02-02 11:16:02 -06:00