Парсинг веба и мобильных приложений

Источники: Amazon, WB, Ozon, 1688, Taobao, Avito, LinkedIn, Cian, Booking, Banki.ru, App Store, Google Play.

Стек: Playwright/Puppeteer + Stealth, Residential/Mobile proxies (Bright Data, Oxylabs), Fingerprint randomization (Canvas, WebGL, TLS JA3), CAPTCHA solving (2Captcha, custom ML), Airflow orchestration, ClickHouse/S3/PostgreSQL/Qdrant storage.

Качество: Дедуп (simhash + embeddings), схема валидация, anomaly detection, SLA 99.5% uptime, freshness < 4h.