Scraping Remote Tech Lead (Web scraping & Anti-bot)

Infatica.io is a global provider of proxy and DaaS solutions. We're building our own high-load web scraping platform: an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems.

The platform will support both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).

We are now looking for an experienced Tech Lead for our web scraping development team who will lead the team, become the technical leader of the platform, drive architectural decisions, and shape the future of our cutting-edge scraping infrastructure. 

Key Responsibilities

Architecture Design

• Data-plane: high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
• Control-plane: API, authorization, billing, quotas, monitoring
• Infrastructure: microservices, Docker/K8s, CI/CD, observability

Development Leadership

• Team building: participate in hiring backend, browser, DevOps, and QA engineers
• Establish development and release processes
• Code quality control and technical decision oversight

Anti-Bot Research & Bypass

• Browser and network-level fingerprinting (JA3, TLS, CDP)
• Protection bypass: Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others

DevOps / SRE

• CI/CD setup, Helm charts, scaling configuration
• Monitoring organization (Prometheus, Grafana, Loki) and SLA processes

Requirements

• 5+ years of engineering experience in high-load backend/data platforms
• Extensive Scraping experience (mandatory)
• Excellent understanding of HTTP, TLS, HTTP/2, proxies, browser stack (CDP, WebRTC)
• Experience with async Python and Go (ideally both), Redis, queues, message brokers
• Advanced level DevOps tools: Kubernetes, Helm, Prometheus, CI/CD
• Experience analyzing and bypassing bot protection systems — strong plus
• Fluent English (all documentation and part of the team are English-speaking)
• Decision-making skills, mentoring abilities, and accountability for results