Python & JavaScript Developer – AI & Web Scraping Experience: 4-7 Years Location: Remote Mode of Engagement: Full-time No of Positions: 3
Education
al
Qualifications
: Bachelor's degree in computer science, Information Technology Industry: IT / Software Development Notice Period: Immediate Joiners Preferred
About the Role
We are looking for a hands-on Web Scraping / Crawling Engineer with 3–5 years of experience in web scraping, browser automation, and scalable data extraction. The ideal candidate should have strong experience working with dynamic and JavaScript-heavy websites, building reliable crawling workflows, handling crawling failures, and working with distributed processing systems. This is a highly technical, hands-on role. You will be expected to design, develop, debug, optimize, and maintain web crawling and data extraction systems.
Responsibilities
Design, develop, and maintain scalable web crawling and scraping systems for dynamic and JavaScript-heavy websites.
Develop browser automation workflows using Playwright, Selenium, Puppeteer, or similar frameworks.
Investigate and resolve crawling issues such as 403/429 responses, redirects, timeouts, rendering failures, session issues, and anti-bot challenges.
Develop robust retry, fallback, and failure-handling mechanisms to improve crawler reliability.