Python Automation Engineer – Web Scraping & AI ( 1 - 4 yrs …, Kalaburagi

Python Automation Engineer – Web Scraping & AI Experience: 1 – 4 Years Location: Remote (WFH) / Bangalore / India Mode of Engagement: Full-time No of Positions: 3 Industry: AI / SaaS / Automation / Data Engineering Notice Period: Immediate Joiners Preferred What We Are Looking For:
- 1 – 4 years of experience in Python-based web scraping, browser automation, and large-scale data extraction projects.
- Strong hands-on experience with Playwright, Selenium, Scrapy, Requests, BeautifulSoup, or similar scraping frameworks.
- Experience scraping dynamic JavaScript-heavy websites and handling complex DOM structures, login sessions, cookies, proxies, CAPTCHA, and anti-bot protections.
- Hands-on experience using LLMs and AI tools such as OpenAI APIs, ChatGPT, Claude, Gemini, LangChain, or AI agents for automating unstructured web data extraction and processing workflows.
- Experience building AI-assisted scraping pipelines for extracting, cleaning, structuring, validating, and enriching unstructured web content.
- Valuable understanding of browser automation, headless browsers, web crawling, and scalable scraping architectures.
- Experience working with APIs, JSON/XML handling, databases, automation workflows, and Python scripting.
- Familiarity with Docker, Linux, Git, cloud platforms, and workflow orchestration tools is an added advantage.
- Strong debugging, analytical, and problem-solving skills with the ability to work in quick-paced AI product environments. Responsibilities
- Develop and maintain scalable web scraping and browser automation systems for structured and unstructured web data extraction.
- Build advanced scraping workflows using Playwright, Selenium, Scrapy, APIs, and Python automation frameworks.
- Handle dynamic JavaScript-based websites, browser rendering challenges, anti-bot protections, proxies, and session management.
- Build AI-powered extraction and automation workflows using LLMs, AI agents, and up-to-date AI automation frameworks.
- Work on unstructured content extraction, intelligent parsing, classification, summarization, and data enrichment workflows using AI models.
- Optimize crawler performance, improve scraping reliability, and maintain high-quality data pipelines.
- Collaborate with AI, engineering, and product teams for scalable data acquisition and automation projects.
- Monitor scraping jobs, debug failures, and improve automation efficiency across large-scale scraping systems. Qualifications
- Bachelor’s degree in Computer Science, Engineering, IT, or related field.
- Strong proficiency in Python programming and browser automation frameworks.
- Good understanding of JavaScript-rendered websites, APIs, automation workflows, and scalable scraping systems.
- Experience using LLM APIs and AI automation tools for unstructured data workflows is highly preferred.
- Familiarity with Docker, Linux, Git, AWS/GCP, or cloud deployment environments is a plus.
- Experience using Playwright, Selenium, Scrapy, APIs, and Python automation frameworks. Apply on Kit Job: kitjob.in/job/4n63fs