About Us:
Chryselys is a Great Place to Work Certified, Pharma Analytics & Business consulting company that delivers data-driven insights leveraging AI-powered, cloud-native platforms to achieve high-impact transformations.
We specialize in digital technologies and advanced data science techniques that provide strategic and operational insights.
Who we are:
People - Our team of industry veterans, advisors and senior strategists have diverse backgrounds and have worked at top tier companies.
Quality - Our goal is to deliver the value of a big five consulting company without the big five cost.
Technology - Our solutions are Business centric built on cloud native technologies.
Role Overview:
As a Web scraping Engineer at Chryselys, you will design and build reliable, scalable data extraction systems from modern web applications, combining browser automation, API extraction, and structured crawling frameworks.
Key Responsibilities:
- Develop scalable scraping and crawling systems using Python
- Use the right approach based on use-case:
- Scrapy for large-scale crawling pipelines
- Playwright / Selenium for dynamic websites
- requests / httpx for API-based extraction
- Analyze and reverse-engineer web applications using DevTools (Network/XHR/GraphQL)
- Implement API-first scraping strategies wherever possible
- Handle JavaScript-heavy sites using DOM interaction and script injection
- Design efficient crawlers with pagination, link-following, and scheduling
- Build fault-tolerant pipelines with retries, logging, and monitoring
- Handle anti-bot constraints (headers, cookies, rate limits, proxy basics)
- Integrate LLM/AI techniques for parsing and structuring complex/unstructured data
- Store and process data (JSON / DB / ETL pipelines)
What You Bring:
- Education: Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field (or equivalent practical experience).
- Experience: 3+ years of hands-on experience building web scraping/crawling solutions in Python, including productionizing pipelines (retries, logging, monitoring, scheduling).
- Skills:
- Technical: Python; Scrapy; Playwright or Selenium; requests/httpx; HTTP/HTTPS fundamentals (headers, cookies, sessions); DevTools network/XHR/GraphQL inspection; HTML/DOM and basic JavaScript; data parsing and normalization; JSON/CSV; basic database/ETL concepts.
- Soft skills: strong problem-solving and debugging; attention to detail; clear documentation/communication; ability to choose the right extraction strategy (API vs browser vs crawler); ownership mindset for reliable, production-grade delivery.
- Other competencies: responsible scraping practices (rate limiting, respectful crawling); understanding of anti-bot constraints and mitigation basics (headers, cookies, backoff, proxy fundamentals).
- Certifications: Not required; relevant cloud or data-engineering certifications are a plus.
Preferred Qualifications:
- Education: Master’s degree in Computer Science/Data Engineering (or similar); coursework in distributed systems, data pipelines, or web technologies.
- Experience: Experience scraping JavaScript-heavy SPAs at scale; building Scrapy pipelines/middlewares/schedulers; proxy rotation and advanced rate-limiting; CAPTCHA-handling approaches; deploying scrapers to cloud environments and running via cron/queues; integrating LLM/AI-assisted parsing for messy or semi-structured pages.
Skills: Async scraping (asyncio/aiohttp/httpx async); database proficiency (PostgreSQL/MongoDB); observability (structured logging, metrics, alerting); containerization (Docker) and CI/CD basics; familiarity with MCP-based scraping tools.
Why Join Us?
- Work on Advanced Analytical techniques using AI/ML in the Market Access functions for the pharmaceutical domain with industry-leading tools.
- Collaborate with Global and US teams to advance Market Access Contracting and Patient Analytics.
- Opportunity to drive AI/ML-based innovations in Market Access Analytics.
- Competitive salary, learning opportunities, and a dynamic work environment
Equal Employment Opportunity:
Chryselys is proud to be an Equal Employment Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Connect with Us: