Similar Jobs
About the Company:
At Coupang we are building the future of ecommerce. Born out of an obsession to make shopping, eating, and living easier than ever, we’re collectively disrupting the multi-billion-dollar e-commerce industry from the ground up. We exist to wow our customers. We know we’re doing the right thing when we hear our customers say, “How did we ever live without Coupang?” We are one of the fastest-growing e-commerce companies that established an unparalleled reputation for being a dominant and reliable force in South Korean commerce.
We are proud to have the best of both worlds — a startup culture with the resources of a large global public company. This fuels us to continue our growth and launch new services at the speed we have been at since our inception. We are all entrepreneurial surrounded by opportunities to drive new initiatives and innovations. At our core, we are bold and ambitious people who like to get our hands dirty and make a hands-on impact. At Coupang, you will see yourself, your colleagues, your team, and the company grow every day.
Our mission to build the future of commerce is real. We push the boundaries of what’s possible to solve problems and break traditional trade-offs. Join Coupang now to create an epic experience in this always - on, high-tech, and hyper-connected world.
About the Role:
As a Staff Software Engineer for the Pricing & Assortment Trust team, building robust distributed systems for crawling , extracting large volumes of assortment and pricing data. The goal is price and product intelligence from a variety of eCommerce sites.
In this role, you will help us always meet the customer trust on price and choice expectations of our customers; by designing and maintaining resilient, distributed data collection applications that overcome throttling and blocking challenges inherent in the real-world, high-volume environments.
What You Will Do
- Serve as a technical expert and help us build and scale our e-commerce data extraction systems.
- In this role, you will design, optimize, and operate high-performance API reverse engineering solutions and web scrapers to extract product data, pricing, inventory, and other key insights from major online retailers and marketplaces.
- Develop and optimize large-scale web scraping pipelines to extract millions of e-commerce product pages daily.
- Reverse-engineer e-commerce websites to identify the best scraping strategies, including API interception, headless browsing, and dynamic content rendering.
- Build distributed crawling solutions using AWS (EC2, Lambda, S3), Kubernetes, or other cloud computing environments.
- Implement anti-bot evasion techniques, including IP rotation, browser fingerprinting, CAPTCHA solving, and request throttling.
- Monitor, debug, and maintain scraping scripts to ensure uninterrupted data extraction, adapting to site changes in real-time.
- Process and clean extracted data efficiently, optimizing storage in SQL/NoSQL databases or cloud-based data lakes.
- Collaborate with data and engineering teams to integrate scraped data into analytics pipelines and real-time monitoring systems.
Basic Qualifications
- At least 7+ years of experience working in web scraping, data extraction, or related fields.
- Proven experience in high-volume, high-frequency data collection, capable of extracting millions of records per hour while maintaining efficiency and reliability.
- Strong experience with headless browsers (Playwright, Puppeteer, Selenium) for scraping JavaScript-heavy sites.
- Proficiency in Python, Node.js, or similar scripting languages. Java experience is a bonus.
- Deep understanding of e-commerce site structures, including pagination, and API calls.
- Experience with proxy management, IP rotation, and bot mitigation techniques at scale.
- Hands-on experience with AWS (EC2, Lambda, S3, CloudWatch), Kubernetes, or containerized workloads for distributed scraping.
- Familiarity with data storage formats (JSON, CSV, Parquet) and database technologies (SQL, NoSQL, DynamoDB, Elasticsearch, etc.).
Nice to Have:
- Expertise with reverse engineering mobile apps and mobile app APIs.
- Expertise in real-time data processing pipelines and message queues (Kafka, RabbitMQ, SQS).
- Understanding of pricing intelligence and price monitoring
- Contributions to open-source web scraping frameworks.
Equal Opportunities for All
Coupang is an equal opportunity employer. Our unprecedented success could not be possible without the valuable inputs of our globally diverse team.
