Competitor Product Scraping: Hair Care Category from Multiple Marketplaces

Data Extracted
Data Extracted
Data Extracted
Lazada Overview
Lazada Overview
Lazada Overview
Script Code
Script Code
Script Code

Project:

Web Scraping

Category:

User Project

Tools:

Web Scraper & Python VSCode

Skills & Tools Used:

✔ Web Scraper Extension – Shopee & Amazon Scraping
✔ Python & Lazada API – Data Extraction
✔ VS Code – Scripting & Automation

Project Overview

This project was conducted based on user requests and business needs to understand which hair care products are in high demand across multiple marketplaces. The goal was to gather structured data that helps identify best-selling products in the SLS-free shampoo, dry shampoo gel, conditioner, and hair serum categories.

Using Web Scraper Extension, I extracted the top 50 best-selling products from Shopee and Amazon, while for Lazada, due to the lack of sales ranking filters, I scraped all available products using Python with Lazada API in VS Code.

Data Collected

To provide a comprehensive view of competitor products, I compiled key information, including:
✔ Product Name & URL
✔ Current Price & Original Price
✔ Total Sales Volume
✔ Discount Indicator (Yes/No)

In addition to tracking sales volume, I took the initiative to include a discount indicator to provide an alternative perspective beyond just sales data. This allows the user to analyze whether discount strategies impact product demand in this category.

The cleaned and structured data was delivered in an Excel spreadsheet, enabling easy comparison of pricing trends, sales performance, and promotional strategies across different platforms.