Frequently asked questions
The questions people actually type into a search box.
How do I get Shopee sales data programmatically?
Query the Data API for brand, category, merchant or SKU metrics with platform=Shopee — monthly GMV, units sold, market share, pricing and ratings across six SEA countries — or order a bulk Parquet export of a whole category. The data is already scraped, cleaned and deduplicated; queries return in seconds.
Data API guide →How do I track competitor prices daily?
Use the Scraping API with a product-detail product (Tokopedia, TikTok Shop, Blibli or Amazon) against your SKU list on a daily schedule, and diff each day's snapshot against the previous one. To decide which products to track, first rank the category's SKUs by GMV with the Data API — the top of the ranking carries most of the revenue.
Recipe: market share → price monitoring →How do I measure ecommerce market share in Southeast Asia?
The Data API computes market share server-side across full-category coverage, by platform and month — brand share, merchant share and category share, based on SKU-level GMV rather than samples or panels.
Data API guide →Can I get Amazon product data?
Yes — Amazon is covered by the Scraping API across ten storefronts (US, UK, DE, FR, IT, ES, CA, AU, JP, SG). amazon_pdp fetches product detail pages by ASIN and country; amazon_search fetches search results by keyword and country. Amazon is scraping-only: it is not part of the aggregated monthly dataset.
Amazon data guide →Can I load the data into BigQuery, Snowflake or Databricks?
Yes. Bulk exports deliver Parquet (or gzipped CSV), which loads natively into BigQuery, Snowflake, Databricks and DuckDB with no schema wrangling. The typical pattern is export → S3/GCS → warehouse load, appending each month to a partitioned table.
Recipe: warehouse load →What does it cost, and can I price a query before paying?
Pricing is prepaid credits from one shared wallet: a Data API row costs 5 credits, catalog calls cost 1 credit, and scraping products are billed per item. Estimates are always free and exact — pass estimate=true to any export request and it returns the row count and credit price without charging. New accounts get free trial credits.
How credits work →Is there a Python client?
Yes — pip install magpie-data. The official client covers both APIs with free client-side validation, automatic chunking, polling with backoff, and delivery to S3, GCS or local disk. It is open source, with runnable pipeline recipes, at github.com/magpieiq/magpie-ecommerce-data-api.
Python quickstart →How fresh is the data?
The aggregated dataset refreshes monthly; available month ranges vary by market and category, and the catalog endpoint lists exactly what is queryable. When you need the state of a page right now — live price, live stock — that is what the Scraping API is for.
Scraping API →Something not covered? The docs hub has both products end to end — start there, or read the client source on GitHub.