Load into BigQuery / Snowflake

Export → object store → warehouse. Magpie exports deliver Parquet, which loads natively into BigQuery, Snowflake, Databricks and DuckDB with no schema wrangling.

← All recipesData API
The problem

I want Shopee/Tokopedia GMV and SKU data as a table my analysts can join, not files in a bucket.

How it works
  1. Run the monthly export to S3 or GCS as Parquet.
  2. Load with the warehouse's native loader (LOAD DATA / COPY INTO / read_parquet).
  3. Append each month to a partitioned table keyed on the month column.
A taste of the code
-- BigQuery
LOAD DATA INTO magpie.facial_serum
FROM FILES (format='PARQUET', uris=['gs://my-bucket/magpie/*.parquet']);

-- DuckDB (local exploration)
SELECT brand, sum(gmv_usd) FROM 'out/*.parquet' GROUP BY 1 ORDER BY 2 DESC;

The full, runnable pipeline — argument parsing, retries, partial-result handling, delivery to S3/GCS — is in the repo: open on GitHub →

What it costs

Export cost only — the Parquet files load into any warehouse without transformation.

Estimates are always free — see how credits work.

Get an API key (free trial credits) →Python client quickstart