Share of search
Who owns the first page for your keywords? Scrape marketplace search results on a schedule and compute appearances, share of top-10 and best rank per brand.
← All recipesScraping API
The problem
Share of search moves before market share does — I want a weekly leading indicator per keyword, per brand.
How it works
- Keep a keyword list (one per line); scrape search results weekly on Tokopedia or Amazon.
- Attribute each result to a brand and compute share of results, share of top-10, best rank.
- Chart it over weeks; cross-check against GMV share from the Data API.
A taste of the code
export MAGPIE_API_KEY=... python pipeline.py --product tokopedia_search \ --keywords keywords.txt --out ./out
The full, runnable pipeline — argument parsing, retries, partial-result handling, delivery to S3/GCS — is in the repo: open on GitHub →
What it costs
Bills per keyword. Search products accept 50 keywords per job; weekly beats daily — the metric doesn't move day-to-day and weekly is 7× cheaper.
Estimates are always free — see how credits work.