Shopify Product Scraper for Competitor Monitoring

What this pipeline does

Shopify competitor monitoring is usually about change, not one-time scraping. You want to know when a competitor adds products, changes prices, sells out, launches a collection, or starts discounting a variant.

The Shopify Product Scraper exports public product records with titles, variants, SKUs, prices, collections, images, stock signals, and storefront URLs. The clean workflow is to keep a current catalog and a history of changes.

Best first run

Start with one public storefront and keep the item limit small.

{
  "storeUrls": ["https://example-store.com"],
  "maxItems": 100,
  "includeCollections": true,
  "watchMode": false
}

Before scheduling, check that the output includes the fields you need for comparison: product, variant, sku, price, collection, and stock.

Catalog row shape

{
  "product": "Example Jacket",
  "variant": "Blue / Medium",
  "sku": "SKU-123",
  "price": 89.0,
  "collection": "new-arrivals",
  "stock": "available",
  "source_url": "https://example-store.com/products/example-jacket"
}

Use SKU when it exists. When it does not, build a stable key from storefront domain, product handle, and variant title. Storefronts are not always tidy, so avoid relying on product titles alone.

Change detection

Track these changes separately:

• New product
• Removed product
• Price drop
• Price increase
• Stock changed
• Collection changed

Different teams care about different changes. Merchandising may care about collection movement. Growth may care about discounts. Sales may care about products that keep selling out.

Deployment notes

Run top competitors daily and smaller competitors weekly. Keep screenshots or raw source URLs only when the team needs auditability. For most teams, a compact change table with source URLs is enough.