Yappman Data
UK and Australian retail price data, collected weekly and daily, on one schema. Abley-Yapp Consulting Limited, United Kingdom.
What we provide
Shelf prices, loyalty prices and promotions for every product the major supermarkets list online, joined across retailers by EAN barcode where the retailer publishes one. A weekly full-catalogue series for the UK and Australia, and a daily fixed basket of 212 UK staples for consistent day-to-day tracking. Retail-level price data with this structure is a nowcast of food inflation weeks ahead of official statistics, and a competitor-price series for CPG and retail analytics.
| Series | Coverage | Frequency | Rows per period | History from |
|---|---|---|---|---|
| UK weekly catalogue | Tesco, Sainsbury's, Asda, Aldi; Morrisons from November 2026 | Weekly, Sunday | ~72,000 | 27 Sep 2026 |
| UK daily basket | 212 staple products at all four retailers, the same items every day | Daily | 848 | 24 Sep 2026 |
| Australia weekly catalogue | Coles, Woolworths, Aldi Australia | Weekly | ~65,000 | October 2026 |
| UK property listings (planned) | Listing counts, asking prices and days on market by area from Rightmove, Zoopla and OnTheMarket | Weekly | — | Q4 2026 |
Weekly UK Online Shelf-Price Index: https://data.yappman.com/shelf-price-index
History accumulates weekly from the dates shown and is never revised. Trials are offered from three months of history.
Fields
One row per product per retailer per period: retailer, retailer product id, EAN, name, brand, pack size, shelf price, was-price, unit price and measure, loyalty price (Clubcard, Nectar, Asda Rewards, More Card, Flybuys, Everyday Rewards), promotion text and end date, stock flag, category path, URL, image URL, rating and review count, timestamp, currency, market, and store id where pricing is store-specific. Shelf price is always the price a non-member pays; loyalty pricing is never folded into it.
How it is collected
Source. The retailers' own public websites, read logged out. No accounts, no baskets, no personal data of any kind.
Method. Automated reads of the pages and JSON any visitor receives, paced at one to two requests a second per retailer, with every path checked against the retailer's robots.txt. Nothing a retailer has disallowed is fetched.
Quality. Nightly canary runs per retailer with alerts; weekly reconciliation of product counts against the previous week and the retailer's own category counts; parsers that fail loudly rather than emit partial rows; missed periods recorded as gaps, never interpolated.
Change control. A change log ships with every delivery; schema and coverage changes are announced 30 days ahead.
Delivery
Weekly (and daily, for the basket) CSV or Parquet files, one per retailer per period, pushed to your S3 bucket or SFTP, or pulled from a signed URL. A REST endpoint on the Apify platform is available for programmatic pulls, and a basket-pricing endpoint prices a list of barcodes across all retailers in one call. Weekly data is available by 08:00 UTC on Sunday; the daily basket by 07:00 UTC.
Due diligence
A methodology and due-diligence document is available on request. It covers provenance, collection method, robots.txt compliance, the terms-of-service position, database-right and copyright treatment, personal data (none), anti-bot handling, audit fields, coverage limits, accuracy checks, retention and corporate details. Retailer names are used only to describe the source of public product information; no affiliation, endorsement or partnership is claimed.
Sample and live tools
- Free sample: the daily basket on Kaggle — UK Supermarket Prices: Daily 212-Item Basket (CC BY 4.0).
- Live UK data: UK Supermarket Price Scraper on the Apify Store.
- Live Australian data: Australia Supermarket Price Scraper on the Apify Store.
- How the collection works: a worked example.
Pricing
Annual licence per series, per buyer entity; indicative from £2,400 a year for the daily basket and £6,000 a year for a weekly catalogue, with bundles available. One-month free trial in the full delivery format. Academic and journalist use of the daily basket is free through the Kaggle dataset.
Contact
Russell Yapp, Abley-Yapp Consulting Limited — info@yappman.com. Email support with a one-business-day response.