Free index files: stable addresses

The UK and AU Online Shelf-Price Index as CSV and JSON at addresses that keep their meaning. Weekly series, not real time. Licensed CC BY 4.0.

The files

IndexCSVJSONPage
UK Online Shelf-Price Indexuk-shelf-price-index.csvuk-shelf-price-index.jsonindex, data dictionary
AU Online Shelf-Price Indexau-shelf-price-index.csvau-shelf-price-index.jsonindex, data dictionary

manifest.json lists, for each index, the latest week and the day it was published, the number of rows, and the size and SHA-256 of each file, so you can check a download. Each week’s figures are added to the files when they are published; published values are not revised except to correct an error, and a correction is a new, marked revision. Browsers and proxies may keep a copy of a file for a few minutes.

What is in a file

Long format: one row per week, record type, retailer and class. The JSON holds the same figures as the public dataset, with the meta item first for each week. The CSV holds the rows without the meta items and one extra last column, base: the base week of that week’s series. For the AU CSV, empty means no value and numbers are written as in the JSON. What each column and record type means is in the data dictionaries linked above.

ColumnUK CSVAU CSV
vintage, publishedAt, revision, recordType, retailer, classyesyes
level, weekOnWeekPct, fourWeekPct, matched, matchedShare, statusyesyes
entered, left, relinked, missingPackSizeyes (empty before 2026-W44)no
baseyes, lastyes, last

Versioning

Within v1 a column keeps its meaning and its place; new columns are added at the end. A change that would break a reader is announced on the notices page before it ships, and a new path will normally be used for it. The older addresses under /data/ hold the same files and are intended to keep working; if one is ever withdrawn, that is announced on the notices page first.

Changelog

The changes below are from the method pages, which give the full text: UK and AU.

Copy-and-paste recipes

Each reads the UK CSV; change the address for the AU file. They keep the headline rows, one per week. The UK index has two series, with base 2026-W39 (weeks 39 and 40) and base 2026-W42 (from week 42), which are not joined: keep the base column with the level, and do not chart levels from different bases as one line.

Python

import pandas as pd
df = pd.read_csv("https://data.yappman.com/data/v1/uk-shelf-price-index.csv")
headline = df[df["recordType"] == "headline"]
print(headline[["vintage", "base", "level", "weekOnWeekPct"]])

R

df <- read.csv("https://data.yappman.com/data/v1/uk-shelf-price-index.csv")
headline <- subset(df, recordType == "headline")
head(headline[, c("vintage", "base", "level", "weekOnWeekPct")])

Excel (Power Query)

Data > Get Data > From Other Sources > Blank Query > Advanced Editor, then paste:

let
    Source = Csv.Document(Web.Contents("https://data.yappman.com/data/v1/uk-shelf-price-index.csv"), [Delimiter = ",", Encoding = 65001, QuoteStyle = QuoteStyle.None]),
    Promoted = Table.PromoteHeaders(Source, [PromoteAllScalars = true])
in
    Promoted

Google Sheets

=IMPORTDATA("https://data.yappman.com/data/v1/uk-shelf-price-index.csv")

Google Sheets limits how much IMPORTDATA can load and how often it refreshes.

Licence and citation

The files are released under CC BY 4.0. Cite as “Yappman Data, UK Online Shelf-Price Index, CC BY 4.0, vintage [week], https://data.yappman.com/shelf-price-index/” (AU: “Yappman Data, AU Online Shelf-Price Index, CC BY 4.0, vintage [week], https://data.yappman.com/au-shelf-price-index/”). Shelf prices only; not CPI and not a measure of prices paid. Retailer names are used only to describe the source of public product information; no affiliation, endorsement or partnership is claimed.