Energy yearbooks cover different years and regions, with varying formats and statistical definitions. Bringing them together requires consistent data structures and a clear record of each source.

Processing scope

The project catalogues Excel files, PDFs and compressed archives, recording source paths, pages, table names and edition years. Identifiable observations are then mapped to indicators, regions, years and units.

01InventoryCatalogue each source once
02ExtractParse tables and layouts
03StandardizeAlign indicators and regions
04ValidateSample source values and check consistency

Processing and provenance records

The project records extraction failures, indicator-selection rules, excluded records and quality checks alongside the published data. This allows others to review both the values and how they were processed.

Explore the yearbook database ↗