Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions changelog.d/uk-facts-395-pound-amounts.fixed.md
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
The delimited-text parser reads amounts printed with a '£' sign, such as '£51,877,954', as numbers, as it already read '$' amounts.
1 change: 1 addition & 0 deletions changelog.d/uk-facts-395.added.md
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
Add the UK facts chronicle#395 asks for: LPS's domestic rates paid and paying occupancies by Northern Ireland district council (rating years 2020-21 to 2025-26), LPS's Lone Pensioner Allowance and Disabled Person's Allowance statistics by council (2009-10 to 2023-24), and ONS's Northern Ireland regional and district domestic rates (1999-00 to 2024-25); DfT BUS01's passenger and concessionary journeys for Wales; the Childcare Offer for Wales report's 2023-24 take-up with its numerator and denominator; ONS's vehicle duty paid by households (CDDZ) and by businesses (EKED); and ONS's CPI weights for gas (04.5.2) and its two classes with the two classes' indices. The OBR's vehicle excise duties line joins the March 2026 receipts package for its 2024-25 outturn, and the October 2026 package now carries the later years under the same line id and concept, `obr.vehicle_excise_duties`.
13 changes: 13 additions & 0 deletions chronicle/bundle.py
Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,7 @@
"dfi-ni-public-transport-statistics-2024-25",
"dfi-ni-public-transport-statistics-2025-26",
"dft-bus01-passenger-journeys-2025",
"dft-bus01-wales-journeys-2025",
"dft-bus0415-fares-index-2026",
"dft-bus04i-operating-revenue-2025",
"dft-bus05i-revenue-support-2025",
Expand Down Expand Up @@ -170,7 +171,10 @@
"isc-annual-census-2024",
"isc-annual-census-2025",
"isc-annual-census-2026",
"lps-disabled-persons-allowance-ye-2024",
"lps-domestic-rates-paid-2026",
"lps-housing-stock-lgd-2026",
"lps-lone-pensioner-allowance-ye-2024",
"mhclg-council-tax-collection-england-2025-26",
"mhclg-council-tax-levels-england-2026-27",
"mhclg-council-tax-levels-england-summary-2025-26",
Expand Down Expand Up @@ -266,6 +270,7 @@
"ons-census2021-ur-hh-age101-sex-ctry",
"ons-census2021-ur-hh-age101-sex-rgn",
"ons-consumer-trends-current-price-september-2026",
"ons-crpsf-ni-domestic-rates-fye2025",
"ons-employee-workplace-pensions-summary-2024",
"ons-families-households-2025",
"ons-household-projections-2022-based",
Expand All @@ -274,6 +279,11 @@
"ons-hpssa-pcon24-year-ending-march-2026",
"ons-lad-population-by-age-2024",
"ons-lad-population-by-age-2025",
"ons-mm23-cpi-index-liquefied-hydrocarbons-october-2026",
"ons-mm23-cpi-index-natural-gas-october-2026",
"ons-mm23-cpi-weight-gas-october-2026",
"ons-mm23-cpi-weight-liquefied-hydrocarbons-october-2026",
"ons-mm23-cpi-weight-natural-gas-october-2026",
"ons-mye-2023-england-regions",
"ons-mye-2023-uk-countries",
"ons-mye-2024-uk",
Expand All @@ -287,6 +297,8 @@
"ons-pipr-rents-by-area-june-2026",
"ons-public-sector-employment-2026",
"ons-public-sector-employment-june-2026",
"ons-pusf-vehicle-duty-businesses-october-2026",
"ons-pusf-vehicle-duty-households-october-2026",
"ons-savings-interest-income",
"ons-small-area-income-msoa-fye2023",
"ons-subnational-dwellings-by-tenure-2024",
Expand Down Expand Up @@ -321,6 +333,7 @@
"voa-council-tax-bands-2025",
"voa-council-tax-stock-by-lad-2025",
"welshgov-bus-statistics-2024-25",
"welshgov-childcare-offer-report-2023-24",
"welshgov-council-tax-collection-2024-25",
"welshgov-council-tax-collection-2025-26",
"welshgov-council-tax-dwellings-2023-24-to-2026-27",
Expand Down
35 changes: 35 additions & 0 deletions chronicle/source_package.py
Original file line number Diff line number Diff line change
Expand Up @@ -1059,6 +1059,41 @@
"obr-efo-economy-october-2026": Path("obr/efo_economy_october_2026"),
"obr-efo-aggregates-october-2026": Path("obr/efo_aggregates_october_2026"),
"obr-efo-policy-october-2026": Path("obr/efo_policy_october_2026"),
# PolicyEngine/chronicle#395
"lps-domestic-rates-paid-2026": Path("lps/domestic_rates_paid_2026"),
"lps-lone-pensioner-allowance-ye-2024": Path(
"lps/lone_pensioner_allowance_ye_2024"
),
"lps-disabled-persons-allowance-ye-2024": Path(
"lps/disabled_persons_allowance_ye_2024"
),
"ons-crpsf-ni-domestic-rates-fye2025": Path("ons/crpsf_ni_domestic_rates_fye2025"),
"dft-bus01-wales-journeys-2025": Path("dft/bus01_wales_journeys_2025"),
"welshgov-childcare-offer-report-2023-24": Path(
"welshgov/childcare_offer_report_2023_24"
),
"ons-pusf-vehicle-duty-households-october-2026": Path(
"ons/pusf_vehicle_duty_households_october_2026"
),
"ons-pusf-vehicle-duty-businesses-october-2026": Path(
"ons/pusf_vehicle_duty_businesses_october_2026"
),
"ons-mm23-cpi-weight-gas-october-2026": Path(
"ons/mm23_cpi_weight_gas_october_2026"
),
"ons-mm23-cpi-weight-natural-gas-october-2026": Path(
"ons/mm23_cpi_weight_natural_gas_october_2026"
),
"ons-mm23-cpi-weight-liquefied-hydrocarbons-october-2026": Path(
"ons/mm23_cpi_weight_liquefied_hydrocarbons_october_2026"
),
"ons-mm23-cpi-index-natural-gas-october-2026": Path(
"ons/mm23_cpi_index_natural_gas_october_2026"
),
"ons-mm23-cpi-index-liquefied-hydrocarbons-october-2026": Path(
"ons/mm23_cpi_index_liquefied_hydrocarbons_october_2026"
),
# end PolicyEngine/chronicle#395
"obr-fuel-duty-receipts-by-vehicle-april-2024": Path(
"obr/fuel_duty_receipts_by_vehicle_april_2024"
),
Expand Down
2 changes: 1 addition & 1 deletion chronicle/sources/cells.py
Original file line number Diff line number Diff line change
Expand Up @@ -1096,7 +1096,7 @@ def _delimited_scalar(value: str) -> Scalar:
return None
if "_" in stripped:
return stripped
numeric = stripped.replace("$", "").replace(",", "")
numeric = stripped.replace("$", "").replace("£", "").replace(",", "")
if numeric.lstrip("-").isdigit():
return int(numeric)
try:
Expand Down
2 changes: 1 addition & 1 deletion chronicle/sources/rows.py
Original file line number Diff line number Diff line change
Expand Up @@ -1416,7 +1416,7 @@ def _delimited_scalar(value: str) -> Scalar:
return None
if "_" in stripped:
return stripped
numeric = stripped.replace("$", "").replace(",", "")
numeric = stripped.replace("$", "").replace("£", "").replace(",", "")
if numeric.lstrip("-").isdigit():
return int(numeric)
try:
Expand Down
Binary file not shown.
26 changes: 26 additions & 0 deletions db/data/lps/disabled_persons_allowance_ye_2024/manifest.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
source_id: lps
package_id: lps-disabled-persons-allowance-ye-2024
dataset: lps_lps-disabled-persons-allowance-ye-2024
source_page: https://www.finance-ni.gov.uk/publications/lone-pensioner-and-disabled-person-allowance-statistics
table: Disabled Person's Allowance (DPA) statistics to year end 2024
license: Open Government Licence v3.0
license_url: https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/
attribution: 'Source: Land & Property Services, Disabled Person''s Allowance (DPA)
statistics to year end 2024 (Published: 29 May 2024). Contains public sector information
licensed under the Open Government Licence v3.0.'
license_evidence: 'The workbook''s Cover Sheet states: ''Contains public sector information
licensed under the Open Government Licence v3.0.'''
license_verified_at: '2026-10-30'
files:
2024:
filename: lps-dpa-ye-2024.XLSX
source_url: https://www.finance-ni.gov.uk/sites/default/files/publications/dfp/lps-dpa-ye-2024.XLSX
sha256: 41b5aaa78d7ed3792a1761972e4be1196e8a6dee8d2be0a26d4d84a823860cfc
size_bytes: 153335
fetched_at: '2026-10-30T13:45:51+00:00'
storage:
r2:
provider: r2
bucket: ledger-raw
key: raw/lps/lps-disabled-persons-allowance-ye-2024/2024/41b5aaa78d7ed3792a1761972e4be1196e8a6dee8d2be0a26d4d84a823860cfc/lps-dpa-ye-2024.XLSX
uri: r2://ledger-raw/raw/lps/lps-disabled-persons-allowance-ye-2024/2024/41b5aaa78d7ed3792a1761972e4be1196e8a6dee8d2be0a26d4d84a823860cfc/lps-dpa-ye-2024.XLSX
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
District Council,Number of Domestic occupancies with a rates payment made in 2020-21 rating year,Domestic Rates paid as at 31st March 2021,Number of Domestic occupancies with a rates payment made in 2021-22 rating year,Domestic Rates paid as at 31st March 2022,Number of Domestic occupancies with a rates payment made in 2022-23 rating year,Domestic Rates paid as at 31st March 2023,Number of Domestic occupancies with a rates payment made in 2023-24 rating year,Domestic Rates paid as at 31st March 2024,Number of Domestic occupancies with a rates payment made in 2024-25 rating year,Domestic Rates paid as at 31st March 2025,Number of Domestic occupancies with a rates payment made in 2025-26 rating year,Domestic Rates paid as at 31st March 2026
Antrim and Newtownabbey,"60,388","£51,877,954","61,869","£53,609,226","62,482","£54,941,178","63,200","£59,598,012","63,890","£62,740,303","64,764 ","£67,083,237"
Ards and North Down,"73,573","£77,169,538","75,079","£80,000,514","75,330","£81,880,418","75,544","£88,782,827","76,421","£93,831,109","77,233 ","£99,315,112"
"Armagh City, Banbridge and Craigavon","83,823","£77,677,974","85,864","£81,263,782","86,944","£84,022,142","87,713","£90,651,436","88,737","£96,143,969","89,839 ","£102,310,045"
Belfast,"152,494","£128,450,302","155,177","£132,243,016","155,326","£135,252,391","156,217","£146,695,586","157,748","£154,922,721","159,589 ","£164,710,647"
Causeway Coast and Glens,"62,929","£59,783,287","64,136","£62,302,754","64,602","£64,057,127","65,099","£70,213,526","65,690","£74,638,296","66,626 ","£79,507,631"
Derry City and Strabane,"59,130","£50,504,688","60,463","£52,578,700","61,244","£54,546,640","61,624","£59,502,890","62,527","£63,416,021","63,300 ","£67,761,117"
Fermanagh and Omagh,"45,209","£40,044,670","46,247","£41,887,670","46,851","£43,196,251","47,540","£46,923,175","47,949","£49,869,460","48,498 ","£52,744,966"
Lisburn and Castlereagh,"61,869","£63,085,716","63,633","£64,919,429","63,944","£67,279,724","64,466","£73,375,284","65,278","£77,271,131","66,310 ","£82,506,955"
Mid and East Antrim,"60,213","£54,583,730","61,759","£56,532,538","62,184","£58,556,508","62,480","£62,884,156","63,305","£68,012,052","63,946 ","£72,388,680"
Mid Ulster,"51,537","£47,848,174","52,868","£49,979,975","53,586","£51,804,985","54,295","£57,194,629","55,134","£61,101,622","56,082 ","£65,497,725"
"Newry, Mourne and Down","66,587","£69,820,431","68,310","£73,012,766","69,288","£75,606,011","70,020","£82,112,996","70,744","£87,596,475","71,701 ","£94,062,463"
Northern Ireland,"777,752","£720,846,463","795,405","£748,330,372","801,781","£771,143,375","808,198","£837,934,517","817,423","£889,543,160","827,888 ","£947,888,579"
29 changes: 29 additions & 0 deletions db/data/lps/domestic_rates_paid_2026/manifest.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
source_id: lps
package_id: lps-domestic-rates-paid-2026
dataset: lps_lps-domestic-rates-paid-2026
source_page: https://www.data.gov.uk/dataset/30535a44-0a05-4bff-98cf-001301a6b4d6/rates-paid-by-district-council-and-sector
table: 'Rates paid by District Council and Sector: Domestic Rates collected by District
Council'
license: Open Government Licence v3.0
license_url: https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/
attribution: 'Source: Land & Property Services, Rates paid by District Council and
Sector (OpenDataNI, resources updated 8 May 2026). Contains public sector information
licensed under the Open Government Licence v3.0.'
license_evidence: 'OpenDataNI''s CKAN record for the dataset (api/3/action/package_show?id=30535a44-0a05-4bff-98cf-001301a6b4d6)
sets license_id ''notspecified'' (''License not specified''). nidirect''s Open data
page (https://www.nidirect.gov.uk/articles/open-data) states: ''All data published
on the OpenDataNI portal falls under the Open Government Licence (OGL).'''
license_verified_at: '2026-10-30'
files:
2026:
filename: domestic-rates-collected-by-district-council.csv
source_url: https://admin.opendatani.gov.uk/dataset/30535a44-0a05-4bff-98cf-001301a6b4d6/resource/2b20b332-1b9d-4260-8b4f-54a1d50b7844/download/domestic-rates-collected-by-district-council.csv
sha256: b8d7d649e2b9bf16a3d308754a123543a6eea48c9f7557f9bd592bfd49ca51ac
size_bytes: 2787
fetched_at: '2026-10-30T11:39:40+00:00'
storage:
r2:
provider: r2
bucket: ledger-raw
key: raw/lps/lps-domestic-rates-paid-2026/2026/b8d7d649e2b9bf16a3d308754a123543a6eea48c9f7557f9bd592bfd49ca51ac/domestic-rates-collected-by-district-council.csv
uri: r2://ledger-raw/raw/lps/lps-domestic-rates-paid-2026/2026/b8d7d649e2b9bf16a3d308754a123543a6eea48c9f7557f9bd592bfd49ca51ac/domestic-rates-collected-by-district-council.csv
Binary file not shown.
26 changes: 26 additions & 0 deletions db/data/lps/lone_pensioner_allowance_ye_2024/manifest.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
source_id: lps
package_id: lps-lone-pensioner-allowance-ye-2024
dataset: lps_lps-lone-pensioner-allowance-ye-2024
source_page: https://www.finance-ni.gov.uk/publications/lone-pensioner-and-disabled-person-allowance-statistics
table: Lone Pensioners Allowance (LPA) statistics to year end 2024
license: Open Government Licence v3.0
license_url: https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/
attribution: 'Source: Land & Property Services, Lone Pensioners Allowance (LPA) statistics
to year end 2024 (Published: 29 May 2024). Contains public sector information licensed
under the Open Government Licence v3.0.'
license_evidence: 'The workbook''s Cover Sheet states: ''Contains public sector information
licensed under the Open Government Licence v3.0.'''
license_verified_at: '2026-10-30'
files:
2024:
filename: lps-lpa-ye-2024.XLSX
source_url: https://www.finance-ni.gov.uk/sites/default/files/publications/dfp/lps-lpa-ye-2024.XLSX
sha256: f2ea22b184f91a861df839b627e7153d5bb9780b16cdf9377d4b2eea1e915b47
size_bytes: 169338
fetched_at: '2026-10-30T13:45:51+00:00'
storage:
r2:
provider: r2
bucket: ledger-raw
key: raw/lps/lps-lone-pensioner-allowance-ye-2024/2024/f2ea22b184f91a861df839b627e7153d5bb9780b16cdf9377d4b2eea1e915b47/lps-lpa-ye-2024.XLSX
uri: r2://ledger-raw/raw/lps/lps-lone-pensioner-allowance-ye-2024/2024/f2ea22b184f91a861df839b627e7153d5bb9780b16cdf9377d4b2eea1e915b47/lps-lpa-ye-2024.XLSX
Binary file not shown.
27 changes: 27 additions & 0 deletions db/data/ons/crpsf_ni_domestic_rates_fye2025/manifest.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
source_id: ons
package_id: ons-crpsf-ni-domestic-rates-fye2025
dataset: ons_ons-crpsf-ni-domestic-rates-fye2025
source_page: https://www.ons.gov.uk/economy/governmentpublicsectorandtaxes/publicsectorfinance/datasets/countryandregionalpublicsectorfinancesrevenuetables
table: 'Country and regional public sector finances revenue tables, financial year
ending 2025: Total Public Sector (PS) Current Receipts excluding PS Banks'
license: Open Government Licence v3.0
license_url: https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/
attribution: 'Source: Office for National Statistics, Country and regional public
sector finances revenue tables, financial year ending 2025 (published 26 May 2026).
Contains public sector information licensed under the Open Government Licence v3.0.'
license_evidence: 'ONS pages state: ''All content is available under the Open Government
Licence v3.0, except where otherwise stated.'' (dataset page)'
license_verified_at: '2026-10-30'
files:
2025:
filename: crpsffye2025totalpublicsectorcurrentreceipts.xlsx
source_url: https://www.ons.gov.uk/file?uri=/economy/governmentpublicsectorandtaxes/publicsectorfinance/datasets/countryandregionalpublicsectorfinancesrevenuetables/financialyearending2025/crpsffye2025totalpublicsectorcurrentreceipts.xlsx
sha256: 9dbadf3d06a6a835a5f8e00951016caba2ddaa3e2dd9eee1f28feca464044b98
size_bytes: 213368
fetched_at: '2026-10-30T11:38:59+00:00'
storage:
r2:
provider: r2
bucket: ledger-raw
key: raw/uk/ons/ons-crpsf-ni-domestic-rates-fye2025/2025/9dbadf3d06a6a835a5f8e00951016caba2ddaa3e2dd9eee1f28feca464044b98/crpsffye2025totalpublicsectorcurrentreceipts.xlsx
uri: r2://ledger-raw/raw/uk/ons/ons-crpsf-ni-domestic-rates-fye2025/2025/9dbadf3d06a6a835a5f8e00951016caba2ddaa3e2dd9eee1f28feca464044b98/crpsffye2025totalpublicsectorcurrentreceipts.xlsx
Loading
Loading