Under the patronage of:

Journal Metrics

Impact factor (2022): 2.1

75th percentile
Powered by  Scopus

More about CiteScore

Source Normalized Impact per Paper (SNIP): 0.474

SCImago Journal Rank (SJR): 0.377


Smarter Cities: Cleaning Electricity, Gas and Water Metered Consumption Data for Social and Urban Research

Original scientific paper

Journal of Sustainable Development of Energy, Water and Environment Systems
Volume 7, Issue 3, September 2019, pp 466-481
DOI: https://doi.org/10.13044/j.sdewes.d6.0242
Mishka Talent
Fenner School of Environment and Society, Australian National University, 46 Sullivans Creek Road, ANU, Canberra, ACT, 0200, Australia


It is claimed that ‘Big Data’ could help cities become ‘smart’, utilise resources more efficiently, and improve inhabitants’ quality of life. Metered consumption data of electricity, gas and water are collected and stored for each household in Australia and provide a valuable source of information for researchers hoping to understand the patterns of consumption and improve resource utilisation. This work tests the assumption that these datasets are sufficiently ‘clean’ to allow interrogation and details the common errors encountered. An inspection of 1-7 years of meter readings of electricity, gas and water for ~60,000 households in Canberra, Australia as well as all datasets of the local government’s energy and water efficiency programs, found this not to be the case. Common errors found include: missing data, biases in erroneous data, errors generated by the data custodians, duplicate entries, the effect of different custodian objectives and of poor data constraints (free flowing text).

Keywords: Data cleaning, Data errors, Duplicate data, Unique dwellings, Electricity, Water.

Creative Commons License
Views (in 2024): 260 | Downloads (in 2024): 122
Total views: 3375 | Total downloads: 1624