HadISD - global sub-daily station dataset -
version 3.4.1.202403p
As a result of the forthcoming
termination of updates to the ISD dataset, HadISD will stop
being updated during 2024. For more details, see
the HadISD
blog
Note for versions 2.0.1.2017p onwards:
In version 3.4.0.2023f we have corrected an issue in the implementation of the neighbour
checks in HadISD, which had been present since 2018
(v2.0.1.2017p onwards). The neighbour checks had not been
running, and the unflagging
using the neighbours had not been working as intended. The
error has now been corrected, and these neighbour checks have run as
intended. For further
details see post on the HadISD blog.
(12-Jan-2024).
HadISD is a global sub-daily dataset based on
the ISD dataset
from NOAA's NCEI. As well as station
selection criteria, a suite of quality control tests has been run on
the major climatological variables. The data span 1/1/1931 to end
March 2024 and each station is available individually. The current
version of HadISD is 3.4.1.202403p. For previous versions
please contact the dataset maintainers.
This is a new version of HadISD, version
3.4.1.202403p. This version is a preliminary one for
2024 and hence has the final character "p". The station lists
have been updated over v3.4.0.2023f. Further details are given in
the blog and also
a Hadley
Centre Technical Note. For full details see the Changelog.
A station listing with IDs and location information
is here
(also with names).
Brief description of the data
Individual stations within the ISD were composited when
it was appropriate to do so. Then stations were selected on the basis of
their length of record and reporting frequency. There are 9957
stations in HadISD.3.4.1.202403p, and these
were passed through a suite of automated quality control tests
designed to remove bad data while keeping the extremes. None of the
ISD flags were used. The QC tests focussed on the temperature,
dewpoint temperature and sea-level pressure variables, although some
were applied to the wind speed and direction and cloud data. The
data files also contain other variables which were pulled through from
the raw ISD record, but have had no QC applied. Note: These data have not
yet been homogenised and so trend fitting should be undertaken with
caution. Results from the homogeneity assessment can be
found here.
Keep in touch
Follow us on twitter: @metofficeHadOBS for updates, news and announcements.
For more detailed information, follow our HadISD blog. Here we describe bug fixes, routine updates and other exploratory analysis.
|
Figure shows the distribution of HadISD stations on
a 1x1degree grid. These are the subset from the ISD which
report at least every 6 hours and have a long enough record. It was created when refreshing
the station list for v3.4.1.202401p.
|
References
When using the dataset in a paper, the following are
the correct citations to use. Please also state the
version number used and date of download
Dunn, R. J. H., (2019), HadISD version 3: monthly updates,
Hadley Centre Technical Note
Dunn, R. J. H., et al. (2016), Expanding HadISD: quality-controlled, sub-daily station data from 1931,
Geoscientific
Instrumentation, Methods and Data Systems, 5, 473-491
Dunn, R. J. H., et
al. (2014), Pairwise homogeneity assessment of HadISD,
Climate
of the Past, 10, 1501-1522
Dunn, R. J. H., et
al. (2012), HadISD: A Quality Controlled global synoptic
report database for selected variables at long-term stations
from 1973-2011, Climate of the Past, 8, 1649-1679
Smith, A., et al. (2011): The Integrated Surface
Database: Recent Developments and
Partnerships. Bulletin
of the American Meteorological Society, 92, 704-708
|
Commercial and media enquiries
You can access the Met Office Customer Centre, any time
of the day or night by phone, fax or e-mail. Trained staff will help
you find the information or products that are right for you.
Contact
the Met Office Customer Centre
|
|
Quality Control Code
The python code used for the station selection and quality control can be
found on github.
We do not intend to provide in-depth
support for this code. We emphasise that the choices we have made in
the selection and QC one of a number of other
equally reasonable choices, and encourage other interested parties to
develop their own QC and filtering procedures to allow the structural
uncertainties of this sub-daily dataset to be investigated.
Homogeneity Assessment
We have assessed the homogeneity of four of the observed
meteorological variables present in HadISD: temperature, dew point
temperature, sea-level pressure and wind speed. This has been
performed on monthly averages of the sub-daily data, and is fully
described in Dunn et
al, 2014, Climate of the Past, 10, 1501-1522. The homogeneity
assessment results for v3.4.0.2023f are available for
download here.
Online Material
A number of summary and diagnostic outputs from the quality control
code as well as station lists for a number of selection criteria are
available here. Also available is
the information from the homogeneity assessment of v3.4.0.2023f.
We have adapted our versioning system
from CRUTEM4,
and so the dataset numbering is of the form HadISD.X.Y.Z.1234i, and
is outlined in more detail in the paper linked above. X
is for a major change and would normally be accompanied by a peer-reviewed
paper. Y is a more minor change, e.g. in one of the QC tests and
would be described in a tech-note. Finally Z is
a small change, for example addition or changes to data in the
past. The last complete year of the dataset is given by 1234, and
the final character shows if the dataset is f-final or
p-preliminary. Therefore HadISD.1.0.1.2012f is the final version of
the dataset containing data up to the end of 2012, and there have
been some changes to past data over HadISD.1.0.0.2011f. For the
monthly updates, the final characters encode the final year and
month of the dataset, e.g. 202001p for the version up to the end of
January 2020.
A number of images and movies created from HadISD to show its
capabilities are here.
Dataset produced in collaboration with:
