Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2018-04-13 12:00

airs
AQUA AIRS 1111 radiances : DataMissing
AQUA AIRS 218 radiances : OutOfRange
Slightly: avg(biascorr)=0, expected range: -0.23 -0.16
iasi
METOP-B IASI 5401 radiances : OutOfRange
1 times in the last 10 days for at least one item
Slightly: avg(biascorr)=0, expected range: 0.21 0.29
METOP-B IASI 5403 radiances : OutOfRange
2 times in the last 10 days for at least one item
Slightly: avg(biascorr)=0, expected range: 0.21 0.29
METOP-B IASI 5405 radiances : OutOfRange
2 times in the last 10 days for at least one item
Slightly: avg(biascorr)=0, expected range: 0.16 0.23
METOP-B IASI 5455 radiances : OutOfRange
2 times in the last 10 days for at least one item
Slightly: avg(biascorr)=0, expected range: 0.37 0.46
METOP-A IASI 410 radiances : OutOfRange
Slightly: avg(fg_depar)=0, expected range: 0.00 0.06
mhs
METOP-B MHS 3 allsky radiances : OutOfRange
6 times in the last 10 days for at least one item
Slightly: avg(biascorr)=0, expected range: 0.39 0.60
NOAA-18 MHS 3 allsky radiances : OutOfRange
14 times in the last 10 days for at least one item
Slightly: avg(biascorr)=0, expected range: 0.32 0.54
Ozone
METOP-B GOME-2 layer ozone, top pressure 1 : OutOfRange
9 times in the last 10 days for at least one item
Slightly: stdev_fg_depar_du=5, expected range: 5.30 5.83
NOAA-19 SBUV layer ozone, top pressure 63940 : OutOfRange
15 times in the last 10 days for at least one item
Slightly: stdev_fg_depar_du=2, expected range: 1.08 2.27
ssmis
DMSP-18 SSMIS 7 allsky radiances : OutOfRange
16 times in the last 10 days for at least one item
Considerably: avg(biascorr)=5, expected range: 5.81 6.30
DMSP-18 SSMIS 11 allsky radiances : OutOfRange
2 times in the last 10 days for at least one item
Slightly: avg(biascorr)=0, expected range: -0.13 0.04
airep
AFR356 AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
Severely: avg(fg_depar)=18, expected range: 0.25 4.70
Severely: rms(fg_depar)=18, expected range: 0.16 5.60
Considerably: freq(qc_pge)=84, expected range: 0.00 70.00
NAX7001 AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=100, expected range: 0.00 70.00
AAL111 AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=80, expected range: 0.00 70.00
VIR141 AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=83, expected range: 0.00 70.00
AAL151 AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=73, expected range: 0.00 70.00
SVA061 AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=92, expected range: 0.00 70.00
BAW281 AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=90, expected range: 0.00 70.00
BAW102 AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
1 times in the last 10 days for at least one item
Considerably: freq(qc_pge)=78, expected range: 0.00 70.00
KLM643 AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
1 times in the last 10 days for at least one item
Considerably: freq(qc_pge)=71, expected range: 0.00 70.00
ACA883 AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=92, expected range: 0.00 70.00
ETH504 AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=88, expected range: 0.00 70.00
LOT26 AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
1 times in the last 10 days for at least one item
Considerably: freq(qc_pge)=85, expected range: 0.00 70.00
NRS7147 AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=70, expected range: 0.00 70.00
ACA847 AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
1 times in the last 10 days for at least one item
Considerably: freq(qc_pge)=77, expected range: 0.00 70.00
BAW1YC AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
1 times in the last 10 days for at least one item
Considerably: freq(qc_pge)=72, expected range: 0.00 70.00
VIR19Z AIREP Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=75, expected range: 0.00 70.00
amdar
EU0538 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
Severely: avg(fg_depar)=12, expected range: -0.67 5.70
Severely: rms(fg_depar)=17, expected range: 0.00 6.10
SL0148 146 Temperature (k) 0 40000 : OutOfRange
Severely: rms(fg_depar)=2, expected range: 0.00 1.31
AETIRJZA 146 Temperature (k) 0 40000 : OutOfRange
Severely: rms(fg_depar)=1, expected range: 0.00 1.15
AU0118 AMDAR Temperature (k) 40000 70000 : OutOfRange
Severely: avg(fg_depar)=-3, expected range: -1.39 1.11
Severely: rms(fg_depar)=6, expected range: 0.00 1.87
EU0485 146 Temperature (k) 70000 101325 : OutOfRange
1 times in the last 10 days for at least one item
Severely: rms(fg_depar)=3, expected range: 0.00 2.20
S2X0YEBA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=3, expected range: 0.00 2.50
0UZUOGBA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=3, expected range: 0.02 2.10
CL0UOHBA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=3, expected range: 0.00 2.30
X5NHWTBA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=3, expected range: 0.00 2.40
TIHV50JA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=4, expected range: 0.00 2.30
HONKS1JA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=4, expected range: 0.00 2.50
3EMYF2JA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=3, expected range: 0.00 2.30
ZRQHC3JA 146 Temperature (k) 70000 101325 : OutOfRange
1 times in the last 10 days for at least one item
Severely: rms(fg_depar)=3, expected range: 0.00 2.20
JULUIEJA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=3, expected range: 0.00 2.30
JALYCIJA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=3, expected range: 0.00 1.82
GCFEILJA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=5, expected range: 0.00 2.20
VKOUNWJA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=4, expected range: 0.00 2.60
CY5LJ2RA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=3, expected range: 0.00 2.40
QQUIWBRA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=3, expected range: 0.00 2.30
CYYVGCRA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: avg(fg_depar)=-2, expected range: -1.13 0.94
Severely: rms(fg_depar)=4, expected range: 0.00 2.10
43CWUWRA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=2, expected range: 0.23 1.73
3XUUOEZA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=3, expected range: 0.00 2.40
LPUMXFZA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=3, expected range: 0.00 2.10
IPZEOGZA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=3, expected range: 0.00 1.97
OLNENVZA 146 Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=3, expected range: 0.00 2.30
CNFPYN AMDAR Temperature (k) 70000 101325 : OutOfRange
Severely: rms(fg_depar)=3, expected range: 0.00 2.60
5RGKX2BA 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=83, expected range: 0.00 70.00
3VVJM4BA 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=100, expected range: 0.00 70.00
SRAHMGBA 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=80, expected range: 0.00 70.00
U4GMVGBA 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=85, expected range: 0.00 70.00
X3RYN1JA 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
1 times in the last 10 days for at least one item
Considerably: freq(qc_pge)=90, expected range: 0.00 70.00
FG5IQ1RA 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=88, expected range: 0.00 70.00
KRVY0FRA 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=75, expected range: 0.00 70.00
44C0KKRA 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=90, expected range: 0.00 70.00
4MVHHLRA 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
2 times in the last 10 days for at least one item
Considerably: freq(qc_pge)=71, expected range: 0.00 70.00
VQNZRURA 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=86, expected range: 0.00 70.00
WEF012ZA 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=87, expected range: 0.00 70.00
G0Q0Q5ZA 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=92, expected range: 0.00 70.00
FTRH1JZA 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
1 times in the last 10 days for at least one item
Considerably: freq(qc_pge)=77, expected range: 0.00 70.00
WYUJ0UZA 146 Wind Vector difference (m/s) 0 40000 : OutOfRange
Considerably: freq(qc_pge)=72, expected range: 0.00 70.00
In-Situ measurements
Drifter Buoy Surface pressure (Pa) WMO BLOCK 72 0 0 : OutOfRange
5 times in the last 10 days for at least one item
Severely: rms(fg_depar)=175, expected range: 0.00 99.00
Slightly: count(*)=79, expected range: 21.00 77.00
All SYNOP Surface pressure (Pa) WMO BLOCK 92 0 0 Missing
All AIREP Wind Vector difference (m/s) Asia 70000 101325 Missing
All AIREP Wind Vector difference (m/s) Indian Ocean 70000 101325 Missing
All Moored Buoy Surface pressure (Pa) WMO BLOCK 28 0 0 Missing
Drifter Buoy Surface pressure (Pa) WMO BLOCK 14 0 0 : OutOfRange
Considerably: rms(fg_depar)=122, expected range: 8.00 94.00
SYNOP Surface pressure (Pa) WMO BLOCK 67 0 0 : OutOfRange
Slightly: rms(fg_depar)=136, expected range: 36.00 120.00
TEMP Land Report Temperature (k) WMO BLOCK 81 0 40000 : OutOfRange
Slightly: avg(fg_depar)=1, expected range: -0.50 1.82
AMDAR Temperature (k) Indian Ocean 70000 101325 : OutOfRange
Slightly: rms(fg_depar)=1, expected range: 0.51 1.42
BUOYS
1601562 189 Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=186, expected range: 0.00 118.00
1701503 189 Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=185, expected range: 0.00 116.00
1701524 189 Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=216, expected range: 0.00 115.00
1400567 189 Surface pressure (Pa) : OutOfRange
1 times in the last 10 days for at least one item
Severely: avg(fg_depar)=471, expected range: -144.00 142.00
Severely: rms(fg_depar)=475, expected range: 0.00 144.00
Considerably: freq(qc_pge)=100, expected range: 0.00 70.00
5501518 189 Surface pressure (Pa) : OutOfRange
2 times in the last 10 days for at least one item
Considerably: freq(qc_pge)=83, expected range: 0.00 70.00
metar
KOMA METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=224, expected range: 0.00 147.00
KDPA METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=191, expected range: 0.00 127.00
K06C METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=183, expected range: 0.00 108.00
KFLD METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=262, expected range: 0.00 118.00
KOSH METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=189, expected range: 0.00 120.00
KSQI METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=211, expected range: 0.00 124.00
KOVL METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=160, expected range: 0.00 106.00
KDSM METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=230, expected range: 0.00 131.00
KIGQ METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=223, expected range: 0.00 116.00
KARR METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=184, expected range: 0.00 117.00
KJOT METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=188, expected range: 0.00 115.00
KLOT METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=202, expected range: 0.00 105.00
KTNU METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=191, expected range: 0.00 123.00
KIKV METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=250, expected range: 0.00 161.00
KMDW METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=215, expected range: 0.00 118.00
KIOW METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=255, expected range: 0.00 168.00
KBKX METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=234, expected range: 0.00 150.00
KGYY METAR Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=229, expected range: 0.00 125.00
ENLA METAR Surface pressure (Pa) : OutOfRange
6 times in the last 10 days for at least one item
Considerably: freq(qc_pge)=100, expected range: 0.00 70.00
ship
TBWUK86 SHIP Report Wind Vector difference (m/s) : OutOfRange
2 times in the last 10 days for at least one item
Severely_persistent: freq(qc_pge)=60, expected range: 0.00 50.00
46147 Automatic SHIP Report Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=251, expected range: 0.00 144.00
46100 Automatic SHIP Report Wind Vector difference (m/s) : OutOfRange
Considerably: freq(qc_pge)=91, expected range: 0.00 70.00
PINX SHIP Report Wind Vector difference (m/s) : OutOfRange
Considerably: freq(qc_pge)=80, expected range: 0.00 70.00
synop
01089 170 Surface pressure (Pa) : OutOfRange
Severely: rms(fg_depar)=228, expected range: 0.00 152.00
85141 SYNOP Surface pressure (Pa) : OutOfRange
Considerably: freq(qc_pge)=100, expected range: 0.00 70.00
23982 170 Surface pressure (Pa) : OutOfRange
Considerably: freq(qc_pge)=75, expected range: 0.00 70.00
08345 170 Surface pressure (Pa) : OutOfRange
3 times in the last 10 days for at least one item
Considerably: freq(qc_pge)=100, expected range: 0.00 70.00
86185 SYNOP Surface pressure (Pa) : OutOfRange
Considerably: freq(qc_pge)=75, expected range: 0.00 70.00
62007 SYNOP Surface pressure (Pa) : OutOfRange
Considerably: freq(qc_pge)=80, expected range: 0.00 70.00
Radiosondes
57687 TEMP Land Report Wind Vector difference (m/s) 0 40000 : OutOfRange
Severely: avg(fg_depar)=7, expected range: 0.43 4.80
Severely: rms(fg_depar)=11, expected range: 0.28 5.70
70200 109 Temperature (k) 40000 70000 : OutOfRange
Severely: avg(fg_depar)=-1, expected range: -0.84 1.28
42399 TEMP Land Report Temperature (k) 70000 101325 : OutOfRange
Considerably: freq(qc_pge)=100, expected range: 0.00 70.00