Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-10-27 00:00

iasi
METOP-B IASI RADIANCES CHANNEL 1521 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0722, expected range: -0.0942 -0.0921
METOP-B IASI RADIANCES CHANNEL 1639 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0103, expected range: -0.0297 -0.0142
METOP-C IASI RADIANCES CHANNEL 1639 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0580, expected range: 0.0340 0.0437
METOP-C IASI RADIANCES CHANNEL 1652 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1155, expected range: 0.0844 0.0968
METOP-C IASI RADIANCES CHANNEL 1658 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1223, expected range: 0.0945 0.1090
METOP-B IASI RADIANCES CHANNEL 333 : out of range
4 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.0425, expected range: -0.0341 -0.0233
METOP-B IASI RADIANCES CHANNEL 1652 : out of range
2 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.1771, expected range: 0.1477 0.1649
METOP-B IASI RADIANCES CHANNEL 1658 : out of range
Considerable: avg_biascorr=0.1078, expected range: 0.0783 0.0968
METOP-B IASI RADIANCES CHANNEL 284 : out of range
2 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.0884, expected range: 0.0975 0.1120
METOP-B IASI RADIANCES CHANNEL 314 : out of range
4 times in the last 10 days for at least one item
Considerable: avg_biascorr=-0.0015, expected range: 0.0116 0.0328
METOP-C IASI RADIANCES CHANNEL 1513 : out of range
2 times in the last 10 days for at least one item
Considerable: avg_biascorr=-0.0323, expected range: -0.0459 -0.0373
cris
NOAA20 CRIS RADIANCES CHANNEL 653 : out of range
4 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.0786, expected range: 0.0595 0.0706
atms
NOAA20 ATMS RADIANCES CHANNEL 15 : out of range
Severe: stdev_fgdepar=0.7568, expected range: 0.5538 0.6636
NPP ATMS RADIANCES CHANNEL 15 : out of range
1 times in the last 10 days for at least one item
Considerable: stdev_fgdepar=0.8005, expected range: 0.6289 0.7315
gpsro
All TERRASAR-X GPSRO SETTING ALL HEIGHTS Global : all data missing
Severe: obs_number=0, expected range: 114.03 1439.70
COSMIC2-E1 GPSRO RISING HEIGHT 4-6 KM : out of range
Considerable: obs_number=2183.0000, expected range: 2588.3300 4030.2950
mwri
FY-3D MWRI RADIANCES (6 channels affected) : out of range
Considerable: obs_number=2764.0000, expected range: 3132.4351 3947.4399
ASCAT EARS
All METOP-A ASCAT Global : all data missing
Severe: obs_number=0, expected range: 320.00 320.00
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1-2 (HPA) : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.0115, expected range: -0.0055 0.0000
Severely_persistent: stdev_fgdepar=0.0130, expected range: 0.0095 0.0098
Radiosondes
LAND TEMP TEMPERATURE (K) 37259 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=8.2594, expected range: 0.0557 1.4672
LAND TEMP TEMPERATURE (K) 37259 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_pge=0.8125, expected range: -0.2983 0.4724
HIGH RESO LAND TEMP TEMPERATURE (K) (3 pressure layers affected) : out of range
Severe: obs_number=568.0000, expected range: 659.3125 678.0208
Considerable: obs_number=269.0000, expected range: 76.3084 175.9416
Considerable: obs_number=288.0000, expected range: 352.4871 443.5129
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 40 : all data missing
Severe: obs_number=0, expected range: 0.00 276.57
LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=147.0000, expected range: 49.3020 104.4480
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA : out of range
Considerable: obs_number=230.0000, expected range: 272.5239 284.4761
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
Considerable: obs_number=369.0000, expected range: 457.0287 483.7213
amdar
WIGOS AMDAR TEMPERATURE (K) WVTUIEZA PRESSURE LAYER 0-300 (HPA) : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=10.6502, expected range: -9.8482 10.8235
Severe: rms_fgdepar=10.6502, expected range: -11.3889 13.8768
Severe: avg_pge=0.9034, expected range: -1.2761 0.7500
airep
AIREP WIND VECTOR DIFF (M/S) UAL901 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.9233, expected range: 0.0000 7.6436
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 97028 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=15.0375, expected range: 0.0000 7.8782
LAND PILOT WIND VECTOR DIFF (M/S) 97096 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=19.7446, expected range: 0.0000 4.9566
synop
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48935 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8349, expected range: -1.1617 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) _MI1425D : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8556, expected range: 0.3393 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 89811 : out of range
Severe: avg_fgdepar=-54.3447, expected range: -85.9947 22.2431
Severe: rms_fgdepar=54.4758, expected range: 14.1239 70.1002
MANUAL LAND SYNOP RH2M (%) 68234 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=39.6090, expected range: 0.0000 17.4389
Severe: avg_pge=0.8587, expected range: -0.3564 0.4262
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43110 : out of range
Severe: rms_fgdepar=542.8385, expected range: 0.0000 98.6088
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42740 : out of range
Severe: rms_fgdepar=304.2899, expected range: 29.2496 144.6013
Severe: avg_pge=0.8314, expected range: -0.4511 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 91203 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8729, expected range: -0.8837 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42803 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=493.6941, expected range: 0.0000 229.9130
Severe: avg_pge=0.8799, expected range: -0.9924 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42837 : out of range
Severe: avg_fgdepar=-999.6142, expected range: -68.2241 42.6182
Severe: rms_fgdepar=999.6142, expected range: 0.0000 52.0816
Severe: avg_pge=0.9445, expected range: 0.0000 0.0000
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 35777 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8142, expected range: -0.8727 0.7500
BUFR LAND SYNOP RH2M (%) 94451 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9794, expected range: -1.7028 0.7500
BUFR LAND SYNOP RH2M (%) 95613 : out of range
Severe: rms_fgdepar=47.7877, expected range: 0.0000 22.2382
Severe: avg_pge=0.8536, expected range: -0.0349 0.0496
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33511 : out of range
Severe: avg_pge=0.8116, expected range: -1.3123 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 95613 : out of range
Severe: rms_fgdepar=305.5077, expected range: 0.0000 216.1744
Severe: avg_pge=0.8099, expected range: 0.0000 0.0000
BUFR LAND SYNOP SURFACE PRESSURE (PA) 16138 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8939, expected range: -1.6592 0.7500
AUTOMATIC LAND SYNOP RH2M (%) : out of range
Considerable: obs_number=1044.0000, expected range: 1139.7522 1296.9145
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) KS1031 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=22.4800, expected range: -7.3572 21.3109
Severely_persistent: rms_fgdepar=22.6119, expected range: 0.0000 21.3696
Severely_persistent: avg_pge=0.9262, expected range: -0.6633 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) A8SI6 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8591, expected range: -0.1987 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 3FGM7 : out of range
Severe: avg_fgdepar=855.7795, expected range: -550.3391 865.0674
Severe: rms_fgdepar=855.7795, expected range: 0.0000 697.4504
Severe: avg_pge=0.8805, expected range: -0.8676 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) UAST : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=1030.0400, expected range: 208.6908 1341.7917
Severe: rms_fgdepar=1030.0400, expected range: 208.6908 1341.7917
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 4600001 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=21.2657, expected range: -2.9570 21.9474
Severely_persistent: rms_fgdepar=21.2894, expected range: 0.0000 22.5688
Severely_persistent: avg_pge=0.9407, expected range: 0.2957 0.7500
MOORED BUOYS WIND VECTOR DIFF (M/S) 3200315 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8848, expected range: -0.8278 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4701740 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8459, expected range: -1.3712 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101652 : out of range
Severe: rms_fgdepar=311.4694, expected range: 0.0000 101.0161
metar
AUTOMATIC METAR SURFACE PRESSURE (PA) KQFW : out of range
39 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-588.3642, expected range: -585.1969 -460.2198
Severely_persistent: rms_fgdepar=589.0921, expected range: 460.4753 587.7410
Severely_persistent: avg_pge=0.8309, expected range: -0.5086 0.7500
METAR SURFACE PRESSURE (PA) FYWB : out of range
Severe: rms_fgdepar=317.7864, expected range: 0.0000 143.5305
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=12.2699, expected range: 2.0160 13.7933
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.0786, expected range: -20.4050 -2.7561
Severely_persistent: rms_fgdepar=17.1442, expected range: 3.2926 20.2695
BUFR LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.0982, expected range: -14.0902 -1.4250
Severely_persistent: rms_fgdepar=12.3809, expected range: 1.9220 14.0045
BUFR LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.0651, expected range: -20.4355 -2.7955
Severely_persistent: rms_fgdepar=17.1293, expected range: 3.3134 20.3053
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24219 : out of range
Severe: rms_fgdepar=11.3370, expected range: 0.0000 3.3806
MANUAL LAND SYNOP 2M TEMPERATURE (K) 35519 : out of range
Severe: rms_fgdepar=12.2333, expected range: 0.0000 6.5495
METAR 2M TEMPERATURE (K) LTCB : out of range
Severe: rms_fgdepar=12.1803, expected range: 1.9712 12.3356
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1AFE9 : out of range
Severe: rms_fgdepar=12.0022, expected range: 0.0000 10.6340
rh2m
MANUAL LAND SYNOP RH2M (%) 16316 : out of range
Severe: rms_fgdepar=38.1080, expected range: 0.0000 20.9281
BUFR LAND SYNOP RH2M (%) 08040 : out of range
Severe: rms_fgdepar=35.2967, expected range: 0.0000 18.9202