Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-10-26 12:00

iasi
METOP-B IASI RADIANCES CHANNEL 1521 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0739, expected range: -0.0954 -0.0921
METOP-B IASI RADIANCES CHANNEL 1639 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0083, expected range: -0.0353 -0.0142
METOP-B IASI RADIANCES CHANNEL 1658 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1225, expected range: 0.0645 0.0810
METOP-B IASI RADIANCES CHANNEL 1652 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1785, expected range: 0.1199 0.1525
METOP-C IASI RADIANCES CHANNEL 1652 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1128, expected range: 0.0794 0.0968
METOP-C IASI RADIANCES CHANNEL 369 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1285, expected range: -0.1165 -0.1076
METOP-B IASI RADIANCES CHANNEL 333 : out of range
3 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.0414, expected range: -0.0341 -0.0253
METOP-B IASI RADIANCES CHANNEL 284 : out of range
1 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.0892, expected range: 0.0975 0.1112
METOP-B IASI RADIANCES CHANNEL 314 : out of range
3 times in the last 10 days for at least one item
Considerable: avg_biascorr=0.0024, expected range: 0.0116 0.0298
METOP-C IASI RADIANCES CHANNEL 1513 : out of range
1 times in the last 10 days for at least one item
Considerable: avg_biascorr=-0.0321, expected range: -0.0477 -0.0373
cris
NOAA20 CRIS RADIANCES (13 channels affected) : out of range
Considerable: stdev_fgdepar=0.1498, expected range: 0.0891 0.1286
gpsro
METOP-C GRAS SETTING HEIGHT 42-44 KM : out of range
Considerable: stdev_norm_fgdepar=0.6974, expected range: 0.1803 0.5006
COSMIC2-E2 GPSRO RISING (23 impact heights affected) : out of range
Considerable: obs_number=1260.0000, expected range: 1702.8090 2690.7205
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1-2 (HPA) : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.0114, expected range: -0.0055 0.0005
Radiosondes
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 29 : all data missing
Severely_persistent: obs_number=0, expected range: 98.06 155.44
LAND TEMP WIND VECTOR DIFF (M/S) 32618 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=16.3877, expected range: 0.0000 8.2540
Severe: avg_pge=0.8220, expected range: -0.3703 0.6650
HIGH RESO LAND TEMP TEMPERATURE (K) PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=3.3074, expected range: 0.0000 1.2327
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 04270 PRESSURE LAYER 900-12 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=17.0009, expected range: 0.0000 12.2103
Severe: avg_pge=0.8851, expected range: -0.7872 0.7500
HIGH RESO LAND TEMP Q (G/KG) 72248 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=3.6932, expected range: 0.0000 1.4632
HIGH RESO LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=123.0000, expected range: 137.1118 152.6382
amdar
AMDAR WIND VECTOR DIFF (M/S) THT2 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=19.3073, expected range: 0.0000 6.0414
WIGOS AMDAR WIND VECTOR DIFF (M/S) XALICUJA PRESSURE LAYER 300-600 (HP : out of range
Severe: rms_fgdepar=17.6464, expected range: 0.0000 8.7311
WIGOS AMDAR WIND VECTOR DIFF (M/S) DJEEILRA PRESSURE LAYER 300-600 (HP : out of range
Severe: avg_fgdepar=21.9573, expected range: -5.1462 10.1897
Severe: rms_fgdepar=21.9573, expected range: 0.0000 10.2234
WIGOS AMDAR WIND VECTOR DIFF (M/S) 1XWUNVBA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=16.7801, expected range: 0.6834 5.0109
airep
AIREP WIND VECTOR DIFF (M/S) ACA861 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=25.8465, expected range: -10.3099 20.0845
Severe: rms_fgdepar=45.6968, expected range: 0.0000 45.7021
AIREP WIND VECTOR DIFF (M/S) UAL181 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=35.6031, expected range: 0.0000 14.4036
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 41624 PRESSURE LAYER 300-600 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8549, expected range: -0.6321 0.7500
synop
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43364 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=419.1226, expected range: 0.0000 322.0978
Severely_persistent: avg_pge=0.8599, expected range: -1.0308 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48935 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8255, expected range: -1.5344 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 89011 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=547.9936, expected range: 0.0000 373.8748
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 72502 : out of range
Severe: rms_fgdepar=304.0704, expected range: 0.0000 121.4639
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 76243 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8388, expected range: -0.7149 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42174 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-1096.7321, expected range: -1690.2983 1274.1203
Severe: rms_fgdepar=1096.7321, expected range: 0.0000 285.0967
Severe: avg_pge=0.9461, expected range: -1.4424 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40716 : out of range
Severe: rms_fgdepar=569.2323, expected range: 0.0000 203.5329
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83698 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8406, expected range: -0.7012 0.7500
MANUAL LAND SYNOP RH2M (%) 67881 : out of range
Severe: avg_pge=0.9469, expected range: -0.0127 0.0256
MANUAL LAND SYNOP RH2M (%) 43133 : out of range
Severe: avg_pge=0.8068, expected range: -0.1755 0.2169
MANUAL LAND SYNOP RH2M (%) 42473 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8486, expected range: -1.9105 0.7500
MANUAL LAND SYNOP RH2M (%) 43025 : out of range
Severe: avg_pge=0.9541, expected range: -0.3049 0.3617
MANUAL LAND SYNOP RH2M (%) 42935 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.9955, expected range: -1.5751 0.7500
MANUAL LAND SYNOP RH2M (%) 83919 : out of range
Severe: avg_pge=0.9896, expected range: -0.1648 0.2283
BUFR LAND SYNOP SURFACE PRESSURE (PA) 13590 : out of range
Severe: rms_fgdepar=583.5015, expected range: 0.0000 87.4202
BUFR LAND SYNOP SURFACE PRESSURE (PA) 04072 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=347.8279, expected range: 0.0000 171.6466
Severe: avg_pge=0.8712, expected range: -0.7922 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 20674 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=510.1941, expected range: 0.0000 262.5384
BUFR LAND SYNOP SURFACE PRESSURE (PA) 86846 : out of range
Severe: avg_fgdepar=821.5539, expected range: -334.2694 323.2514
Severe: rms_fgdepar=821.5806, expected range: 0.0000 238.8366
Severe: avg_pge=0.9130, expected range: 0.0000 0.0000
BUFR LAND SYNOP SURFACE PRESSURE (PA) 41886 : out of range
Severe: rms_fgdepar=311.1822, expected range: 0.0000 156.6723
BUFR LAND SYNOP SURFACE PRESSURE (PA) 13629 : out of range
Severe: rms_fgdepar=340.1001, expected range: 0.0000 200.8902
Severe: avg_pge=0.8198, expected range: -0.8240 0.7500
BUFR LAND SYNOP RH2M (%) 94920 : out of range
Severe: rms_fgdepar=32.6742, expected range: 0.0000 15.1933
BUFR LAND SYNOP RH2M (%) 95840 : out of range
Severe: rms_fgdepar=45.4835, expected range: 0.0000 15.8729
BUFR LAND SYNOP RH2M (%) 95839 : out of range
Severe: rms_fgdepar=31.3860, expected range: 0.0000 12.8405
BUFR LAND SYNOP RH2M (%) 28049 : out of range
Severe: rms_fgdepar=40.7634, expected range: 0.0000 7.9945
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) KS1031 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8979, expected range: -0.6746 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRRD7 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8472, expected range: -0.9780 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRMV8 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8245, expected range: -0.3670 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) DCQN : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=981.8777, expected range: -1224.8815 1280.6948
Severely_persistent: rms_fgdepar=981.8777, expected range: -895.2199 1183.6063
Severely_persistent: avg_pge=0.8893, expected range: -1.2435 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRFE9 : out of range
Severe: avg_fgdepar=20.2125, expected range: -8.2420 15.4195
Severe: rms_fgdepar=20.2125, expected range: 0.0000 16.5235
Severe: avg_pge=0.9070, expected range: -1.1222 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V7021 : out of range
Severe: avg_fgdepar=-519.3831, expected range: -1211.5772 8.2873
Severe: rms_fgdepar=519.9982, expected range: 0.0000 1186.9570
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7AP5 : out of range
Severe: avg_fgdepar=665.2705, expected range: -426.6457 384.5465
Severe: rms_fgdepar=665.2705, expected range: 0.0000 239.7746
BUFR SHIP SYNOP SURFACE PRESSURE (PA) AMOUK36 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=574.3994, expected range: 0.0000 408.1752
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRRH6 : out of range
Severe: avg_fgdepar=-1267.7626, expected range: -621.6527 303.4296
Severe: rms_fgdepar=1267.7626, expected range: 0.0000 615.2478
Severe: avg_pge=0.9296, expected range: -1.1189 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) H3BV : out of range
Severe: avg_fgdepar=1046.1406, expected range: -307.3003 219.8055
Severe: rms_fgdepar=1046.1406, expected range: 0.0000 286.2710
Severe: avg_pge=0.8977, expected range: -0.4284 0.5567
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 4600001 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8682, expected range: 0.3127 0.7500
MOORED BUOYS WIND VECTOR DIFF (M/S) 3200315 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9039, expected range: -0.6281 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4701740 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=505.3424, expected range: -532.9795 769.0263
Severely_persistent: avg_pge=0.8839, expected range: -1.2860 0.7500
MOORED BUOYS SURFACE PRESSURE (PA) 4400075 : out of range
Severe: rms_fgdepar=345.2550, expected range: 0.0000 82.3632
MOORED BUOYS SURFACE PRESSURE (PA) 4400076 : out of range
Severe: rms_fgdepar=323.8769, expected range: 0.0000 73.9501
MOORED BUOYS SURFACE PRESSURE (PA) 4400077 : out of range
Severe: rms_fgdepar=410.5721, expected range: 0.0000 80.1220
MOORED BUOYS SURFACE PRESSURE (PA) 4400008 : out of range
Severe: rms_fgdepar=367.2010, expected range: 0.0000 162.2583
MOORED BUOYS SURFACE PRESSURE (PA) : out of range
Severe: rms_fgdepar=189.8740, expected range: 26.8412 106.4999
DRIFTING BUOYS SURFACE PRESSURE (PA) 2101663 : out of range
Severe: rms_fgdepar=390.3871, expected range: 0.0000 153.6567
DRIFTING BUOYS SURFACE PRESSURE (PA) 2101806 : out of range
Severe: rms_fgdepar=325.1692, expected range: 0.0000 134.1277
DRIFTING BUOYS SURFACE PRESSURE (PA) 1301619 : out of range
Severe: rms_fgdepar=354.6018, expected range: 0.0000 102.1907
metar
AUTOMATIC METAR SURFACE PRESSURE (PA) KQFW : out of range
39 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-537.9929, expected range: -587.8408 -456.5072
Severely_persistent: rms_fgdepar=538.4347, expected range: 456.6789 590.3461
METAR SURFACE PRESSURE (PA) KACK : out of range
Severe: rms_fgdepar=342.1960, expected range: 0.0000 52.5387
snow
BUFR LAND SYNOP SNOW (CM) _MI1EDCD : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=100.0000, expected range: 99.0070 100.6197
BUFR LAND SYNOP SNOW (CM) _MI1EDCD : out of range
20 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=100.0000, expected range: 99.0070 100.6196
AUTOMATIC LAND SYNOP SNOW (CM) : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-18.4966, expected range: -97.3128 -57.0922
Severe: rms_fgdepar=154.7583, expected range: 434.7391 503.4375
BUFR LAND SYNOP SNOW (CM) 01091 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=21.4658, expected range: 0.0000 6.2371
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.5968, expected range: -18.1924 -3.2923
Severely_persistent: rms_fgdepar=17.5968, expected range: 3.8420 18.0675
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24691 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.1296, expected range: -15.6090 4.3967
Severely_persistent: rms_fgdepar=14.1447, expected range: 0.0000 15.0207
BUFR LAND SYNOP 2M TEMPERATURE (K) 24691 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.1740, expected range: -15.6491 4.3217
Severely_persistent: rms_fgdepar=14.1890, expected range: 0.0000 15.1136
BUFR LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.6750, expected range: -18.2166 -3.3388
Severely_persistent: rms_fgdepar=17.6750, expected range: 3.8772 18.0906
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI187D8 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.9540, expected range: -25.1919 16.2417
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI187D8 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=17.9540, expected range: -12.1797 23.7661
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71931 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=17.3937, expected range: -2.3804 1.9772
Severe: rms_fgdepar=17.4077, expected range: 0.0000 2.5889
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.8709, expected range: -13.1158 -1.6561
Severe: rms_fgdepar=14.9964, expected range: 2.1651 13.1043
MANUAL LAND SYNOP 2M TEMPERATURE (K) 16840 : out of range
Severe: avg_fgdepar=-12.7789, expected range: -4.3801 3.6678
Severe: rms_fgdepar=12.7789, expected range: 0.0000 3.9368
METAR 2M TEMPERATURE (K) SKUI : out of range
Severe: rms_fgdepar=11.3764, expected range: 0.0000 3.2323
METAR 2M TEMPERATURE (K) KDYS : out of range
Severe: avg_fgdepar=-19.6542, expected range: -13.5505 7.3752
Severe: rms_fgdepar=19.6542, expected range: 0.0000 16.1526
Severe: avg_est_pge=0.8068, expected range: -0.2609 0.7540
METAR 2M TEMPERATURE (K) SBST : out of range
Severe: rms_fgdepar=12.2470, expected range: 0.0000 4.6252
BUFR LAND SYNOP 2M TEMPERATURE (K) 16840 : out of range
Severe: avg_fgdepar=-12.8317, expected range: -3.3930 3.0974
Severe: rms_fgdepar=12.8317, expected range: 0.0000 3.5771
BUFR LAND SYNOP 2M TEMPERATURE (K) 71931 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=17.3337, expected range: -2.4236 1.9247
Severe: rms_fgdepar=17.3465, expected range: 0.0000 2.6602
BUFR LAND SYNOP 2M TEMPERATURE (K) 89577 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.7664, expected range: -13.4022 -1.5032
Severe: rms_fgdepar=14.8853, expected range: 2.0409 13.3531
BUFR LAND SYNOP 2M TEMPERATURE (K) 87349 : out of range
Severe: avg_fgdepar=12.1248, expected range: -12.3403 15.3723
Severe: rms_fgdepar=12.1248, expected range: 0.0000 10.3957
rh2m
LAND TEMP RH2M (%) 72388 : out of range
Severe: rms_fgdepar=31.1341, expected range: 0.0000 14.6645