Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-10-27 12:00

airs
AQUA AIRS RADIANCES CHANNEL 1111 : out of range
Severe: avg_fgdepar=0.4866, expected range: -0.2729 0.0806
Severe: stdev_fgdepar=1.1049, expected range: 0.3208 0.4888
Severe: avg_biascorr=0.4521, expected range: 0.3912 0.4190
mwhs2
FY-3D MWHS2 ALLSKY RADIANCES CHANNEL 14 : out of range
Considerable: stdev_norm_fgdepar=0.7695, expected range: 0.5566 0.6979
ASCAT EARS
All METOP-A ASCAT Global : all data missing
Severe: obs_number=0, expected range: 0.00 2861.61
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1-2 (HPA) : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.0119, expected range: -0.0055 0.0002
Severely_persistent: stdev_fgdepar=0.0117, expected range: 0.0094 0.0098
Radiosondes
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 29 : all data missing
Severely_persistent: obs_number=0, expected range: 72.48 192.02
LAND TEMP WIND VECTOR DIFF (M/S) 72456 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=15.5808, expected range: 0.0000 7.1655
LAND TEMP Q (G/KG) 74646 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.8030, expected range: 0.0000 2.1256
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
2 times in the last 10 days for at least one item
Severe: obs_number=92.0000, expected range: 168.5704 184.9852
Considerable: obs_number=110.0000, expected range: 93.1836 101.4164
LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=961.0000, expected range: 426.3508 760.1492
Considerable: obs_number=107.0000, expected range: 130.3053 163.4447
HIGH RESO LAND TEMP TEMPERATURE (K) (3 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=266.0000, expected range: 343.9160 443.3340
HIGH RESO LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=129.0000, expected range: 139.4950 150.7550
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) 1DBSSUJA PRESSURE LAYER 300-600 (HP : out of range
Severe: rms_fgdepar=16.3233, expected range: 0.0000 6.2708
WIGOS AMDAR WIND VECTOR DIFF (M/S) LB2WUUBA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=19.3558, expected range: 0.0000 6.0611
WIGOS AMDAR WIND VECTOR DIFF (M/S) SVWUOFJA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=17.2960, expected range: 0.0000 8.2031
WIGOS AMDAR WIND VECTOR DIFF (M/S) AS0LZ2RA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=17.7425, expected range: 0.0000 5.9385
airep
AIREP WIND VECTOR DIFF (M/S) UAL900 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=21.1944, expected range: 0.0000 14.4140
AIREP WIND VECTOR DIFF (M/S) ACA881 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=21.5585, expected range: 0.0000 15.6926
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : missing
1 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 1391.5343
synop
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42174 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-916.4722, expected range: -1668.9920 1230.2286
Severely_persistent: rms_fgdepar=916.4722, expected range: 0.0000 291.2229
Severely_persistent: avg_pge=0.9368, expected range: -1.2952 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 16138 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8824, expected range: -1.6300 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 68331 : out of range
Severe: rms_fgdepar=31.3797, expected range: 0.0000 16.7317
MANUAL LAND SYNOP RH2M (%) 42661 : out of range
Severe: avg_pge=0.9938, expected range: -0.6666 0.7500
MANUAL LAND SYNOP RH2M (%) 43071 : out of range
Severe: avg_fgdepar=62.4368, expected range: -59.4335 62.5434
Severe: rms_fgdepar=62.4368, expected range: 0.0000 47.4097
Severe: avg_pge=1.0000, expected range: -0.0017 0.0083
MANUAL LAND SYNOP RH2M (%) 42237 : out of range
Severe: avg_pge=0.8435, expected range: -1.3135 0.7500
MANUAL LAND SYNOP RH2M (%) 83919 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=50.7373, expected range: 14.2803 32.9490
Severe: rms_fgdepar=50.7373, expected range: 14.2803 32.9490
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 86170 : out of range
Severe: avg_fgdepar=-674.2400, expected range: -171.3018 197.6526
Severe: rms_fgdepar=816.7353, expected range: 18.6027 134.0808
Severe: avg_pge=0.8254, expected range: -0.6297 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 61075 : out of range
Severe: rms_fgdepar=311.6668, expected range: 0.0000 121.0417
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 65467 : out of range
Severe: rms_fgdepar=308.8968, expected range: 0.0000 136.9096
BUFR LAND SYNOP RH2M (%) 94921 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=33.8266, expected range: 0.0000 15.6353
BUFR LAND SYNOP RH2M (%) 63741 : out of range
Severe: avg_pge=0.8619, expected range: -0.0046 0.0114
BUFR LAND SYNOP RH2M (%) 94843 : out of range
Severe: avg_fgdepar=51.6665, expected range: -17.2184 21.5107
Severe: rms_fgdepar=51.6665, expected range: 0.0000 16.8812
BUFR LAND SYNOP RH2M (%) 94864 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=52.5320, expected range: -16.5686 33.7255
Severe: rms_fgdepar=52.5320, expected range: 0.0000 33.7255
BUFR LAND SYNOP RH2M (%) 95835 : out of range
Severe: rms_fgdepar=31.4536, expected range: 0.0000 17.4545
BUFR LAND SYNOP RH2M (%) 95726 : out of range
Severe: avg_fgdepar=51.4218, expected range: -21.6722 33.8348
Severe: rms_fgdepar=51.4218, expected range: 0.0000 28.0789
BUFR LAND SYNOP RH2M (%) 94797 : out of range
Severe: rms_fgdepar=33.9371, expected range: 0.0000 18.7045
BUFR LAND SYNOP RH2M (%) 95839 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=32.3770, expected range: 0.0000 12.0493
BUFR LAND SYNOP SURFACE PRESSURE (PA) 29571 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=331.0961, expected range: 14.8257 113.7475
BUFR LAND SYNOP SURFACE PRESSURE (PA) 13622 : out of range
Severe: avg_pge=0.8304, expected range: -0.9835 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 14545 : out of range
Severe: avg_pge=0.8062, expected range: -0.3066 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 94866 : out of range
Severe: rms_fgdepar=312.4882, expected range: 0.0000 78.2189
BUFR LAND SYNOP SURFACE PRESSURE (PA) 13376 : out of range
Severe: rms_fgdepar=330.3714, expected range: 0.0000 123.6030
BUFR LAND SYNOP SURFACE PRESSURE (PA) 13629 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8157, expected range: -1.0516 0.7500
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) A8SI6 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=29.3739, expected range: -9.0463 29.7517
Severely_persistent: rms_fgdepar=29.7600, expected range: 0.0000 30.7338
Severely_persistent: avg_pge=0.9412, expected range: -0.2854 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRDT6 : out of range
Severe: avg_fgdepar=20.1640, expected range: -24.7675 44.0432
Severe: rms_fgdepar=20.1640, expected range: 0.0000 44.0432
Severe: avg_pge=0.9124, expected range: -0.8785 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) DITL2 : out of range
Severe: rms_fgdepar=658.7003, expected range: 0.0000 182.8144
BUFR SHIP SYNOP SURFACE PRESSURE (PA) D5XC5 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-564.0657, expected range: -748.8315 -314.4448
Severe: rms_fgdepar=564.0657, expected range: 314.4448 748.8315
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRKQ5 : out of range
Severe: avg_fgdepar=532.2965, expected range: -618.4731 610.3264
Severe: rms_fgdepar=615.1223, expected range: 0.0000 513.1360
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7KD7 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=920.5964, expected range: -122.9614 384.4161
Severe: rms_fgdepar=920.5964, expected range: 0.0000 539.7544
Severe: avg_pge=0.8823, expected range: -0.3794 0.6784
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V8838 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=341.7041, expected range: 0.0000 159.8029
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7DP9 : out of range
Severe: avg_pge=0.8025, expected range: 0.4856 0.7500
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 4600001 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9217, expected range: 0.2995 0.7500
MOORED BUOYS WIND VECTOR DIFF (M/S) 4600073 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=20.2375, expected range: -17.0025 33.4622
Severely_persistent: rms_fgdepar=20.5776, expected range: 0.0000 33.7720
Severely_persistent: avg_pge=0.9355, expected range: 0.0836 0.7500
MOORED BUOYS WIND VECTOR DIFF (M/S) 3200315 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8964, expected range: -0.9319 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4701740 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8054, expected range: -1.3471 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6204572 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=580.3626, expected range: -1117.8799 771.5570
Severely_persistent: rms_fgdepar=602.7065, expected range: 0.0000 678.3982
Severely_persistent: avg_pge=0.8850, expected range: -0.1371 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 1301619 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=416.7626, expected range: 0.0000 116.8251
DRIFTING BUOYS SURFACE PRESSURE (PA) 2501719 : out of range
Severe: rms_fgdepar=376.5249, expected range: 0.0000 164.1787
metar
AUTOMATIC METAR SURFACE PRESSURE (PA) KQFW : out of range
39 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-513.3975, expected range: -583.1463 -462.0605
Severely_persistent: rms_fgdepar=514.4646, expected range: 462.2927 585.6480
METAR SURFACE PRESSURE (PA) KADM : out of range
Severe: rms_fgdepar=361.8847, expected range: 0.0000 117.8061
METAR SURFACE PRESSURE (PA) KOUN : out of range
Severe: rms_fgdepar=355.9015, expected range: 0.0000 151.6054
METAR SURFACE PRESSURE (PA) OIBV : out of range
Severe: rms_fgdepar=310.3544, expected range: 0.0000 165.3156
AUTOMATIC METAR SURFACE PRESSURE (PA) FAPE : out of range
Severe: rms_fgdepar=317.9902, expected range: 0.0000 97.6726
snow
AUTOMATIC LAND SYNOP SNOW (CM) : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-19.8659, expected range: -92.7017 -67.1277
Severe: rms_fgdepar=158.8152, expected range: 433.2052 510.7727
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.5583, expected range: -20.4050 -2.7561
Severely_persistent: rms_fgdepar=14.7634, expected range: 3.2926 20.2695
BUFR LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
21 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.5668, expected range: -20.4355 -2.7955
Severely_persistent: rms_fgdepar=14.7733, expected range: 3.3134 20.3053
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=12.0083, expected range: 5.4597 16.9830
MANUAL LAND SYNOP 2M TEMPERATURE (K) 24143 : out of range
Severe: rms_fgdepar=10.4911, expected range: 0.0000 5.0133
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI18ADC : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=13.0437, expected range: -6.6965 13.2156
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI18ADC : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=13.6026, expected range: 0.0000 16.6102
BUFR LAND SYNOP 2M TEMPERATURE (K) : out of range
Considerable: obs_number=65809.0000, expected range: 71648.1797 77588.5262
Considerable: obs_number=209.0000, expected range: 232.8164 268.6280