Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-10-28 00:00

amsua
NOAA 18 AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
Severe: stdev_norm_fgdepar=0.0058, expected range: 0.9362 0.9821
cris
NOAA20 CRIS RADIANCES CHANNEL 1109 : out of range
Slight: stdev_fgdepar=0.7401, expected range: 0.5875 0.7011
amsr2
AMSR2 GCOM-W1 ALLSKY RADIANCES (6 channels affected) : out of range
Considerable: obs_number=9161.0000, expected range: 15568.5321 18802.7179
atms
NOAA20 ATMS RADIANCES CHANNEL 14 : out of range
1 times in the last 10 days for at least one item
Considerable: stdev_fgdepar=0.4180, expected range: 0.3194 0.3819
gpsro
COSMIC2-E1 GPSRO SETTING (23 impact heights affected) : out of range
Considerable: obs_number=1871.0000, expected range: 2137.6833 2640.5667
ASCAT EARS
All METOP-A ASCAT Global : all data missing
Severe: obs_number=0, expected range: 0.00 2861.61
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1-2 (HPA) : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.0123, expected range: -0.0055 -0.0010
Radiosondes
LAND TEMP WIND VECTOR DIFF (M/S) 72469 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=16.4739, expected range: 0.0000 7.5538
LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: obs_number=543.0000, expected range: 64.1297 98.1203
LAND TEMP Q (G/KG) 40430 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.9030, expected range: 0.0000 1.9109
All LAND TEMP ALL LAYERS WMO BLOCK 42 : all data missing
Severe: obs_number=0, expected range: 0.00 271.39
All LAND TEMP ALL LAYERS WMO BLOCK 43 : all data missing
Severe: obs_number=0, expected range: 0.00 277.57
HIGH RESO LAND TEMP TEMPERATURE (K) 52323 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.0636, expected range: 0.2014 3.0324
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 94672 (2 pressure layers af : out of range
Severe: rms_fgdepar=17.6004, expected range: 0.1021 3.8932
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=182.0000, expected range: 87.6707 94.0793
Severe: obs_number=187.0000, expected range: 85.8413 98.6587
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 61 : all data missing
Severe: obs_number=0, expected range: 47.69 221.31
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
Considerable: obs_number=8471.0000, expected range: 9593.1290 10975.6210
HIGH RESO LAND TEMP TEMPERATURE (K) (4 pressure layers affected) : out of range
Considerable: obs_number=275.0000, expected range: 1492.0384 2269.2116
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=687.0000, expected range: 853.8098 1159.1902
amdar
AMDAR TEMPERATURE (K) 00040340 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=12.5289, expected range: 0.0000 5.2482
AMDAR WIND VECTOR DIFF (M/S) 00040367 PRESSURE LAYER 900-1200 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=40.3298, expected range: -9.2570 20.1195
Severe: rms_fgdepar=47.1123, expected range: 0.0000 38.4825
Severe: avg_pge=0.8127, expected range: -0.5919 0.7500
AMDAR WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : missing
Severe: obs_number=0.0000, expected range: 0.0000 286.3651
ADS-C WIND VECTOR DIFF (M/S) 4B1SV4JA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=21.4126, expected range: 0.0000 9.0470
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 06234 (2 pressure layers affe : out of range
Severe: rms_fgdepar=15.3165, expected range: 0.0000 10.4019
Severe: avg_pge=0.8446, expected range: -0.5177 0.7500
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 48407 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=16.8583, expected range: 0.0000 6.7005
LAND PILOT WIND VECTOR DIFF (M/S) 97096 PRESSURE LAYER 600-900 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=15.2575, expected range: 0.0000 6.2967
synop
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43364 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8052, expected range: -1.6297 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42174 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=638.8617, expected range: -363.1891 344.3425
Severely_persistent: rms_fgdepar=638.8617, expected range: 0.0000 214.9124
Severely_persistent: avg_pge=0.9074, expected range: -1.1317 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43009 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8175, expected range: -1.0505 0.7500
MANUAL LAND SYNOP RH2M (%) 68240 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=31.2974, expected range: 0.0000 16.1399
MANUAL LAND SYNOP RH2M (%) 42661 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=31.5348, expected range: 0.0000 16.0655
MANUAL LAND SYNOP RH2M (%) 43071 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=36.2518, expected range: 0.0000 15.6180
MANUAL LAND SYNOP RH2M (%) 94323 : out of range
Severe: avg_pge=0.9972, expected range: -0.0195 0.0295
MANUAL LAND SYNOP RH2M (%) 35739 : out of range
Severe: rms_fgdepar=44.7943, expected range: 0.0000 24.2001
BUFR LAND SYNOP RH2M (%) 15490 : out of range
Severe: rms_fgdepar=32.5953, expected range: 0.0000 12.6819
BUFR LAND SYNOP RH2M (%) 08021 : out of range
Severe: rms_fgdepar=46.0963, expected range: 0.0000 20.8691
BUFR LAND SYNOP RH2M (%) 94642 : out of range
Severe: avg_pge=0.8330, expected range: -1.0126 0.7500
BUFR LAND SYNOP RH2M (%) 94323 : out of range
Severe: avg_pge=1.0000, expected range: -0.0292 0.0403
BUFR LAND SYNOP RH2M (%) 14474 : out of range
Severe: avg_pge=0.8526, expected range: -0.1981 0.2451
BUFR LAND SYNOP RH2M (%) 17195 : out of range
Severe: rms_fgdepar=31.9166, expected range: 0.0000 14.7225
BUFR LAND SYNOP RH2M (%) 95695 : out of range
Severe: rms_fgdepar=40.2973, expected range: 0.0000 9.3493
BUFR LAND SYNOP RH2M (%) 94686 : out of range
Severe: rms_fgdepar=35.7080, expected range: 0.0000 8.3503
BUFR LAND SYNOP RH2M (%) 94796 : out of range
Severe: rms_fgdepar=31.0625, expected range: 0.0000 8.0759
BUFR LAND SYNOP RH2M (%) 15118 : out of range
Severe: avg_fgdepar=56.3171, expected range: -50.3080 92.9640
Severe: rms_fgdepar=56.4411, expected range: 0.0000 93.4598
Severe: avg_pge=0.8781, expected range: -0.4741 0.6007
BUFR LAND SYNOP RH2M (%) 94798 : out of range
Severe: rms_fgdepar=30.0450, expected range: 0.0000 9.6599
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33511 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8270, expected range: -1.1992 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48033 : out of range
Severe: rms_fgdepar=572.5231, expected range: 0.0000 412.2574
BUFR LAND SYNOP SURFACE PRESSURE (PA) 16114 : out of range
Severe: avg_pge=0.8005, expected range: -0.8829 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 98548 : out of range
Severe: rms_fgdepar=576.1263, expected range: 0.0000 146.6268
AUTOMATIC LAND SYNOP RH2M (%) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=58.0000, expected range: 108.2481 137.3074
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) UAST : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=706.3705, expected range: 203.9713 1378.4256
Severely_persistent: rms_fgdepar=706.3705, expected range: 203.9713 1378.4256
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) A8SI6 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8024, expected range: -0.4470 0.7500
SHIP SURFACE PRESSURE (PA) TBWUK31 : out of range
Severe: rms_fgdepar=378.1390, expected range: 0.0000 171.9763
Severe: avg_pge=0.8424, expected range: -0.7460 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V7021 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-549.0719, expected range: -1089.4911 1.8540
Severe: rms_fgdepar=549.0719, expected range: 0.0000 1152.4931
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 3FJP4 : out of range
Severe: avg_fgdepar=-1001.2397, expected range: -237.3869 164.7146
Severe: rms_fgdepar=1001.2397, expected range: 0.0000 198.6156
Severe: avg_pge=0.9116, expected range: -0.2590 0.3218
BUFR SHIP SYNOP SURFACE PRESSURE (PA) D5ZQ6 : out of range
Severe: avg_pge=0.8174, expected range: -1.0836 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V8838 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=379.4623, expected range: 0.0000 176.5247
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 9V2171 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=20.6354, expected range: -13.7689 28.1753
Severe: rms_fgdepar=20.6354, expected range: 0.0000 28.3581
Severe: avg_pge=0.9224, expected range: -0.8860 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 9HA2006 : out of range
Severe: rms_fgdepar=19.7615, expected range: 0.0000 6.9728
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) UERK : out of range
Severe: rms_fgdepar=15.4829, expected range: 0.0000 10.1214
Severe: avg_pge=0.8824, expected range: -1.1233 0.7500
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 4600001 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=20.2166, expected range: -2.6224 20.3944
Severely_persistent: rms_fgdepar=20.2548, expected range: 0.0000 21.7647
Severely_persistent: avg_pge=0.9398, expected range: 0.2985 0.7500
MOORED BUOYS WIND VECTOR DIFF (M/S) 4600073 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=23.6169, expected range: -14.5199 31.9602
Severely_persistent: rms_fgdepar=23.6547, expected range: 0.0000 32.9866
Severely_persistent: avg_pge=0.9466, expected range: 0.1012 0.7500
MOORED BUOYS WIND VECTOR DIFF (M/S) 3200315 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8886, expected range: -1.0262 0.7500
MOORED BUOYS WIND VECTOR DIFF (M/S) 2200107 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8593, expected range: 0.4361 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4701740 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8059, expected range: -1.3437 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4801636 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=548.1806, expected range: -1934.0111 2038.6944
Severely_persistent: rms_fgdepar=550.0267, expected range: 0.0000 1010.0659
Severely_persistent: avg_pge=0.8780, expected range: 0.0363 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6203719 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-680.0114, expected range: -2131.3176 1833.8884
Severely_persistent: rms_fgdepar=683.9844, expected range: 0.0000 1257.3267
Severely_persistent: avg_pge=0.9132, expected range: -0.9020 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6301564 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=407.3920, expected range: 0.0000 188.9975
DRIFTING BUOYS SURFACE PRESSURE (PA) 2501719 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=310.6926, expected range: 0.0000 165.1254
metar
AUTOMATIC METAR SURFACE PRESSURE (PA) KQFW : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-501.2154, expected range: -578.7474 -472.5376
Severely_persistent: rms_fgdepar=504.1733, expected range: 472.7481 581.1609
METAR SURFACE PRESSURE (PA) SCTE : out of range
Severe: rms_fgdepar=311.1663, expected range: 0.0000 89.2627
METAR SURFACE PRESSURE (PA) SBUR : out of range
Severe: rms_fgdepar=319.6054, expected range: 0.0000 179.9584
METAR SURFACE PRESSURE (PA) RJAW : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=607.5267, expected range: 0.0000 80.4162
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.7296, expected range: -19.0318 -5.5390
Severely_persistent: rms_fgdepar=13.7685, expected range: 5.9689 18.9290
BUFR LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
21 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.7060, expected range: -19.0256 -5.6009
Severely_persistent: rms_fgdepar=13.7441, expected range: 6.0029 18.9373
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 03896 : out of range
Severe: avg_fgdepar=-15.0486, expected range: -2.0969 0.9617
Severe: rms_fgdepar=15.0486, expected range: 0.0000 1.9391
METAR 2M TEMPERATURE (K) LTCB : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=13.6541, expected range: 0.0445 14.1823
Severe: rms_fgdepar=13.7889, expected range: 1.4663 13.8824
METAR 2M TEMPERATURE (K) ENHK : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.5307, expected range: 0.0000 5.4345
METAR 2M TEMPERATURE (K) EDGS : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.7883, expected range: 0.2374 2.8904
BUFR LAND SYNOP 2M TEMPERATURE (K) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=47863.0000, expected range: 71578.6506 77574.7244
Considerable: obs_number=87.0000, expected range: 118.5831 167.0419
Considerable: obs_number=202.0000, expected range: 227.7212 271.9259
rh2m
MANUAL LAND SYNOP RH2M (%) 72250 : out of range
Severe: rms_fgdepar=31.4998, expected range: 0.0000 15.7735
BUFR LAND SYNOP RH2M (%) : out of range
Considerable: obs_number=27636.0000, expected range: 39308.1739 50571.2011