Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-09-23 00:00

gpsro
COSMIC2-E6 GPSRO SETTING HEIGHT 18-20 KM : out of range
Considerable: obs_number=1641.0000, expected range: 1872.4075 2773.8425
COSMIC2-E6 GPSRO SETTING (11 impact heights affected) : out of range
Considerable: obs_number=1461.0000, expected range: 1742.8602 2715.6398
COSMIC2-E1 GPSRO SETTING HEIGHT 16-18 KM : out of range
Slight: avg_norm_fgdepar=0.1617, expected range: -0.1435 0.0687
COSMIC2-E1 GPSRO RISING HEIGHT 38-40 KM : out of range
Slight: stdev_norm_fgdepar=0.7266, expected range: 0.5083 0.6749
COSMIC2-E1 GPSRO RISING HEIGHT 44-46 KM : out of range
Slight: stdev_norm_fgdepar=0.6230, expected range: 0.2693 0.5222
COSMIC2-E1 GPSRO RISING HEIGHT 46-48 KM : out of range
Slight: stdev_norm_fgdepar=0.5809, expected range: 0.2324 0.4784
Radiosondes
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 88 : all data missing
Severe: obs_number=0, expected range: 98.31 162.44
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 40 : all data missing
Severe: obs_number=0, expected range: 70.29 117.37
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=50.0000, expected range: 120.9745 160.5255
Considerable: obs_number=50.0000, expected range: 120.9745 160.5255
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=566.0000, expected range: 620.5395 697.7105
amdar
ADS-C WIND VECTOR DIFF (M/S) ENVEDQBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=21.4220, expected range: 0.0000 17.4525
ADS-C WIND VECTOR DIFF (M/S) 3FOEDQRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=19.4242, expected range: 0.0000 10.1115
prof
All EUROPEAN WIND PROFILER ALL LAYERS South West Pacific : all data missing
Severe: obs_number=0, expected range: 77.52 703.73
All EUROPEAN WIND PROFILER ALL LAYERS West pacific Tropica : all data missing
Severe: obs_number=0, expected range: 77.52 703.73
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=330.0000, expected range: 589.1091 817.6409
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 64450 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=15.9727, expected range: 0.3661 5.5995
synop
MANUAL LAND SYNOP RH2M (%) 63210 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=1.0000, expected range: -1.8311 0.7500
MANUAL LAND SYNOP RH2M (%) 76402 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9164, expected range: -1.8963 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71366 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8198, expected range: -1.4159 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 86648 : out of range
35 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=869.2021, expected range: 392.1466 1062.4728
Severely_persistent: avg_pge=0.9127, expected range: 0.5489 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) _MI11C99 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8591, expected range: 0.6268 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 68839 : out of range
Severe: avg_fgdepar=55.2188, expected range: -21.4085 18.0332
Severe: rms_fgdepar=55.2188, expected range: 0.0000 17.3940
Severe: avg_pge=0.9969, expected range: -0.0367 0.0479
MANUAL LAND SYNOP Z (M) 68032 : out of range
Severe: rms_fgdepar=324.9033, expected range: 0.0000 182.7896
MANUAL LAND SYNOP RH2M (%) 35001 : out of range
Severe: rms_fgdepar=36.1846, expected range: 0.0000 19.5294
MANUAL LAND SYNOP RH2M (%) 62014 : out of range
Severe: rms_fgdepar=33.8812, expected range: 1.8440 15.7793
MANUAL LAND SYNOP RH2M (%) 40305 : out of range
Severe: avg_pge=0.8604, expected range: -1.7033 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 31102 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=586.3249, expected range: 0.0000 250.8614
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 37792 : out of range
Severe: avg_fgdepar=521.2502, expected range: -0.0878 151.0422
Severe: rms_fgdepar=728.7934, expected range: 7.2535 148.0543
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83235 : out of range
Severe: avg_fgdepar=582.0469, expected range: -73.7904 -3.1411
Severe: rms_fgdepar=582.0469, expected range: 3.1411 73.7904
Severe: avg_pge=0.8999, expected range: 0.0000 0.0000
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 31285 : out of range
Severe: rms_fgdepar=527.4489, expected range: 0.0000 324.5670
BUFR LAND SYNOP Z (M) 06798 : out of range
Severe: rms_fgdepar=119.0194, expected range: 1.4010 63.6740
BUFR LAND SYNOP RH2M (%) 06750 : out of range
Severe: avg_fgdepar=-50.8810, expected range: -44.9277 27.6914
Severe: rms_fgdepar=51.9377, expected range: 0.0000 40.8083
BUFR LAND SYNOP RH2M (%) 94422 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.9811, expected range: -1.5540 0.7500
BUFR LAND SYNOP RH2M (%) 94444 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9905, expected range: -1.5090 0.7500
BUFR LAND SYNOP RH2M (%) 71284 : out of range
Severe: rms_fgdepar=38.9206, expected range: 0.0000 22.0420
BUFR LAND SYNOP RH2M (%) 08175 : out of range
Severe: rms_fgdepar=36.6413, expected range: 0.0000 16.7030
BUFR LAND SYNOP SURFACE PRESSURE (PA) 13625 : out of range
Severe: avg_pge=0.8558, expected range: -0.9509 0.7500
BUFR LAND SYNOP Z (M) : out of range
Slight: rms_fgdepar=81.8066, expected range: 54.5517 74.8373
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OZSK2 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=830.1797, expected range: -53.0847 1241.2450
Severely_persistent: rms_fgdepar=837.3063, expected range: 0.0000 1258.3177
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V3933 : out of range
Severe: rms_fgdepar=355.1049, expected range: 0.0000 149.0431
BUFR SHIP SYNOP SURFACE PRESSURE (PA) ZCDF4 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=480.3164, expected range: -220.1335 326.1128
Severe: avg_pge=0.8104, expected range: -0.4274 0.4851
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7EQ4 : out of range
Severe: avg_fgdepar=-504.1450, expected range: -935.4302 1067.2930
Severe: rms_fgdepar=504.1450, expected range: 0.0000 889.9078
Severe: avg_pge=0.8153, expected range: -1.1233 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRMR6 : out of range
Severe: avg_fgdepar=-512.7443, expected range: -868.8829 584.5363
Severe: rms_fgdepar=512.7443, expected range: 0.0000 853.1465
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7QS7 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-681.4302, expected range: -870.7782 -475.6006
Severe: rms_fgdepar=681.4302, expected range: 475.4348 853.8819
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6BX9 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-585.7442, expected range: -1589.6779 800.7529
Severe: rms_fgdepar=588.2686, expected range: 0.0000 1602.8214
Severe: avg_pge=0.8418, expected range: -1.4730 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) KSKM : out of range
Severe: avg_fgdepar=600.2928, expected range: -107.8688 299.0784
Severe: rms_fgdepar=600.5116, expected range: 0.0000 311.2651
Severe: avg_pge=0.8269, expected range: -0.8280 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 7KGP : out of range
Severe: avg_fgdepar=-554.6702, expected range: -652.5328 -219.6524
Severe: rms_fgdepar=554.6702, expected range: 219.6524 652.5328
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 2300593 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8155, expected range: -0.5185 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4801753 : out of range
Severe: rms_fgdepar=355.9704, expected range: 0.0000 153.2669
DRIFTING BUOYS SURFACE PRESSURE (PA) 5301635 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=307.5849, expected range: 0.0000 59.8253
DRIFTING BUOYS SURFACE PRESSURE (PA) 6401857 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8060, expected range: -1.6063 0.7500
metar
METAR SURFACE PRESSURE (PA) SBMK : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=317.3339, expected range: 2.3822 72.6845
METAR SURFACE PRESSURE (PA) SLPS : out of range
Severe: avg_fgdepar=606.0003, expected range: -509.7716 440.7911
Severe: rms_fgdepar=606.0003, expected range: 0.0000 386.9673
Severe: avg_pge=0.8262, expected range: -0.6694 0.7500
snow
BUFR LAND SYNOP SNOW (CM) _MI10DB0 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=52.9024, expected range: 48.9023 64.7669
BUFR LAND SYNOP SNOW (CM) _MI10DB0 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=53.5776, expected range: 50.0654 64.7144
BUFR LAND SYNOP SNOW (CM) _MI1B25E : out of range
26 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=54.4733, expected range: 41.5010 67.2373
BUFR LAND SYNOP SNOW (CM) _MI1B25E : out of range
26 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=54.5742, expected range: 42.0445 67.0815
BUFR LAND SYNOP SNOW (CM) _MI16E6F : out of range
28 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=69.0000, expected range: 43.3168 77.1269
BUFR LAND SYNOP SNOW (CM) _MI16E6F : out of range
28 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=69.0000, expected range: 45.1209 76.2180
BUFR LAND SYNOP SNOW (CM) 08940 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=31.5582, expected range: 6.0112 10.7591
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89815 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-18.3761, expected range: -32.4316 7.8590
Severely_persistent: rms_fgdepar=18.3761, expected range: 0.0000 30.7152
METAR 2M TEMPERATURE (K) KMSY : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.7004, expected range: -27.2749 16.6075
Severely_persistent: rms_fgdepar=13.7004, expected range: 0.0000 25.0755
BUFR LAND SYNOP 2M TEMPERATURE (K) 89815 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-18.4307, expected range: -27.4170 3.4966
Severely_persistent: rms_fgdepar=18.4307, expected range: 0.0000 26.5875
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI18ADC : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=12.1279, expected range: 0.0000 14.2870
METAR 2M TEMPERATURE (K) LIMV : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.2486, expected range: 0.0000 4.2838