Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-09-28 12:00

iasi
METOP-C IASI RADIANCES CHANNEL 83 : out of range
Considerable: avg_fgdepar=-0.0430, expected range: -0.0202 0.0253
METOP-B IASI RADIANCES CHANNEL 79 : out of range
6 times in the last 10 days for at least one item
Slight: avg_fgdepar=-0.0111, expected range: -0.0062 0.0131
atms
NPP ATMS RADIANCES CHANNEL 9 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.5465, expected range: -0.4580 -0.4301
NOAA20 ATMS RADIANCES CHANNEL 10 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.4777, expected range: -0.4270 -0.4227
NOAA20 ATMS RADIANCES CHANNEL 8 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.7149, expected range: -0.5950 -0.5937
ssmis
DMSP-17 SSMIS RADIANCES CHANNEL 17 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-2.5201, expected range: -2.9773 -2.8491
DMSP-17 SSMIS RADIANCES CHANNEL 10 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_norm_fgdepar=-0.1383, expected range: -0.1024 -0.0555
DMSP-17 SSMIS RADIANCES CHANNEL 11 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_norm_fgdepar=-0.1764, expected range: -0.1309 -0.0905
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1010-1011 (HPA) : out of range
10 times in the last 10 days for at least one item
Slight: avg_fgdepar=-3.9279, expected range: -3.3301 -3.3301
Radiosondes
All LAND TEMP ALL LAYERS WMO BLOCK 17 : all data missing
Severely_persistent: obs_number=0, expected range: 0.00 258.20
LAND TEMP Q (G/KG) 44292 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.0787, expected range: 0.0000 1.0828
LAND TEMP Q (G/KG) 41217 PRESSURE LAYER 900-1200 (HPA) : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=6.0988, expected range: 0.0000 9.4492
LAND TEMP TEMPERATURE (K) 78988 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=7.8038, expected range: 0.1757 3.0257
LAND TEMP TEMPERATURE (K) 32150 PRESSURE LAYER 300-600 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8965, expected range: -0.9032 0.7500
LAND TEMP WIND VECTOR DIFF (M/S) 30054 PRESSURE LAYER 300-600 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=16.2404, expected range: 0.0000 7.5685
HIGH RESO LAND TEMP TEMPERATURE (K) 93844 PRESSURE LAYER 900-1200 (HPA : out of range
Severe: rms_fgdepar=6.3682, expected range: 0.0000 2.8298
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
Severe: obs_number=465.0000, expected range: 361.8098 376.6902
HIGH RESO LAND TEMP TEMPERATURE (K) PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.7297, expected range: 0.0000 1.8049
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : out of range
Severe: obs_number=546.0000, expected range: 450.8180 459.6820
All HIGH RESO SEA TEMP ALL LAYERS Tropics : all data missing
Severe: obs_number=0, expected range: 148.69 170.98
All HIGH RESO SEA TEMP ALL LAYERS South Atlantic : all data missing
Severe: obs_number=0, expected range: 150.63 167.37
All BUFR TEMP DESCENT ALL LAYERS Tropics : all data missing
Severe: obs_number=0, expected range: 83.63 100.37
All BUFR TEMP DESCENT ALL LAYERS South Atlantic : all data missing
Severe: obs_number=0, expected range: 83.63 100.37
amdar
AMDAR WIND VECTOR DIFF (M/S) THT8 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.2262, expected range: 0.1810 5.5264
TAMDAR WIND VECTOR DIFF (M/S) 00005154 PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=20.2237, expected range: 10.8429 25.1446
Severe: rms_fgdepar=20.4266, expected range: 10.6791 25.5757
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU1722 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_pge=0.8280, expected range: -0.8235 0.7500
WIGOS AMDAR TEMPERATURE (K) EU1722 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_fgdepar=11.1217, expected range: -12.8457 19.1771
Severe: rms_fgdepar=11.1514, expected range: 0.0000 20.3442
Severe: avg_pge=0.8911, expected range: -1.5703 0.7500
WIGOS AMDAR TEMPERATURE (K) EU0868 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=7.0503, expected range: 0.0000 2.3456
MODE-S WIND VECTOR DIFF (M/S) M3A5BE8 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=15.2575, expected range: 0.0000 4.6229
MODE-S WIND VECTOR DIFF (M/S) MAFB9CC PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=17.0530, expected range: 0.0000 5.0000
airep
AIREP WIND VECTOR DIFF (M/S) ETD19G PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.5634, expected range: 0.0000 28.5911
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : missing
5 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 0.0000 1055.4336
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 68392 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8924, expected range: -1.1436 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 36341 : out of range
Severe: rms_fgdepar=35.1497, expected range: 0.0000 14.4652
MANUAL LAND SYNOP Z (M) 68032 : out of range
Severe: rms_fgdepar=257.3893, expected range: 0.0000 136.9781
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 48947 : out of range
Severe: rms_fgdepar=314.1920, expected range: 0.0000 195.3563
Severe: avg_pge=0.8179, expected range: -0.2666 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43318 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=315.6633, expected range: 0.0000 73.2688
MANUAL LAND SYNOP RH2M (%) 42170 : out of range
Severe: avg_pge=0.9994, expected range: -0.1608 0.2144
MANUAL LAND SYNOP RH2M (%) 36498 : out of range
Severe: rms_fgdepar=31.3065, expected range: 0.0000 15.5558
MANUAL LAND SYNOP RH2M (%) 62459 : out of range
Severe: avg_pge=0.9784, expected range: -0.7435 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) : out of range
2 times in the last 10 days for at least one item
Severe: obs_number=2209.0000, expected range: 1726.9639 1782.5916
Severe: obs_number=422.0000, expected range: 264.0745 274.4255
Severe: obs_number=1111.0000, expected range: 514.2222 517.5556
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48033 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-933.9757, expected range: -630.2231 482.3077
Severe: rms_fgdepar=933.9757, expected range: 0.0000 573.9948
Severe: avg_pge=0.9390, expected range: -1.3737 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 36953 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=644.9276, expected range: 0.0000 297.9808
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48385 : out of range
Severe: rms_fgdepar=430.4096, expected range: 0.0000 283.4008
Severe: avg_pge=0.8222, expected range: -0.1497 0.3704
BUFR LAND SYNOP SURFACE PRESSURE (PA) 30957 : out of range
Severe: rms_fgdepar=673.2757, expected range: 0.0000 143.5407
BUFR LAND SYNOP SURFACE PRESSURE (PA) 41859 : out of range
Severe: rms_fgdepar=535.8221, expected range: 0.0000 175.9710
BUFR LAND SYNOP RH2M (%) 36001 : out of range
Severe: rms_fgdepar=35.1551, expected range: 0.0000 13.0412
BUFR LAND SYNOP RH2M (%) 86771 : out of range
Severe: rms_fgdepar=37.7825, expected range: 0.0000 21.0167
BUFR LAND SYNOP RH2M (%) 29802 : out of range
Severe: rms_fgdepar=42.4907, expected range: 0.0000 16.0034
BUFR LAND SYNOP RH2M (%) 35283 : out of range
Severe: rms_fgdepar=30.7135, expected range: 0.0000 12.7538
BUFR LAND SYNOP RH2M (%) 35294 : out of range
Severe: rms_fgdepar=42.4827, expected range: 0.0000 21.6460
BUFR LAND SYNOP RH2M (%) 28775 : out of range
Severe: rms_fgdepar=36.3517, expected range: 0.0000 11.9871
BUFR LAND SYNOP RH2M (%) 29706 : out of range
Severe: rms_fgdepar=36.9101, expected range: 0.0000 17.2699
BUFR LAND SYNOP RH2M (%) 36026 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=30.3085, expected range: 0.0000 16.0704
BUFR LAND SYNOP RH2M (%) 94566 : out of range
Severe: avg_fgdepar=55.6740, expected range: -32.2355 56.7223
Severe: rms_fgdepar=55.6740, expected range: 0.0000 56.7223
Severe: avg_pge=0.9966, expected range: -0.0233 0.0381
BUFR LAND SYNOP RH2M (%) 28766 : out of range
Severe: rms_fgdepar=31.1848, expected range: 0.0000 12.0128
BUFR LAND SYNOP RH2M (%) 28966 : out of range
Severe: rms_fgdepar=36.9715, expected range: 0.0000 11.3091
BUFR LAND SYNOP RH2M (%) 28786 : out of range
Severe: rms_fgdepar=30.3922, expected range: 0.0000 9.1490
BUFR LAND SYNOP RH2M (%) 28877 : out of range
Severe: rms_fgdepar=46.2050, expected range: 0.0000 17.2434
BUFR LAND SYNOP RH2M (%) 28838 : out of range
Severe: rms_fgdepar=38.8055, expected range: 0.0000 15.7822
BUFR LAND SYNOP RH2M (%) 35188 : out of range
Severe: rms_fgdepar=37.4490, expected range: 0.0000 11.6466
BUFR LAND SYNOP RH2M (%) 94619 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=57.6085, expected range: -51.1218 98.7375
Severe: rms_fgdepar=57.6085, expected range: 0.0000 98.7375
Severe: avg_pge=0.9970, expected range: -0.8999 0.7500
BUFR LAND SYNOP RH2M (%) 35179 : out of range
Severe: rms_fgdepar=47.1766, expected range: 0.0000 12.7348
BUFR LAND SYNOP RH2M (%) 28879 : out of range
Severe: rms_fgdepar=39.1987, expected range: 0.0000 13.2777
MANUAL LAND SYNOP SURFACE PRESSURE (PA) : out of range
Considerable: obs_number=90.0000, expected range: 30.4950 41.7550
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA4048 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=933.5016, expected range: -1366.4492 2704.7344
Severely_persistent: rms_fgdepar=933.5016, expected range: 0.0000 2590.8815
Severely_persistent: avg_pge=0.8940, expected range: -1.3281 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) KIAB : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=856.0848, expected range: 354.3809 926.0450
Severely_persistent: rms_fgdepar=856.0848, expected range: 354.3390 926.1403
BUFR SHIP SYNOP SURFACE PRESSURE (PA) YBBQ2 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=778.8749, expected range: 284.6107 1253.7069
Severe: rms_fgdepar=778.8749, expected range: 245.5884 1306.8076
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7OJ5 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=524.1041, expected range: 0.0000 622.8906
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRJH7 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=542.7265, expected range: 0.0000 1145.0844
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRSJ8 : out of range
Severe: avg_fgdepar=-551.5802, expected range: -664.2839 -491.6340
Severe: rms_fgdepar=551.5802, expected range: 490.0768 667.4203
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 7KIY : out of range
Severe: avg_fgdepar=35.5805, expected range: -0.2485 6.0878
Severe: rms_fgdepar=35.5805, expected range: 0.0000 6.0768
Severe: avg_pge=0.9496, expected range: -0.6188 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 4802594 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=540.1156, expected range: -406.8413 357.6197
Severely_persistent: rms_fgdepar=540.2215, expected range: 0.0000 292.6938
Severely_persistent: avg_pge=0.8934, expected range: -1.0865 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101849 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8536, expected range: -1.0230 0.7500
MOORED BUOYS WIND VECTOR DIFF (M/S) 6100198 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9184, expected range: -0.9185 0.7500
MOORED BUOYS WIND VECTOR DIFF (M/S) : out of range
2 times in the last 10 days for at least one item
Severe: obs_number=326.0000, expected range: 262.9101 273.7566
MOORED BUOYS SURFACE PRESSURE (PA) 4200023 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-905.7547, expected range: -32.1042 88.7353
Severe: rms_fgdepar=960.1086, expected range: 3.2036 77.9291
Severe: avg_pge=0.8728, expected range: -0.1160 0.1716
MOORED BUOYS SURFACE PRESSURE (PA) 4100064 : out of range
Severe: avg_fgdepar=-562.1316, expected range: -138.9179 175.4203
Severe: rms_fgdepar=562.2306, expected range: 7.8637 71.4635
Severe: avg_pge=0.9122, expected range: -0.3321 0.4008
MOORED BUOYS SURFACE PRESSURE (PA) : out of range
Severe: rms_fgdepar=170.1851, expected range: 28.7171 77.7808
DRIFTING BUOYS SURFACE PRESSURE (PA) : out of range
Severe: rms_fgdepar=153.8904, expected range: 32.7910 71.4733
DRIFTING BUOYS SURFACE PRESSURE (PA) 1601735 : out of range
Severe: rms_fgdepar=370.2379, expected range: 0.0000 121.8126
metar
METAR SURFACE PRESSURE (PA) HTMH : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=902.2437, expected range: 598.2556 1141.3031
Severely_persistent: rms_fgdepar=902.2453, expected range: 599.0883 1140.8845
METAR SURFACE PRESSURE (PA) RPMD : out of range
Severe: rms_fgdepar=411.8681, expected range: 0.0000 141.6913
METAR SURFACE PRESSURE (PA) TGPY : out of range
Severe: rms_fgdepar=386.5258, expected range: 0.4195 108.4649
AUTOMATIC METAR SURFACE PRESSURE (PA) KVNC : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=668.0098, expected range: -35.2914 69.0349
Severe: rms_fgdepar=984.7031, expected range: 0.0000 81.8372
AUTOMATIC METAR SURFACE PRESSURE (PA) KSPG : out of range
Severe: rms_fgdepar=302.0850, expected range: 0.0000 127.8116
AUTOMATIC METAR SURFACE PRESSURE (PA) KSRQ : out of range
Severe: rms_fgdepar=671.1547, expected range: 14.5140 132.8670
AUTOMATIC METAR SURFACE PRESSURE (PA) KRSW : out of range
Severe: rms_fgdepar=688.8160, expected range: 0.0000 112.8856
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-776.9897, expected range: -796.5240 -760.7151
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=776.9984, expected range: 761.2061 796.2178
BUFR LAND SYNOP SNOW (CM) _MI1F9AC : out of range
29 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=50.1044, expected range: 41.9187 64.3509
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71052 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.5232, expected range: -17.1079 -4.0308
Severely_persistent: rms_fgdepar=15.5232, expected range: 3.6702 17.7466
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 51777 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.4393, expected range: -19.0613 -7.1123
Severely_persistent: rms_fgdepar=13.4393, expected range: 7.1123 19.0613
BUFR LAND SYNOP 2M TEMPERATURE (K) 71052 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.4665, expected range: -16.9625 -3.9352
Severely_persistent: rms_fgdepar=15.4769, expected range: 3.6785 17.4138
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
26 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-16.4977, expected range: -21.0019 -7.1789
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
26 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=16.5568, expected range: 7.2016 21.0569
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.7813, expected range: -18.6401 -5.2911
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=14.0038, expected range: 5.2743 18.7677
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 51747 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-13.5740, expected range: -22.7197 19.9310
Severe: rms_fgdepar=13.5740, expected range: 0.1771 13.7809
METAR 2M TEMPERATURE (K) UGMS : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=16.0267, expected range: 5.1392 14.7803
Severe: rms_fgdepar=16.0751, expected range: 5.0921 14.9194
LAND TEMP 2M TEMPERATURE (K) 61052 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.3494, expected range: 0.0000 14.5448
rh2m
MANUAL LAND SYNOP RH2M (%) 64454 : out of range
Severe: rms_fgdepar=33.1659, expected range: 0.0000 18.6482