Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-05-13 00:00

amsua
NOAA 15 AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0709, expected range: 0.1542 0.2004
NOAA 18 AMSUA ALL SKY RADIANCES CHANNEL 9 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.5584, expected range: -0.6584 -0.6229
NOAA 18 AMSUA ALL SKY RADIANCES CHANNEL 7 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.5539, expected range: -0.4709 -0.3836
METOP-B AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2186, expected range: 0.3147 0.3333
METOP-B AMSUA ALL SKY RADIANCES CHANNEL 9 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2502, expected range: -0.1314 -0.1102
METOP-C AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2742, expected range: -0.1608 -0.1513
METOP-C AMSUA ALL SKY RADIANCES CHANNEL 9 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.7233, expected range: -0.6370 -0.5965
iasi
METOP-C IASI RADIANCES CHANNEL 113 : out of range
Slight: avg_fgdepar=0.0136, expected range: -0.0162 0.0076
METOP-C IASI RADIANCES CHANNEL 138 : out of range
Slight: avg_fgdepar=0.0179, expected range: -0.0164 0.0085
mhs
NOAA-19 MHS ALLSKY RADIANCES CHANNEL 4 : out of range
Considerable: obs_number=36870.0000, expected range: 41179.5115 52932.8635
atms
NPP ATMS RADIANCES CHANNEL 19 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1484, expected range: -0.2025 -0.1786
NPP ATMS RADIANCES CHANNEL 20 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0211, expected range: -0.0264 -0.0209
NPP ATMS RADIANCES CHANNEL 21 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1838, expected range: 0.1277 0.1371
NPP ATMS RADIANCES CHANNEL 14 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0171, expected range: -0.0384 -0.0164
NPP ATMS RADIANCES CHANNEL 11 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2919, expected range: -0.2392 -0.1889
NPP ATMS RADIANCES CHANNEL 12 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.4946, expected range: -0.4307 -0.3781
NPP ATMS RADIANCES CHANNEL 13 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.4319, expected range: -0.3684 -0.3446
NOAA20 ATMS RADIANCES CHANNEL 22 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.4937, expected range: 0.4317 0.4639
gpsro
COSMIC2-E2 GPSRO SETTING (24 impact heights affected) : out of range
Considerable: obs_number=430.0000, expected range: 1716.8026 2583.1974
Atmospheric Motion Vector
AQUA MODIS CLEAR WV WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA : out of range
5 times in the last 10 days for at least one item
Severely_persistent: obs_number=414.0000, expected range: 194.2210 261.4521
METEOSAT-8 AMV VIS2 WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA : out of range
Considerable: obs_number=1708.0000, expected range: 483.1074 1187.6577
NOAA-15 AVHRR IR WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : out of range
Slight: stdev_fgdepar=2.9011, expected range: 1.1607 2.8875
Geostationary CSR
METEOSAT-8 SEVIRI RADIANCES CHANNEL 3 : out of range
4 times in the last 10 days for at least one item
Considerable: obs_number=23225.0000, expected range: 18628.6203 22236.6297
Radiosondes
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=6.1965, expected range: 0.1298 7.1602
Severely_persistent: rms_fgdepar=6.1965, expected range: 0.1688 7.1720
LAND TEMP TEMPERATURE (K) 96935 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_pge=0.8730, expected range: -0.3239 0.4708
LAND TEMP Q (G/KG) 27730 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.1097, expected range: 0.0000 0.8761
LAND TEMP WIND VECTOR DIFF (M/S) 17095 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=16.9915, expected range: 0.0000 6.4851
LAND TEMP WIND VECTOR DIFF (M/S) 26298 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=15.6084, expected range: 0.0000 7.7621
Severe: avg_pge=0.8919, expected range: -0.9044 0.7500
HIGH RESO LAND TEMP Q (G/KG) 72659 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=2.9621, expected range: 0.0000 1.5197
HIGH RESO LAND TEMP Q (G/KG) 58027 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.2797, expected range: 0.0000 1.7902
HIGH RESO LAND TEMP Q (G/KG) 72649 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=4.7062, expected range: 0.0000 2.3769
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 56492 PRESSURE LAYER 300-60 : out of range
Severe: avg_fgdepar=21.1606, expected range: -0.6042 6.4881
Severe: rms_fgdepar=24.1728, expected range: 0.0000 8.3233
All HIGH RESO SEA TEMP ALL LAYERS North Atlantic : all data missing
Severe: obs_number=0, expected range: 23.71 724.29
All HIGH RESO SEA TEMP ALL LAYERS Global : all data missing
Severe: obs_number=0, expected range: 177.46 774.85
BUFR TEMP DESCENT Q (G/KG) PRESSURE LAYER 900-1200 (HPA) : missing
1 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 814.7953
LAND TEMP TEMPERATURE (K) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: obs_number=61.0000, expected range: 129.1156 257.7732
Considerable: obs_number=560.0000, expected range: 653.8412 787.6588
Considerable: obs_number=120.0000, expected range: 198.7540 289.6905
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=55.0000, expected range: 84.9198 94.8302
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) LJNENXBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=26.6581, expected range: -2.6322 9.2699
Severe: rms_fgdepar=26.6581, expected range: 0.0000 10.5698
WIGOS AMDAR WIND VECTOR DIFF (M/S) WSYICIJA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=17.0532, expected range: 0.0599 5.5753
ADS-C WIND VECTOR DIFF (M/S) VNWI3GJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.9270, expected range: 0.0000 10.4145
ADS-C WIND VECTOR DIFF (M/S) 2CGXUXJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.4785, expected range: 0.0000 8.0697
ADS-C WIND VECTOR DIFF (M/S) WN5UC5RA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=24.3564, expected range: 0.0000 12.4577
ADS-C WIND VECTOR DIFF (M/S) BPZEDQRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.7970, expected range: 0.0000 15.1936
pilot
LAND PILOT WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=109.0000, expected range: 152.9881 228.0119
synop
MANUAL LAND SYNOP RH2M (%) 42770 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8959, expected range: -1.2097 0.7500
MANUAL LAND SYNOP RH2M (%) 41697 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9946, expected range: -1.5709 0.7500
MANUAL LAND SYNOP RH2M (%) 42459 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8491, expected range: -1.9280 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 35331 : out of range
Severe: rms_fgdepar=48.5585, expected range: 0.0000 18.2365
Severe: avg_pge=0.8312, expected range: -0.0474 0.0598
MANUAL LAND SYNOP RH2M (%) 42744 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9999, expected range: -1.4432 0.7500
MANUAL LAND SYNOP RH2M (%) 41715 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=59.3126, expected range: -3.6933 41.7826
Severe: rms_fgdepar=59.3126, expected range: 0.0000 45.1626
Severe: avg_pge=1.0000, expected range: -1.2394 0.7500
MANUAL LAND SYNOP RH2M (%) 42557 : out of range
Severe: avg_pge=0.9166, expected range: -0.4339 0.5679
MANUAL LAND SYNOP Z (M) 38734 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8215, expected range: -1.7768 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42500 : out of range
Severe: rms_fgdepar=527.5163, expected range: 0.0000 129.0046
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40260 : out of range
Severe: rms_fgdepar=383.7451, expected range: 0.0000 280.3984
Severe: avg_pge=0.8451, expected range: -0.3043 0.7500
BUFR LAND SYNOP RH2M (%) 72551 : out of range
Severe: rms_fgdepar=40.8061, expected range: 0.0000 27.8998
Severe: avg_pge=0.9904, expected range: -0.0007 0.0069
BUFR LAND SYNOP RH2M (%) 76412 : out of range
Severe: avg_pge=0.8166, expected range: -0.0084 0.0178
BUFR LAND SYNOP RH2M (%) 71193 : out of range
Severe: avg_fgdepar=57.2650, expected range: -30.4683 27.0033
Severe: rms_fgdepar=57.7914, expected range: 0.0000 22.2060
BUFR LAND SYNOP RH2M (%) 71734 : out of range
Severe: avg_fgdepar=50.2181, expected range: -27.5552 15.3550
Severe: rms_fgdepar=50.2478, expected range: 0.0000 17.9619
Severe: avg_pge=0.9922, expected range: -0.0001 0.0064
BUFR LAND SYNOP RH2M (%) 34394 : out of range
Severe: avg_pge=0.9533, expected range: -0.4567 0.6497
BUFR LAND SYNOP RH2M (%) 25129 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8356, expected range: -1.5764 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 64450 : out of range
Severe: rms_fgdepar=759.4427, expected range: 0.0000 148.0960
BUFR LAND SYNOP SURFACE PRESSURE (PA) 27981 : out of range
Severe: rms_fgdepar=364.9047, expected range: 0.0000 250.9208
Severe: avg_pge=0.8122, expected range: -0.6089 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 76243 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8208, expected range: 0.0527 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 12805 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=464.9432, expected range: 0.0000 77.3542
BUFR LAND SYNOP SURFACE PRESSURE (PA) 61995 : out of range
Severe: rms_fgdepar=676.8557, expected range: 12.8326 160.9753
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33156 : out of range
Severe: rms_fgdepar=303.0970, expected range: 0.0000 97.4874
Severe: avg_pge=0.8374, expected range: -0.1615 0.1833
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 3E2426 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=22.8614, expected range: -21.6290 44.2255
Severely_persistent: rms_fgdepar=23.0663, expected range: 0.0000 46.0718
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRLA2 : out of range
Severe: avg_fgdepar=568.9509, expected range: 217.0942 837.8548
Severe: rms_fgdepar=568.9509, expected range: 217.0942 837.8548
Severe: avg_pge=0.8141, expected range: 0.5009 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 45006 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=301.5650, expected range: 0.0000 121.0620
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V6416 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=524.0085, expected range: 0.0000 472.0934
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRJU8 : out of range
Severe: avg_fgdepar=-504.2122, expected range: -426.0010 396.4240
Severe: rms_fgdepar=504.2122, expected range: 0.0000 282.3049
Severe: avg_pge=0.8253, expected range: -0.7554 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) UGYU : out of range
Severe: avg_fgdepar=-895.4293, expected range: -768.7904 227.4553
Severe: rms_fgdepar=895.4293, expected range: 0.0000 768.7904
Severe: avg_pge=0.9004, expected range: -0.9418 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) WDH7560 : out of range
Severe: avg_pge=0.9005, expected range: 0.0058 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 6CV53CK : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8257, expected range: 0.1130 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 5401536 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8409, expected range: -1.4641 0.7500
metar
METAR SURFACE PRESSURE (PA) FDSK : out of range
Severe: avg_fgdepar=501.5925, expected range: -139.0417 185.4667
Severe: rms_fgdepar=501.5925, expected range: 0.0000 185.9141
Severe: avg_pge=0.8005, expected range: -0.2720 0.3163
METAR SURFACE PRESSURE (PA) FDMS : out of range
Severe: avg_fgdepar=602.5982, expected range: -102.2362 190.0869
Severe: rms_fgdepar=602.5982, expected range: 0.0000 159.4337
Severe: avg_pge=0.8233, expected range: -0.0139 0.0156
AUTOMATIC METAR SURFACE PRESSURE (PA) KD60 : out of range
Severe: rms_fgdepar=348.9410, expected range: 0.0000 191.2433
AUTOMATIC METAR SURFACE PRESSURE (PA) K4R5 : out of range
Severe: rms_fgdepar=322.5627, expected range: 0.0000 165.0525
AUTOMATIC METAR SURFACE PRESSURE (PA) KFOZ : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=333.0496, expected range: 0.0000 109.6385
snow
MANUAL LAND SYNOP SNOW (CM) 30815 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=52.0000, expected range: 35.5724 74.2231
Severely_persistent: rms_fgdepar=52.0000, expected range: 35.5724 74.2231
BUFR LAND SYNOP SNOW (CM) 01361 : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=60.7566, expected range: 44.3941 58.6999
Severely_persistent: rms_fgdepar=60.7657, expected range: 44.3943 58.7042
BUFR LAND SYNOP SNOW (CM) 01003 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-74.1107, expected range: -79.5665 -73.3715
Severely_persistent: rms_fgdepar=74.1107, expected range: 73.3715 79.5665
BUFR LAND SYNOP SNOW (CM) 30815 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=52.0000, expected range: 35.6057 74.2380
Severely_persistent: rms_fgdepar=52.0000, expected range: 35.6057 74.2380
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-737.6018, expected range: -737.1504 -712.5698
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=737.6021, expected range: 712.5724 737.1497
BUFR LAND SYNOP SNOW (CM) 01008 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-88.9020, expected range: -94.2563 -89.4193
Severely_persistent: rms_fgdepar=88.9021, expected range: 89.4194 94.2563
BUFR LAND SYNOP SNOW (CM) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=58.5573, expected range: 208.9948 387.9972
MANUAL LAND SYNOP SNOW (CM) 24724 : out of range
Severe: rms_fgdepar=18.2469, expected range: 0.0000 7.3690
t2m
LAND TEMP 2M TEMPERATURE (K) 65503 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.7638, expected range: -24.1883 8.5099
Severely_persistent: rms_fgdepar=14.8308, expected range: 0.0000 24.2623
BUFR LAND SYNOP 2M TEMPERATURE (K) 78896 : out of range
28 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.4034, expected range: -17.4130 -8.0145
Severely_persistent: rms_fgdepar=14.5610, expected range: 8.0258 17.9270
METAR 2M TEMPERATURE (K) TTPP : out of range
Severe: avg_fgdepar=-14.9413, expected range: -0.1754 2.8516
Severe: rms_fgdepar=14.9996, expected range: 1.0618 2.9043
METAR 2M TEMPERATURE (K) VECX : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.2810, expected range: 4.0495 12.9694
LAND TEMP 2M TEMPERATURE (K) 72558 : out of range
Severe: rms_fgdepar=10.9220, expected range: 0.0000 3.7742
BUFR LAND SYNOP 2M TEMPERATURE (K) : out of range
3 times in the last 10 days for at least one item
Considerable: obs_number=9390.0000, expected range: 11518.0320 13700.2180
Considerable: obs_number=7225.0000, expected range: 9317.0151 11479.2349
Considerable: obs_number=8530.0000, expected range: 10626.5906 12806.6594
rh2m
METAR RH2M (%) TTPP : out of range
Severe: rms_fgdepar=33.1592, expected range: 0.6555 16.2613
BUFR LAND SYNOP RH2M (%) _MI1D8EC : out of range
Severe: rms_fgdepar=39.6487, expected range: 0.0000 19.6222
BUFR LAND SYNOP RH2M (%) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=5181.0000, expected range: 6299.7260 7625.1490
Considerable: obs_number=7328.0000, expected range: 8452.9220 9796.9530
Considerable: obs_number=6492.0000, expected range: 7574.8233 8950.0517