Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-11-04 00:00

AMSUA Pacific RARS
All NOAA-18 AMSUA ALL SKY CHANNELS Global : all data missing
Severe: obs_number=0, expected range: 725.61 803.39
All NOAA-19 AMSUA ALL SKY CHANNELS Global : all data missing
Severe: obs_number=0, expected range: 229.12 1497.39
airs
AQUA AIRS RADIANCES CHANNEL 1012 : out of range
Considerable: stdev_fgdepar=0.3123, expected range: 0.3833 0.4954
Atmospheric Motion Vector
All HIMAWARI-8 AMV CLOUDY WV3 ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 133.57 888.75
All AQUA MODIS CLEAR WV ALL LAYERS Global : all data missing
Severe: obs_number=0, expected range: 587.11 1906.89
GOES-16 AMV IR1 WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : out of range
Slight: stdev_press=63.4161, expected range: 73.1357 91.6236
resat
All NOAA-19 SBUV ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 512.04 562.67
Radiosondes
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_pge=0.8163, expected range: -1.0824 0.7500
LAND TEMP TEMPERATURE (K) 21946 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=8.3623, expected range: 0.0000 2.2320
LAND TEMP TEMPERATURE (K) 47122 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=6.0120, expected range: 0.0716 2.9402
LAND TEMP TEMPERATURE (K) 97014 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=8.1254, expected range: 0.0000 2.2698
HIGH RESO LAND TEMP Q (G/KG) 76595 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=2.4782, expected range: 0.0000 0.4304
HIGH RESO LAND TEMP Q (G/KG) 91285 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=2.1849, expected range: 0.0000 0.8637
HIGH RESO LAND TEMP Q (G/KG) 16622 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.8249, expected range: 0.0000 1.5468
HIGH RESO LAND TEMP TEMPERATURE (K) 72558 PRESSURE LAYER 900-1200 (HPA : out of range
Severe: rms_fgdepar=6.4442, expected range: 0.0000 1.9411
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 04270 PRESSURE LAYER 900-12 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=20.2056, expected range: -2.0267 6.5817
Severe: rms_fgdepar=20.6828, expected range: 0.0000 7.0141
Severe: avg_pge=0.8823, expected range: -0.7459 0.7500
amdar
WIGOS AMDAR TEMPERATURE (K) CNNKXR PRESSURE LAYER 300-600 (HPA) : out of range
8 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=9.8033, expected range: 0.0000 22.7399
AMDAR TEMPERATURE (K) TAP023 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=6.4318, expected range: 0.0827 0.8693
Severe: avg_pge=0.8063, expected range: 0.0000 0.0000
WIGOS AMDAR WIND VECTOR DIFF (M/S) MX0029 PRESSURE LAYER 900-1200 (HPA : out of range
Severe: rms_fgdepar=16.2694, expected range: 0.0000 12.5930
Severe: avg_pge=0.8127, expected range: -0.7364 0.7500
ADS-C WIND VECTOR DIFF (M/S) 4RYAPWRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=37.0861, expected range: 0.0000 17.9401
ADS-C WIND VECTOR DIFF (M/S) FTRH1JZA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=24.2138, expected range: 0.0000 36.3423
ADS-C WIND VECTOR DIFF (M/S) LIFMAAZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.3477, expected range: 0.3722 6.5648
ADS-C WIND VECTOR DIFF (M/S) LO5SVXJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.2002, expected range: 0.0000 11.2751
ADS-C WIND VECTOR DIFF (M/S) OA1CBFJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.0099, expected range: 0.0405 7.2701
ADS-C WIND VECTOR DIFF (M/S) UTQICNBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.6840, expected range: 0.0000 20.1570
airep
AIREP WIND VECTOR DIFF (M/S) AAL48 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=24.0892, expected range: 0.0000 7.8557
AIREP WIND VECTOR DIFF (M/S) AAL722 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=32.6219, expected range: 0.9709 5.0923
AIREP WIND VECTOR DIFF (M/S) AAL754 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.8308, expected range: 0.8968 5.6190
AIREP WIND VECTOR DIFF (M/S) AAL86 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.3060, expected range: 0.8791 6.3009
AIREP WIND VECTOR DIFF (M/S) ACA834 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=24.8655, expected range: 0.6353 6.5724
AIREP WIND VECTOR DIFF (M/S) ACA850 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=28.0024, expected range: 0.0000 22.7542
AIREP WIND VECTOR DIFF (M/S) ACA856 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=34.3181, expected range: 0.0000 8.0283
AIREP WIND VECTOR DIFF (M/S) AMX008 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.6330, expected range: 0.0000 19.5879
AIREP WIND VECTOR DIFF (M/S) BAW81V PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.9645, expected range: 0.3287 6.8070
AIREP WIND VECTOR DIFF (M/S) NBT601 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=23.8919, expected range: -3.4234 9.7329
Severe: rms_fgdepar=31.4811, expected range: 0.0000 10.9942
AIREP WIND VECTOR DIFF (M/S) NBT702 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.5806, expected range: 0.3420 6.9256
AIREP WIND VECTOR DIFF (M/S) UAL82 PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=25.3249, expected range: 0.0000 10.1266
AIREP WIND VECTOR DIFF (M/S) UAL907 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=35.7796, expected range: 0.0000 10.6431
AIREP WIND VECTOR DIFF (M/S) UAL91 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=27.6787, expected range: 0.0000 12.9871
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 48877 PRESSURE LAYER 900-1200 (HPA) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=21.4123, expected range: -12.7352 28.7251
Severely_persistent: rms_fgdepar=21.4123, expected range: 0.0000 29.8273
Severely_persistent: avg_pge=0.9264, expected range: -0.3153 0.7500
synop
BUFR LAND SYNOP SURFACE PRESSURE (PA) _MI126CC : out of range
39 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-557.1150, expected range: -659.0041 -496.4024
Severely_persistent: rms_fgdepar=557.2766, expected range: 496.1759 659.6196
AUTOMATIC LAND SYNOP RH2M (%) 41272 : out of range
Severe: avg_pge=0.8482, expected range: -0.7233 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 16125 : out of range
Severe: rms_fgdepar=659.9334, expected range: 0.0000 164.3556
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42262 : out of range
Severe: rms_fgdepar=425.0359, expected range: 0.0000 162.2324
Severe: avg_pge=0.8768, expected range: -0.2487 0.3017
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42671 : out of range
Severe: rms_fgdepar=593.9434, expected range: 0.0000 57.9097
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 43318 : out of range
Severe: rms_fgdepar=325.7459, expected range: 0.0000 85.1156
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62200 : out of range
Severe: avg_fgdepar=-886.4014, expected range: -338.5470 300.4210
Severe: rms_fgdepar=886.4014, expected range: 0.0000 275.2974
Severe: avg_pge=0.9284, expected range: -0.7694 0.7500
MANUAL LAND SYNOP RH2M (%) 95323 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9165, expected range: -1.3228 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 14537 : out of range
Severe: rms_fgdepar=540.8613, expected range: 0.0000 216.8358
BUFR LAND SYNOP SURFACE PRESSURE (PA) 21813 : out of range
Severe: rms_fgdepar=389.1571, expected range: 0.0000 149.2544
BUFR LAND SYNOP SURFACE PRESSURE (PA) 23847 : out of range
Severe: rms_fgdepar=341.8155, expected range: 0.0000 165.2061
BUFR LAND SYNOP SURFACE PRESSURE (PA) 31102 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=720.3355, expected range: -266.4795 421.5569
Severe: rms_fgdepar=721.7478, expected range: 0.0000 381.3160
Severe: avg_pge=0.8966, expected range: -0.8189 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48413 : out of range
Severe: rms_fgdepar=371.1479, expected range: 0.0000 108.5071
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48914 : out of range
Severe: rms_fgdepar=523.6816, expected range: 0.0000 182.2076
BUFR LAND SYNOP SURFACE PRESSURE (PA) 76548 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8131, expected range: -1.3659 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 93498 : out of range
Severe: avg_pge=0.8495, expected range: -1.2382 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 94981 : out of range
Severe: avg_fgdepar=-858.2371, expected range: -100.0086 63.9587
Severe: rms_fgdepar=858.2371, expected range: 0.0000 100.0086
Severe: avg_pge=0.9402, expected range: 0.0000 0.0000
BUFR LAND SYNOP RH2M (%) 08571 : out of range
Severe: avg_pge=0.9873, expected range: -0.0226 0.0335
BUFR LAND SYNOP RH2M (%) 17060 : out of range
Severe: rms_fgdepar=49.4341, expected range: 0.0000 35.7004
Severe: avg_pge=0.9988, expected range: -0.0060 0.0135
BUFR LAND SYNOP RH2M (%) 17350 : out of range
Severe: rms_fgdepar=49.5934, expected range: -17.6591 25.7666
Severe: avg_pge=0.9545, expected range: -0.0962 0.1199
BUFR LAND SYNOP RH2M (%) 23656 : out of range
Severe: rms_fgdepar=34.0284, expected range: 0.0000 18.4966
BUFR LAND SYNOP RH2M (%) 30504 : out of range
Severe: avg_fgdepar=50.2141, expected range: -21.9935 57.4172
Severe: rms_fgdepar=50.2627, expected range: 0.0000 55.2864
BUFR LAND SYNOP RH2M (%) 33236 : out of range
Severe: rms_fgdepar=42.0078, expected range: -23.4731 33.3156
Severe: avg_pge=0.9396, expected range: -0.0127 0.0201
BUFR LAND SYNOP RH2M (%) 95323 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9746, expected range: -1.4761 0.7500
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) YBBQ2 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8617, expected range: -0.3332 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) YXK7JYM : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=22.0189, expected range: -13.9174 35.2488
Severely_persistent: rms_fgdepar=22.0189, expected range: 0.0000 34.6698
Severely_persistent: avg_pge=0.9187, expected range: -0.7022 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA3777 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=979.6088, expected range: 818.5181 1211.1255
Severely_persistent: rms_fgdepar=979.6088, expected range: 818.5181 1211.1255
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OUIY2 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-638.0574, expected range: -927.2306 -201.1402
Severely_persistent: rms_fgdepar=638.0574, expected range: 200.8794 931.0735
BUFR SHIP SYNOP SURFACE PRESSURE (PA) SKEC : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8365, expected range: -1.2683 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 7KJS : out of range
Severe: rms_fgdepar=393.6889, expected range: 0.0000 144.3488
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA4455 : out of range
Severe: rms_fgdepar=377.4549, expected range: 0.0000 178.5390
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HXD9 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=317.7790, expected range: 0.0000 155.3426
BUFR SHIP SYNOP SURFACE PRESSURE (PA) DFPG2 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8223, expected range: 0.2380 0.7500
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 4600080 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=23.8617, expected range: -26.5635 35.3578
Severely_persistent: rms_fgdepar=23.8641, expected range: -26.6262 36.1751
Severely_persistent: avg_pge=0.9489, expected range: -0.8687 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4802597 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=586.5361, expected range: -814.5536 962.5012
Severely_persistent: rms_fgdepar=586.7475, expected range: -695.7101 926.4308
Severely_persistent: avg_pge=0.8922, expected range: -1.2402 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 2101836 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=521.8196, expected range: -389.0072 348.9280
Severe: rms_fgdepar=538.1390, expected range: 0.0000 490.2669
Severe: avg_pge=0.8798, expected range: -1.1848 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6301846 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-750.9133, expected range: -588.9329 517.3849
Severe: rms_fgdepar=758.6774, expected range: 0.0000 662.0374
Severe: avg_pge=0.9170, expected range: -1.2140 0.7500
metar
METAR SURFACE PRESSURE (PA) EQAY : out of range
Severe: rms_fgdepar=461.6339, expected range: 0.0000 407.6154
Severe: avg_pge=0.8068, expected range: -0.7149 0.7500
METAR SURFACE PRESSURE (PA) GMAT : out of range
Severe: rms_fgdepar=533.5428, expected range: 0.0000 322.8462
METAR SURFACE PRESSURE (PA) LIQW : out of range
Severe: avg_fgdepar=-589.4262, expected range: -432.0670 474.3775
Severe: rms_fgdepar=761.3094, expected range: -579.7029 745.8711
METAR SURFACE PRESSURE (PA) LRCT : out of range
Severe: avg_fgdepar=569.2828, expected range: -121.1283 193.4761
Severe: rms_fgdepar=638.9419, expected range: 0.0000 162.1810
METAR SURFACE PRESSURE (PA) MHLM : out of range
Severe: rms_fgdepar=305.2236, expected range: 0.0000 113.6648
AUTOMATIC METAR SURFACE PRESSURE (PA) KSLN : out of range
Severe: rms_fgdepar=319.8185, expected range: 0.0000 168.2604
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-788.2086, expected range: -781.9688 -765.2684
Severely_persistent: rms_fgdepar=788.2097, expected range: 765.5250 781.7885
MANUAL LAND SYNOP SNOW (CM) 29367 : out of range
Severe: rms_fgdepar=22.7373, expected range: 0.0000 3.9898
BUFR LAND SYNOP SNOW (CM) _MF1378B : out of range
Severe: rms_fgdepar=25.0644, expected range: 4.4235 8.9772
BUFR LAND SYNOP SNOW (CM) _MF1B2B2 : out of range
Severe: rms_fgdepar=15.5216, expected range: 0.0000 1.9661
BUFR LAND SYNOP SNOW (CM) _MI12EE6 : out of range
Severe: rms_fgdepar=16.5089, expected range: 0.5834 6.0898
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71052 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-19.6691, expected range: -23.1167 -8.0932
Severely_persistent: rms_fgdepar=19.6691, expected range: 8.2074 23.1147
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71506 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.0057, expected range: -15.1417 1.9353
Severely_persistent: rms_fgdepar=13.0420, expected range: 0.0000 15.1793
METAR 2M TEMPERATURE (K) KTLH : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.3217, expected range: -16.8771 -5.1620
Severely_persistent: rms_fgdepar=12.3217, expected range: 6.3012 16.9811
BUFR LAND SYNOP 2M TEMPERATURE (K) 71052 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-19.7174, expected range: -22.6877 -8.6739
Severely_persistent: rms_fgdepar=19.7181, expected range: 8.7804 22.7055
BUFR LAND SYNOP 2M TEMPERATURE (K) 71506 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.7186, expected range: -14.8453 1.7931
Severely_persistent: rms_fgdepar=12.7560, expected range: 0.0000 14.9218
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1D122 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=12.0769, expected range: 4.5920 18.3714
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 68926 : out of range
Severe: avg_fgdepar=-18.7190, expected range: -3.2550 2.8512
Severe: rms_fgdepar=18.7190, expected range: 0.0000 3.3411
MANUAL LAND SYNOP 2M TEMPERATURE (K) 25335 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.2919, expected range: 0.0000 8.4217
METAR 2M TEMPERATURE (K) EGOS : out of range
Severe: rms_fgdepar=14.0468, expected range: 0.0669 2.1333
METAR 2M TEMPERATURE (K) SCJO : out of range
Severe: avg_fgdepar=12.6981, expected range: -3.3410 8.9886
Severe: rms_fgdepar=12.6981, expected range: 0.0000 9.2589
BUFR LAND SYNOP 2M TEMPERATURE (K) 25335 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.3718, expected range: 0.0000 8.5240
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13804 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-17.5536, expected range: 8.9868 25.2113
Severe: rms_fgdepar=17.5536, expected range: 9.5927 24.8835
rh2m
MANUAL LAND SYNOP RH2M (%) 83064 : out of range
Severe: rms_fgdepar=32.2004, expected range: 0.0000 18.0995