Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-11-17 00:00

AMSUA Pacific RARS
All NOAA-18 AMSUA ALL SKY CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 359.87 1681.12
All NOAA-19 AMSUA ALL SKY CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 114.61 1466.89
gpsro
All KOMPSAT-5 GPSRO SETTING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 258.23 830.27
Atmospheric Motion Vector
All HIMAWARI-8 AMV CLOUDY WV3 ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 256.69 867.14
Radiosondes
LAND TEMP TEMPERATURE (K) 23955 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=9.3048, expected range: 0.0000 3.0155
LAND TEMP Q (G/KG) 83525 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=5.8178, expected range: 0.0000 2.1463
LAND TEMP Q (G/KG) 83779 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.3481, expected range: 0.0000 1.7067
LAND TEMP Q (G/KG) 96253 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=4.5544, expected range: 0.0000 1.8348
HIGH RESO LAND TEMP TEMPERATURE (K) 12425 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=10.5256, expected range: -0.2543 0.8633
Severe: rms_fgdepar=10.7171, expected range: 0.2994 1.4156
Severe: avg_pge=0.8579, expected range: -0.0278 0.0448
amdar
AMDAR WIND VECTOR DIFF (M/S) JP9Z44WZ PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=19.2275, expected range: 0.0000 7.8436
AMDAR WIND VECTOR DIFF (M/S) JP9Z7YY9 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.7739, expected range: 0.0000 5.6530
WIGOS AMDAR WIND VECTOR DIFF (M/S) GSWGUUZA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=19.4054, expected range: 0.0000 7.6734
ADS-C WIND VECTOR DIFF (M/S) 5BJDERJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=26.6055, expected range: 0.0000 15.1902
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 01405 PRESSURE LAYER 600-900 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=23.6007, expected range: 2.1307 6.7268
Severely_persistent: rms_fgdepar=23.7569, expected range: 2.2977 8.3936
Severely_persistent: avg_pge=0.9068, expected range: -0.5219 0.7500
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 01438 PRESSURE LAYER 600-900 : out of range
Severe: avg_fgdepar=21.0061, expected range: -0.2362 5.6654
Severe: rms_fgdepar=21.0061, expected range: 0.0000 6.1376
Severe: avg_pge=0.8883, expected range: -0.3298 0.5393
synop
MANUAL LAND SYNOP RH2M (%) 65125 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9540, expected range: -1.3831 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 63450 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8024, expected range: -1.9410 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 63533 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8379, expected range: -1.5626 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 81797 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=582.8396, expected range: 489.0196 707.3347
Severely_persistent: rms_fgdepar=584.1833, expected range: 489.2364 707.8016
BUFR LAND SYNOP SURFACE PRESSURE (PA) 84825 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-506.3977, expected range: -700.2662 -355.9634
Severely_persistent: rms_fgdepar=506.8910, expected range: 359.0160 699.6560
AUTOMATIC LAND SYNOP RH2M (%) 68102 : out of range
Severe: avg_fgdepar=50.7546, expected range: -42.6535 25.8735
Severe: rms_fgdepar=50.7546, expected range: 0.0000 42.6535
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 89057 : out of range
Severe: rms_fgdepar=422.5002, expected range: 0.0000 306.5054
Severe: avg_pge=0.8848, expected range: -1.1937 0.7500
MANUAL LAND SYNOP RH2M (%) 62120 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.9210, expected range: -0.0091 0.0173
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 35796 : out of range
Severe: rms_fgdepar=373.7982, expected range: 0.0000 135.1086
Severe: avg_pge=0.8585, expected range: 0.0000 0.0000
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 36392 : out of range
Severe: rms_fgdepar=454.5275, expected range: 0.0000 84.6030
Severe: avg_pge=0.8767, expected range: 0.0000 0.0000
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62225 : out of range
Severe: avg_fgdepar=613.3920, expected range: -84.2969 114.5982
Severe: rms_fgdepar=613.3920, expected range: -82.7964 113.6298
Severe: avg_pge=0.9025, expected range: 0.0000 0.0000
BUFR LAND SYNOP RH2M (%) 06747 : out of range
Severe: avg_fgdepar=-50.9358, expected range: -85.4568 47.0667
Severe: rms_fgdepar=50.9508, expected range: 0.0000 84.6738
Severe: avg_pge=0.8521, expected range: -0.3141 0.3814
BUFR LAND SYNOP RH2M (%) 08057 : out of range
Severe: avg_fgdepar=-50.0375, expected range: -45.0191 23.1606
Severe: rms_fgdepar=50.0375, expected range: 0.0000 42.5540
Severe: avg_pge=0.8774, expected range: -0.0170 0.0271
BUFR LAND SYNOP SURFACE PRESSURE (PA) 36819 : out of range
Severe: avg_pge=0.8354, expected range: -0.9720 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48990 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-740.6255, expected range: -2219.3085 1684.9961
Severe: rms_fgdepar=740.6255, expected range: -1574.0376 2146.3629
Severe: avg_pge=0.9489, expected range: -2.1746 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71476 : out of range
Severe: avg_pge=0.8304, expected range: 0.2624 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 76548 : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8230, expected range: -0.5453 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 89057 : out of range
Severe: rms_fgdepar=343.8768, expected range: 0.0000 309.0918
Severe: avg_pge=0.8589, expected range: -0.8078 0.7500
ship
AUTOMATIC SHIP WIND VECTOR DIFF (M/S) 62153 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9080, expected range: -0.6315 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 3FYD4 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=680.6998, expected range: -252.0562 1344.5782
Severely_persistent: rms_fgdepar=680.6998, expected range: 0.0000 1295.6280
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V5027 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-575.2271, expected range: -1825.4130 1172.5826
Severely_persistent: rms_fgdepar=575.2271, expected range: 0.0000 970.3812
Severely_persistent: avg_pge=0.8493, expected range: 0.1701 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) LF5B : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8938, expected range: -0.5108 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) LF4X : out of range
Severe: rms_fgdepar=304.7128, expected range: 0.0000 281.4375
Severe: avg_pge=0.8162, expected range: -1.1127 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) SKEC : out of range
Severe: rms_fgdepar=437.0106, expected range: 0.0000 123.4819
Severe: avg_pge=0.8611, expected range: -0.6944 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7TO3 : out of range
Severe: rms_fgdepar=603.7439, expected range: 0.0000 533.9960
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRFS2 : out of range
Severe: avg_fgdepar=635.5013, expected range: 119.6147 416.0804
Severe: rms_fgdepar=646.3879, expected range: 118.6423 419.1070
Severe: avg_pge=0.8187, expected range: 0.1536 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WDJ3192 : out of range
Severe: rms_fgdepar=578.7517, expected range: 0.0000 157.7227
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 1301612 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8497, expected range: -1.5575 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6501679 : out of range
21 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=527.6218, expected range: -929.4158 1244.4355
Severely_persistent: rms_fgdepar=532.3618, expected range: 0.0000 1191.2232
Severely_persistent: avg_pge=0.8910, expected range: -1.1130 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 2302615 : out of range
Severe: avg_fgdepar=702.6489, expected range: -240.3254 315.5662
Severe: rms_fgdepar=708.5071, expected range: 0.0000 268.1532
Severe: avg_pge=0.9131, expected range: -0.8162 0.7500
metar
METAR SURFACE PRESSURE (PA) LDZD : out of range
Severe: rms_fgdepar=420.7883, expected range: 0.0000 97.6776
METAR SURFACE PRESSURE (PA) LIRL : out of range
Severe: rms_fgdepar=647.8692, expected range: 0.0000 235.5861
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-796.6218, expected range: -802.8610 -771.4563
Severely_persistent: rms_fgdepar=796.6242, expected range: 771.8972 802.5145
BUFR LAND SYNOP SNOW (CM) _MI17AC6 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-75.4480, expected range: -81.5164 -33.4453
Severely_persistent: rms_fgdepar=75.4593, expected range: 33.4725 81.5268
BUFR LAND SYNOP SNOW (CM) _MI1EDCD : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=100.0000, expected range: 100.0000 100.0000
Severely_persistent: rms_fgdepar=100.0000, expected range: 100.0000 100.0000
MANUAL LAND SYNOP SNOW (CM) 29759 : out of range
Severe: rms_fgdepar=17.3479, expected range: 0.0000 5.8252
t2m
MANUAL LAND SYNOP 2M TEMPERATURE (K) 23383 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.5331, expected range: -21.0528 15.1833
Severely_persistent: rms_fgdepar=12.5961, expected range: 0.0000 19.1597
BUFR LAND SYNOP 2M TEMPERATURE (K) 02031 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.1516, expected range: -11.4352 7.6000
Severely_persistent: rms_fgdepar=14.2789, expected range: -6.0018 11.4638
BUFR LAND SYNOP 2M TEMPERATURE (K) 23383 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.3585, expected range: -20.9765 15.1619
Severely_persistent: rms_fgdepar=12.4216, expected range: 0.0000 19.0669
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1D581 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.8796, expected range: -20.1753 -10.0280
Severely_persistent: rms_fgdepar=15.8809, expected range: 9.9892 20.2771
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02031 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-12.9584, expected range: -10.6730 7.2888
Severe: rms_fgdepar=13.0468, expected range: -5.9481 10.9467
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02036 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-15.1761, expected range: -12.3830 10.4313
Severe: rms_fgdepar=15.1808, expected range: -6.0119 11.5270
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02110 : out of range
Severe: rms_fgdepar=10.3749, expected range: 0.0000 4.9863
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02121 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=10.2018, expected range: 0.0000 3.8889
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02245 : out of range
Severe: rms_fgdepar=10.5194, expected range: 0.0000 5.1612
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 02821 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=15.5839, expected range: -5.7646 2.5204
Severe: rms_fgdepar=15.5839, expected range: 0.0000 5.4100
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 54218 : out of range
Severe: avg_fgdepar=12.1059, expected range: -10.8685 16.7008
Severe: rms_fgdepar=12.1059, expected range: 0.0000 14.3723
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 68353 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-17.0761, expected range: -16.2998 10.4224
Severe: rms_fgdepar=17.0761, expected range: -8.7824 16.8903
MANUAL LAND SYNOP 2M TEMPERATURE (K) 28116 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=11.2872, expected range: 0.0000 1.9146
METAR 2M TEMPERATURE (K) ESNV : out of range
Severe: rms_fgdepar=10.5569, expected range: 0.0000 5.7619
LAND TEMP 2M TEMPERATURE (K) 42971 : out of range
Severe: avg_fgdepar=-17.2008, expected range: -0.7607 3.4433
Severe: rms_fgdepar=17.2008, expected range: 0.0000 3.4433
BUFR LAND SYNOP 2M TEMPERATURE (K) 01058 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=12.1531, expected range: 0.0000 3.7950
BUFR LAND SYNOP 2M TEMPERATURE (K) 01064 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=18.5406, expected range: -4.6278 2.6280
Severe: rms_fgdepar=18.5419, expected range: 0.0756 3.4676
BUFR LAND SYNOP 2M TEMPERATURE (K) 02036 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-15.4752, expected range: -12.4334 10.4887
Severe: rms_fgdepar=15.4819, expected range: 0.0000 11.6547
BUFR LAND SYNOP 2M TEMPERATURE (K) 02821 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=18.0214, expected range: -5.0799 2.3234
Severe: rms_fgdepar=18.0590, expected range: 0.0000 4.2822
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1FED7 : out of range
Severe: avg_fgdepar=-12.7895, expected range: -32.9937 45.3192
Severe: rms_fgdepar=12.7895, expected range: 0.0000 29.2801
rh2m
AUTOMATIC LAND SYNOP RH2M (%) 02055 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=34.5412, expected range: 0.0000 14.1773
MANUAL LAND SYNOP RH2M (%) 60285 : out of range
Severe: rms_fgdepar=38.3708, expected range: 0.0000 21.6083
MANUAL LAND SYNOP RH2M (%) 87540 : out of range
Severe: rms_fgdepar=35.0013, expected range: 0.0000 17.8301
BUFR LAND SYNOP RH2M (%) 01058 : out of range
Severe: rms_fgdepar=34.5434, expected range: 0.0000 6.7148
BUFR LAND SYNOP RH2M (%) 01132 : out of range
Severe: rms_fgdepar=32.0560, expected range: 0.0000 17.6843
BUFR LAND SYNOP RH2M (%) 01143 : out of range
Severe: rms_fgdepar=33.9496, expected range: 0.0000 19.2851