Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-09-24 12:00

airs
AQUA AIRS RADIANCES CHANNEL 128 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0179, expected range: -0.1055 -0.1007
AQUA AIRS RADIANCES CHANNEL 129 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1284, expected range: -0.1899 -0.1793
AQUA AIRS RADIANCES CHANNEL 138 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1206, expected range: -0.3077 -0.1068
atms
NPP ATMS RADIANCES CHANNEL 9 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.5813, expected range: -0.4580 -0.4051
ssmis
DMSP-17 SSMIS RADIANCES CHANNEL 17 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-2.5678, expected range: -2.9894 -2.8491
gpsro
SPIRE LEMUR 3U GPSRO SETTING HEIGHT 2-4 KM : out of range
Slight: stdev_norm_fgdepar=0.8689, expected range: 0.6749 0.8153
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1010-1011 (HPA) : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-3.9694, expected range: -3.3301 -3.2938
NOAA-19 SBUV OZONE, TOP (21 pressure layers affected) : out of range
19 times in the last 10 days for at least one item
Severely_persistent: obs_number=8.0000, expected range: 51.2578 68.4026
Radiosondes
LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=7.2474, expected range: -0.9235 12.0625
Severely_persistent: rms_fgdepar=7.2474, expected range: 0.0000 12.1064
All HIGH RESO SEA TEMP ALL LAYERS Alantic Tropical are : all data missing
Severely_persistent: obs_number=0, expected range: 60.20 311.00
All BUFR TEMP DESCENT ALL LAYERS Alantic Tropical are : all data missing
Severely_persistent: obs_number=0, expected range: 79.75 104.25
LAND TEMP WIND VECTOR DIFF (M/S) 20744 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=17.3890, expected range: 0.0000 6.6082
LAND TEMP WIND VECTOR DIFF (M/S) 20744 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_pge=0.8140, expected range: -1.3595 0.7500
LAND TEMP WIND VECTOR DIFF (M/S) 37259 PRESSURE LAYER 900-1200 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=17.6691, expected range: 0.0000 15.7838
Severe: avg_pge=0.8810, expected range: -0.4893 0.7500
LAND TEMP TEMPERATURE (K) 20744 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=8.1327, expected range: 0.0000 2.9789
Severe: avg_pge=0.8919, expected range: -0.2648 0.4197
LAND TEMP TEMPERATURE (K) 82026 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=7.8356, expected range: 0.8293 2.2135
All LAND TEMP ALL LAYERS WMO BLOCK 17 : all data missing
Severe: obs_number=0, expected range: 19.29 285.17
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 53915 (2 pressure layers af : out of range
Severe: rms_fgdepar=18.3748, expected range: 0.1404 5.2726
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) (2 pressure layers affected : out of range
1 times in the last 10 days for at least one item
Severe: obs_number=185.0000, expected range: 83.7109 100.7891
HIGH RESO SEA TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: obs_number=51.0000, expected range: 150.6459 169.3541
All HIGH RESO SEA TEMP ALL LAYERS South Atlantic : all data missing
Severe: obs_number=0, expected range: 148.96 169.37
All BUFR TEMP DESCENT ALL LAYERS North Atlantic : all data missing
Severe: obs_number=0, expected range: 0.00 285.64
All BUFR TEMP DESCENT ALL LAYERS Tropics : all data missing
Severe: obs_number=0, expected range: 82.99 100.51
All BUFR TEMP DESCENT ALL LAYERS South Atlantic : all data missing
Severe: obs_number=0, expected range: 81.34 101.99
LAND TEMP WIND VECTOR DIFF (M/S) (3 pressure layers affected) : out of range
Considerable: obs_number=1023.0000, expected range: 261.2315 434.0185
LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
Considerable: obs_number=54.0000, expected range: 3.0958 13.0465
HIGH RESO LAND TEMP TEMPERATURE (K) (4 pressure layers affected) : out of range
Considerable: obs_number=913.0000, expected range: 395.0230 505.7270
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU1722 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=29.0012, expected range: -13.0632 33.3743
Severe: rms_fgdepar=31.2141, expected range: 0.0000 36.6043
Severe: avg_pge=0.8422, expected range: -1.0077 0.7500
ADS-C WIND VECTOR DIFF (M/S) SRAHMGBA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=20.2595, expected range: 0.0000 31.4182
ADS-C WIND VECTOR DIFF (M/S) Y5FYCOBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.1444, expected range: 0.1965 7.2671
ADS-C WIND VECTOR DIFF (M/S) YHHJNAJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.2744, expected range: 0.0000 10.3549
ADS-C WIND VECTOR DIFF (M/S) JR2XLNJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.8765, expected range: 0.0000 9.5620
ADS-C WIND VECTOR DIFF (M/S) FAKJG2RA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.9937, expected range: 0.0000 9.6056
ADS-C WIND VECTOR DIFF (M/S) A3SKLBRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.4968, expected range: 0.0000 8.4977
ADS-C WIND VECTOR DIFF (M/S) JUEBTRRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=27.3009, expected range: 0.0510 7.2670
ADS-C WIND VECTOR DIFF (M/S) VQOUIJZA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=27.1323, expected range: 0.0000 8.3966
ADS-C WIND VECTOR DIFF (M/S) WSRSVRZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=27.7901, expected range: 0.0000 23.2299
airep
AIREP WIND VECTOR DIFF (M/S) AIC911 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=21.3101, expected range: -3.3701 12.6561
Severe: rms_fgdepar=21.3101, expected range: 0.0000 15.5158
Severe: avg_pge=0.8374, expected range: -0.8527 0.7500
AIREP WIND VECTOR DIFF (M/S) VIR41R PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=21.3778, expected range: 0.0000 21.2627
prof
All EUROPEAN WIND PROFILER ALL LAYERS South West Pacific : all data missing
Severe: obs_number=0, expected range: 98.09 836.16
All EUROPEAN WIND PROFILER ALL LAYERS West pacific Tropica : all data missing
Severe: obs_number=0, expected range: 98.09 836.16
synop
BUFR LAND SYNOP SURFACE PRESSURE (PA) 34254 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=508.4586, expected range: 0.0000 340.6459
Severely_persistent: avg_pge=0.8668, expected range: -1.2875 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71588 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-500.1554, expected range: -564.1392 -289.6082
Severely_persistent: rms_fgdepar=528.0601, expected range: 375.6215 614.0572
Severely_persistent: avg_pge=0.8818, expected range: 0.5029 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 68939 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8591, expected range: 0.5392 0.7500
MANUAL LAND SYNOP Z (M) 38734 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=243.7528, expected range: 0.0000 183.0889
Severe: avg_pge=0.9710, expected range: -0.0171 0.0207
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40022 : out of range
Severe: avg_fgdepar=-634.4010, expected range: -253.4715 122.0976
Severe: rms_fgdepar=635.1026, expected range: 0.0000 261.5155
Severe: avg_pge=0.9092, expected range: -0.6730 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 76573 : out of range
Severe: rms_fgdepar=307.9709, expected range: 0.0000 95.9315
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 80234 : out of range
Severe: avg_fgdepar=508.1321, expected range: 104.0879 441.7850
Severe: rms_fgdepar=547.9322, expected range: 121.6894 442.1036
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83499 : out of range
Severe: rms_fgdepar=386.7021, expected range: 73.2941 146.0356
Severe: avg_pge=0.8438, expected range: -0.6056 0.7500
MANUAL LAND SYNOP RH2M (%) 72302 : out of range
Severe: rms_fgdepar=30.7027, expected range: 0.0000 16.1450
MANUAL LAND SYNOP RH2M (%) 41697 : out of range
Severe: avg_pge=0.9738, expected range: -0.7897 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 73030 : out of range
Severe: rms_fgdepar=335.4596, expected range: 0.0000 105.8193
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71180 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=386.4196, expected range: 0.0000 194.1707
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71412 : out of range
Severe: rms_fgdepar=304.8824, expected range: 22.1003 72.2191
BUFR LAND SYNOP SURFACE PRESSURE (PA) 76662 : out of range
Severe: avg_pge=0.8084, expected range: -0.3079 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71403 : out of range
Severe: rms_fgdepar=339.3848, expected range: 0.0000 62.5233
Severe: avg_pge=0.8020, expected range: -0.3269 0.4162
BUFR LAND SYNOP SURFACE PRESSURE (PA) 73023 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=540.7489, expected range: 0.0000 136.6025
BUFR LAND SYNOP SURFACE PRESSURE (PA) 81833 : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=399.9610, expected range: 272.4850 392.1720
Severe: avg_pge=0.8001, expected range: 0.7535 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24725 : out of range
Severe: rms_fgdepar=464.0356, expected range: 0.0000 74.8581
BUFR LAND SYNOP SURFACE PRESSURE (PA) 20046 : out of range
Severe: rms_fgdepar=549.0155, expected range: 0.0000 129.2279
BUFR LAND SYNOP SURFACE PRESSURE (PA) 28867 : out of range
Severe: rms_fgdepar=345.4780, expected range: 0.0000 112.4967
BUFR LAND SYNOP SURFACE PRESSURE (PA) 33187 : out of range
Severe: rms_fgdepar=316.0435, expected range: 0.0000 85.6244
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71408 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=389.7610, expected range: 52.1168 242.5957
Severe: avg_pge=0.8939, expected range: 0.3759 0.7500
BUFR LAND SYNOP RH2M (%) 72255 : out of range
Severe: rms_fgdepar=38.3167, expected range: 0.0000 19.8345
BUFR LAND SYNOP RH2M (%) _1705DC6 : out of range
Severe: rms_fgdepar=30.6109, expected range: 1.8323 16.6874
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRRD7 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=669.6940, expected range: 225.0833 1146.4707
Severely_persistent: rms_fgdepar=669.6940, expected range: 223.9111 1152.8970
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA4048 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1103.2104, expected range: 395.6433 1410.6965
Severely_persistent: rms_fgdepar=1109.2341, expected range: 409.3383 1402.7441
BUFR SHIP SYNOP SURFACE PRESSURE (PA) VABC : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=1029.6806, expected range: -1716.1142 2335.9760
Severely_persistent: rms_fgdepar=1039.0096, expected range: 0.0000 1874.6258
Severely_persistent: avg_pge=0.8950, expected range: -0.8787 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7A5552 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=924.9072, expected range: 643.6050 1223.5486
Severe: rms_fgdepar=924.9072, expected range: 648.5186 1226.0986
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V3933 : out of range
Severe: rms_fgdepar=437.3159, expected range: 0.0000 368.0370
Severe: avg_pge=0.8047, expected range: -1.1003 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7OJ5 : out of range
Severe: avg_fgdepar=-1221.0087, expected range: -592.1889 426.8567
Severe: rms_fgdepar=1221.0087, expected range: 0.0000 458.8257
Severe: avg_pge=0.9289, expected range: -1.1186 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) MERFR17 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=528.7580, expected range: -306.6822 226.0700
Severe: rms_fgdepar=549.1763, expected range: 0.0000 248.8814
Severe: avg_pge=0.8739, expected range: -0.8017 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7A2668 : out of range
Severe: avg_fgdepar=564.8333, expected range: -743.9929 906.6078
Severe: rms_fgdepar=564.8333, expected range: 0.0000 532.6517
Severe: avg_pge=0.8226, expected range: -0.9644 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) RCLKYXB : out of range
Severe: rms_fgdepar=542.9394, expected range: 0.0000 318.7555
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WUSD : out of range
Severe: rms_fgdepar=396.7301, expected range: 0.0000 143.6423
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) V7OJ5 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=16.6929, expected range: 0.0000 13.8266
Severe: avg_pge=0.8896, expected range: -0.9972 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) H3VS : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=15.7274, expected range: 0.0000 8.2888
Severe: avg_pge=0.8980, expected range: -1.1755 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 6501670 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8718, expected range: -0.7840 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 3301611 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8506, expected range: -1.0061 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 2302614 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8136, expected range: -1.1857 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4101849 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=534.0965, expected range: -857.5251 1214.1383
Severely_persistent: avg_pge=0.8165, expected range: -1.5396 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4802600 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=384.5706, expected range: 0.0000 118.9816
metar
METAR SURFACE PRESSURE (PA) HTMH : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=881.7474, expected range: 708.9839 971.5158
Severe: rms_fgdepar=881.7474, expected range: 709.1463 971.8375
METAR SURFACE PRESSURE (PA) SKFL : out of range
Severe: rms_fgdepar=404.5495, expected range: 0.0000 123.9045
METAR SURFACE PRESSURE (PA) SKYP : out of range
Severe: rms_fgdepar=469.3267, expected range: 0.0000 208.6095
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-760.8124, expected range: -793.6888 -763.6032
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=761.3214, expected range: 763.6023 793.7131
BUFR LAND SYNOP SNOW (CM) _MF12FF7 : out of range
30 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=51.0000, expected range: 41.2670 60.9790
BUFR LAND SYNOP SNOW (CM) _MF12FF7 : out of range
30 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=51.2152, expected range: 42.9300 60.2698
BUFR LAND SYNOP SNOW (CM) _MI1F9AC : out of range
27 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=50.3125, expected range: 43.1013 63.1746
BUFR LAND SYNOP SNOW (CM) _MI1F9AC : out of range
27 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=51.6218, expected range: 43.7023 64.1722
t2m
METAR 2M TEMPERATURE (K) KTLH : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.8267, expected range: -27.4986 9.0636
Severely_persistent: rms_fgdepar=14.7592, expected range: 0.0000 23.3955
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
28 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.6988, expected range: -22.9138 -6.3370
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
28 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=13.6990, expected range: 6.3813 22.9750
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71052 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-14.1134, expected range: -14.5401 -5.0092
Severe: rms_fgdepar=15.1371, expected range: 4.9963 14.5638
METAR 2M TEMPERATURE (K) GCXO : out of range
Severe: avg_fgdepar=-12.6304, expected range: -2.7147 1.7166
Severe: rms_fgdepar=16.9210, expected range: 0.0000 4.1117
LAND TEMP 2M TEMPERATURE (K) 61052 : out of range
Severe: rms_fgdepar=12.4796, expected range: 0.0000 14.4471
BUFR LAND SYNOP 2M TEMPERATURE (K) 71052 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-15.1488, expected range: -13.2018 -5.4946
Severe: rms_fgdepar=16.1608, expected range: 5.3223 13.9813
LAND TEMP 2M TEMPERATURE (K) : out of range
Considerable: obs_number=110.0000, expected range: 55.2775 68.6048
rh2m
All AUTOMATIC LAND SYNOP WMO BLOCK 17 : all data missing
Severely_persistent: obs_number=0, expected range: 318.89 1531.04
All AUTOMATIC LAND SYNOP WMO BLOCK 18 : all data missing
Severely_persistent: obs_number=0, expected range: 224.75 1122.04