Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-11-21 00:00

amsua
NOAA 18 AMSUA ALL SKY RADIANCES CHANNEL 13 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.6537, expected range: 0.5474 0.5997
NOAA 18 AMSUA ALL SKY RADIANCES CHANNEL 14 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.6613, expected range: 0.5300 0.5821
NOAA 19 AMSUA ALL SKY RADIANCES CHANNEL 14 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.6664, expected range: 0.5271 0.6011
METOP-B AMSUA ALL SKY RADIANCES CHANNEL 14 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.6608, expected range: 0.5089 0.5829
METOP-C AMSUA ALL SKY RADIANCES CHANNEL 14 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.6294, expected range: 0.4876 0.5438
NOAA 15 AMSUA ALL SKY RADIANCES CHANNEL 5 : out of range
Slight: stdev_norm_fgdepar=0.9154, expected range: 0.8028 0.8912
iasi
METOP-C IASI RADIANCES (11 channels affected) : out of range
Considerable: stdev_fgdepar=0.6042, expected range: 0.2867 0.4893
cris
NOAA20 CRIS RADIANCES CHANNEL 618 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0630, expected range: -0.1196 -0.1022
NOAA20 CRIS RADIANCES CHANNEL 653 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0898, expected range: 0.0114 0.0438
airs
AQUA AIRS RADIANCES CHANNEL 139 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0342, expected range: -0.0697 -0.0539
AQUA AIRS RADIANCES CHANNEL 144 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1357, expected range: -0.1875 -0.1622
AQUA AIRS RADIANCES CHANNEL 227 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0369, expected range: 0.0097 0.0244
AQUA AIRS RADIANCES CHANNEL 1868 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.4333, expected range: 0.3499 0.3844
atms
NPP ATMS RADIANCES CHANNEL 14 : out of range
26 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1160, expected range: -0.0825 -0.0407
Severely_persistent: avg_biascorr=-0.0004, expected range: -0.1627 -0.0734
Severely_persistent: stdev_fgdepar=0.5070, expected range: 0.4156 0.4489
NPP ATMS RADIANCES CHANNEL 13 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0752, expected range: -0.3223 -0.2593
NPP ATMS RADIANCES CHANNEL 12 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1430, expected range: -0.3653 -0.2905
NPP ATMS RADIANCES CHANNEL 15 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=0.8980, expected range: 0.6420 0.7315
Severely_persistent: stdev_fgdepar=0.8431, expected range: 0.5847 0.7198
NOAA20 ATMS RADIANCES CHANNEL 14 : out of range
28 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=0.4596, expected range: 0.3742 0.3991
Severely_persistent: stdev_fgdepar=0.4334, expected range: 0.3172 0.3819
NOAA20 ATMS RADIANCES CHANNEL 15 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=0.8255, expected range: 0.6472 0.6636
Severely_persistent: stdev_fgdepar=0.8264, expected range: 0.5058 0.6480
NOAA20 ATMS RADIANCES (5 channels affected) : out of range
1 times in the last 10 days for at least one item
Severe: avg_biascorr=-0.1871, expected range: -0.4455 -0.3590
ssmis
DMSP-17 SSMIS RADIANCES CHANNEL 5 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.0042, expected range: 0.0035 0.0037
Atmospheric Motion Vector
METOP-B AMV IR WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : out of range
Considerable: obs_number=570.0000, expected range: 177.1321 421.4306
Geostationary CSR
HIMAWARI-8 AHI RADIANCES CHANNEL 2 : out of range
Considerable: obs_number=11128.0000, expected range: 12128.3459 14683.6541
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 100-101 (HPA) : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.0032, expected range: 0.0128 0.0297
Radiosondes
All LAND TEMP ALL LAYERS WMO BLOCK 12 : all data missing
Severely_persistent: obs_number=0, expected range: 33.20 153.92
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 30 : all data missing
Severely_persistent: obs_number=0, expected range: 29.29 262.88
BUFR TEMP DESCENT TEMPERATURE (K) PRESSURE LAYER 900-1200 (HPA) : missing
5 times in the last 10 days for at least one item
Severely_persistent: obs_number=0.0000, expected range: 0.0000 540.4876
LAND TEMP TEMPERATURE (K) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_pge=0.8138, expected range: -0.8431 0.7500
LAND TEMP WIND VECTOR DIFF (M/S) 32389 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_fgdepar=21.1443, expected range: -1.6115 7.5163
LAND TEMP WIND VECTOR DIFF (M/S) 32389 (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8002, expected range: -0.3399 0.4512
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 57447 PRESSURE LAYER 0-300 : out of range
Severe: avg_fgdepar=33.8511, expected range: 1.6663 3.3199
Severe: avg_pge=0.8885, expected range: -0.0465 0.0742
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 57447 (3 pressure layers af : out of range
Severe: rms_fgdepar=34.3122, expected range: 1.8880 3.8586
HIGH RESO LAND TEMP Q (G/KG) 94578 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.7428, expected range: 0.0000 1.9302
LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : out of range
Considerable: rms_fgdepar=10.0543, expected range: 1.1613 6.9561
amdar
MODE-S WIND VECTOR DIFF (M/S) MCD49FD PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.9355, expected range: 0.0000 5.9015
ADS-C WIND VECTOR DIFF (M/S) BRNUU1BA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=26.5016, expected range: 0.0000 9.5276
ADS-C WIND VECTOR DIFF (M/S) VAYCOOBA PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=22.1695, expected range: 0.0000 41.9745
ADS-C WIND VECTOR DIFF (M/S) UKUGD2RA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=20.6862, expected range: -2.5925 11.6752
Severe: rms_fgdepar=20.6862, expected range: 0.0000 13.2866
ADS-C WIND VECTOR DIFF (M/S) UMV0J5RA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=20.4744, expected range: 0.0000 34.8379
ADS-C WIND VECTOR DIFF (M/S) BKHUQAZA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=19.5728, expected range: 0.0000 10.0213
airep
AIREP WIND VECTOR DIFF (M/S) UAL944 PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=31.1859, expected range: 0.0000 47.9968
AIREP WIND VECTOR DIFF (M/S) UAL435 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=20.1141, expected range: -3.2649 9.3186
Severe: rms_fgdepar=32.2654, expected range: 0.0000 9.1747
AIREP WIND VECTOR DIFF (M/S) LOT45 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.9339, expected range: 0.0000 23.0271
AIREP WIND VECTOR DIFF (M/S) ETD47N PRESSURE LAYER 0-300 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=20.4747, expected range: 0.0000 73.0769
AIREP WIND VECTOR DIFF (M/S) BAW24R PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=25.5350, expected range: 0.0000 53.3553
AIREP WIND VECTOR DIFF (M/S) QTR34X PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.5984, expected range: 0.0000 9.9867
synop
AUTOMATIC LAND SYNOP RH2M (%) 38345 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=50.7418, expected range: 10.1220 58.6920
Severely_persistent: rms_fgdepar=50.7418, expected range: 10.1220 58.6920
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 97284 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8109, expected range: -0.4245 0.7500
BUFR LAND SYNOP RH2M (%) 94422 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9976, expected range: -1.4222 0.7500
MANUAL LAND SYNOP RH2M (%) 17350 : out of range
Severe: avg_pge=0.9834, expected range: -0.3078 0.4226
MANUAL LAND SYNOP RH2M (%) 38202 : out of range
Severe: avg_fgdepar=51.9362, expected range: -23.3360 32.6910
Severe: rms_fgdepar=51.9491, expected range: 0.0000 27.9636
MANUAL LAND SYNOP RH2M (%) 38203 : out of range
Severe: rms_fgdepar=36.9112, expected range: 0.0000 18.0732
MANUAL LAND SYNOP RH2M (%) 42026 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=50.3422, expected range: -13.5035 77.4254
Severe: rms_fgdepar=50.3422, expected range: 0.0000 77.4254
Severe: avg_pge=0.9103, expected range: -0.8320 0.7500
MANUAL LAND SYNOP RH2M (%) 38836 : out of range
Severe: avg_fgdepar=58.7481, expected range: -48.2058 68.7962
Severe: rms_fgdepar=58.7481, expected range: 0.0000 63.9934
Severe: avg_pge=0.9792, expected range: -0.1288 0.1661
BUFR LAND SYNOP RH2M (%) 94622 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9979, expected range: -1.2857 0.7500
BUFR LAND SYNOP RH2M (%) 95626 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8830, expected range: -1.5796 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 31561 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=813.9961, expected range: -269.7985 230.1267
Severe: rms_fgdepar=814.1511, expected range: 0.0000 197.0649
Severe: avg_pge=0.9299, expected range: 0.0000 0.0000
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24737 : out of range
Severe: rms_fgdepar=489.8960, expected range: 0.0000 187.2287
MANUAL LAND SYNOP RH2M (%) : out of range
Considerable: rms_fgdepar=25.3119, expected range: 8.8395 18.6460
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) SJA4RSK : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8382, expected range: -1.8762 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WDG8082 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8477, expected range: -1.2055 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WMPP : out of range
Severe: rms_fgdepar=341.3154, expected range: 0.0000 177.4337
BUFR SHIP SYNOP SURFACE PRESSURE (PA) MWAQ : out of range
Severe: rms_fgdepar=339.5710, expected range: 3.3476 63.9020
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) KISI : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.9041, expected range: -1.3430 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) AVQU : out of range
Severe: rms_fgdepar=16.0350, expected range: 0.0000 11.6185
Severe: avg_pge=0.8822, expected range: -0.8379 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) : out of range
2 times in the last 10 days for at least one item
Considerable: rms_fgdepar=198.1176, expected range: 57.9155 149.8669
Considerable: obs_number=164.0000, expected range: 211.1775 240.9475
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 6203607 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-782.6608, expected range: -835.8383 740.1505
Severely_persistent: rms_fgdepar=784.1001, expected range: -747.1540 996.5290
Severely_persistent: avg_pge=0.9307, expected range: -1.5447 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4802552 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8334, expected range: -0.9499 0.7500
metar
METAR SURFACE PRESSURE (PA) GOGK : out of range
Severe: rms_fgdepar=340.6739, expected range: 0.0000 174.7891
METAR SURFACE PRESSURE (PA) LOXZ : out of range
Severe: rms_fgdepar=451.2814, expected range: 0.0000 195.2057
snow
MANUAL LAND SYNOP SNOW (CM) 30815 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=76.9294, expected range: 21.9373 92.1324
Severely_persistent: rms_fgdepar=76.9294, expected range: 21.9373 92.1324
MANUAL LAND SYNOP SNOW (CM) 11138 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-64.0956, expected range: -73.2379 -62.9109
Severely_persistent: rms_fgdepar=64.0956, expected range: 62.9109 73.2379
BUFR LAND SYNOP SNOW (CM) 47005 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=98.7078, expected range: -103.4232 138.3211
Severely_persistent: rms_fgdepar=98.7078, expected range: -100.5163 137.7566
BUFR LAND SYNOP SNOW (CM) 30815 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=76.9419, expected range: 21.8120 92.2026
Severely_persistent: rms_fgdepar=76.9419, expected range: 21.8120 92.2026
BUFR LAND SYNOP SNOW (CM) _MI1BD27 : out of range
22 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-56.2565, expected range: -88.8385 -12.8441
BUFR LAND SYNOP SNOW (CM) _MI1BD27 : out of range
22 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=56.2816, expected range: 12.8889 88.9022
MANUAL LAND SYNOP SNOW (CM) 23708 : out of range
Severe: rms_fgdepar=15.9735, expected range: 0.0000 6.9070
ROCOB TEMP SNOW (CM) 63307785 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=17.6708, expected range: 0.0000 2.7292
BUFR LAND SYNOP SNOW (CM) 01058 : out of range
Severe: rms_fgdepar=17.1001, expected range: 0.0000 3.0258
t2m
BUFR LAND SYNOP 2M TEMPERATURE (K) 04112 : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-16.0415, expected range: -17.8556 -11.3486
Severely_persistent: rms_fgdepar=16.1485, expected range: 11.5726 17.9406
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1FF92 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=13.0749, expected range: 4.9157 14.6874
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1FF92 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=13.2640, expected range: 5.1125 14.7817
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 68182 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=14.8956, expected range: -9.6737 11.6739
Severe: rms_fgdepar=14.8979, expected range: -7.1262 11.9222
MANUAL LAND SYNOP 2M TEMPERATURE (K) 38932 : out of range
Severe: avg_fgdepar=-12.0808, expected range: -5.6019 4.3990
Severe: rms_fgdepar=12.0817, expected range: 0.0000 5.9601
MANUAL LAND SYNOP 2M TEMPERATURE (K) 36796 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-17.3124, expected range: -12.0108 6.7104
Severe: rms_fgdepar=17.3689, expected range: 0.0000 10.8934
MANUAL LAND SYNOP 2M TEMPERATURE (K) 36897 : out of range
Severe: avg_fgdepar=-15.0421, expected range: -15.5996 11.5034
Severe: rms_fgdepar=15.4490, expected range: 0.0000 11.5590
MANUAL LAND SYNOP 2M TEMPERATURE (K) 36879 : out of range
Severe: avg_fgdepar=12.6144, expected range: -5.1042 11.7058
Severe: rms_fgdepar=12.6165, expected range: 0.0000 11.3216
METAR 2M TEMPERATURE (K) LIMA : out of range
Severe: rms_fgdepar=11.4168, expected range: 0.0000 3.7812
METAR 2M TEMPERATURE (K) LEVD : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=11.4516, expected range: 0.4270 4.1260
BUFR LAND SYNOP 2M TEMPERATURE (K) 36796 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-17.3624, expected range: -12.0608 6.6604
Severe: rms_fgdepar=17.4188, expected range: 0.0000 11.0113
BUFR LAND SYNOP 2M TEMPERATURE (K) 36879 : out of range
Severe: avg_fgdepar=12.5644, expected range: -5.1542 11.6558
Severe: rms_fgdepar=12.5665, expected range: 0.0000 11.2508
rh2m
MANUAL LAND SYNOP RH2M (%) 29842 : out of range
Severe: rms_fgdepar=35.4471, expected range: 0.0000 20.1235
BUFR LAND SYNOP RH2M (%) _MI1F070 : out of range
Severe: rms_fgdepar=34.8131, expected range: 0.0000 16.3889
BUFR LAND SYNOP RH2M (%) _MI160C0 : out of range
Severe: rms_fgdepar=30.5895, expected range: 0.0000 16.3072
BUFR LAND SYNOP RH2M (%) _MI141A1 : out of range
Severe: rms_fgdepar=30.9130, expected range: 0.0000 14.0061
BUFR LAND SYNOP RH2M (%) _MI1BCF6 : out of range
Severe: rms_fgdepar=34.2927, expected range: 0.0000 19.0673