Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2021-11-20 12:00

amsua
NOAA 18 AMSUA ALL SKY RADIANCES CHANNEL 14 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.7004, expected range: 0.5297 0.5821
NOAA 19 AMSUA ALL SKY RADIANCES CHANNEL 14 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.6667, expected range: 0.5398 0.6011
METOP-B AMSUA ALL SKY RADIANCES CHANNEL 14 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.6813, expected range: 0.5344 0.5829
METOP-C AMSUA ALL SKY RADIANCES CHANNEL 13 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.6009, expected range: 0.5152 0.5626
METOP-C AMSUA ALL SKY RADIANCES CHANNEL 14 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.6644, expected range: 0.4862 0.5438
cris
NOAA20 CRIS RADIANCES CHANNEL 618 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0784, expected range: -0.1155 -0.1022
NOAA20 CRIS RADIANCES CHANNEL 653 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0848, expected range: 0.0122 0.0438
airs
AQUA AIRS RADIANCES CHANNEL 210 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0499, expected range: -0.0430 -0.0345
AQUA AIRS RADIANCES CHANNEL 144 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1429, expected range: -0.1873 -0.1622
AQUA AIRS RADIANCES CHANNEL 227 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0417, expected range: 0.0091 0.0244
AQUA AIRS RADIANCES CHANNEL 1471 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.6217, expected range: -0.7731 -0.7046
AQUA AIRS RADIANCES CHANNEL 224 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0246, expected range: -0.0699 -0.0612
atms
NPP ATMS RADIANCES CHANNEL 13 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0948, expected range: -0.3490 -0.2593
NPP ATMS RADIANCES CHANNEL 12 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.1757, expected range: -0.3934 -0.2905
NPP ATMS RADIANCES CHANNEL 14 : out of range
25 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=0.4920, expected range: 0.4242 0.4489
NPP ATMS RADIANCES CHANNEL 15 : out of range
11 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=0.9081, expected range: 0.6555 0.7315
Severely_persistent: stdev_fgdepar=0.8520, expected range: 0.5847 0.7198
NOAA20 ATMS RADIANCES CHANNEL 14 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.3434, expected range: -0.2938 -0.2883
Severely_persistent: stdev_fgdepar=0.4413, expected range: 0.3782 0.3991
Considerable: avg_biascorr=-0.0776, expected range: -0.2167 -0.1301
NOAA20 ATMS RADIANCES CHANNEL 13 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2057, expected range: -0.4781 -0.3590
NOAA20 ATMS RADIANCES CHANNEL 15 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: stdev_fgdepar=0.8325, expected range: 0.6417 0.6636
NOAA20 ATMS RADIANCES CHANNEL 5 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=0.1797, expected range: -0.0458 0.0824
NPP ATMS RADIANCES CHANNEL 6 : out of range
Considerable: obs_number=6787.0000, expected range: 7101.3942 7983.3664
ssmis
DMSP-17 SSMIS RADIANCES CHANNEL 5 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: stdev_norm_fgdepar=0.0041, expected range: 0.0035 0.0037
resat
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 100-101 (HPA) : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-0.0030, expected range: 0.0128 0.0306
NOAA-19 SBUV OZONE, TOP PRESSURE LAYER 1-2 (HPA) : out of range
17 times in the last 10 days for at least one item
Slight: stdev_fgdepar=0.0268, expected range: 0.0113 0.0113
Radiosondes
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 30 : all data missing
Severely_persistent: obs_number=0, expected range: 11.68 310.19
LAND TEMP TEMPERATURE (K) 23330 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=6.2169, expected range: 0.0000 3.5191
LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=3.4452, expected range: 0.9102 2.2771
HIGH RESO LAND TEMP Q (G/KG) 94461 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=2.3641, expected range: 0.0000 1.2597
BUFR TEMP DESCENT Q (G/KG) PRESSURE LAYER 900-1200 (HPA) : missing
4 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 0.0000 505.8559
HIGH RESO LAND TEMP TEMPERATURE (K) (4 pressure layers affected) : out of range
Considerable: obs_number=148.0000, expected range: 275.9324 322.8176
HIGH RESO LAND TEMP Q (G/KG) (2 pressure layers affected) : out of range
3 times in the last 10 days for at least one item
Considerable: obs_number=283.0000, expected range: 357.6195 387.3805
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) U5TWUUZA PRESSURE LAYER 600-900 (HP : out of range
Severe: rms_fgdepar=17.3340, expected range: 0.0000 8.4682
Severe: avg_pge=0.8347, expected range: -0.3408 0.4852
WIGOS AMDAR WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA) : missing
Severe: obs_number=0.0000, expected range: 0.0000 387.3718
ADS-C WIND VECTOR DIFF (M/S) 0DIBA0BA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=24.1742, expected range: 0.0000 31.9163
ADS-C WIND VECTOR DIFF (M/S) N50KMEBA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=23.0423, expected range: 0.0000 14.8532
ADS-C WIND VECTOR DIFF (M/S) 1JI1NGBA PRESSURE LAYER 0-300 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=34.4337, expected range: -12.1099 24.1039
Severe: rms_fgdepar=61.9147, expected range: 0.0000 41.7159
ADS-C WIND VECTOR DIFF (M/S) GN0RPDJA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=26.0823, expected range: 0.0000 12.6143
ADS-C WIND VECTOR DIFF (M/S) BU01OHJA PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=21.0136, expected range: -65.9313 85.9320
ADS-C WIND VECTOR DIFF (M/S) ZHWIG1RA PRESSURE LAYER 0-300 (HPA) : out of range
4 times in the last 10 days for at least one item
Severe: rms_fgdepar=28.3900, expected range: 0.0000 42.2883
ADS-C WIND VECTOR DIFF (M/S) YUEIMERA PRESSURE LAYER 0-300 (HPA) : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=26.1530, expected range: 0.0000 14.3946
ADS-C WIND VECTOR DIFF (M/S) GYOTA4ZA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=17.9138, expected range: 1.2101 6.1268
ADS-C WIND VECTOR DIFF (M/S) OQGDSDZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=20.2768, expected range: 0.0000 25.7197
ADS-C WIND VECTOR DIFF (M/S) YCYVSMZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=28.8252, expected range: 0.0000 10.4323
ADS-C WIND VECTOR DIFF (M/S) 1FDI0NZA PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=23.5919, expected range: -2.6244 13.8173
Severe: rms_fgdepar=37.9059, expected range: 0.0000 20.0841
airep
AIREP WIND VECTOR DIFF (M/S) VIR7B PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=34.6290, expected range: 0.0000 25.3956
synop
AUTOMATIC LAND SYNOP RH2M (%) 68182 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-50.6252, expected range: -30.2569 32.8290
Severely_persistent: rms_fgdepar=50.6709, expected range: 0.0000 20.7792
Severely_persistent: avg_pge=0.9999, expected range: -0.0036 0.0119
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 35777 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=538.6581, expected range: -377.8883 277.8967
Severely_persistent: rms_fgdepar=540.6460, expected range: 0.0000 419.8335
Severely_persistent: avg_pge=0.8894, expected range: -1.3286 0.7500
BUFR LAND SYNOP RH2M (%) 94907 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-51.2971, expected range: -142.9019 73.4431
Severely_persistent: rms_fgdepar=51.2971, expected range: 0.0000 108.5254
MANUAL LAND SYNOP RH2M (%) 65361 : out of range
Severe: avg_pge=0.9996, expected range: -0.1672 0.2564
MANUAL LAND SYNOP RH2M (%) 68461 : out of range
Severe: rms_fgdepar=40.2761, expected range: 0.0267 14.0385
MANUAL LAND SYNOP RH2M (%) 67843 : out of range
Severe: rms_fgdepar=45.3200, expected range: 0.0000 12.6874
MANUAL LAND SYNOP RH2M (%) 65545 : out of range
Severe: avg_pge=0.9891, expected range: -0.1821 0.2460
MANUAL LAND SYNOP RH2M (%) 17246 : out of range
Severe: rms_fgdepar=31.3041, expected range: 0.0000 17.1904
MANUAL LAND SYNOP RH2M (%) 42559 : out of range
Severe: avg_pge=0.9608, expected range: -0.0076 0.0164
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 35361 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=680.0637, expected range: -413.6188 343.1328
Severe: rms_fgdepar=684.3652, expected range: -342.0568 475.5191
Severe: avg_pge=0.9102, expected range: -1.0858 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 35234 : out of range
Severe: rms_fgdepar=394.3072, expected range: 0.0000 140.0068
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40605 : out of range
Severe: avg_pge=0.8118, expected range: -1.0171 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 35225 : out of range
Severe: rms_fgdepar=364.1787, expected range: 0.0000 137.1728
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 35325 : out of range
Severe: rms_fgdepar=312.9985, expected range: 0.0000 105.8844
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 35416 : out of range
Severe: rms_fgdepar=354.5876, expected range: 0.0000 139.5438
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 67217 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=341.1639, expected range: 0.0000 63.8442
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 37609 : out of range
Severe: rms_fgdepar=317.5762, expected range: 0.0000 163.9621
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 35229 : out of range
Severe: rms_fgdepar=326.4465, expected range: 0.0000 118.6690
BUFR LAND SYNOP RH2M (%) 71793 : out of range
Severe: avg_fgdepar=50.3973, expected range: -14.8034 50.1799
Severe: rms_fgdepar=50.3973, expected range: 0.0000 50.3790
ship
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA5197 : out of range
22 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=662.8934, expected range: 350.5174 813.1119
Severely_persistent: rms_fgdepar=687.4684, expected range: 347.8268 817.6912
BUFR SHIP SYNOP SURFACE PRESSURE (PA) SJA4RSK : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8534, expected range: -1.8715 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) C6OR4 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=44.3819, expected range: -9.6976 18.0270
Severe: rms_fgdepar=44.3819, expected range: 0.0000 18.0266
Severe: avg_pge=0.9616, expected range: -0.8479 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) VRTO7 : out of range
Severe: rms_fgdepar=15.5468, expected range: 0.0000 7.8704
Severe: avg_pge=0.8923, expected range: -0.8680 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) EUMDE30 : out of range
Severe: rms_fgdepar=341.3883, expected range: 0.0000 106.2903
Severe: avg_pge=0.8430, expected range: -0.0425 0.0523
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V2171 : out of range
Severe: avg_fgdepar=-587.2599, expected range: -154.7032 232.8444
Severe: rms_fgdepar=587.2599, expected range: 0.0000 263.2016
Severe: avg_pge=0.8466, expected range: -0.4874 0.5724
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WDG8082 : out of range
Severe: avg_pge=0.8334, expected range: -1.2052 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) MAOR4 : out of range
Severe: rms_fgdepar=314.2780, expected range: 0.0000 119.8666
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7UU5 : out of range
Severe: avg_fgdepar=649.1393, expected range: 258.0655 658.3249
Severe: rms_fgdepar=649.1393, expected range: 258.0655 658.3249
Severe: avg_pge=0.8373, expected range: -0.0814 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=162.0000, expected range: 204.3326 250.9616
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 4402716 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-514.2809, expected range: -1400.7990 1629.8935
Severely_persistent: rms_fgdepar=514.2809, expected range: 0.0000 997.8484
DRIFTING BUOYS SURFACE PRESSURE (PA) 6203607 : out of range
13 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=564.2344, expected range: -1267.3318 1096.2472
Severely_persistent: rms_fgdepar=580.5290, expected range: -1011.8317 1323.7567
DRIFTING BUOYS SURFACE PRESSURE (PA) 4601599 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8597, expected range: -1.2523 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 3301606 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=438.0197, expected range: 0.0000 74.8364
Severe: avg_pge=0.8834, expected range: -0.0263 0.0316
DRIFTING BUOYS SURFACE PRESSURE (PA) 4401557 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=474.7768, expected range: 0.0000 74.9395
snow
BUFR LAND SYNOP SNOW (CM) 47005 : out of range
6 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=99.2910, expected range: -108.9046 153.6637
Severely_persistent: rms_fgdepar=99.2910, expected range: -105.9911 152.9010
BUFR LAND SYNOP SNOW (CM) _MI1BD27 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-59.5474, expected range: -88.3407 -10.2439
BUFR LAND SYNOP SNOW (CM) _MI1BD27 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=59.5792, expected range: 11.7160 91.1417
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=12.2760, expected range: 0.2178 21.2209
BUFR LAND SYNOP 2M TEMPERATURE (K) 04112 : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-17.7547, expected range: -19.5534 -9.0955
Severely_persistent: rms_fgdepar=17.7852, expected range: 9.7522 19.3711
BUFR LAND SYNOP 2M TEMPERATURE (K) 89578 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.2022, expected range: -21.3253 0.1538
Severely_persistent: rms_fgdepar=12.5133, expected range: 0.2954 21.2668
MANUAL LAND SYNOP 2M TEMPERATURE (K) 36873 : out of range
Severe: avg_fgdepar=12.4515, expected range: -4.0173 7.8498
Severe: rms_fgdepar=12.4603, expected range: 0.0000 7.2875
MANUAL LAND SYNOP 2M TEMPERATURE (K) 25335 : out of range
Severe: rms_fgdepar=11.5160, expected range: 0.6282 6.7988
MANUAL LAND SYNOP 2M TEMPERATURE (K) 30745 : out of range
Severe: rms_fgdepar=10.1164, expected range: 0.0000 5.7305
METAR 2M TEMPERATURE (K) EGGD : out of range
Severe: rms_fgdepar=11.5595, expected range: 0.0000 3.1220
METAR 2M TEMPERATURE (K) SKGI : out of range
Severe: rms_fgdepar=11.3869, expected range: 0.0000 6.3014
BUFR LAND SYNOP 2M TEMPERATURE (K) 36873 : out of range
Severe: avg_fgdepar=12.4015, expected range: -4.0673 7.7998
Severe: rms_fgdepar=12.4103, expected range: 0.0000 7.2329
rh2m
MANUAL LAND SYNOP RH2M (%) 64460 : out of range
Severe: rms_fgdepar=37.3515, expected range: 0.0000 16.1948