Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-05-16 00:00

amsua
NOAA 15 AMSUA ALL SKY RADIANCES CHANNEL 12 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0451, expected range: -0.0745 -0.0695
NOAA 15 AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1017, expected range: 0.1542 0.2088
NOAA 18 AMSUA ALL SKY RADIANCES CHANNEL 7 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.5396, expected range: -0.4709 -0.4268
NOAA 19 AMSUA ALL SKY RADIANCES CHANNEL 9 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2011, expected range: -0.1727 -0.1383
METOP-B AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2221, expected range: 0.3147 0.3621
METOP-C AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2330, expected range: -0.1608 -0.1318
atms
NPP ATMS RADIANCES CHANNEL 14 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0002, expected range: -0.0178 -0.0164
NPP ATMS RADIANCES CHANNEL 11 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2806, expected range: -0.2392 -0.2216
NPP ATMS RADIANCES CHANNEL 12 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.4838, expected range: -0.4307 -0.3779
NPP ATMS RADIANCES CHANNEL 13 : out of range
21 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.4543, expected range: -0.3684 -0.3189
NOAA20 ATMS RADIANCES CHANNEL 20 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2412, expected range: -0.2997 -0.2913
NOAA20 ATMS RADIANCES CHANNEL 22 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.5067, expected range: 0.4465 0.4639
NOAA20 ATMS RADIANCES CHANNEL 18 : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=7225.0000, expected range: 4731.5203 6544.2650
ssmis
DMSP-18 SSMIS RADIANCES CHANNEL 10 : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=8955.0000, expected range: 9734.4316 11244.3184
DMSP-18 SSMIS RADIANCES CHANNEL 11 : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=8968.0000, expected range: 9769.0597 11233.1903
gpsro
TERRASAR-X GPSRO SETTING HEIGHT 36-38 KM : out of range
Severe: stdev_norm_fgdepar=1.6288, expected range: 0.7973 1.2159
COSMIC2-E6 GPSRO RISING HEIGHT 46-48 KM : out of range
Considerable: stdev_norm_fgdepar=0.9684, expected range: 0.4930 0.8096
TERRASAR-X GPSRO SETTING HEIGHT 42-44 KM : out of range
Slight: stdev_norm_fgdepar=1.4074, expected range: 0.6211 1.1954
Atmospheric Motion Vector
HIMAWARI-8 AMV IR1 WIND VECTOR DIFF (M/S) PRESSURE LAYER 900-1200 (HPA : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=303.0000, expected range: 731.5170 1344.6670
Radiosondes
LAND TEMP WIND VECTOR DIFF (M/S) 25403 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.0068, expected range: 0.0000 6.1611
LAND TEMP WIND VECTOR DIFF (M/S) 17196 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.4145, expected range: 0.9060 7.7413
LAND TEMP WIND VECTOR DIFF (M/S) 32540 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=23.0406, expected range: 0.0000 6.6941
LAND TEMP WIND VECTOR DIFF (M/S) 32540 PRESSURE LAYER 900-1200 (HPA) : out of range
3 times in the last 10 days for at least one item
Severe: avg_pge=0.8470, expected range: -0.2358 0.7500
All LAND TEMP ALL LAYERS WMO BLOCK 61 : all data missing
Severe: obs_number=0, expected range: 9.57 323.96
All HIGH RESO LAND TEMP ALL LAYERS WMO BLOCK 78 : all data missing
Severe: obs_number=0, expected range: 98.25 153.46
HIGH RESO LAND TEMP Q (G/KG) (3 pressure layers affected) : out of range
Considerable: obs_number=988.0000, expected range: 757.3368 844.9132
HIGH RESO LAND TEMP TEMPERATURE (K) (3 pressure layers affected) : out of range
Considerable: obs_number=78.0000, expected range: 171.1029 334.8971
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=64.0000, expected range: 113.7550 177.9950
amdar
AMDAR TEMPERATURE (K) CNJCA121 (2 pressure layers affected) : out of range
Severe: avg_fgdepar=10.3383, expected range: -0.5712 0.6138
Severe: rms_fgdepar=10.3383, expected range: 0.0822 1.2821
Severe: avg_pge=0.9329, expected range: -0.0823 0.1501
WIGOS AMDAR TEMPERATURE (K) 0MVKGDBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=9.1285, expected range: 0.0000 2.1921
WIGOS AMDAR WIND VECTOR DIFF (M/S) ENGUNWZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.5661, expected range: 0.0000 8.6357
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU1824 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=15.5642, expected range: 0.0000 5.5895
WIGOS AMDAR WIND VECTOR DIFF (M/S) O5QKXOBA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=15.2832, expected range: 0.0000 6.8144
WIGOS AMDAR WIND VECTOR DIFF (M/S) 3ERG3NZA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=16.3274, expected range: 0.0000 5.4630
AMDAR WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=1394.0000, expected range: 170.3090 960.5660
Considerable: obs_number=649.0000, expected range: 6.9584 421.6666
ADS-C TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=390.0000, expected range: 48.0356 273.8682
airep
AIREP WIND VECTOR DIFF (M/S) WJA1852 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=21.6877, expected range: 0.0000 18.2435
prof
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 94926 PRESSURE LAYER 300-600 : out of range
Severe: rms_fgdepar=17.0976, expected range: 0.0000 11.7525
Severe: avg_pge=0.8223, expected range: -0.8218 0.7500
EUROPEAN WIND PROFILER VECTOR DIFF (M/S) 94907 PRESSURE LAYER 300-600 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=21.2265, expected range: -1.0393 11.4594
Severe: rms_fgdepar=22.6234, expected range: 0.0000 13.3628
Severe: avg_pge=0.8458, expected range: -0.4225 0.7500
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 42452 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_pge=0.8870, expected range: -0.8422 0.7500
synop
MANUAL LAND SYNOP RH2M (%) 42770 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=52.7896, expected range: 1.8090 83.2273
Severely_persistent: rms_fgdepar=52.7896, expected range: 1.8090 83.2273
Severely_persistent: avg_pge=0.9999, expected range: -0.6277 0.7500
MANUAL LAND SYNOP RH2M (%) 42459 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9474, expected range: -1.8892 0.7500
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 89666 : out of range
Severe: avg_pge=0.8552, expected range: -1.0796 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 68821 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=55.4001, expected range: -80.3475 109.2428
Severe: rms_fgdepar=55.4001, expected range: -72.6430 104.3272
Severe: avg_pge=0.9630, expected range: -1.7228 0.7500
AUTOMATIC LAND SYNOP RH2M (%) 68714 : out of range
Severe: rms_fgdepar=34.0341, expected range: 0.0000 10.1884
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 89251 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8361, expected range: -1.0035 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40712 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=534.4757, expected range: 0.0000 163.7665
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 44232 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.8474, expected range: -1.4576 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 91648 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=-1078.8979, expected range: -213.1428 84.4493
Severe: rms_fgdepar=1078.8979, expected range: 0.0000 210.4339
Severe: avg_pge=0.9457, expected range: -1.1848 0.7500
MANUAL LAND SYNOP RH2M (%) 63210 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=50.2296, expected range: -55.9208 92.2484
Severe: rms_fgdepar=50.2296, expected range: 0.0000 85.8128
Severe: avg_pge=0.9995, expected range: -1.9096 0.7500
MANUAL LAND SYNOP RH2M (%) 94661 : out of range
Severe: rms_fgdepar=44.6641, expected range: 0.0000 26.8659
Severe: avg_pge=0.8943, expected range: -0.0106 0.0191
MANUAL LAND SYNOP RH2M (%) 61075 : out of range
Severe: rms_fgdepar=43.3607, expected range: 0.0000 25.3481
Severe: avg_pge=0.9847, expected range: -0.0018 0.0082
MANUAL LAND SYNOP RH2M (%) 41785 : out of range
Severe: rms_fgdepar=49.3247, expected range: 0.0000 44.8498
Severe: avg_pge=1.0000, expected range: -0.0604 0.0931
MANUAL LAND SYNOP RH2M (%) 76848 : out of range
Severe: rms_fgdepar=41.7295, expected range: 0.0000 24.9769
Severe: avg_pge=0.8328, expected range: -0.2022 0.2471
MANUAL LAND SYNOP Z (M) 67663 : out of range
Severe: rms_fgdepar=153.1296, expected range: 17.7651 82.8933
BUFR LAND SYNOP SURFACE PRESSURE (PA) 38201 : out of range
Severe: rms_fgdepar=367.2152, expected range: 0.0000 173.9799
BUFR LAND SYNOP SURFACE PRESSURE (PA) 96751 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-609.0559, expected range: -688.8694 -517.9408
Severe: rms_fgdepar=609.2732, expected range: 517.4573 690.6075
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48391 : out of range
Severe: rms_fgdepar=354.0137, expected range: 0.0000 109.8663
BUFR LAND SYNOP SURFACE PRESSURE (PA) 97072 : out of range
4 times in the last 10 days for at least one item
Severe: avg_fgdepar=-896.4419, expected range: -1104.7484 -669.9363
Severe: rms_fgdepar=897.4143, expected range: 673.7493 1102.9633
BUFR LAND SYNOP SURFACE PRESSURE (PA) 35053 : out of range
Severe: rms_fgdepar=576.6772, expected range: 0.0000 97.1020
BUFR LAND SYNOP SURFACE PRESSURE (PA) 94334 : out of range
Severe: avg_fgdepar=-759.0467, expected range: -110.7659 149.8395
Severe: rms_fgdepar=759.0467, expected range: 0.0000 75.3867
Severe: avg_pge=0.9290, expected range: 0.0000 0.0000
BUFR LAND SYNOP SURFACE PRESSURE (PA) 28877 : out of range
Severe: rms_fgdepar=365.3836, expected range: 0.0000 161.5620
Severe: avg_pge=0.8072, expected range: -0.4824 0.6178
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48018 : out of range
Severe: rms_fgdepar=562.9787, expected range: 0.0000 224.5621
BUFR LAND SYNOP SURFACE PRESSURE (PA) 24538 : out of range
Severe: rms_fgdepar=413.2786, expected range: 0.0000 130.2517
BUFR LAND SYNOP RH2M (%) 94710 : out of range
Severe: avg_pge=0.8545, expected range: -0.0262 0.0386
BUFR LAND SYNOP RH2M (%) 72320 : out of range
Severe: rms_fgdepar=34.4620, expected range: 0.0000 28.8797
Severe: avg_pge=0.9987, expected range: -0.9301 0.7500
BUFR LAND SYNOP RH2M (%) 94661 : out of range
Severe: rms_fgdepar=41.4285, expected range: 0.0000 27.5509
Severe: avg_pge=0.8027, expected range: -0.0064 0.0143
BUFR LAND SYNOP RH2M (%) 71623 : out of range
Severe: rms_fgdepar=30.5285, expected range: 0.0000 14.3045
BUFR LAND SYNOP RH2M (%) 07386 : out of range
Severe: rms_fgdepar=38.1476, expected range: 0.0000 13.7397
BUFR LAND SYNOP RH2M (%) 72217 : out of range
Severe: avg_fgdepar=54.8271, expected range: -20.1095 29.5807
Severe: rms_fgdepar=54.8271, expected range: -42.0805 59.6813
Severe: avg_pge=0.9998, expected range: -0.9526 0.7500
BUFR LAND SYNOP RH2M (%) 96147 : out of range
Severe: avg_pge=0.9704, expected range: -2.2323 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) : out of range
1 times in the last 10 days for at least one item
Considerable: obs_number=121.0000, expected range: 101.7024 110.0476
BUFR LAND SYNOP SURFACE PRESSURE (PA) : out of range
2 times in the last 10 days for at least one item
Considerable: obs_number=1520.0000, expected range: 1769.9350 1909.3983
Considerable: obs_number=2491.0000, expected range: 2764.1167 2985.6333
Considerable: obs_number=103.0000, expected range: 159.5006 184.2494
Considerable: obs_number=441.0000, expected range: 490.5517 555.8927
Considerable: obs_number=1731.0000, expected range: 1958.1131 2139.1369
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) OXAW2 : out of range
Severe: rms_fgdepar=16.6805, expected range: 0.0000 10.7178
Severe: avg_pge=0.8867, expected range: -0.8022 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) TBWUK51 : out of range
3 times in the last 10 days for at least one item
Severe: rms_fgdepar=457.5254, expected range: 0.0000 213.1190
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 2IYH3 : out of range
2 times in the last 10 days for at least one item
Severe: avg_fgdepar=509.1548, expected range: -251.6396 1575.9688
Severe: rms_fgdepar=509.1557, expected range: 0.0000 1624.8862
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V3776 : out of range
Severe: avg_fgdepar=-535.8311, expected range: -48.9302 587.0882
Severe: rms_fgdepar=535.8311, expected range: 0.0000 586.3354
Severe: avg_pge=0.8293, expected range: 0.0932 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6BI7 : out of range
Severe: avg_fgdepar=990.9482, expected range: -420.9876 293.5012
Severe: rms_fgdepar=990.9482, expected range: 0.0000 252.4877
Severe: avg_pge=0.8963, expected range: -0.7703 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6PZ8 : out of range
Severe: avg_fgdepar=-525.0197, expected range: -828.0971 -55.0549
Severe: rms_fgdepar=525.0197, expected range: 55.0549 828.0971
Severe: avg_pge=0.8307, expected range: 0.6283 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) UGYU : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-541.2731, expected range: -850.4689 350.5170
Severe: rms_fgdepar=541.2731, expected range: 0.0000 850.1174
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 5501658 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-710.8433, expected range: -170.8616 186.6038
Severe: rms_fgdepar=723.5248, expected range: 0.0000 148.7930
Severe: avg_pge=0.9049, expected range: -0.1282 0.1696
metar
METAR SURFACE PRESSURE (PA) FTTC : out of range
Severe: rms_fgdepar=469.3165, expected range: 0.0000 206.3471
snow
BUFR LAND SYNOP SNOW (CM) 01361 : out of range
32 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=64.5918, expected range: 40.9157 69.0093
Severely_persistent: rms_fgdepar=64.5919, expected range: 40.9172 69.0160
BUFR LAND SYNOP SNOW (CM) 01003 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-71.3169, expected range: -79.1921 -71.3999
Severely_persistent: rms_fgdepar=71.3169, expected range: 71.3999 79.1921
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-738.0396, expected range: -747.9596 -710.1669
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=738.0405, expected range: 710.1681 747.9596
BUFR LAND SYNOP SNOW (CM) _MI1D545 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=56.0517, expected range: 49.4133 67.0677
BUFR LAND SYNOP SNOW (CM) _MI1D545 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=56.0790, expected range: 49.4251 67.1279
BUFR LAND SYNOP SNOW (CM) _MI161D5 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=55.8740, expected range: 56.3232 82.9690
BUFR LAND SYNOP SNOW (CM) _MI161D5 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=55.9297, expected range: 56.3372 82.9666
BUFR LAND SYNOP SNOW (CM) _MI17AC6 : out of range
28 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=97.9994, expected range: 86.1888 111.7983
BUFR LAND SYNOP SNOW (CM) _MI17AC6 : out of range
28 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=98.0015, expected range: 86.1911 111.8466
BUFR LAND SYNOP SNOW (CM) 01008 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-90.8947, expected range: -94.1388 -87.3486
Severely_persistent: rms_fgdepar=90.8948, expected range: 87.3486 94.1389
BUFR LAND SYNOP SNOW (CM) _MI1F541 : out of range
Severe: avg_fgdepar=53.0870, expected range: 31.8788 49.6522
BUFR LAND SYNOP SNOW (CM) _MI1F541 : out of range
Severe: rms_fgdepar=53.5419, expected range: 32.0367 50.2432
t2m
LAND TEMP 2M TEMPERATURE (K) 65503 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.3865, expected range: -25.3283 8.8686
Severely_persistent: rms_fgdepar=14.4422, expected range: 0.0000 26.0825
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-15.8319, expected range: -32.9454 11.1736
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
14 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=15.8319, expected range: 6.9391 18.7015
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.5262, expected range: -16.7068 -4.3425
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI158E9 : out of range
8 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=13.5262, expected range: 4.7582 16.4648
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 55472 : out of range
Severe: avg_fgdepar=12.0875, expected range: 3.7299 11.8085
Severe: rms_fgdepar=12.0875, expected range: 3.7299 11.8085
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 52836 : out of range
Severe: avg_fgdepar=14.1965, expected range: -13.1583 15.1902
Severe: rms_fgdepar=14.1965, expected range: 0.0000 11.1063
rh2m
BUFR LAND SYNOP RH2M (%) 01220 : out of range
Severe: rms_fgdepar=33.2332, expected range: 0.0000 16.7677