Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-05-08 00:00

amsua
NOAA 15 AMSUA ALL SKY RADIANCES CHANNEL 12 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.0552, expected range: -0.0728 -0.0695
NOAA 15 AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1099, expected range: 0.1542 0.2105
METOP-B AMSUA ALL SKY RADIANCES CHANNEL 7 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.5114, expected range: -0.3936 -0.3883
METOP-B AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.2421, expected range: 0.3147 0.3653
METOP-B AMSUA ALL SKY RADIANCES CHANNEL 9 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2235, expected range: -0.1314 -0.0433
METOP-C AMSUA ALL SKY RADIANCES CHANNEL 7 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-1.0450, expected range: -0.9457 -0.9191
METOP-C AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.2378, expected range: -0.1608 -0.1155
METOP-C AMSUA ALL SKY RADIANCES CHANNEL 9 : out of range
15 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.6957, expected range: -0.6370 -0.5625
iasi
METOP-B IASI RADIANCES (71 channels affected) : out of range
Considerable: obs_number=2502.0000, expected range: 2129.3758 2317.8742
cris
NOAA20 CRIS RADIANCES CHANNEL 75 : out of range
Considerable: avg_fgdepar=-0.0020, expected range: 0.0023 0.0105
atms
NPP ATMS RADIANCES CHANNEL 20 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0097, expected range: -0.0492 -0.0209
NPP ATMS RADIANCES CHANNEL 21 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.1777, expected range: 0.1081 0.1371
NPP ATMS RADIANCES CHANNEL 14 : out of range
16 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=0.0182, expected range: -0.0536 -0.0164
NPP ATMS RADIANCES CHANNEL 13 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_biascorr=-0.4123, expected range: -0.3684 -0.3394
gpsro
COSMIC2-E2 GPSRO RISING HEIGHT 26-28 KM : out of range
2 times in the last 10 days for at least one item
Considerable: stdev_norm_fgdepar=1.3798, expected range: 1.0075 1.2484
Atmospheric Motion Vector
METOP-B AMV IR WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : out of range
3 times in the last 10 days for at least one item
Considerable: obs_number=262.0000, expected range: 125.3802 179.7505
DUAL-METOP AMV IR WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: stdev_press=25.9930, expected range: 18.2077 21.7819
METOP-C AMV IR WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : out of range
Considerable: obs_number=238.0000, expected range: 105.1720 182.0225
resat
All METOP-B GOME-2 ALL LAYERS Global : all data missing
Severe: obs_number=0, expected range: 51270.29 59479.34
Radiosondes
LAND TEMP TEMPERATURE (K) 31004 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_fgdepar=-9.1295, expected range: -1.7773 1.5701
Severe: rms_fgdepar=9.3487, expected range: 0.0000 1.9741
Severe: avg_pge=0.8756, expected range: -0.3133 0.4337
LAND TEMP Q (G/KG) 41316 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=4.0826, expected range: 0.5612 1.8738
LAND TEMP Q (G/KG) 83928 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.4672, expected range: 0.0000 1.9518
LAND TEMP WIND VECTOR DIFF (M/S) 36003 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=22.4502, expected range: -12.3702 26.6001
Severe: rms_fgdepar=28.5392, expected range: 0.0000 31.3230
LAND TEMP WIND VECTOR DIFF (M/S) 29862 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_fgdepar=34.3603, expected range: -0.2106 4.1245
Severe: rms_fgdepar=34.3603, expected range: 0.0000 5.1224
Severe: avg_pge=0.9265, expected range: -0.2023 0.2738
LAND TEMP WIND VECTOR DIFF (M/S) 20292 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=18.2062, expected range: 0.0000 6.0938
Severe: avg_pge=0.9118, expected range: -0.5616 0.7500
HIGH RESO LAND TEMP TEMPERATURE (K) PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=3.0549, expected range: 0.4751 1.5151
Severe: rms_fgdepar=4.0278, expected range: 0.4951 1.3095
HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
Severe: obs_number=471.0000, expected range: 557.8098 572.6902
HIGH RESO LAND TEMP Q (G/KG) 72764 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.6775, expected range: 0.0000 1.7082
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 72318 PRESSURE LAYER 900-12 : out of range
Severe: rms_fgdepar=18.0303, expected range: 0.9068 4.8587
Severe: avg_pge=0.9094, expected range: -0.8275 0.7500
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : missing
2 times in the last 10 days for at least one item
Severe: obs_number=0.0000, expected range: 10.8253 263.4514
All HIGH RESO LAND TEMP ALL LAYERS South pole : all data missing
Severe: obs_number=0, expected range: 0.00 613.56
HIGH RESO LAND TEMP TEMPERATURE (K) (3 pressure layers affected) : out of range
Considerable: obs_number=642.0000, expected range: 779.5201 888.7299
amdar
AMDAR TEMPERATURE (K) 00040323 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=7.4571, expected range: 0.0000 4.1276
Severe: avg_pge=0.8296, expected range: -0.7338 0.7500
AMDAR WIND VECTOR DIFF (M/S) THT2 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=26.0484, expected range: -4.5407 11.4739
Severe: rms_fgdepar=26.0532, expected range: 0.0000 12.1728
Severe: avg_pge=0.8770, expected range: -0.3120 0.3822
ADS-C WIND VECTOR DIFF (M/S) UDGEC5JA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=26.1797, expected range: 0.0000 12.1926
ADS-C WIND VECTOR DIFF (M/S) 0ZZKG5ZA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.2548, expected range: 0.0000 12.2412
WIGOS AMDAR Q (G/KG) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: obs_number=2720.0000, expected range: 4358.3800 6895.3700
airep
AIREP WIND VECTOR DIFF (M/S) VIR355 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.3360, expected range: 0.0000 5.9192
AIREP WIND VECTOR DIFF (M/S) UAL968 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=16.8774, expected range: 0.0000 8.6368
synop
AUTOMATIC LAND SYNOP SURFACE PRESSURE (PA) 41244 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=538.7561, expected range: 0.0000 1746.4167
MANUAL LAND SYNOP RH2M (%) 42473 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9801, expected range: -1.7743 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 71613 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=566.4357, expected range: 0.0000 1700.0653
BUFR LAND SYNOP SURFACE PRESSURE (PA) 23383 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=645.4280, expected range: 0.0000 750.0560
BUFR LAND SYNOP SURFACE PRESSURE (PA) _80779BD : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=725.6803, expected range: 645.1061 806.4065
BUFR LAND SYNOP SURFACE PRESSURE (PA) _80779BD : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=725.9257, expected range: 645.4212 807.0110
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 86490 : out of range
Severe: rms_fgdepar=301.8327, expected range: 0.0000 144.5646
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40851 : out of range
Severe: rms_fgdepar=390.0281, expected range: 0.0000 97.8879
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83064 : out of range
Severe: rms_fgdepar=352.8751, expected range: 32.5376 188.2666
Severe: avg_pge=0.8087, expected range: -0.6383 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 17275 : out of range
Severe: rms_fgdepar=330.4853, expected range: 23.9556 304.9759
Severe: avg_pge=0.8332, expected range: 0.0577 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 37749 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8245, expected range: -1.2328 0.7500
MANUAL LAND SYNOP RH2M (%) 42752 : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9970, expected range: -1.6830 0.7500
MANUAL LAND SYNOP RH2M (%) 42459 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9985, expected range: -1.4099 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 29471 : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=394.2585, expected range: 0.0000 144.1723
BUFR LAND SYNOP SURFACE PRESSURE (PA) 14562 : out of range
4 times in the last 10 days for at least one item
Severe: avg_pge=0.8180, expected range: 0.4057 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 35182 : out of range
Severe: rms_fgdepar=689.3397, expected range: 0.0000 166.8599
BUFR LAND SYNOP RH2M (%) 72764 : out of range
Severe: avg_fgdepar=-54.7101, expected range: -22.1676 18.9125
Severe: rms_fgdepar=54.7101, expected range: 0.0000 13.9613
BUFR LAND SYNOP RH2M (%) 36078 : out of range
Severe: rms_fgdepar=31.2771, expected range: 0.0000 16.8123
ship
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) EUMDE39 : out of range
23 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=20.4093, expected range: -18.8669 51.4024
Severely_persistent: rms_fgdepar=20.8800, expected range: 0.0000 51.8219
Severely_persistent: avg_pge=0.9045, expected range: 0.3834 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7QJ3 : out of range
29 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=639.0523, expected range: 311.0227 975.5324
Severely_persistent: rms_fgdepar=641.8496, expected range: 304.1439 985.6695
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OWFD2 : out of range
Severe: avg_pge=0.8086, expected range: 0.6561 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V6416 : out of range
Severe: avg_fgdepar=709.1800, expected range: -368.8466 393.8271
Severe: rms_fgdepar=710.6105, expected range: 0.0000 451.3258
Severe: avg_pge=0.8414, expected range: -0.6186 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 7KKS : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-500.4966, expected range: -573.8338 -303.3677
Severe: rms_fgdepar=500.4966, expected range: 315.1450 566.7008
Severe: avg_pge=0.8200, expected range: 0.6895 0.7500
buoy
DRIFTING BUOYS SURFACE PRESSURE (PA) 6102797 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8479, expected range: -1.3721 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 2302618 : out of range
19 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=565.8944, expected range: 0.0000 1357.3587
Severely_persistent: avg_pge=0.8633, expected range: -0.0159 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5102722 : out of range
Severe: rms_fgdepar=431.5009, expected range: 0.0000 63.1567
DRIFTING BUOYS SURFACE PRESSURE (PA) 6204576 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8885, expected range: -0.1438 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 5501667 : out of range
Severe: rms_fgdepar=411.1927, expected range: 0.0000 174.3718
metar
METAR SURFACE PRESSURE (PA) DRRM : out of range
Severe: avg_fgdepar=-544.7305, expected range: -190.0524 146.4213
Severe: rms_fgdepar=724.2625, expected range: 0.0000 122.6269
snow
ROCOB TEMP SNOW (CM) 63301060 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=57.1581, expected range: 54.7485 83.1263
Severely_persistent: rms_fgdepar=57.1581, expected range: 54.7485 83.1263
ROCOB TEMP SNOW (CM) 64301321 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=51.6049, expected range: 50.1234 55.4996
Severely_persistent: rms_fgdepar=51.6049, expected range: 50.1234 55.4996
BUFR LAND SYNOP SNOW (CM) _MF1DB41 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-65.3529, expected range: -67.5758 -46.5314
BUFR LAND SYNOP SNOW (CM) _MF1DB41 : out of range
36 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=65.3617, expected range: 46.5617 67.6028
BUFR LAND SYNOP SNOW (CM) 01003 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-77.0058, expected range: -85.6985 -73.6136
Severely_persistent: rms_fgdepar=77.0058, expected range: 73.6136 85.6985
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-726.0314, expected range: -727.6031 -714.7562
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=726.0315, expected range: 714.7572 727.6041
BUFR LAND SYNOP SNOW (CM) _MI1D545 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=51.9702, expected range: 21.4308 65.2000
BUFR LAND SYNOP SNOW (CM) _MI1D545 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=51.9769, expected range: 21.4365 65.2943
BUFR LAND SYNOP SNOW (CM) _MI161D5 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=72.3011, expected range: 58.0859 73.9558
BUFR LAND SYNOP SNOW (CM) _MI161D5 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=72.3030, expected range: 58.1045 73.9642
BUFR LAND SYNOP SNOW (CM) _MI1CD76 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-91.5795, expected range: -92.1967 -66.4840
BUFR LAND SYNOP SNOW (CM) _MI1CD76 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=91.5816, expected range: 66.5005 92.2140
BUFR LAND SYNOP SNOW (CM) _MI11AD6 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=74.6148, expected range: 51.9034 86.3832
BUFR LAND SYNOP SNOW (CM) _MI11AD6 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=74.6344, expected range: 51.9328 86.3938
BUFR LAND SYNOP SNOW (CM) 01008 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-91.3162, expected range: -95.4377 -91.1847
Severely_persistent: rms_fgdepar=91.3162, expected range: 91.1848 95.4377
BUFR LAND SYNOP SNOW (CM) _MI1BB4C : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-56.9386, expected range: -88.2412 -48.4662
BUFR LAND SYNOP SNOW (CM) _MI1BB4C : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=56.9452, expected range: 48.5016 88.2390
BUFR LAND SYNOP SNOW (CM) _MI135AD : out of range
30 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-54.1570, expected range: -76.3801 -34.7027
BUFR LAND SYNOP SNOW (CM) _MI135AD : out of range
30 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=54.1598, expected range: 34.7269 76.3994
BUFR LAND SYNOP SNOW (CM) _MI1A5CE : out of range
26 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-54.7784, expected range: -60.7221 -41.7222
BUFR LAND SYNOP SNOW (CM) _MI1A5CE : out of range
26 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=54.7946, expected range: 41.7741 60.7434
BUFR LAND SYNOP SNOW (CM) _MI1B83F : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=53.3231, expected range: 54.7978 70.2632
BUFR LAND SYNOP SNOW (CM) _MI1B83F : out of range
38 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=53.3271, expected range: 54.8309 70.2909
BUFR LAND SYNOP SNOW (CM) _MI196EF : out of range
36 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=100.0000, expected range: 100.0000 100.0000
BUFR LAND SYNOP SNOW (CM) _MI196EF : out of range
36 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=100.0000, expected range: 100.0000 100.0000
MANUAL LAND SYNOP SNOW (CM) 23891 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=16.0427, expected range: 5.9912 11.6981
ROCOB TEMP SNOW (CM) 64301568 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=16.5605, expected range: 0.0000 3.5957
t2m
LAND TEMP 2M TEMPERATURE (K) 65503 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.0350, expected range: -23.1802 8.3893
Severely_persistent: rms_fgdepar=14.0515, expected range: 0.0000 23.2768
BUFR LAND SYNOP 2M TEMPERATURE (K) 04112 : out of range
34 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-14.8086, expected range: -20.7087 -8.6831
Severely_persistent: rms_fgdepar=15.0119, expected range: 9.2673 20.4457
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.6326, expected range: -22.1408 -4.3466
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI13149 : out of range
20 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=12.6343, expected range: 4.3005 22.2691
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1DB3C : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-12.2380, expected range: -11.5373 12.0567
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1DB3C : out of range
5 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=12.2381, expected range: 0.0000 11.9228
METAR 2M TEMPERATURE (K) FVMV : out of range
Severe: rms_fgdepar=11.1250, expected range: 0.0000 5.6761