Operational Data Checking
An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.
Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).
The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.
Delayed cut-off 4DVAR at 2022-05-13 00:00
| amsua | ||
| NOAA 15 AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
18 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=0.0709, expected range: 0.1542 0.2004 |
 | |
| NOAA 18 AMSUA ALL SKY RADIANCES CHANNEL 9 : out of range
19 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=-0.5584, expected range: -0.6584 -0.6229 |
 | |
| NOAA 18 AMSUA ALL SKY RADIANCES CHANNEL 7 : out of range
19 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=-0.5539, expected range: -0.4709 -0.3836 |
 | |
| METOP-B AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
19 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=0.2186, expected range: 0.3147 0.3333 |
 | |
| METOP-B AMSUA ALL SKY RADIANCES CHANNEL 9 : out of range
19 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=-0.2502, expected range: -0.1314 -0.1102 |
 | |
| METOP-C AMSUA ALL SKY RADIANCES CHANNEL 8 : out of range
19 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=-0.2742, expected range: -0.1608 -0.1513 |
 | |
| METOP-C AMSUA ALL SKY RADIANCES CHANNEL 9 : out of range
19 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=-0.7233, expected range: -0.6370 -0.5965 |
 | |
| iasi | ||
| METOP-C IASI RADIANCES CHANNEL 113 : out of range
Slight: avg_fgdepar=0.0136, expected range: -0.0162 0.0076 |
 | |
| METOP-C IASI RADIANCES CHANNEL 138 : out of range
Slight: avg_fgdepar=0.0179, expected range: -0.0164 0.0085 |
 | |
| mhs | ||
| NOAA-19 MHS ALLSKY RADIANCES CHANNEL 4 : out of range
Considerable: obs_number=36870.0000, expected range: 41179.5115 52932.8635 |
 | |
| atms | ||
| NPP ATMS RADIANCES CHANNEL 19 : out of range
18 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=-0.1484, expected range: -0.2025 -0.1786 |
 | |
| NPP ATMS RADIANCES CHANNEL 20 : out of range
18 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=0.0211, expected range: -0.0264 -0.0209 |
 | |
| NPP ATMS RADIANCES CHANNEL 21 : out of range
19 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=0.1838, expected range: 0.1277 0.1371 |
 | |
| NPP ATMS RADIANCES CHANNEL 14 : out of range
19 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=0.0171, expected range: -0.0384 -0.0164 |
 | |
| NPP ATMS RADIANCES CHANNEL 11 : out of range
18 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=-0.2919, expected range: -0.2392 -0.1889 |
 | |
| NPP ATMS RADIANCES CHANNEL 12 : out of range
18 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=-0.4946, expected range: -0.4307 -0.3781 |
 | |
| NPP ATMS RADIANCES CHANNEL 13 : out of range
18 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=-0.4319, expected range: -0.3684 -0.3446 |
 | |
| NOAA20 ATMS RADIANCES CHANNEL 22 : out of range
19 times in the last 10 days for at least one item Severely_persistent: avg_biascorr=0.4937, expected range: 0.4317 0.4639 |
 | |
| gpsro | ||
| COSMIC2-E2 GPSRO SETTING (24 impact heights affected) : out of range
Considerable: obs_number=430.0000, expected range: 1716.8026 2583.1974 |
 | |
| Atmospheric Motion Vector | ||
| AQUA MODIS CLEAR WV WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA : out of range
5 times in the last 10 days for at least one item Severely_persistent: obs_number=414.0000, expected range: 194.2210 261.4521 |
 | |
| METEOSAT-8 AMV VIS2 WIND VECTOR DIFF (M/S) PRESSURE LAYER 600-900 (HPA : out of range
Considerable: obs_number=1708.0000, expected range: 483.1074 1187.6577 |
 | |
| NOAA-15 AVHRR IR WIND VECTOR DIFF (M/S) PRESSURE LAYER 300-600 (HPA) : out of range
Slight: stdev_fgdepar=2.9011, expected range: 1.1607 2.8875 |
 | |
| Geostationary CSR | ||
| METEOSAT-8 SEVIRI RADIANCES CHANNEL 3 : out of range
4 times in the last 10 days for at least one item Considerable: obs_number=23225.0000, expected range: 18628.6203 22236.6297 |
 | |
| Radiosondes | ||
| LAND TEMP Q (G/KG) 38341 PRESSURE LAYER 900-1200 (HPA) : out of range
5 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=6.1965, expected range: 0.1298 7.1602 Severely_persistent: rms_fgdepar=6.1965, expected range: 0.1688 7.1720 |
 | |
| LAND TEMP TEMPERATURE (K) 96935 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_pge=0.8730, expected range: -0.3239 0.4708 |
 | |
| LAND TEMP Q (G/KG) 27730 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=2.1097, expected range: 0.0000 0.8761 |
 | |
| LAND TEMP WIND VECTOR DIFF (M/S) 17095 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=16.9915, expected range: 0.0000 6.4851 |
 | |
| LAND TEMP WIND VECTOR DIFF (M/S) 26298 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=15.6084, expected range: 0.0000 7.7621 Severe: avg_pge=0.8919, expected range: -0.9044 0.7500 |
 | |
| HIGH RESO LAND TEMP Q (G/KG) 72659 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=2.9621, expected range: 0.0000 1.5197 |
 | |
| HIGH RESO LAND TEMP Q (G/KG) 58027 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=3.2797, expected range: 0.0000 1.7902 |
 | |
| HIGH RESO LAND TEMP Q (G/KG) 72649 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=4.7062, expected range: 0.0000 2.3769 |
 | |
| HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 56492 PRESSURE LAYER 300-60 : out of range
Severe: avg_fgdepar=21.1606, expected range: -0.6042 6.4881 Severe: rms_fgdepar=24.1728, expected range: 0.0000 8.3233 |
 | |
| All HIGH RESO SEA TEMP ALL LAYERS North Atlantic : all data missing
Severe: obs_number=0, expected range: 23.71 724.29 |
||
| All HIGH RESO SEA TEMP ALL LAYERS Global : all data missing
Severe: obs_number=0, expected range: 177.46 774.85 |
||
| BUFR TEMP DESCENT Q (G/KG) PRESSURE LAYER 900-1200 (HPA) : missing
1 times in the last 10 days for at least one item Severe: obs_number=0.0000, expected range: 0.0000 814.7953 |
 | |
| LAND TEMP TEMPERATURE (K) PRESSURE LAYER 600-900 (HPA) : out of range
Considerable: obs_number=61.0000, expected range: 129.1156 257.7732 Considerable: obs_number=560.0000, expected range: 653.8412 787.6588 Considerable: obs_number=120.0000, expected range: 198.7540 289.6905 |
 | |
| HIGH RESO LAND TEMP TEMPERATURE (K) (2 pressure layers affected) : out of range
1 times in the last 10 days for at least one item Considerable: obs_number=55.0000, expected range: 84.9198 94.8302 |
 | |
| amdar | ||
| WIGOS AMDAR WIND VECTOR DIFF (M/S) LJNENXBA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=26.6581, expected range: -2.6322 9.2699 Severe: rms_fgdepar=26.6581, expected range: 0.0000 10.5698 |
 | |
| WIGOS AMDAR WIND VECTOR DIFF (M/S) WSYICIJA PRESSURE LAYER 900-1200 (H : out of range
Severe: rms_fgdepar=17.0532, expected range: 0.0599 5.5753 |
 | |
| ADS-C WIND VECTOR DIFF (M/S) VNWI3GJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=18.9270, expected range: 0.0000 10.4145 |
 | |
| ADS-C WIND VECTOR DIFF (M/S) 2CGXUXJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.4785, expected range: 0.0000 8.0697 |
 | |
| ADS-C WIND VECTOR DIFF (M/S) WN5UC5RA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=24.3564, expected range: 0.0000 12.4577 |
 | |
| ADS-C WIND VECTOR DIFF (M/S) BPZEDQRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.7970, expected range: 0.0000 15.1936 |
 | |
| pilot | ||
| LAND PILOT WIND VECTOR DIFF (M/S) PRESSURE LAYER 0-300 (HPA) : out of range
Considerable: obs_number=109.0000, expected range: 152.9881 228.0119 |
 | |
| synop | ||
| MANUAL LAND SYNOP RH2M (%) 42770 : out of range
9 times in the last 10 days for at least one item Severely_persistent: avg_pge=0.8959, expected range: -1.2097 0.7500 |
 | |
| MANUAL LAND SYNOP RH2M (%) 41697 : out of range
11 times in the last 10 days for at least one item Severely_persistent: avg_pge=0.9946, expected range: -1.5709 0.7500 |
 | |
| MANUAL LAND SYNOP RH2M (%) 42459 : out of range
5 times in the last 10 days for at least one item Severely_persistent: avg_pge=0.8491, expected range: -1.9280 0.7500 |
 | |
| AUTOMATIC LAND SYNOP RH2M (%) 35331 : out of range
Severe: rms_fgdepar=48.5585, expected range: 0.0000 18.2365 Severe: avg_pge=0.8312, expected range: -0.0474 0.0598 |
 | |
| MANUAL LAND SYNOP RH2M (%) 42744 : out of range
1 times in the last 10 days for at least one item Severe: avg_pge=0.9999, expected range: -1.4432 0.7500 |
 | |
| MANUAL LAND SYNOP RH2M (%) 41715 : out of range
1 times in the last 10 days for at least one item Severe: avg_fgdepar=59.3126, expected range: -3.6933 41.7826 Severe: rms_fgdepar=59.3126, expected range: 0.0000 45.1626 Severe: avg_pge=1.0000, expected range: -1.2394 0.7500 |
 | |
| MANUAL LAND SYNOP RH2M (%) 42557 : out of range
Severe: avg_pge=0.9166, expected range: -0.4339 0.5679 |
 | |
| MANUAL LAND SYNOP Z (M) 38734 : out of range
1 times in the last 10 days for at least one item Severe: avg_pge=0.8215, expected range: -1.7768 0.7500 |
 | |
| MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42500 : out of range
Severe: rms_fgdepar=527.5163, expected range: 0.0000 129.0046 |
 | |
| MANUAL LAND SYNOP SURFACE PRESSURE (PA) 40260 : out of range
Severe: rms_fgdepar=383.7451, expected range: 0.0000 280.3984 Severe: avg_pge=0.8451, expected range: -0.3043 0.7500 |
 | |
| BUFR LAND SYNOP RH2M (%) 72551 : out of range
Severe: rms_fgdepar=40.8061, expected range: 0.0000 27.8998 Severe: avg_pge=0.9904, expected range: -0.0007 0.0069 |
 | |
| BUFR LAND SYNOP RH2M (%) 76412 : out of range
Severe: avg_pge=0.8166, expected range: -0.0084 0.0178 |
 | |
| BUFR LAND SYNOP RH2M (%) 71193 : out of range
Severe: avg_fgdepar=57.2650, expected range: -30.4683 27.0033 Severe: rms_fgdepar=57.7914, expected range: 0.0000 22.2060 |
 | |
| BUFR LAND SYNOP RH2M (%) 71734 : out of range
Severe: avg_fgdepar=50.2181, expected range: -27.5552 15.3550 Severe: rms_fgdepar=50.2478, expected range: 0.0000 17.9619 Severe: avg_pge=0.9922, expected range: -0.0001 0.0064 |
 | |
| BUFR LAND SYNOP RH2M (%) 34394 : out of range
Severe: avg_pge=0.9533, expected range: -0.4567 0.6497 |
 | |
| BUFR LAND SYNOP RH2M (%) 25129 : out of range
2 times in the last 10 days for at least one item Severe: avg_pge=0.8356, expected range: -1.5764 0.7500 |
 | |
| BUFR LAND SYNOP SURFACE PRESSURE (PA) 64450 : out of range
Severe: rms_fgdepar=759.4427, expected range: 0.0000 148.0960 |
 | |
| BUFR LAND SYNOP SURFACE PRESSURE (PA) 27981 : out of range
Severe: rms_fgdepar=364.9047, expected range: 0.0000 250.9208 Severe: avg_pge=0.8122, expected range: -0.6089 0.7500 |
 | |
| BUFR LAND SYNOP SURFACE PRESSURE (PA) 76243 : out of range
3 times in the last 10 days for at least one item Severe: avg_pge=0.8208, expected range: 0.0527 0.7500 |
 | |
| BUFR LAND SYNOP SURFACE PRESSURE (PA) 12805 : out of range
1 times in the last 10 days for at least one item Severe: rms_fgdepar=464.9432, expected range: 0.0000 77.3542 |
 | |
| BUFR LAND SYNOP SURFACE PRESSURE (PA) 61995 : out of range
Severe: rms_fgdepar=676.8557, expected range: 12.8326 160.9753 |
 | |
| BUFR LAND SYNOP SURFACE PRESSURE (PA) 33156 : out of range
Severe: rms_fgdepar=303.0970, expected range: 0.0000 97.4874 Severe: avg_pge=0.8374, expected range: -0.1615 0.1833 |
 | |
| ship | ||
| BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 3E2426 : out of range
6 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=22.8614, expected range: -21.6290 44.2255 Severely_persistent: rms_fgdepar=23.0663, expected range: 0.0000 46.0718 |
 | |
| BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRLA2 : out of range
Severe: avg_fgdepar=568.9509, expected range: 217.0942 837.8548 Severe: rms_fgdepar=568.9509, expected range: 217.0942 837.8548 Severe: avg_pge=0.8141, expected range: 0.5009 0.7500 |
 | |
| BUFR SHIP SYNOP SURFACE PRESSURE (PA) 45006 : out of range
1 times in the last 10 days for at least one item Severe: rms_fgdepar=301.5650, expected range: 0.0000 121.0620 |
 | |
| BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V6416 : out of range
3 times in the last 10 days for at least one item Severe: rms_fgdepar=524.0085, expected range: 0.0000 472.0934 |
 | |
| BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRJU8 : out of range
Severe: avg_fgdepar=-504.2122, expected range: -426.0010 396.4240 Severe: rms_fgdepar=504.2122, expected range: 0.0000 282.3049 Severe: avg_pge=0.8253, expected range: -0.7554 0.7500 |
 | |
| BUFR SHIP SYNOP SURFACE PRESSURE (PA) UGYU : out of range
Severe: avg_fgdepar=-895.4293, expected range: -768.7904 227.4553 Severe: rms_fgdepar=895.4293, expected range: 0.0000 768.7904 Severe: avg_pge=0.9004, expected range: -0.9418 0.7500 |
 | |
| BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) WDH7560 : out of range
Severe: avg_pge=0.9005, expected range: 0.0058 0.7500 |
 | |
| BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) 6CV53CK : out of range
2 times in the last 10 days for at least one item Severe: avg_pge=0.8257, expected range: 0.1130 0.7500 |
 | |
| buoy | ||
| DRIFTING BUOYS SURFACE PRESSURE (PA) 5401536 : out of range
9 times in the last 10 days for at least one item Severely_persistent: avg_pge=0.8409, expected range: -1.4641 0.7500 |
 | |
| metar | ||
| METAR SURFACE PRESSURE (PA) FDSK : out of range
Severe: avg_fgdepar=501.5925, expected range: -139.0417 185.4667 Severe: rms_fgdepar=501.5925, expected range: 0.0000 185.9141 Severe: avg_pge=0.8005, expected range: -0.2720 0.3163 |
 | |
| METAR SURFACE PRESSURE (PA) FDMS : out of range
Severe: avg_fgdepar=602.5982, expected range: -102.2362 190.0869 Severe: rms_fgdepar=602.5982, expected range: 0.0000 159.4337 Severe: avg_pge=0.8233, expected range: -0.0139 0.0156 |
 | |
| AUTOMATIC METAR SURFACE PRESSURE (PA) KD60 : out of range
Severe: rms_fgdepar=348.9410, expected range: 0.0000 191.2433 |
 | |
| AUTOMATIC METAR SURFACE PRESSURE (PA) K4R5 : out of range
Severe: rms_fgdepar=322.5627, expected range: 0.0000 165.0525 |
 | |
| AUTOMATIC METAR SURFACE PRESSURE (PA) KFOZ : out of range
2 times in the last 10 days for at least one item Severe: rms_fgdepar=333.0496, expected range: 0.0000 109.6385 |
 | |
| snow | ||
| MANUAL LAND SYNOP SNOW (CM) 30815 : out of range
12 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=52.0000, expected range: 35.5724 74.2231 Severely_persistent: rms_fgdepar=52.0000, expected range: 35.5724 74.2231 |
 | |
| BUFR LAND SYNOP SNOW (CM) 01361 : out of range
32 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=60.7566, expected range: 44.3941 58.6999 Severely_persistent: rms_fgdepar=60.7657, expected range: 44.3943 58.7042 |
 | |
| BUFR LAND SYNOP SNOW (CM) 01003 : out of range
18 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=-74.1107, expected range: -79.5665 -73.3715 Severely_persistent: rms_fgdepar=74.1107, expected range: 73.3715 79.5665 |
 | |
| BUFR LAND SYNOP SNOW (CM) 30815 : out of range
12 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=52.0000, expected range: 35.6057 74.2380 Severely_persistent: rms_fgdepar=52.0000, expected range: 35.6057 74.2380 |
 | |
| BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
36 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=-737.6018, expected range: -737.1504 -712.5698 |
||
| BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
36 times in the last 10 days for at least one item Severely_persistent: rms_fgdepar=737.6021, expected range: 712.5724 737.1497 |
||
| BUFR LAND SYNOP SNOW (CM) 01008 : out of range
38 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=-88.9020, expected range: -94.2563 -89.4193 Severely_persistent: rms_fgdepar=88.9021, expected range: 89.4194 94.2563 |
 | |
| BUFR LAND SYNOP SNOW (CM) : out of range
6 times in the last 10 days for at least one item Severely_persistent: rms_fgdepar=58.5573, expected range: 208.9948 387.9972 |
 | |
| MANUAL LAND SYNOP SNOW (CM) 24724 : out of range
Severe: rms_fgdepar=18.2469, expected range: 0.0000 7.3690 |
 | |
| t2m | ||
| LAND TEMP 2M TEMPERATURE (K) 65503 : out of range
14 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=-14.7638, expected range: -24.1883 8.5099 Severely_persistent: rms_fgdepar=14.8308, expected range: 0.0000 24.2623 |
 | |
| BUFR LAND SYNOP 2M TEMPERATURE (K) 78896 : out of range
28 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=-14.4034, expected range: -17.4130 -8.0145 Severely_persistent: rms_fgdepar=14.5610, expected range: 8.0258 17.9270 |
 | |
| METAR 2M TEMPERATURE (K) TTPP : out of range
Severe: avg_fgdepar=-14.9413, expected range: -0.1754 2.8516 Severe: rms_fgdepar=14.9996, expected range: 1.0618 2.9043 |
 | |
| METAR 2M TEMPERATURE (K) VECX : out of range
4 times in the last 10 days for at least one item Severe: rms_fgdepar=12.2810, expected range: 4.0495 12.9694 |
 | |
| LAND TEMP 2M TEMPERATURE (K) 72558 : out of range
Severe: rms_fgdepar=10.9220, expected range: 0.0000 3.7742 |
 | |
| BUFR LAND SYNOP 2M TEMPERATURE (K) : out of range
3 times in the last 10 days for at least one item Considerable: obs_number=9390.0000, expected range: 11518.0320 13700.2180 Considerable: obs_number=7225.0000, expected range: 9317.0151 11479.2349 Considerable: obs_number=8530.0000, expected range: 10626.5906 12806.6594 |
 | |
| rh2m | ||
| METAR RH2M (%) TTPP : out of range
Severe: rms_fgdepar=33.1592, expected range: 0.6555 16.2613 |
 | |
| BUFR LAND SYNOP RH2M (%) _MI1D8EC : out of range
Severe: rms_fgdepar=39.6487, expected range: 0.0000 19.6222 |
||
| BUFR LAND SYNOP RH2M (%) : out of range
1 times in the last 10 days for at least one item Considerable: obs_number=5181.0000, expected range: 6299.7260 7625.1490 Considerable: obs_number=7328.0000, expected range: 8452.9220 9796.9530 Considerable: obs_number=6492.0000, expected range: 7574.8233 8950.0517 |
 | |