Operational Data Checking
An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.
Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).
The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.
Delayed cut-off 4DVAR at 2022-11-14 00:00
| AMSUA Pacific RARS | ||
| All NOAA-18 AMSUA ALL SKY CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 359.87 1681.12 |
||
| All NOAA-19 AMSUA ALL SKY CHANNELS Global : all data missing
Severely_persistent: obs_number=0, expected range: 114.61 1466.89 |
||
| cris | ||
| NOAA20 CRIS RADIANCES CHANNEL 657 : out of range
Considerable: stdev_fgdepar=0.3392, expected range: 0.2840 0.3198 |
 | |
| NPP CRIS RADIANCES CHANNEL 606 : out of range
Slight: stdev_fgdepar=0.2738, expected range: 0.2250 0.2638 |
 | |
| NPP CRIS RADIANCES CHANNEL 649 : out of range
Slight: stdev_fgdepar=0.3332, expected range: 0.2713 0.3192 |
 | |
| NOAA20 CRIS RADIANCES CHANNEL 590 : out of range
Slight: stdev_fgdepar=0.2720, expected range: 0.2306 0.2592 |
 | |
| gpsro | ||
| All KOMPSAT-5 GPSRO SETTING ALL HEIGHTS Global : all data missing
Severely_persistent: obs_number=0, expected range: 164.25 964.82 |
||
| Atmospheric Motion Vector | ||
| All HIMAWARI-8 AMV CLOUDY WV3 ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 256.69 867.14 |
||
| resat | ||
| All NOAA-19 SBUV ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 510.25 561.42 |
||
| Radiosondes | ||
| LAND TEMP TEMPERATURE (K) 23078 PRESSURE LAYER 900-1200 (HPA) : out of range
2 times in the last 10 days for at least one item Severe: rms_fgdepar=8.0080, expected range: 0.0000 3.7080 |
 | |
| LAND TEMP TEMPERATURE (K) 30758 PRESSURE LAYER 900-1200 (HPA) : out of range
3 times in the last 10 days for at least one item Severe: avg_pge=0.8610, expected range: -0.7570 0.7500 |
 | |
| LAND TEMP WIND VECTOR DIFF (M/S) 34882 PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_fgdepar=34.1229, expected range: -1.1481 5.1250 Severe: avg_pge=0.9096, expected range: -0.2495 0.3089 |
 | |
| LAND TEMP WIND VECTOR DIFF (M/S) 34882 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=34.1229, expected range: 0.0000 7.3569 |
| |
| LAND TEMP Q (G/KG) 67197 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=-6.2800, expected range: -3.3249 3.7934 Severe: rms_fgdepar=6.2800, expected range: 0.0000 2.6203 Severe: avg_pge=0.9168, expected range: -0.0064 0.0135 |
 | |
| HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 56146 PRESSURE LAYER 0-300 : out of range
Severe: avg_fgdepar=25.4353, expected range: 0.5486 3.9533 Severe: rms_fgdepar=27.5118, expected range: 0.6032 4.6249 |
 | |
| amdar | ||
| WIGOS AMDAR TEMPERATURE (K) CNNMWQ PRESSURE LAYER 300-600 (HPA) : out of range
6 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=-12.9637, expected range: -16.7334 6.2024 Severely_persistent: rms_fgdepar=12.9637, expected range: 0.0000 18.6358 Severely_persistent: avg_pge=0.9135, expected range: -0.1470 0.7500 |
 | |
| WIGOS AMDAR TEMPERATURE (K) CNNKXR PRESSURE LAYER 600-900 (HPA) : out of range
6 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=-9.2649, expected range: -40.9733 20.5050 Severely_persistent: rms_fgdepar=9.2649, expected range: 0.0000 38.8554 Severely_persistent: avg_pge=0.8617, expected range: -0.8416 0.7500 |
 | |
| WIGOS AMDAR TEMPERATURE (K) CNMNNS PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_pge=0.8252, expected range: -0.3293 0.7500 |
 | |
| WIGOS AMDAR TEMPERATURE (K) CNNKUO PRESSURE LAYER 300-600 (HPA) : out of range
4 times in the last 10 days for at least one item Severe: avg_pge=0.8353, expected range: -0.9197 0.7500 |
 | |
| WIGOS AMDAR TEMPERATURE (K) CNNKYS PRESSURE LAYER 300-600 (HPA) : out of range
Severe: rms_fgdepar=10.2791, expected range: 0.0000 21.3821 |
 | |
| WIGOS AMDAR TEMPERATURE (K) CNQNOP (2 pressure layers affected) : out of range
Severe: avg_fgdepar=-13.9226, expected range: -23.8999 12.3275 Severe: rms_fgdepar=13.9226, expected range: 0.0000 24.9030 Severe: avg_pge=0.9177, expected range: -0.4230 0.7500 |
 | |
| WIGOS AMDAR TEMPERATURE (K) CNQQNT PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_pge=0.8513, expected range: -0.2217 0.7500 |
 | |
| MODE-S WIND VECTOR DIFF (M/S) M7EE73F PRESSURE LAYER 300-600 (HPA) : out of range
Severe: avg_fgdepar=21.9737, expected range: -2.8710 7.6684 Severe: rms_fgdepar=22.8965, expected range: 0.0000 8.6195 |
 | |
| ADS-C WIND VECTOR DIFF (M/S) MLJJV5RA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.6961, expected range: 0.0000 16.9156 |
 | |
| airep | ||
| AIREP WIND VECTOR DIFF (M/S) ANZ145 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=22.7081, expected range: 0.0000 6.6795 |
 | |
| AIREP WIND VECTOR DIFF (M/S) ANZ175 PRESSURE LAYER 0-300 (HPA) : out of range
1 times in the last 10 days for at least one item Severe: avg_fgdepar=30.5058, expected range: -1.9028 7.1898 Severe: rms_fgdepar=42.3231, expected range: 0.0000 8.1049 |
 | |
| AIREP WIND VECTOR DIFF (M/S) ANZ284 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=28.3857, expected range: 0.0000 9.1920 |
 | |
| AIREP WIND VECTOR DIFF (M/S) LAN800 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: avg_fgdepar=39.9808, expected range: -5.8028 13.1802 Severe: rms_fgdepar=47.2376, expected range: 0.0000 16.0982 |
 | |
| synop | ||
| BUFR LAND SYNOP SURFACE PRESSURE (PA) 81797 : out of range
28 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=599.6204, expected range: 470.3946 731.6122 Severely_persistent: rms_fgdepar=600.0505, expected range: 470.6004 732.0505 |
 | |
| BUFR LAND SYNOP SURFACE PRESSURE (PA) 84825 : out of range
6 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=-535.0775, expected range: -670.9231 -386.7786 Severely_persistent: rms_fgdepar=536.0680, expected range: 388.7689 671.3178 |
 | |
| MANUAL LAND SYNOP SURFACE PRESSURE (PA) 32215 : out of range
Severe: rms_fgdepar=316.8994, expected range: 0.0000 169.0580 Severe: avg_pge=0.8065, expected range: -0.4371 0.6127 |
 | |
| MANUAL LAND SYNOP SURFACE PRESSURE (PA) 62176 : out of range
Severe: rms_fgdepar=549.1923, expected range: -439.8458 576.1110 |
 | |
| MANUAL LAND SYNOP SURFACE PRESSURE (PA) 63450 : out of range
Severe: rms_fgdepar=471.6054, expected range: 0.0000 97.6410 Severe: avg_pge=0.8223, expected range: 0.0000 0.0000 |
 | |
| MANUAL LAND SYNOP SURFACE PRESSURE (PA) 63533 : out of range
Severe: rms_fgdepar=496.8451, expected range: -293.7135 405.9882 Severe: avg_pge=0.8464, expected range: -0.6875 0.7500 |
 | |
| MANUAL LAND SYNOP SURFACE PRESSURE (PA) 76220 : out of range
Severe: avg_fgdepar=588.6701, expected range: -1789.1006 2293.8147 Severe: rms_fgdepar=588.6701, expected range: 0.0000 1811.5846 Severe: avg_pge=0.8701, expected range: -1.0044 0.7500 |
 | |
| MANUAL LAND SYNOP SURFACE PRESSURE (PA) 80440 : out of range
Severe: avg_fgdepar=660.0363, expected range: -430.1601 386.5254 Severe: rms_fgdepar=939.8090, expected range: 0.0000 332.3992 |
 | |
| MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83522 : out of range
2 times in the last 10 days for at least one item Severe: avg_pge=0.8024, expected range: 0.6275 0.7500 |
 | |
| BUFR LAND SYNOP SURFACE PRESSURE (PA) 23606 : out of range
Severe: rms_fgdepar=520.9882, expected range: 0.0000 182.3734 |
 | |
| BUFR LAND SYNOP SURFACE PRESSURE (PA) 24585 : out of range
3 times in the last 10 days for at least one item Severe: avg_pge=0.8002, expected range: -0.7333 0.7500 |
 | |
| BUFR LAND SYNOP SURFACE PRESSURE (PA) 35358 : out of range
3 times in the last 10 days for at least one item Severe: rms_fgdepar=595.6157, expected range: 0.0000 188.2330 |
 | |
| BUFR LAND SYNOP SURFACE PRESSURE (PA) 35739 : out of range
3 times in the last 10 days for at least one item Severe: avg_fgdepar=675.0429, expected range: -218.3080 201.5920 Severe: rms_fgdepar=689.9098, expected range: 0.0000 169.2049 Severe: avg_pge=0.9111, expected range: -0.2485 0.2820 |
 | |
| BUFR LAND SYNOP SURFACE PRESSURE (PA) 48990 : out of range
Severe: avg_fgdepar=-808.0261, expected range: -1059.5426 895.8132 Severe: rms_fgdepar=808.0261, expected range: -783.1033 998.7381 Severe: avg_pge=0.9533, expected range: -2.0310 0.7500 |
 | |
| BUFR LAND SYNOP RH2M (%) 40405 : out of range
Severe: avg_pge=0.8609, expected range: -0.4720 0.5503 |
 | |
| BUFR LAND SYNOP RH2M (%) 60120 : out of range
Severe: rms_fgdepar=47.2703, expected range: 0.0000 19.7461 Severe: avg_pge=0.9098, expected range: -0.0007 0.0068 |
 | |
| BUFR LAND SYNOP RH2M (%) 71263 : out of range
Severe: rms_fgdepar=37.8735, expected range: 0.0000 18.3039 |
 | |
| ship | ||
| BUFR SHIP SYNOP SURFACE PRESSURE (PA) 7JWH : out of range
10 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=513.7983, expected range: -1138.5422 1422.7456 Severely_persistent: rms_fgdepar=514.3140, expected range: -982.1685 1334.2840 Severely_persistent: avg_pge=0.8036, expected range: -1.7295 0.7500 |
 | |
| BUFR SHIP SYNOP SURFACE PRESSURE (PA) OXLD2 : out of range
10 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=611.4006, expected range: -1142.8209 1462.3851 Severely_persistent: rms_fgdepar=611.4006, expected range: -1019.2969 1395.1061 Severely_persistent: avg_pge=0.8271, expected range: -1.6885 0.7500 |
 | |
| BUFR SHIP SYNOP SURFACE PRESSURE (PA) WYQ4356 : out of range
14 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=1305.5758, expected range: -1490.1460 1653.0271 Severely_persistent: rms_fgdepar=1307.6770, expected range: -1151.4346 1659.4128 Severely_persistent: avg_pge=0.9198, expected range: -1.5834 0.7500 |
 | |
| SHIP SURFACE PRESSURE (PA) TBWUK31 : out of range
Severe: rms_fgdepar=425.3021, expected range: 0.0000 117.9545 |
 | |
| BUFR SHIP SYNOP SURFACE PRESSURE (PA) S6CH4 : out of range
Severe: avg_fgdepar=-557.7015, expected range: -577.0639 568.1148 Severe: rms_fgdepar=644.0396, expected range: 0.0000 525.3936 |
 | |
| BUFR SHIP SYNOP SURFACE PRESSURE (PA) V7UT8 : out of range
Severe: avg_fgdepar=637.8455, expected range: -347.6212 315.4304 Severe: rms_fgdepar=637.8455, expected range: 0.0000 235.4769 Severe: avg_pge=0.8551, expected range: -0.6895 0.7500 |
 | |
| BUFR SHIP SYNOP SURFACE PRESSURE (PA) VRGW2 : out of range
Severe: avg_fgdepar=707.9995, expected range: -258.7433 258.1470 Severe: rms_fgdepar=707.9995, expected range: 0.0000 269.7525 Severe: avg_pge=0.8554, expected range: -0.0806 0.0973 |
 | |
| buoy | ||
| DRIFTING BUOYS SURFACE PRESSURE (PA) 6501679 : out of range
7 times in the last 10 days for at least one item Severely_persistent: rms_fgdepar=542.0467, expected range: 0.0000 636.0948 Severely_persistent: avg_pge=0.8244, expected range: -1.1918 0.7500 |
 | |
| MOORED BUOYS SURFACE PRESSURE (PA) 4400064 : out of range
3 times in the last 10 days for at least one item Severe: avg_fgdepar=-684.7876, expected range: -340.4053 506.1980 Severe: rms_fgdepar=684.7876, expected range: 0.0000 567.0316 Severe: avg_pge=0.9265, expected range: -0.4263 0.7500 |
 | |
| DRIFTING BUOYS SURFACE PRESSURE (PA) 1301612 : out of range
3 times in the last 10 days for at least one item Severe: avg_pge=0.8000, expected range: -1.0504 0.7500 |
 | |
| DRIFTING BUOYS SURFACE PRESSURE (PA) 2101816 : out of range
Severe: rms_fgdepar=307.8534, expected range: 0.0000 143.3495 |
 | |
| DRIFTING BUOYS SURFACE PRESSURE (PA) 4101718 : out of range
4 times in the last 10 days for at least one item Severe: avg_fgdepar=500.9624, expected range: -221.8771 244.9037 Severe: rms_fgdepar=501.2305, expected range: -228.2547 333.2040 Severe: avg_pge=0.8930, expected range: -0.5953 0.6800 |
 | |
| snow | ||
| BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=-790.7609, expected range: -805.1165 -765.4936 Severely_persistent: rms_fgdepar=790.7614, expected range: 765.7662 804.9392 |
 | |
| BUFR LAND SYNOP SNOW (CM) _MI17AC6 : out of range
22 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=-65.1328, expected range: -72.5641 -24.6210 Severely_persistent: rms_fgdepar=65.1562, expected range: 24.7689 72.5243 |
 | |
| BUFR LAND SYNOP SNOW (CM) _MI1EDCD : out of range
8 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=99.9631, expected range: 100.0000 100.0000 Severely_persistent: rms_fgdepar=99.9631, expected range: 100.0000 100.0000 |
 | |
| MANUAL LAND SYNOP SNOW (CM) 29771 : out of range
Severe: rms_fgdepar=21.7029, expected range: 0.0000 9.2623 |
 | |
| MANUAL LAND SYNOP SNOW (CM) 35026 : out of range
Severe: rms_fgdepar=18.1542, expected range: 0.0000 6.4978 |
 | |
| MANUAL LAND SYNOP SNOW (CM) 35179 : out of range
Severe: rms_fgdepar=16.0266, expected range: 0.0000 2.9136 |
 | |
| BUFR LAND SYNOP SNOW (CM) 56106 : out of range
Severe: rms_fgdepar=72.2825, expected range: -5.4081 7.6620 |
 | |
| BUFR LAND SYNOP SNOW (CM) : out of range
Severe: rms_fgdepar=13.9160, expected range: 0.0000 1.5010 |
 | |
| t2m | ||
| METAR 2M TEMPERATURE (K) LTCB : out of range
8 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=13.4857, expected range: 0.2423 18.0876 Severely_persistent: rms_fgdepar=13.6000, expected range: 2.0163 17.4621 |
 | |
| BUFR LAND SYNOP 2M TEMPERATURE (K) _MI1D581 : out of range
28 times in the last 10 days for at least one item Severely_persistent: avg_fgdepar=-14.1097, expected range: -20.8732 -10.1643 Severely_persistent: rms_fgdepar=14.1097, expected range: 10.1655 20.9194 |
 | |
| AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 56106 : out of range
2 times in the last 10 days for at least one item Severe: avg_fgdepar=12.6173, expected range: 6.0036 14.8735 Severe: rms_fgdepar=12.6173, expected range: 6.0036 14.8735 |
 | |
| MANUAL LAND SYNOP 2M TEMPERATURE (K) 23078 : out of range
2 times in the last 10 days for at least one item Severe: avg_fgdepar=-12.4988, expected range: -10.1255 9.2443 Severe: rms_fgdepar=12.5067, expected range: 0.0000 8.9638 |
 | |
| MANUAL LAND SYNOP 2M TEMPERATURE (K) 23383 : out of range
2 times in the last 10 days for at least one item Severe: rms_fgdepar=12.4786, expected range: 0.0000 4.9574 |
 | |
| METAR 2M TEMPERATURE (K) KFEW : out of range
Severe: avg_fgdepar=16.5007, expected range: -10.6200 9.8227 Severe: rms_fgdepar=16.5007, expected range: 0.0000 10.5795 |
 | |
| LAND TEMP 2M TEMPERATURE (K) 23078 : out of range
Severe: avg_fgdepar=-12.8605, expected range: -8.6188 7.9043 Severe: rms_fgdepar=12.8605, expected range: 0.0000 6.7580 |
 | |
| BUFR LAND SYNOP 2M TEMPERATURE (K) 23078 : out of range
2 times in the last 10 days for at least one item Severe: avg_fgdepar=-12.8218, expected range: -10.2578 9.3996 Severe: rms_fgdepar=12.8291, expected range: 0.0000 9.0642 |
 | |
| BUFR LAND SYNOP 2M TEMPERATURE (K) 23383 : out of range
2 times in the last 10 days for at least one item Severe: rms_fgdepar=12.4198, expected range: 0.0000 5.0312 |
 | |
| rh2m | ||
| MANUAL LAND SYNOP RH2M (%) 11938 : out of range
Severe: rms_fgdepar=33.0686, expected range: 0.0000 18.5510 |
 | |
| MANUAL LAND SYNOP RH2M (%) 78670 : out of range
Severe: rms_fgdepar=34.6095, expected range: 0.0000 13.1189 |
 | |
| MANUAL LAND SYNOP RH2M (%) 94696 : out of range
Severe: rms_fgdepar=31.0023, expected range: 0.0000 13.5409 |
 | |
| BUFR LAND SYNOP RH2M (%) 15302 : out of range
Severe: rms_fgdepar=39.9935, expected range: 0.0000 22.4607 |
 | |