Operational Data Checking

An automatic data checking system has been implemented at ECMWF to trigger warnings in case of anomalies affecting the quality or the availability of the data assimilated by the model. Selected statistical parameters (number of observations, bias correction, and mean bias-corrected background, analysis departures and probability of gross error) are checked against an expected range. An appropriate alert message (including a time series plot) is generated if statistics are outside the specified ranges. A severity level (slight, considerable, severe) is assigned to each message depending on how far statistics are from the expected values. Two kinds of ranges are used by the automatic checking: Soft and Hard limits. Soft limits are updated automatically using statistics from the last twenty days (extremes are excluded during this process). Hard limits are adjusted manually when required.

Currently, the automatic checking is limited to data passing through the minimisation process (including VarBC passive data). It's being applied twice a day to the delayed cut-off 4D-VAR cycles (00 and 12) and four times a day to the early delivery assimilation system (00,06,12 and 18).

The alarm system results are based on feedback information from the ECMWF data assimilation and consequently reflect the ECMWF data usage. Although most warnings are related to data problems, they may on occasion also be related to model issues. Alerts are provided for information on an as-is basis and may be withdrawn or changed without notice. ECMWF accepts no responsibility for actions taken on the basis of these results.

Delayed cut-off 4DVAR at 2022-11-05 00:00

AMSUA Pacific RARS
All NOAA-18 AMSUA ALL SKY CHANNELS Global : all data missing
Severe: obs_number=0, expected range: 359.87 1681.12
All NOAA-19 AMSUA ALL SKY CHANNELS Global : all data missing
Severe: obs_number=0, expected range: 114.61 1466.89
gpsro
COSMIC2-E1 GPSRO SETTING HEIGHT 38-40 KM : out of range
Severe: stdev_norm_fgdepar=1.4434, expected range: 0.6242 1.0563
Considerable: stdev_norm_fgdepar=1.4682, expected range: 0.5677 1.1336
COSMIC2-E1 GPSRO SETTING HEIGHT 40-42 KM : out of range
Severe: stdev_norm_fgdepar=1.3142, expected range: 0.5644 0.9645
COSMIC2-E1 GPSRO SETTING HEIGHT 48-50 KM : out of range
Considerable: stdev_norm_fgdepar=1.1329, expected range: 0.4616 0.9015
COSMIC2-E1 GPSRO SETTING HEIGHT 42-44 KM : out of range
Considerable: stdev_norm_fgdepar=1.3200, expected range: 0.4754 1.0132
Slight: stdev_norm_fgdepar=1.2515, expected range: 0.4839 0.9992
COSMIC2-E1 GPSRO SETTING (24 impact heights affected) : out of range
Slight: obs_number=408.0000, expected range: 1411.5471 3036.3279
COSMIC2-E1 GPSRO SETTING HEIGHT 46-48 KM : out of range
Slight: stdev_norm_fgdepar=1.1584, expected range: 0.4340 0.9725
Atmospheric Motion Vector
All HIMAWARI-8 AMV CLOUDY WV3 ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 134.18 895.15
resat
All NOAA-19 SBUV ALL LAYERS Global : all data missing
Severely_persistent: obs_number=0, expected range: 513.74 559.64
Radiosondes
LAND TEMP WIND VECTOR DIFF (M/S) 21946 (2 pressure layers affected) : out of range
Severe: rms_fgdepar=23.8312, expected range: 0.0000 5.5607
LAND TEMP WIND VECTOR DIFF (M/S) 32618 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: rms_fgdepar=15.5988, expected range: 0.0000 8.5245
LAND TEMP WIND VECTOR DIFF (M/S) 21946 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: avg_fgdepar=28.3751, expected range: -0.4895 5.6783
Severe: avg_pge=0.9402, expected range: -0.6682 0.7500
HIGH RESO LAND TEMP TEMPERATURE (K) 30557 PRESSURE LAYER 900-1200 (HPA : out of range
2 times in the last 10 days for at least one item
Severe: avg_pge=0.9015, expected range: -0.9379 0.7500
HIGH RESO LAND TEMP TEMPERATURE (K) 72249 PRESSURE LAYER 900-1200 (HPA : out of range
Severe: rms_fgdepar=6.3344, expected range: 0.0000 2.3106
HIGH RESO LAND TEMP WIND VECTOR DIFF (M/S) 17607 PRESSURE LAYER 300-60 : out of range
Severe: rms_fgdepar=16.5007, expected range: 0.0000 4.7335
Severe: avg_pge=0.8025, expected range: -0.0527 0.0721
amdar
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU0544 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=15.0472, expected range: 0.0000 8.2988
WIGOS AMDAR WIND VECTOR DIFF (M/S) EU8536 PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=17.9699, expected range: 0.0000 7.3765
WIGOS AMDAR TEMPERATURE (K) 5CCUNVRA PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=6.1849, expected range: 0.0000 3.3003
WIGOS AMDAR TEMPERATURE (K) YUOUNVJA PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=7.0985, expected range: 0.0000 2.3603
WIGOS AMDAR Q (G/KG) WKDUOFBA PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=5.8994, expected range: 0.0000 2.8425
MODE-S WIND VECTOR DIFF (M/S) M077F89 PRESSURE LAYER 900-1200 (HPA) : out of range
Severe: rms_fgdepar=16.1323, expected range: 0.0000 7.0422
ADS-C WIND VECTOR DIFF (M/S) C03XONRA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=23.8284, expected range: 0.0000 15.3238
ADS-C WIND VECTOR DIFF (M/S) NVTCZCJA PRESSURE LAYER 0-300 (HPA) : out of range
Severe: rms_fgdepar=24.9178, expected range: 0.0000 9.0766
pilot
LAND PILOT WIND VECTOR DIFF (M/S) 96749 PRESSURE LAYER 600-900 (HPA) : out of range
Severe: avg_fgdepar=35.6037, expected range: -0.4123 6.0687
Severe: rms_fgdepar=35.6037, expected range: 0.0000 6.1169
Severe: avg_pge=0.9550, expected range: -0.5590 0.7500
synop
MANUAL LAND SYNOP RH2M (%) 65125 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=55.1812, expected range: -32.2641 97.7121
Severely_persistent: rms_fgdepar=55.1812, expected range: 0.0000 97.7121
Severely_persistent: avg_pge=0.8907, expected range: -1.3325 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 31102 : out of range
9 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8560, expected range: -1.1049 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 76548 : out of range
5 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8227, expected range: -1.1623 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) 81834 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8418, expected range: 0.6243 0.7500
BUFR LAND SYNOP SURFACE PRESSURE (PA) _MI126CC : out of range
43 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-553.1741, expected range: -654.0270 -504.7011
Severely_persistent: rms_fgdepar=554.1283, expected range: 504.4242 654.6998
BUFR LAND SYNOP SURFACE PRESSURE (PA) _MI15AAF : out of range
13 times in the last 10 days for at least one item
Severely_persistent: rms_fgdepar=502.7590, expected range: 425.7600 581.2744
MANUAL LAND SYNOP RH2M (%) 41785 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.9399, expected range: -0.7770 0.7500
MANUAL LAND SYNOP RH2M (%) 64706 : out of range
Severe: rms_fgdepar=46.1275, expected range: 0.0000 43.4591
Severe: avg_pge=0.9987, expected range: -0.0328 0.0475
MANUAL LAND SYNOP RH2M (%) 67020 : out of range
Severe: avg_fgdepar=-50.9534, expected range: -50.4180 24.9562
Severe: rms_fgdepar=50.9534, expected range: 0.0000 50.4374
Severe: avg_pge=0.9997, expected range: -0.2853 0.3479
MANUAL LAND SYNOP RH2M (%) 67665 : out of range
Severe: avg_pge=0.8399, expected range: -0.0033 0.0103
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 42492 : out of range
Severe: rms_fgdepar=379.4965, expected range: 0.0000 153.9412
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 82571 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8668, expected range: -0.4435 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 83925 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-801.3967, expected range: -587.1562 363.0574
Severe: rms_fgdepar=801.3967, expected range: 0.0000 552.3629
Severe: avg_pge=0.9291, expected range: -1.3673 0.7500
MANUAL LAND SYNOP SURFACE PRESSURE (PA) 86128 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8159, expected range: -0.7773 0.7500
BUFR LAND SYNOP RH2M (%) 16138 : out of range
Severe: rms_fgdepar=30.2206, expected range: 0.0000 13.6023
BUFR LAND SYNOP SURFACE PRESSURE (PA) 11933 : out of range
Severe: rms_fgdepar=338.2534, expected range: 0.0000 80.4812
Severe: avg_pge=0.8192, expected range: -0.0365 0.0415
BUFR LAND SYNOP SURFACE PRESSURE (PA) 14258 : out of range
Severe: rms_fgdepar=368.9403, expected range: 0.0000 119.1814
BUFR LAND SYNOP SURFACE PRESSURE (PA) 16153 : out of range
Severe: rms_fgdepar=352.6395, expected range: 0.0000 197.2371
Severe: avg_pge=0.8260, expected range: -0.4707 0.6872
BUFR LAND SYNOP SURFACE PRESSURE (PA) 27176 : out of range
Severe: rms_fgdepar=539.0424, expected range: 0.0000 88.5482
BUFR LAND SYNOP SURFACE PRESSURE (PA) 29974 : out of range
Severe: rms_fgdepar=576.0229, expected range: 0.0000 262.7370
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48062 : out of range
Severe: rms_fgdepar=386.8282, expected range: 11.6386 130.4991
BUFR LAND SYNOP SURFACE PRESSURE (PA) 48350 : out of range
Severe: rms_fgdepar=418.9035, expected range: 0.0000 185.1641
ship
AUTOMATIC SHIP WIND VECTOR DIFF (M/S) 46205 : out of range
7 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8722, expected range: -0.5231 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) OUIY2 : out of range
10 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-527.0574, expected range: -1213.4675 55.5170
Severely_persistent: rms_fgdepar=527.0574, expected range: 0.0000 1213.3980
BUFR SHIP SYNOP SURFACE PRESSURE (PA) SKEC : out of range
8 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8622, expected range: -1.5821 0.7500
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) D5YO8 : out of range
Severe: rms_fgdepar=22.8316, expected range: 0.0000 17.8038
BUFR SHIP SYNOP WIND VECTOR DIFF (M/S) JPTX : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=20.0019, expected range: -18.7623 30.4394
Severe: rms_fgdepar=20.1117, expected range: 0.0000 30.3787
Severe: avg_pge=0.9142, expected range: -1.3304 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 7KDP : out of range
Severe: avg_fgdepar=518.4218, expected range: -1018.2729 1379.2860
Severe: rms_fgdepar=518.4218, expected range: 0.0000 1357.7139
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HA4455 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=447.1302, expected range: 0.0000 201.0404
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9HRJ9 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=328.2530, expected range: 0.0000 115.5008
BUFR SHIP SYNOP SURFACE PRESSURE (PA) 9V5774 : out of range
Severe: avg_pge=0.8151, expected range: -0.6212 0.7500
BUFR SHIP SYNOP SURFACE PRESSURE (PA) C6FN5 : out of range
Severe: rms_fgdepar=360.3999, expected range: 0.0000 112.9262
BUFR SHIP SYNOP SURFACE PRESSURE (PA) WDH7554 : out of range
3 times in the last 10 days for at least one item
Severe: avg_fgdepar=-865.0505, expected range: -242.9738 264.3156
Severe: rms_fgdepar=865.0505, expected range: 0.0000 158.6744
Severe: avg_pge=0.8943, expected range: -0.1234 0.1512
buoy
MOORED BUOYS WIND VECTOR DIFF (M/S) 4600080 : out of range
18 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.9152, expected range: -1.0933 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 4802597 : out of range
17 times in the last 10 days for at least one item
Severely_persistent: avg_pge=0.8875, expected range: -1.5012 0.7500
MOORED BUOYS SURFACE PRESSURE (PA) 6200084 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=522.6467, expected range: -70.9237 94.8287
Severe: rms_fgdepar=525.9017, expected range: 0.0000 100.4410
Severe: avg_pge=0.8871, expected range: -0.3084 0.3881
DRIFTING BUOYS SURFACE PRESSURE (PA) 4301608 : out of range
1 times in the last 10 days for at least one item
Severe: avg_pge=0.8664, expected range: -1.1961 0.7500
DRIFTING BUOYS SURFACE PRESSURE (PA) 6204595 : out of range
1 times in the last 10 days for at least one item
Severe: avg_fgdepar=-599.0754, expected range: -375.3887 376.2544
Severe: rms_fgdepar=609.4524, expected range: -374.9911 534.2986
Severe: avg_pge=0.9094, expected range: -1.3699 0.7500
metar
METAR SURFACE PRESSURE (PA) LIEA : out of range
Severe: rms_fgdepar=371.2091, expected range: 0.0000 83.0530
METAR SURFACE PRESSURE (PA) LUBM : out of range
Severe: rms_fgdepar=487.6650, expected range: 0.0000 123.2379
METAR SURFACE PRESSURE (PA) MBPV : out of range
Severe: avg_fgdepar=529.8027, expected range: -286.8776 147.1180
Severe: rms_fgdepar=529.8027, expected range: 0.0000 294.6470
snow
BUFR LAND SYNOP SNOW (CM) _MF1EB15 : out of range
38 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-789.5549, expected range: -783.1090 -763.7088
Severely_persistent: rms_fgdepar=789.5550, expected range: 764.0600 782.8553
MANUAL LAND SYNOP SNOW (CM) 23078 : out of range
Severe: rms_fgdepar=25.2877, expected range: 1.9405 13.6751
MANUAL LAND SYNOP SNOW (CM) 29367 : out of range
1 times in the last 10 days for at least one item
Severe: rms_fgdepar=22.9581, expected range: 0.0000 3.6615
BUFR LAND SYNOP SNOW (CM) _MF1378B : out of range
2 times in the last 10 days for at least one item
Severe: rms_fgdepar=27.6664, expected range: 1.4829 13.0630
t2m
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 71052 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.5179, expected range: -23.1167 -8.0932
Severely_persistent: rms_fgdepar=13.5668, expected range: 8.2074 23.1147
BUFR LAND SYNOP 2M TEMPERATURE (K) 71052 : out of range
12 times in the last 10 days for at least one item
Severely_persistent: avg_fgdepar=-13.2670, expected range: -22.6877 -8.6739
Severely_persistent: rms_fgdepar=13.3367, expected range: 8.7804 22.7055
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 04301 : out of range
Severe: avg_fgdepar=-15.1552, expected range: -13.4278 9.4558
Severe: rms_fgdepar=15.1961, expected range: 0.0000 12.4555
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 68255 : out of range
Severe: avg_fgdepar=-14.1171, expected range: -7.0488 6.5200
Severe: rms_fgdepar=14.1171, expected range: 0.0000 6.4898
AUTOMATIC LAND SYNOP 2M TEMPERATURE (K) 89828 : out of range
Severe: avg_fgdepar=16.0858, expected range: -10.2547 11.6978
Severe: rms_fgdepar=16.2260, expected range: 0.0000 9.3741
MANUAL LAND SYNOP 2M TEMPERATURE (K) 83925 : out of range
Severe: rms_fgdepar=11.7260, expected range: 0.0000 5.9103
BUFR LAND SYNOP 2M TEMPERATURE (K) 04301 : out of range
Severe: avg_fgdepar=-15.4632, expected range: -14.1523 9.9689
Severe: rms_fgdepar=15.5026, expected range: -6.6140 13.1042
BUFR LAND SYNOP 2M TEMPERATURE (K) 89828 : out of range
Severe: avg_fgdepar=14.7789, expected range: -8.2924 8.9098
Severe: rms_fgdepar=15.1143, expected range: 0.3556 8.2298
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI14199 : out of range
Severe: rms_fgdepar=10.9979, expected range: 0.2853 3.4027
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI15A6E : out of range
Severe: rms_fgdepar=12.0104, expected range: 0.0000 7.2141
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI16C34 : out of range
Severe: avg_fgdepar=12.4780, expected range: -1.5564 9.6550
Severe: rms_fgdepar=12.6280, expected range: 0.0000 9.7578
BUFR LAND SYNOP 2M TEMPERATURE (K) _MI19A95 : out of range
Severe: avg_fgdepar=13.4126, expected range: -0.9111 8.5728
Severe: rms_fgdepar=13.4924, expected range: 0.0000 8.8139
rh2m
MANUAL LAND SYNOP RH2M (%) 16138 : out of range
Severe: rms_fgdepar=32.1723, expected range: 0.0000 14.8270
MANUAL LAND SYNOP RH2M (%) 41061 : out of range
Severe: rms_fgdepar=30.1028, expected range: 8.7227 20.5120
LAND TEMP RH2M (%) 16064 : out of range
Severe: rms_fgdepar=38.8554, expected range: 0.0000 15.4676
BUFR LAND SYNOP RH2M (%) 08347 : out of range
Severe: rms_fgdepar=39.3831, expected range: 0.1300 21.3933
BUFR LAND SYNOP RH2M (%) 60178 : out of range
Severe: rms_fgdepar=31.3661, expected range: 0.0000 16.9538
BUFR LAND SYNOP RH2M (%) _MI1075F : out of range
Severe: rms_fgdepar=30.7331, expected range: 0.0000 16.8369
BUFR LAND SYNOP RH2M (%) _MI1281C : out of range
Severe: rms_fgdepar=32.0232, expected range: 0.0000 15.8611
BUFR LAND SYNOP RH2M (%) _MI14211 : out of range
Severe: rms_fgdepar=33.7270, expected range: 0.0000 16.4213
BUFR LAND SYNOP RH2M (%) _MI14558 : out of range
Severe: rms_fgdepar=35.0086, expected range: 0.0000 17.5879
BUFR LAND SYNOP RH2M (%) _MI15A49 : out of range
Severe: rms_fgdepar=31.3471, expected range: 0.0000 17.2706
BUFR LAND SYNOP RH2M (%) _MI16DC3 : out of range
Severe: rms_fgdepar=34.7987, expected range: 0.0000 13.6846
BUFR LAND SYNOP RH2M (%) _MI19CB7 : out of range
Severe: rms_fgdepar=33.9473, expected range: 0.0000 13.9888
BUFR LAND SYNOP RH2M (%) _MI1B1C1 : out of range
Severe: rms_fgdepar=31.5226, expected range: 0.0000 13.2767
BUFR LAND SYNOP RH2M (%) _MI1BB7F : out of range
Severe: rms_fgdepar=32.1579, expected range: 0.0000 14.3612
BUFR LAND SYNOP RH2M (%) _MI1D057 : out of range
Severe: rms_fgdepar=35.0177, expected range: 0.0000 13.1604
BUFR LAND SYNOP RH2M (%) _MI1E1F6 : out of range
Severe: rms_fgdepar=31.5032, expected range: 0.0000 16.2083