Zezo forum:

Post by Alexandria | 2019-11-06 | 06:02:55

At 0558 UTC, the information returned by having the cursor on "GFS: 00Z" is "Last file: gfs.t00z+36h".

19 Comments

Post by toxcct | 2019-11-06 | 10:41:00

And now, it seems to be stuck integrating t06z+15h...

Post by zezo | 2019-11-06 | 10:42:11

NCEP Operational Status Message
Wed Nov 6 05:31:00 2019 GMT
NOUS42 KWNO 060530
ADMNFD

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
0530Z WED NOV 06 2019

The nomads.ncep.noaa.gov site is currently slow to respond...we
are investigating.

SDM/NCO/NCEP

Post by zezo | 2019-11-06 | 10:44:53

NOAA server was timing out last night.

Right now the last available file is still 15z

Post by toxcct | 2019-11-06 | 10:58:36

Thanks Cvetan.

Where can we see these status online (if any) ?

Post by zezo | 2019-11-06 | 11:44:29

Above comes from

https://tgftp.nws.noaa.gov/tgstatus/

Main page is
https://www.nco.ncep.noaa.gov/pmb/nwprod/prodstat/index.html

But right now it's all green because the problem is not with the model itself. More like a failing server in the load-balancing structure.

It happens few times/year and they usually resolve it in a day or two.

Post by sylvainmeteo | 2019-11-06 | 11:57:52

Looks like it's solved

Post by zezo | 2019-11-06 | 11:59:51

Yes, router is in sync with NOAA now. Not sure about VR.

It looks like the server fails at peak time, but works 2 hours later.

Post by zezo | 2019-11-06 | 15:51:13

from the NOMADS mailing list:

During the last 24hrs, the data center hosting NOMADS began experiencing communications issues. These communication issues may cause slow access to NOMADS grib filter and other services, as well as delayed receipt of model data to NOMADS. We are actively troubleshooting this issue and working towards a resolution.

Post by zezo | 2019-11-06 | 16:04:39

nomads server is totally unresponsive now:

500 Status read failed: Connection reset by peer

Post by zezo | 2019-11-06 | 16:11:28

But an alternate server seems to be responding, so switching the source for a while.

Post by toxcct | 2019-11-06 | 16:15:53

Not sure VR switches source or not in such case...

Post by zezo | 2019-11-06 | 16:27:23

They are still running old data. Some of it is even 00z

BUT

-They will get in sync sooner or later.
-Future route depends on future data, so it's better to use the last grib in the long run

Current conditions will diverge, of course. Not sure which is worse.

Post by toxcct | 2019-11-06 | 16:57:44

Yeah, i'm seeing a bit of divergence around brazil on the NY-SF Record right now.
Hope it gets back soon ^^

Post by zezo | 2019-11-06 | 17:10:24

Reverting the first 30 hours or so to GFS06, because VR is still running that and NOAA nomads is still down.

Post by zezo | 2019-11-06 | 17:52:07

Udate: VR is running 12z now, so switching back to current data.

Post by zezo | 2019-11-06 | 18:33:41

Another update from the NOMADS mailing list:

A quick update. We have moved our FTPPRD site to our College Park center, and NOMADS is now in Boulder. This should help alleviate the issues that are currently plaguing NOMADS and other websites that are hosted out of College Park. We expect some further congestion/contention on our web services as customers work to pick up the data that they have been missing for the last few cycles, so please be patient if download speeds still appear to be slow, but we believe there should be an overall improvement moving forward.

Another update will come later today when we have fully restored services in College Park.

Post by toxcct | 2019-11-13 | 13:44:28

Hi Cvetan,
any known issue with the gribs today ?
It seems we're stuck with 06Z+381h, while the "06 UTC GFS" status is fully complete on the NCEP side...

Post by zezo | 2019-11-13 | 14:01:15

NOAA are doing some network maintenance again.

In the early afternoon VR were still running with GFS00z data, so I reverted to it too. One hour later tha game was in sync so I updated again, and the manual interventions mess the indicator logic a bit.

I'l be keeping an eye on it because NOAA says:

The NOMADS site is currently undergoing network upgrades. This work is causing users to see slowness and for the site to sometimes be unresponsive. This work began yesterday and is scheduled to conclude tomorrow. Once the work is complete, users will see NOMADS services return to normal. We appreciate your patience while we make these important infrastructure upgrades.

--