No appropriate work server was available [ATI]

[DBoone]

Thanks for the update Vijay. We'll hang in there.

[pfv]

Thanks Prof, please keep us often updated

[vvoelz]

Just wanted to let you know that I'm looking into these issues further on the ATI server that I maintain (vspg2v2). So far it looks like WUs are being sent/received fine, but I'll dig deeper into the reported errors. Hopefully we'll figure out what's going on soon.

Vince

p.s. I'm rebuilding the job stack (again) on this machine, so pleas bear with us with the intermittent unavailability...

[Tynat]

Thanks for the updates. Yeah, server is currently unavailable, but the last WU resulted in UNSTABLE_MACHINE five times.

Project: 5745 (Run 0, Clone 59, Gen 228) was first reported as bad on 2009-12-18 (Fri), 5:11 pm. I have added the relevant part of my GPU log to the existing thread.

[VijayPande]

How are things going from the donor side? Has it gotten any better?

[Tynat]

Yes, thank you. There has been a very noticeable improvement. Since my last UNSTABLE_MACHINE report mentioned above, both GPU clients are able to receive work and continue to have clean runs.

[Brazos]

Better here - working on Project: 5742 (Run 2, Clone 275, Gen 0) with no problems yet.

Thanks!

[Sahkolihaa]

My HD3870 seems to be doing fine.

[scottwilkins]

I just checked logs. Some machines showed the unstable error over the weekend. Today all are flowing. Maybe too early to tell if anything has improved yet...

[bruce]

I just checked logs. Some machines showed the unstable error over the weekend. Today all are flowing. Maybe too early to tell if anything has improved yet...

Let's stay on topic here. The topic title is "No appropriate work server..." That was a problem, and I believe that you have to agree that it has certainly improved. The stablity of the WUs being is really a separate issue.

From your perspective, I can see how getting unstable WUs assigned isn't any better than getting no WUs assigned but from the Pande Group's perspective, they have entirely different causes and entirely different fixes. I'm sure that they intend to fix both problems, but you're not answering the question that was asked.

[pfv]

All my ATI clients are receiving WU and are happily folding. Thanks to Bruce for contacting FAH, vvoelz for fixing it and to Prof for the follow up!

[Bog]

Since Monday morning both GPU clients receive good work units in the first attempt - no more waiting and so far no more "UNSTABLE_MACHINE" .

[Bog]

Code: Select all

[16:07:58] Completed 99%
[16:10:03] Completed 100%
[16:10:03] Successful run
[16:10:03] DynamicWrapper: Finished Work Unit: sleep=10000
[16:10:13] Reserved 218672 bytes for xtc file; Cosm status=0
[16:10:13] Allocated 218672 bytes for xtc file
[16:10:13] - Reading up to 218672 from "work/wudata_04.xtc": Read 218672
[16:10:13] Read 218672 bytes from xtc file; available packet space=786211792
[16:10:13] xtc file hash check passed.
[16:10:13] Reserved 33528 33528 786211792 bytes for arc file=<work/wudata_04.trr> Cosm status=0
[16:10:13] Allocated 33528 bytes for arc file
[16:10:13] - Reading up to 33528 from "work/wudata_04.trr": Read 33528
[16:10:13] Read 33528 bytes from arc file; available packet space=786178264
[16:10:13] trr file hash check passed.
[16:10:13] Allocated 560 bytes for edr file
[16:10:13] Read bedfile
[16:10:13] edr file hash check passed.
[16:10:13] Allocated 47277 bytes for logfile
[16:10:13] Read logfile
[16:10:13] GuardedRun: success in DynamicWrapper
[16:10:13] GuardedRun: done
[16:10:13] Run: GuardedRun completed.
[16:10:15] - Writing 300549 bytes of core data to disk...
[16:10:15] Done: 300037 -> 262940 (compressed to 87.6 percent)
[16:10:15]   ... Done.
[16:10:15] - Shutting down core 
[16:10:15] 
[16:10:15] Folding@home Core Shutdown: FINISHED_UNIT
[16:10:19] CoreStatus = 64 (100)
[16:10:19] Sending work to server
[16:10:19] Project: 5737 (Run 1, Clone 311, Gen 60)
[16:10:19] - Read packet limit of 540015616... Set to 524286976.


[16:10:19] + Attempting to send results [August 16 16:10:19 UTC]
[16:10:19] Gpu type=1 species=4.
[16:10:23] - Couldn't send HTTP request to server
[16:10:23] + Could not connect to Work Server (results)
[16:10:23]     (171.64.65.102:8080)
[16:10:23] + Retrying using alternative port
[16:10:25] - Couldn't send HTTP request to server
[16:10:25] + Could not connect to Work Server (results)
[16:10:25]     (171.64.65.102:80)
[16:10:25] - Error: Could not transmit unit 04 (completed August 16) to work server.
[16:10:25]   Keeping unit 04 in queue.
[16:10:25] Project: 5737 (Run 1, Clone 311, Gen 60)
[16:10:25] - Read packet limit of 540015616... Set to 524286976.


[16:10:25] + Attempting to send results [August 16 16:10:25 UTC]
[16:10:25] Gpu type=1 species=4.
[16:10:27] - Couldn't send HTTP request to server
[16:10:27] + Could not connect to Work Server (results)
[16:10:27]     (171.64.65.102:8080)
[16:10:27] + Retrying using alternative port
[16:10:29] - Couldn't send HTTP request to server
[16:10:29] + Could not connect to Work Server (results)
[16:10:29]     (171.64.65.102:80)
[16:10:29] - Error: Could not transmit unit 04 (completed August 16) to work server.
[16:10:29] - Read packet limit of 540015616... Set to 524286976.


[16:10:29] + Attempting to send results [August 16 16:10:29 UTC]
[16:10:29] Gpu type=1 species=4.
[16:10:30] - Couldn't send HTTP request to server
[16:10:30]   (Got status 503)
[16:10:30] + Could not connect to Work Server (results)
[16:10:30]     (171.67.108.17:8080)
[16:10:30] + Retrying using alternative port
[16:14:06] - Couldn't send HTTP request to server
[16:14:06] + Could not connect to Work Server (results)
[16:14:06]     (171.67.108.17:80)
[16:14:06]   Could not transmit unit 04 to Collection server; keeping in queue.
[16:14:06] - Preparing to get new work unit...
[16:14:06] Cleaning up work directory
[16:14:06] + Attempting to get work packet
[16:14:06] Passkey found
[16:14:06] Gpu type=1 species=4.
[16:14:06] - Connecting to assignment server
[16:14:10] + No appropriate work server was available; will try again in a bit.
[16:14:10] + Couldn't get work instructions.
[16:14:10] - Attempt #1  to get work failed, and no other work to do.
Waiting before retry.
[16:14:28] + Attempting to get work packet
[16:14:28] Passkey found
[16:14:28] Gpu type=1 species=4.
[16:14:28] - Connecting to assignment server
[16:14:30] + No appropriate work server was available; will try again in a bit.
[16:14:30] + Couldn't get work instructions.
[16:14:30] - Attempt #2  to get work failed, and no other work to do.
Waiting before retry.
[16:14:42] + Attempting to get work packet
[16:14:42] Passkey found
[16:14:42] Gpu type=1 species=4.
[16:14:42] - Connecting to assignment server
[16:14:45] + No appropriate work server was available; will try again in a bit.
[16:14:45] + Couldn't get work instructions.
[16:14:45] - Attempt #3  to get work failed, and no other work to do.
Waiting before retry.
[16:15:20] + Attempting to get work packet
[16:15:20] Passkey found
[16:15:20] Gpu type=1 species=4.
[16:15:20] - Connecting to assignment server
[16:15:22] + No appropriate work server was available; will try again in a bit.
[16:15:22] + Couldn't get work instructions.
[16:15:22] - Attempt #4  to get work failed, and no other work to do.
Waiting before retry.
[16:16:06] + Attempting to get work packet
[16:16:06] Passkey found
[16:16:06] Gpu type=1 species=4.
[16:16:06] - Connecting to assignment server
[16:16:09] + No appropriate work server was available; will try again in a bit.
[16:16:09] + Couldn't get work instructions.
[16:16:09] - Attempt #5  to get work failed, and no other work to do.
Waiting before retry.
[16:17:41] + Attempting to get work packet
[16:17:41] Passkey found
[16:17:41] Gpu type=1 species=4.
[16:17:41] - Connecting to assignment server
[16:17:46] + No appropriate work server was available; will try again in a bit.
[16:17:46] + Couldn't get work instructions.
[16:17:46] - Attempt #6  to get work failed, and no other work to do.
Waiting before retry.

Folding@Home Client Shutdown.


--- Opening Log file [August 16 16:20:08 UTC] 


# Windows GPU Systray Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.30r2

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: C:\Documents and Settings\Blackcat\Application Data\Folding@home-gpu


[16:20:08] - Ask before connecting: No
[16:20:08] - User name: Bog (Team 176977)
[16:20:08] - User ID: 1DBBC1E51C24AA8A
[16:20:08] - Machine ID: 7
[16:20:08] 
[16:20:08] Gpu type=1 species=4.
[16:20:08] Loaded queue successfully.
[16:20:08] Initialization complete
[16:20:08] - Preparing to get new work unit...
[16:20:08] Cleaning up work directory
[16:20:08] + Attempting to get work packet
[16:20:08] Project: 5737 (Run 1, Clone 311, Gen 60)
[16:20:08] - Read packet limit of 540015616... Set to 524286976.


[16:20:08] + Attempting to send results [August 16 16:20:08 UTC]
[16:20:08] Passkey found
[16:20:08] Gpu type=1 species=4.
[16:20:08] - Connecting to assignment server
[16:20:08] Gpu type=1 species=4.
[16:20:10] - Couldn't send HTTP request to server
[16:20:10] + Could not connect to Work Server (results)
[16:20:10]     (171.64.65.102:8080)
[16:20:10] + Retrying using alternative port
[16:20:11] + No appropriate work server was available; will try again in a bit.
[16:20:11] + Couldn't get work instructions.
[16:20:11] - Attempt #1  to get work failed, and no other work to do.
Waiting before retry.
[16:20:13] - Couldn't send HTTP request to server
[16:20:13] + Could not connect to Work Server (results)
[16:20:13]     (171.64.65.102:80)
[16:20:13] - Error: Could not transmit unit 04 (completed August 16) to work server.
[16:20:13] - Read packet limit of 540015616... Set to 524286976.


[16:20:13] + Attempting to send results [August 16 16:20:13 UTC]
[16:20:13] Gpu type=1 species=4.
[16:20:13] - Couldn't send HTTP request to server
[16:20:13]   (Got status 503)
[16:20:13] + Could not connect to Work Server (results)
[16:20:13]     (171.67.108.17:8080)
[16:20:13] + Retrying using alternative port
[16:20:23] + Attempting to get work packet
[16:20:23] Passkey found
[16:20:23] Gpu type=1 species=4.
[16:20:23] - Connecting to assignment server
[16:20:25] + No appropriate work server was available; will try again in a bit.
[16:20:25] + Couldn't get work instructions.
[16:20:25] - Attempt #2  to get work failed, and no other work to do.
Waiting before retry.
[16:20:37] + Attempting to get work packet
[16:20:37] Passkey found
[16:20:37] Gpu type=1 species=4.
[16:20:37] - Connecting to assignment server
[16:20:38] + No appropriate work server was available; will try again in a bit.
[16:20:38] + Couldn't get work instructions.
[16:20:38] - Attempt #3  to get work failed, and no other work to do.
Waiting before retry.
[16:21:13] + Attempting to get work packet
[16:21:13] Passkey found
[16:21:13] Gpu type=1 species=4.
[16:21:13] - Connecting to assignment server
[16:21:15] + No appropriate work server was available; will try again in a bit.
[16:21:15] + Couldn't get work instructions.
[16:21:15] - Attempt #4  to get work failed, and no other work to do.
Waiting before retry.
[16:21:59] + Attempting to get work packet
[16:21:59] Passkey found
[16:21:59] Gpu type=1 species=4.
[16:21:59] - Connecting to assignment server
[16:22:01] + No appropriate work server was available; will try again in a bit.
[16:22:01] + Couldn't get work instructions.
[16:22:01] - Attempt #5  to get work failed, and no other work to do.
Waiting before retry.
[16:23:25] + Attempting to get work packet
[16:23:25] Passkey found
[16:23:25] Gpu type=1 species=4.
[16:23:25] - Connecting to assignment server
[16:23:27] + No appropriate work server was available; will try again in a bit.
[16:23:27] + Couldn't get work instructions.
[16:23:27] - Attempt #6  to get work failed, and no other work to do.
Waiting before retry.
[16:23:48] - Couldn't send HTTP request to server
[16:23:48] + Could not connect to Work Server (results)
[16:23:48]     (171.67.108.17:80)
[16:23:48]   Could not transmit unit 04 to Collection server; keeping in queue.
[16:26:19] + Attempting to get work packet
[16:26:19] Passkey found
[16:26:19] Gpu type=1 species=4.
[16:26:19] - Connecting to assignment server
[16:26:23] + No appropriate work server was available; will try again in a bit.
[16:26:23] + Couldn't get work instructions.
[16:26:23] - Attempt #7  to get work failed, and no other work to do.
Waiting before retry.
[16:31:44] + Attempting to get work packet
[16:31:44] Passkey found
[16:31:44] Gpu type=1 species=4.
[16:31:44] - Connecting to assignment server
[16:31:46] + No appropriate work server was available; will try again in a bit.
[16:31:46] + Couldn't get work instructions.
[16:31:46] - Attempt #8  to get work failed, and no other work to do.
Waiting before retry.
[16:42:27] + Attempting to get work packet
[16:42:27] Passkey found
[16:42:27] Gpu type=1 species=4.
[16:42:27] - Connecting to assignment server
[16:42:29] + No appropriate work server was available; will try again in a bit.
[16:42:29] + Couldn't get work instructions.
[16:42:29] - Attempt #9  to get work failed, and no other work to do.
Waiting before retry.
[17:03:52] + Attempting to get work packet
[17:03:52] Passkey found
[17:03:52] Gpu type=1 species=4.
[17:03:52] - Connecting to assignment server
[17:03:56] + No appropriate work server was available; will try again in a bit.
[17:03:56] + Couldn't get work instructions.
[17:03:56] - Attempt #10  to get work failed, and no other work to do.
Waiting before retry.
[17:46:39] + Attempting to get work packet
[17:46:39] Passkey found
[17:46:39] Gpu type=1 species=4.
[17:46:39] - Connecting to assignment server
[17:46:43] + No appropriate work server was available; will try again in a bit.
[17:46:43] + Couldn't get work instructions.
[17:46:43] - Attempt #11  to get work failed, and no other work to do.
Waiting before retry.

Here we go again - and this time I am not even able to send the completed work unit .

[bruce]

That server was down from Mon Aug 16 09:00:11 PDT 2010 to 11:00 and you posted at 10:00 PDT. There is a second Work Server for ATI but it is currently out of WUs to assign.