Page 1 of 1
Upload failing to WS/CS 128.252.203.10
Posted: Sat Jun 18, 2022 4:53 pm
by TheWolf
Code: Select all
*********************** Log Started 2022-06-18T04:30:34Z ***********************
04:41:53:WARNING:WU01:FS00:Failed to send results, will try again later
04:53:14:WARNING:WU01:FS00:Failed to send results, will try again later
04:53:14:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
04:53:14:WARNING:WU01:FS00:Exception: Failed to send results to work server: Failed to connect to 66.170.111.50:80: A socket operation was attempted to an unreachable host.
04:53:14:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
04:53:14:ERROR:WU01:FS00:Exception: Failed to connect to 128.252.203.10:80: A socket operation was attempted to an unreachable host.
05:26:05:WARNING:WU01:FS00:Failed to send results, will try again later
05:57:20:WARNING:WU01:FS00:Failed to send results, will try again later
06:29:11:WARNING:WU01:FS00:Failed to send results, will try again later
06:59:17:WARNING:WU01:FS00:Failed to send results, will try again later
06:59:37:WARNING:WU01:FS00:Exception: Failed to send results to work server: Transfer failed
06:59:40:ERROR:WU01:FS00:Exception: Transfer failed
07:12:14:WARNING:WU01:FS00:Failed to send results, will try again later
07:23:33:WARNING:WU01:FS00:Failed to send results, will try again later
07:34:50:WARNING:WU01:FS00:Failed to send results, will try again later
07:46:06:WARNING:WU01:FS00:Failed to send results, will try again later
07:57:23:WARNING:WU01:FS00:Failed to send results, will try again later
08:08:40:WARNING:WU01:FS00:Failed to send results, will try again later
08:26:34:WARNING:WU01:FS00:Failed to send results, will try again later
08:55:41:WARNING:WU01:FS00:Failed to send results, will try again later
09:42:39:WARNING:WU01:FS00:Failed to send results, will try again later
******************************* Date: 2022-06-18 *******************************
10:42:35:WARNING:WU01:FS00:Failed to send results, will try again later
06:29:11:WARNING:WU01:FS00:Failed to send results, will try again later
06:59:17:WARNING:WU01:FS00:Failed to send results, will try again later
06:59:37:WARNING:WU01:FS00:Exception: Failed to send results to work server: Transfer failed
06:59:40:ERROR:WU01:FS00:Exception: Transfer failed
07:12:14:WARNING:WU01:FS00:Failed to send results, will try again later
07:23:33:WARNING:WU01:FS00:Failed to send results, will try again later
07:34:50:WARNING:WU01:FS00:Failed to send results, will try again later
07:46:06:WARNING:WU01:FS00:Failed to send results, will try again later
07:57:23:WARNING:WU01:FS00:Failed to send results, will try again later
08:08:40:WARNING:WU01:FS00:Failed to send results, will try again later
08:26:34:WARNING:WU01:FS00:Failed to send results, will try again later
08:55:41:WARNING:WU01:FS00:Failed to send results, will try again later
09:42:39:WARNING:WU01:FS00:Failed to send results, will try again later
******************************* Date: 2022-06-18 *******************************
10:42:35:WARNING:WU01:FS00:Failed to send results, will try again later
11:42:56:WARNING:WU01:FS00:Failed to send results, will try again later
12:42:33:WARNING:WU01:FS00:Failed to send results, will try again later
13:32:09:WARNING:WU01:FS00:Failed to send results, will try again later
13:43:24:WARNING:WU01:FS00:Failed to send results, will try again later
13:55:42:WARNING:WU01:FS00:Failed to send results, will try again later
14:07:11:WARNING:WU01:FS00:Failed to send results, will try again later
14:18:24:WARNING:WU01:FS00:Failed to send results, will try again later
14:29:35:WARNING:WU01:FS00:Failed to send results, will try again later
14:47:35:WARNING:WU01:FS00:Failed to send results, will try again later
15:16:35:WARNING:WU01:FS00:Failed to send results, will try again later
16:03:33:WARNING:WU01:FS00:Failed to send results, will try again later
******************************* Date: 2022-06-18 *******************************
16:52:23:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
16:52:25:WARNING:WU01:FS00:Exception: Failed to send results to work server: Failed to connect to 66.170.111.50:80: No connection could be made because the target machine actively refused it.
Re: Upload failing to WS 128.252.203.10
Posted: Sat Jun 18, 2022 5:33 pm
by Joe_H
I have sent a message to the person listed as responsible for this server.
Re: Unable to upload to server 66.170.111.50
Posted: Sat Jun 18, 2022 5:44 pm
by TheWolf
Code: Select all
17:06:59:WU01:FS00:Trying to send results to collection se
17:06:59:WU01:FS00:Uploading 65.16MiB to 128.252.203.10
17:06:59:WU01:FS00:Connecting to 128.252.203.10:8080
17:07:03:WU02:FS00:0x22:Attempting to create CUDA context:
17:07:03:WU02:FS00:0x22: Configuring platform CUDA
17:07:05:WU01:FS00:Upload 1.06%
17:07:07:WU02:FS00:0x22: Using CUDA and gpu 0
17:07:07:WU02:FS00:0x22:Completed 2250000 out of 2500000 s
17:07:11:WU01:FS00:Upload 2.30%
17:07:17:WU01:FS00:Upload 3.64%
17:07:23:WU01:FS00:Upload 4.99%
17:07:29:WU01:FS00:Upload 6.23%
17:07:35:WU01:FS00:Upload 7.58%
17:07:41:WU01:FS00:Upload 8.82%
17:07:47:WU01:FS00:Upload 10.17%
17:07:53:WU01:FS00:Upload 11.41%
17:07:59:WU01:FS00:Upload 12.66%
17:08:05:WU01:FS00:Upload 13.91%
17:08:11:WU01:FS00:Upload 15.25%
17:08:17:WU01:FS00:Upload 16.59%
17:08:23:WU01:FS00:Upload 17.84%
17:08:29:WU01:FS00:Upload 19.18%
17:08:35:WU01:FS00:Upload 20.53%
17:08:41:WU01:FS00:Upload 21.77%
17:08:47:WU01:FS00:Upload 23.12%
17:08:53:WU01:FS00:Upload 24.36%
17:08:59:WU01:FS00:Upload 25.71%
17:09:05:WU01:FS00:Upload 26.95%
17:09:11:WU01:FS00:Upload 28.20%
17:09:17:WU01:FS00:Upload 29.54%
17:09:23:WU01:FS00:Upload 30.89%
17:09:29:WU01:FS00:Upload 32.13%
17:09:35:WU01:FS00:Upload 33.48%
17:09:41:WU01:FS00:Upload 34.72%
17:09:47:WU01:FS00:Upload 36.06%
17:09:53:WU01:FS00:Upload 37.41%
17:09:59:WU01:FS00:Upload 38.65%
17:10:05:WU01:FS00:Upload 40.00%
17:10:11:WU01:FS00:Upload 41.24%
17:10:17:WU01:FS00:Upload 42.59%
17:10:23:WU01:FS00:Upload 43.93%
17:10:29:WU01:FS00:Upload 45.18%
17:10:35:WU01:FS00:Upload 46.52%
17:10:41:WU01:FS00:Upload 47.77%
17:10:47:WU01:FS00:Upload 49.01%
17:10:47:WU02:FS00:0x22:Completed 2275000 out of 2500000 s
17:10:53:WU01:FS00:Upload 50.36%
17:10:59:WU01:FS00:Upload 51.60%
17:11:05:WU01:FS00:Upload 52.95%
17:11:11:WU01:FS00:Upload 54.29%
17:11:17:WU01:FS00:Upload 55.54%
17:11:23:WU01:FS00:Upload 56.88%
17:11:29:WU01:FS00:Upload 58.13%
17:11:35:WU01:FS00:Upload 59.47%
17:11:41:WU01:FS00:Upload 60.72%
17:11:47:WU01:FS00:Upload 62.06%
17:11:53:WU01:FS00:Upload 63.31%
17:11:59:WU01:FS00:Upload 64.65%
17:12:05:WU01:FS00:Upload 65.99%
17:12:11:WU01:FS00:Upload 67.33%
17:12:17:WU01:FS00:Upload 68.58%
17:12:23:WU01:FS00:Upload 69.92%
17:12:29:WU01:FS00:Upload 71.27%
17:12:35:WU01:FS00:Upload 72.51%
17:12:41:WU01:FS00:Upload 73.86%
17:12:47:WU01:FS00:Upload 75.10%
17:12:53:WU01:FS00:Upload 76.45%
17:12:59:WU01:FS00:Upload 77.69%
17:13:05:WU01:FS00:Upload 79.04%
17:13:11:WU01:FS00:Upload 80.28%
17:13:17:WU01:FS00:Upload 81.63%
17:13:23:WU01:FS00:Upload 82.39%
17:13:31:WU01:FS00:Upload 83.35%
17:13:37:WU01:FS00:Upload 84.60%
17:13:44:WU01:FS00:Upload 85.94%
17:13:50:WU01:FS00:Upload 87.28%
17:13:57:WU01:FS00:Upload 87.67%
17:14:03:WU01:FS00:Upload 88.72%
17:14:09:WU01:FS00:Upload 89.97%
17:14:15:WU01:FS00:Upload 91.03%
17:14:21:WU01:FS00:Upload 92.27%
17:14:27:WU01:FS00:Upload 93.62%
17:14:28:WU02:FS00:0x22:Completed 2300000 out of 2500000 s
17:14:30:WU02:FS00:0x22:Checkpoint completed at step 23000
17:14:33:WU01:FS00:Upload 94.86%
17:14:39:WU01:FS00:Upload 96.11%
17:14:45:WU01:FS00:Upload 97.45%
17:14:51:WU01:FS00:Upload 98.70%
17:14:58:WU01:FS00:Upload 99.27%
17:15:08:WU01:FS00:Upload complete
17:15:08:WU01:FS00:Server responded WORK_ACK (400)
17:15:08:WU01:FS00:Final credit estimate, 202822.00 points
17:15:08:WU01:FS00:Cleaning up
It finally uploaded to server .10 for 202k points a 150k loss.
Good work getting something going, thanks.
Sorry about the other post I forgot how to wrap with code.
Re: Unable to upload to server 66.170.111.50
Posted: Sat Jun 18, 2022 6:06 pm
by TheWolf
Code: Select all
17:06:59:WU01:FS00:Trying to send results to collection se
17:06:59:WU01:FS00:Uploading 65.16MiB to 128.252.203.10
17:06:59:WU01:FS00:Connecting to 128.252.203.10:8080
17:07:03:WU02:FS00:0x22:Attempting to create CUDA context:
17:07:03:WU02:FS00:0x22: Configuring platform CUDA
17:07:05:WU01:FS00:Upload 1.06%
17:07:07:WU02:FS00:0x22: Using CUDA and gpu 0
17:07:07:WU02:FS00:0x22:Completed 2250000 out of 2500000 s
17:07:11:WU01:FS00:Upload 2.30%
17:07:17:WU01:FS00:Upload 3.64%
17:07:23:WU01:FS00:Upload 4.99%
17:07:29:WU01:FS00:Upload 6.23%
17:07:35:WU01:FS00:Upload 7.58%
17:07:41:WU01:FS00:Upload 8.82%
17:07:47:WU01:FS00:Upload 10.17%
17:07:53:WU01:FS00:Upload 11.41%
17:07:59:WU01:FS00:Upload 12.66%
17:08:05:WU01:FS00:Upload 13.91%
17:08:11:WU01:FS00:Upload 15.25%
17:08:17:WU01:FS00:Upload 16.59%
17:08:23:WU01:FS00:Upload 17.84%
17:08:29:WU01:FS00:Upload 19.18%
17:08:35:WU01:FS00:Upload 20.53%
17:08:41:WU01:FS00:Upload 21.77%
17:08:47:WU01:FS00:Upload 23.12%
17:08:53:WU01:FS00:Upload 24.36%
17:08:59:WU01:FS00:Upload 25.71%
17:09:05:WU01:FS00:Upload 26.95%
17:09:11:WU01:FS00:Upload 28.20%
17:09:17:WU01:FS00:Upload 29.54%
17:09:23:WU01:FS00:Upload 30.89%
17:09:29:WU01:FS00:Upload 32.13%
17:09:35:WU01:FS00:Upload 33.48%
17:09:41:WU01:FS00:Upload 34.72%
17:09:47:WU01:FS00:Upload 36.06%
17:09:53:WU01:FS00:Upload 37.41%
17:09:59:WU01:FS00:Upload 38.65%
17:10:05:WU01:FS00:Upload 40.00%
17:10:11:WU01:FS00:Upload 41.24%
17:10:17:WU01:FS00:Upload 42.59%
17:10:23:WU01:FS00:Upload 43.93%
17:10:29:WU01:FS00:Upload 45.18%
17:10:35:WU01:FS00:Upload 46.52%
17:10:41:WU01:FS00:Upload 47.77%
17:10:47:WU01:FS00:Upload 49.01%
17:10:47:WU02:FS00:0x22:Completed 2275000 out of 2500000 s
17:10:53:WU01:FS00:Upload 50.36%
17:10:59:WU01:FS00:Upload 51.60%
17:11:05:WU01:FS00:Upload 52.95%
17:11:11:WU01:FS00:Upload 54.29%
17:11:17:WU01:FS00:Upload 55.54%
17:11:23:WU01:FS00:Upload 56.88%
17:11:29:WU01:FS00:Upload 58.13%
17:11:35:WU01:FS00:Upload 59.47%
17:11:41:WU01:FS00:Upload 60.72%
17:11:47:WU01:FS00:Upload 62.06%
17:11:53:WU01:FS00:Upload 63.31%
17:11:59:WU01:FS00:Upload 64.65%
17:12:05:WU01:FS00:Upload 65.99%
17:12:11:WU01:FS00:Upload 67.33%
17:12:17:WU01:FS00:Upload 68.58%
17:12:23:WU01:FS00:Upload 69.92%
17:12:29:WU01:FS00:Upload 71.27%
17:12:35:WU01:FS00:Upload 72.51%
17:12:41:WU01:FS00:Upload 73.86%
17:12:47:WU01:FS00:Upload 75.10%
17:12:53:WU01:FS00:Upload 76.45%
17:12:59:WU01:FS00:Upload 77.69%
17:13:05:WU01:FS00:Upload 79.04%
17:13:11:WU01:FS00:Upload 80.28%
17:13:17:WU01:FS00:Upload 81.63%
17:13:23:WU01:FS00:Upload 82.39%
17:13:31:WU01:FS00:Upload 83.35%
17:13:37:WU01:FS00:Upload 84.60%
17:13:44:WU01:FS00:Upload 85.94%
17:13:50:WU01:FS00:Upload 87.28%
17:13:57:WU01:FS00:Upload 87.67%
17:14:03:WU01:FS00:Upload 88.72%
17:14:09:WU01:FS00:Upload 89.97%
17:14:15:WU01:FS00:Upload 91.03%
17:14:21:WU01:FS00:Upload 92.27%
17:14:27:WU01:FS00:Upload 93.62%
17:14:28:WU02:FS00:0x22:Completed 2300000 out of 2500000 s
17:14:30:WU02:FS00:0x22:Checkpoint completed at step 23000
17:14:33:WU01:FS00:Upload 94.86%
17:14:39:WU01:FS00:Upload 96.11%
17:14:45:WU01:FS00:Upload 97.45%
17:14:51:WU01:FS00:Upload 98.70%
17:14:58:WU01:FS00:Upload 99.27%
17:15:08:WU01:FS00:Upload complete
17:15:08:WU01:FS00:Server responded WORK_ACK (400)
17:15:08:WU01:FS00:Final credit estimate, 202822.00 points
17:15:08:WU01:FS00:Cleaning up
It finally uploaded to server .10 for 202k points a 150k loss.
Good work getting something going, thanks.
Sorry about the other post I forgot how to wrap with code.
Re: Upload failing to WS/CS 128.252.203.10
Posted: Sun Jun 19, 2022 5:32 am
by Joe_H
One of the researchers from the lab responded to my message that they restarted this server. That appears to have cleared up a hung or lost connection to the WS involved and allowed the upload to happen. They could not find any errors in the server logs, other connections and uploads were working.