Page 1 of 3

missing points from all projects 19600 since yesterday

Posted: Thu Oct 12, 2023 4:38 pm
by mattifolder
Since yesterday my comuter folded 9 projects 19600 without errors. Also all were uploaded to server without errors. They are not in EOC database. The point summary at my FAH page (https://stats.foldingathome.org/donor/id/15961) ist actually the same as from EOC (https://folding.extremeoverclocking.com ... =&u=371390), so that this can't be only a failure in EOC database.

The upload was done to server 160.45.68.201. Here one section from log file for successfully upload:

Code: Select all

16:08:54:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
16:08:54:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:19600 run:334 clone:0 gen:787 core:0x22 unit:0x000000000000031300004c900000014e
16:08:54:WU01:FS00:Uploading 1.97MiB to 160.45.68.201
16:08:54:WU01:FS00:Connecting to 160.45.68.201:8080
16:08:54:WU00:FS00:Downloading 1.63MiB
16:08:54:WU00:FS00:Download complete
16:08:54:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:19600 run:27 clone:0 gen:754 core:0x22 unit:0x00000000000002f200004c900000001b
16:08:54:WU00:FS00:Starting
16:08:54:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 15760 -checkpoint 3 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100 -forceasm
16:08:54:WU00:FS00:Started FahCore on PID 6768
16:08:54:WU00:FS00:Core PID:8908
16:08:54:WU00:FS00:FahCore 0x22 started
16:08:55:WU00:FS00:0x22:*********************** Log Started 2023-10-12T16:08:54Z ***********************
16:08:55:WU01:FS00:Upload complete

Re: missing points from all projects 19600 since yesterday

Posted: Thu Oct 12, 2023 6:17 pm
by TheWolf
I seeing the same, very low workunit counts as well. I have six GPU's all fairly high end that has been doing on avg. of 13 to 15 million PPD.
For the past 3 days that unit count has dropped from 150ish to 50 to 60 range with a points drop of around 10m PPD.
Something is very wrong with the points system and unit count.

Re: missing points from all projects 19600 since yesterday

Posted: Thu Oct 12, 2023 6:38 pm
by TheWolf
To add to this I get alot of WU's from server 160.45.68.201 that only take around 35 mins. to complete and one of the reasions my WU count is so high. With all my cards ranging from Titan Xp, Tesla P100, Tesla P40, RTX 3060 12GB, Titan X "Pascal" and Tesla M40 <= 45 mins.
All but one are working these 19600 WU's so my WU count shouldn't be only 9 for the past 12 hours.

Re: missing points from all projects 19600 since yesterday

Posted: Thu Oct 12, 2023 6:47 pm
by TheWolf

Re: missing points from all projects 19600 since yesterday

Posted: Thu Oct 12, 2023 8:18 pm
by Joe_H
I have sent a message to the researcher running 19600 and the stats database manager.

Re: missing points from all projects 19600 since yesterday

Posted: Thu Oct 12, 2023 8:50 pm
by TheWolf
Thanks Joe! The 3060 is the only card not running these for some reasion. It gets project 18725 over and over and takes around 4:30 to complete.
I do get other projects on all the other cards, but they are far and few between. I did get one other project that was different I saw today on either
the Titan X or P100 but I didn't catch the project number and I do see a extra WU at 3pm I'm sure it was that one.

Re: missing points from all projects 19600 since yesterday

Posted: Thu Oct 12, 2023 10:37 pm
by mattifolder
Joe_H wrote: Thu Oct 12, 2023 8:18 pm I have sent a message to the researcher running 19600 and the stats database manager.
Thank you. :)

Re: missing points from all projects 19600 since yesterday

Posted: Fri Oct 13, 2023 12:40 am
by BobWilliams757
Good eye Mattifolder!

I had a couple as well, starting on the 11th. All prior to that seem to have been credited.

Re: missing points from all projects 19600 since yesterday

Posted: Fri Oct 13, 2023 5:01 am
by TheWolf
I just set some to finish until this is fixed. No since wasting power the power bill is 400+ esch month as is.
Others I chaned the config to see if they pick up something different. If not I will shut those down too.
Hope to see this fixed soon other wise I will just stop folding.
Good luck with a fix.

Re: missing points from all projects 19600 since yesterday

Posted: Fri Oct 13, 2023 5:02 am
by mattifolder
There are also points for a 19506 project missing.

Re: missing points from all projects 19600 since yesterday

Posted: Fri Oct 13, 2023 2:11 pm
by TheWolf
Good morning, still seeing the same thing lots of work sent back without getting any points.
On a good note its my BD turned 68 and on one rig I picked up a 19504 project, but it from server 201
so I do not expect to aee any points for it either. Server 201 has to be super backlogged after four days
of not giving donors any updates for their hard work?

No credit from project 19600

Posted: Mon Oct 16, 2023 11:21 am
by Zac67
Merged with existing topic - j

Today I've had the second WU (at least) from that project without getting any credit:

06:54:05:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
06:54:05:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:19600 run:880 clone:0 gen:565 core:0x22 unit:0x000000000000023500004c9000000370
06:54:05:WU00:FS01:Uploading 2.61MiB to 160.45.68.201
06:54:05:WU00:FS01:Connecting to 160.45.68.201:8080
06:54:06:WU00:FS01:Upload complete
06:54:06:WU00:FS01:Server responded WORK_ACK (400)
06:54:06:WU00:FS01:Final credit estimate, 55916.00 points

Re: missing points from all projects 19600 since yesterday

Posted: Mon Oct 16, 2023 1:34 pm
by fz4z
Image

Re: missing points from all projects 19600 since yesterday

Posted: Mon Oct 16, 2023 4:20 pm
by Joe_H
I have access to a different graph that shows the total points and hours being logged by the stats database, that does not show such a dip. I suspect there is also a problem with generating the flat files that EOC downloads to use for its stats display.

Re: missing points from all projects 19600 since yesterday

Posted: Mon Oct 16, 2023 5:01 pm
by Zac67
My first missing credit WU from that project that's still in the logs is from 4 Oct, so this issue isn't really new. I'm blackholing 160.45.68.201 until this is sorted out.