Project 5506: (Run 8, Clone 329, Gen 113)

[Torin3]

I apologize for not saving the log on this one, but I wound up deleting everything in the client directory except the *.dll files to try and not get this one again. I got it about 10 times in a row, and every time it would shut down at "Starting GUI server" with the message NANs detected. I did write down the project number and R/C/G info to make sure I was getting the same WU.

I haven't had any problems with this client up to this point. Even after updating to V 1.13 of FahCore_11, though I did reduce the shader clocks to reduce the heat a bit as this is card 4 in a 4 GPU2 client system.

[Torin3]

It came though again, and I remembered to save the log this time:

Code: Select all

[11:37:51] Completed 100%
[11:37:51] Successful run
[11:37:51] DynamicWrapper: Finished Work Unit: sleep=10000
[11:38:01] Reserved 1129276 bytes for xtc file; Cosm status=0
[11:38:01] Allocated 1129276 bytes for xtc file
[11:38:01] - Reading up to 1129276 from "work/wudata_03.xtc": Read 1129276
[11:38:01] Read 1129276 bytes from xtc file; available packet space=785301188
[11:38:01] xtc file hash check passed.
[11:38:01] Reserved 34800 34800 785301188 bytes for arc file=<work/wudata_03.trr> Cosm status=0
[11:38:01] Allocated 34800 bytes for arc file
[11:38:01] - Reading up to 34800 from "work/wudata_03.trr": Read 34800
[11:38:01] Read 34800 bytes from arc file; available packet space=785266388
[11:38:01] trr file hash check passed.
[11:38:01] Allocated 560 bytes for edr file
[11:38:01] Read bedfile
[11:38:01] edr file hash check passed.
[11:38:01] Allocated 25276 bytes for logfile
[11:38:01] Read logfile
[11:38:01] GuardedRun: success in DynamicWrapper
[11:38:01] GuardedRun: done
[11:38:01] Run: GuardedRun completed.
[11:38:02] - Writing 1190424 bytes of core data to disk...
[11:38:02] Done: 1189912 -> 1146835 (compressed to 96.3 percent)
[11:38:02]   ... Done.
[11:38:02] - Shutting down core 
[11:38:02] 
[11:38:02] Folding@home Core Shutdown: FINISHED_UNIT
[11:38:05] CoreStatus = 64 (100)
[11:38:05] Unit 3 finished with 97 percent of time to deadline remaining.
[11:38:05] Updated performance fraction: 0.971527
[11:38:05] Sending work to server
[11:38:05] Project: 5013 (Run 2, Clone 503, Gen 3)
[11:38:05] - Read packet limit of 540015616... Set to 524286976.


[11:38:05] + Attempting to send results [October 12 11:38:05 UTC]
[11:38:05] - Reading file work/wuresults_03.dat from core
[11:38:05]   (Read 1147347 bytes from disk)
[11:38:05] Connecting to http://171.64.65.20:8080/
[11:38:19] Posted data.
[11:38:19] Initial: 0000; - Uploaded at ~80 kB/s
[11:38:19] - Averaged speed for that direction ~78 kB/s
[11:38:19] + Results successfully sent
[11:38:19] Thank you for your contribution to Folding@Home.
[11:38:19] + Number of Units Completed: 3

[11:38:23] Trying to send all finished work units
[11:38:23] + No unsent completed units remaining.
[11:38:23] - Preparing to get new work unit...
[11:38:23] + Attempting to get work packet
[11:38:23] - Will indicate memory of 2046 MB
[11:38:23] - Connecting to assignment server
[11:38:23] Connecting to http://assign-GPU.stanford.edu:8080/
[11:38:24] Posted data.
[11:38:24] Initial: 40AB; - Successful: assigned to (171.64.65.106).
[11:38:24] + News From Folding@Home: GPU folding beta
[11:38:24] Loaded queue successfully.
[11:38:24] Connecting to http://171.64.65.106:8080/
[11:38:25] Posted data.
[11:38:25] Initial: 0000; - Receiving payload (expected size: 45952)
[11:38:25] Conversation time very short, giving reduced weight in bandwidth avg
[11:38:25] - Downloaded at ~89 kB/s
[11:38:25] - Averaged speed for that direction ~57 kB/s
[11:38:25] + Received work.
[11:38:25] Trying to send all finished work units
[11:38:25] + No unsent completed units remaining.
[11:38:25] + Closed connections
[11:38:25] 
[11:38:25] + Processing work unit
[11:38:25] Core required: FahCore_11.exe
[11:38:25] Core found.
[11:38:25] Working on queue slot 04 [October 12 11:38:25 UTC]
[11:38:25] + Working ...
[11:38:25] - Calling '.\FahCore_11.exe -dir work/ -suffix 04 -priority 96 -checkpoint 15 -verbose -lifeline 4680 -version 620'

[11:38:25] 
[11:38:25] *------------------------------*
[11:38:25] Folding@Home GPU Core - Beta
[11:38:25] Version 1.13 (Mon Sep 29 12:58:49 PDT 2008)
[11:38:25] 
[11:38:25] Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86 
[11:38:25] Build host: amoeba
[11:38:25] Board Type: Nvidia
[11:38:25] Core      : 
[11:38:25] Preparing to commence simulation
[11:38:25] - Looking at optimizations...
[11:38:25] - Created dyn
[11:38:25] - Files status OK
[11:38:25] - Expanded 45440 -> 246249 (decompressed 541.9 percent)
[11:38:25] Called DecompressByteArray: compressed_data_size=45440 data_size=246249, decompressed_data_size=246249 diff=0
[11:38:25] - Digital signature verified
[11:38:25] 
[11:38:25] Project: 5506 (Run 8, Clone 329, Gen 113)
[11:38:25] 
[11:38:25] Assembly optimizations on if available.
[11:38:25] Entering M.D.
[11:38:32] Working on p5506_supervillin_e1
[11:38:33] Client config found, loading data.
[11:38:33] mdrun_gpu returned 
[11:38:33] NANs detected on GPU
[11:38:33] 
[11:38:33] Folding@home Core Shutdown: INTERRUPTED
[11:38:36] CoreStatus = 66 (102)
[11:38:36] + Shutdown requested by user. Exiting.***** Got a SIGTERM signal (2)
[11:38:36] Killing all core threads

Folding@Home Client Shutdown.

[toTOW]

This is a badWU, there are many reports for 0 credits in the DB

P.S : You're using v1.13 core, I suggest you to read this : viewtopic.php?f=52&t=6182

[Torin3]

I assume that I don't need to report it again in that thread, but if I run across a new one, I will report it there as well.

Thanks!