Project: 2685 (Run 3, Clone 22, Gen 46)

[texinga]

Had a really strange thing happen today on a 2685 WU on my main Bigadv rig. This rig has processed countless Bigadvs of all types for the last 3 months. It is a standard Workstation rig with a single 5650 Xeon, no overclocking or other performance tweaks and dedicated to Folding when I Fold. I run no other programs on it while Folding and don't even browse the internet. The memory is 6GB and after the WU problem today I ran 2 complete passes without error of Memtest86. I was actually watching the WU finish in the Console Client (FAH630) when it happened. It got through stating 100% complete, but rather than sending the information as it normally would, I got the error info included in the Log file below.

I'm very perplexed about what this would all of sudden happen and see no indications of having a problem with my PC. I have plenty of disk space (~311GB free) and just the one drive C where everything is installed. I don't know for sure that this 2685 WU is at fault, but wanted to report it here in case someone could help me figure out what to do about this problem. In the Log, you will also see that the FAH Client, rather than obeying the -oneunit argument I had set for this Bigadv job, went ahead and began loading the very same WU to me again. I had to cancel that because I need to see if I can figure out what happened. I think the FAH client should not restart itself under these conditions or at least it would be helpful if it didn't automatically grab another Bigadv IMO.

Code: Select all

--- Opening Log file [February 5 03:48:28 UTC] 


# Windows SMP Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.30

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: C:\Users\xxxxxx\FAH
Executable: C:\Users\xxxxxx\FAH\FAH-630.exe
Arguments: -oneunit -bigadv -smp 

[03:48:28] - Ask before connecting: No
[03:48:28] - User name: texinga (Team 111065)
[03:48:28] - User ID: 
[03:48:28] - Machine ID: 1
[03:48:28] 
[03:48:28] Loaded queue successfully.
[03:48:28] - Preparing to get new work unit...
[03:48:28] Cleaning up work directory
[03:48:28] + Attempting to get work packet
[03:48:28] Passkey found
[03:48:28] - Connecting to assignment server
[03:48:29] - Successful: assigned to (171.67.108.22).
[03:48:29] + News From Folding@Home: Welcome to Folding@Home
[03:48:29] Loaded queue successfully.
[03:48:58] + Closed connections
[03:48:58] 
[03:48:58] + Processing work unit
[03:48:58] Core required: FahCore_a3.exe
[03:48:58] Core found.
[03:48:58] Working on queue slot 07 [February 5 03:48:58 UTC]
[03:48:58] + Working ...
[03:48:58] 
[03:48:58] *------------------------------*
[03:48:58] Folding@Home Gromacs SMP Core
[03:48:58] Version 2.22 (Mar 12, 2010)
[03:48:58] 
[03:48:58] Preparing to commence simulation
[03:48:58] - Looking at optimizations...
[03:48:58] - Created dyn
[03:48:58] - Files status OK
[03:49:05] - Expanded 26652277 -> 33000273 (decompressed 123.8 percent)
[03:49:05] Called DecompressByteArray: compressed_data_size=26652277 data_size=33000273, decompressed_data_size=33000273 diff=0
[03:49:05] - Digital signature verified
[03:49:05] 
[03:49:05] Project: 2685 (Run 3, Clone 22, Gen 46)
[03:49:05] 
[03:49:05] Assembly optimizations on if available.
[03:49:05] Entering M.D.
[03:49:16] Completed 0 out of 250000 steps  (0%)
[04:22:27] Completed 2500 out of 250000 steps  (1%)
[04:55:41] Completed 5000 out of 250000 steps  (2%)
[05:28:50] Completed 7500 out of 250000 steps  (3%)
[06:02:05] Completed 10000 out of 250000 steps  (4%)
[06:35:19] Completed 12500 out of 250000 steps  (5%)
[07:08:39] Completed 15000 out of 250000 steps  (6%)
[07:41:48] Completed 17500 out of 250000 steps  (7%)
[08:15:04] Completed 20000 out of 250000 steps  (8%)
[08:48:09] Completed 22500 out of 250000 steps  (9%)
[09:21:27] Completed 25000 out of 250000 steps  (10%)
[09:54:40] Completed 27500 out of 250000 steps  (11%)
[10:27:49] Completed 30000 out of 250000 steps  (12%)
[11:01:03] Completed 32500 out of 250000 steps  (13%)
[11:34:10] Completed 35000 out of 250000 steps  (14%)
[12:07:31] Completed 37500 out of 250000 steps  (15%)
[12:40:39] Completed 40000 out of 250000 steps  (16%)
[13:13:55] Completed 42500 out of 250000 steps  (17%)
[13:47:03] Completed 45000 out of 250000 steps  (18%)
[14:20:21] Completed 47500 out of 250000 steps  (19%)
[14:53:35] Completed 50000 out of 250000 steps  (20%)
[15:26:40] Completed 52500 out of 250000 steps  (21%)
[15:59:50] Completed 55000 out of 250000 steps  (22%)
[16:32:55] Completed 57500 out of 250000 steps  (23%)
[17:06:11] Completed 60000 out of 250000 steps  (24%)
[17:39:18] Completed 62500 out of 250000 steps  (25%)
[18:12:31] Completed 65000 out of 250000 steps  (26%)
[18:45:39] Completed 67500 out of 250000 steps  (27%)
[19:18:53] Completed 70000 out of 250000 steps  (28%)
[19:52:11] Completed 72500 out of 250000 steps  (29%)
[20:26:02] Completed 75000 out of 250000 steps  (30%)
[20:59:19] Completed 77500 out of 250000 steps  (31%)
[21:32:34] Completed 80000 out of 250000 steps  (32%)
[22:05:58] Completed 82500 out of 250000 steps  (33%)
[22:39:15] Completed 85000 out of 250000 steps  (34%)
[23:12:41] Completed 87500 out of 250000 steps  (35%)
[23:45:57] Completed 90000 out of 250000 steps  (36%)
[00:19:36] Completed 92500 out of 250000 steps  (37%)
[00:53:00] Completed 95000 out of 250000 steps  (38%)
[01:26:21] Completed 97500 out of 250000 steps  (39%)
[02:00:54] Completed 100000 out of 250000 steps  (40%)
[02:34:12] Completed 102500 out of 250000 steps  (41%)
[03:07:43] Completed 105000 out of 250000 steps  (42%)
[03:41:04] Completed 107500 out of 250000 steps  (43%)
[04:14:34] Completed 110000 out of 250000 steps  (44%)
[04:47:57] Completed 112500 out of 250000 steps  (45%)
[05:21:28] Completed 115000 out of 250000 steps  (46%)
[05:54:57] Completed 117500 out of 250000 steps  (47%)
[06:28:20] Completed 120000 out of 250000 steps  (48%)
[07:01:45] Completed 122500 out of 250000 steps  (49%)
[07:35:08] Completed 125000 out of 250000 steps  (50%)
[08:08:33] Completed 127500 out of 250000 steps  (51%)
[08:41:53] Completed 130000 out of 250000 steps  (52%)
[09:15:19] Completed 132500 out of 250000 steps  (53%)
[09:48:40] Completed 135000 out of 250000 steps  (54%)
[10:22:08] Completed 137500 out of 250000 steps  (55%)
[10:55:33] Completed 140000 out of 250000 steps  (56%)
[11:28:57] Completed 142500 out of 250000 steps  (57%)
[12:02:24] Completed 145000 out of 250000 steps  (58%)
[12:35:46] Completed 147500 out of 250000 steps  (59%)
[13:09:11] Completed 150000 out of 250000 steps  (60%)
[13:42:31] Completed 152500 out of 250000 steps  (61%)
[14:15:58] Completed 155000 out of 250000 steps  (62%)
[14:49:20] Completed 157500 out of 250000 steps  (63%)
[15:22:46] Completed 160000 out of 250000 steps  (64%)
[15:56:10] Completed 162500 out of 250000 steps  (65%)
[16:29:30] Completed 165000 out of 250000 steps  (66%)
[17:02:53] Completed 167500 out of 250000 steps  (67%)
[17:36:15] Completed 170000 out of 250000 steps  (68%)
[18:09:39] Completed 172500 out of 250000 steps  (69%)
[18:43:08] Completed 175000 out of 250000 steps  (70%)
[19:16:26] Completed 177500 out of 250000 steps  (71%)
[19:49:41] Completed 180000 out of 250000 steps  (72%)
[20:22:58] Completed 182500 out of 250000 steps  (73%)
[20:56:14] Completed 185000 out of 250000 steps  (74%)
[21:30:07] Completed 187500 out of 250000 steps  (75%)
[22:03:27] Completed 190000 out of 250000 steps  (76%)
[22:36:39] Completed 192500 out of 250000 steps  (77%)
[23:09:55] Completed 195000 out of 250000 steps  (78%)
[23:43:02] Completed 197500 out of 250000 steps  (79%)
[00:16:17] Completed 200000 out of 250000 steps  (80%)
[00:49:25] Completed 202500 out of 250000 steps  (81%)
[01:22:39] Completed 205000 out of 250000 steps  (82%)
[01:55:52] Completed 207500 out of 250000 steps  (83%)
[02:28:57] Completed 210000 out of 250000 steps  (84%)
[03:02:12] Completed 212500 out of 250000 steps  (85%)
[03:36:40] Completed 215000 out of 250000 steps  (86%)
[04:09:52] Completed 217500 out of 250000 steps  (87%)
[04:43:01] Completed 220000 out of 250000 steps  (88%)
[05:16:16] Completed 222500 out of 250000 steps  (89%)
[05:49:26] Completed 225000 out of 250000 steps  (90%)
[06:22:35] Completed 227500 out of 250000 steps  (91%)
[06:55:47] Completed 230000 out of 250000 steps  (92%)
[07:28:54] Completed 232500 out of 250000 steps  (93%)
[08:02:08] Completed 235000 out of 250000 steps  (94%)
[08:35:17] Completed 237500 out of 250000 steps  (95%)
[09:08:32] Completed 240000 out of 250000 steps  (96%)
[09:41:38] Completed 242500 out of 250000 steps  (97%)
[10:14:53] Completed 245000 out of 250000 steps  (98%)
[10:48:03] Completed 247500 out of 250000 steps  (99%)
[11:21:30] Completed 250000 out of 250000 steps  (100%)
[11:21:49] DynamicWrapper: Finished Work Unit: sleep=10000
[11:21:59] 
[11:21:59] Finished Work Unit:
[11:21:59] - Reading up to 56491680 from "work/wudata_07.trr": Read 56491680
[11:21:59] trr file hash check passed.
[11:21:59] Could not allocate memory for xtcfile
[11:21:59] 
[11:21:59] Folding@home Core Shutdown: UNKNOWN_ERROR
[11:22:03] CoreStatus = 77 (119)
[11:22:03] Client-core communications error: ERROR 0x77
[11:22:03] Deleting current work unit & continuing...
[11:22:19] - Preparing to get new work unit...
[11:22:19] Cleaning up work directory
[11:22:19] + Attempting to get work packet
[11:22:19] Passkey found
[11:22:19] - Connecting to assignment server
[11:22:20] - Successful: assigned to (171.67.108.22).
[11:22:20] + News From Folding@Home: Welcome to Folding@Home
[11:22:20] Loaded queue successfully.
[11:22:57] + Closed connections
[11:23:02] 
[11:23:02] + Processing work unit
[11:23:02] Core required: FahCore_a3.exe
[11:23:02] Core found.
[11:23:02] Working on queue slot 08 [February 7 11:23:02 UTC]
[11:23:02] + Working ...
[11:23:02] 
[11:23:02] *------------------------------*
[11:23:02] Folding@Home Gromacs SMP Core
[11:23:02] Version 2.22 (Mar 12, 2010)
[11:23:02] 
[11:23:02] Preparing to commence simulation
[11:23:02] - Looking at optimizations...
[11:23:02] - Created dyn
[11:23:02] - Files status OK
[11:23:08] - Expanded 26652277 -> 33000273 (decompressed 123.8 percent)
[11:23:08] Called DecompressByteArray: compressed_data_size=26652277 data_size=33000273, decompressed_data_size=33000273 diff=0
[11:23:08] - Digital signature verified
[11:23:08] 
[11:23:08] Project: 2685 (Run 3, Clone 22, Gen 46)
[11:23:08] 
[11:23:09] Assembly optimizations on if available.
[11:23:09] Entering M.D.
[11:23:19] Completed 0 out of 250000 steps  (0%)

Folding@Home Client Shutdown at user request.

Folding@Home Client Shutdown.

[gwildperson]

The -oneunit flag is ignored after an error. It only considers completed WUs.

Are the files from that WU still in the \work folder? We may be able to learn something from them. They would contain a 07 somewhere in the name. (The next WU would have files containing 08.) Sorting the files by time might help determine if they're still there.

[texinga]

Yes, I haven't cleared the FAH "Work" folder yet because I wanted to wait to see what I could learn from this issue.

In that folder, there is a file titled "wudata_07_prev.cpt" and it is the only file with an "07" in the title. It has a last modified timestamp of 6:19 am today which is very near the time that the WU was supposed to finish this morning.

What can I do with that file to find out some useful information...I'm all ears!

Thanks,

Rick

[gwildperson]

Unfortunately that's not a file that would be useful, at this point.

[texinga]

I just noticed something that may be pertinent to what happened. As I said, I have 6GB of memory installed and all 6GB tested OK with Memtest86 today (which is a boot oriented test outside of the Windows OS). But....I just remembered that this PC has Windows Vista 32bit installed. From what I recall, all 32bit versions of Windows limit the usable memory to 4GB. I confirmed this looking at the Task Manager "Performance" tab because it shows 3566MB (or roughly 3.5GB) of Physical memory, 2058MB Cached and 65MB Free in the Memory info area.

So, the question. Is that too little memory to run Bigadvs or could I possibly be on the cusp of whether it is enough or not? If it is too little, then maybe I've just been lucky all these months with the Bigadvs that have run without problem. I don't know, but thought I'd throw this out there in case it does matter.

Rick

[PantherX]

There isn't any report in the WU database yet so have marked it for a follow-up.

Regarding your concern about memory, the current Windows FahCore_a3 is 32 bit so that would mean that it can use a maximum of 2 GB (the limit is 2 GB per process).

[PantherX]

The WU Project: 2685 (Run 3, Clone 22, Gen 46) has been successfully completed.