Project: 5101 (Run 0, Clone 77, Gen 69)
Project: 2676 (Run 2, Clone 37, Gen 10)
Project: 2676 (Run 2, Clone 37, Gen 10)
Project: 5101 (Run 0, Clone 77, Gen 69)
console output log:
Code: Select all
[04:11:06] Timered checkpoint triggered.
[04:14:23] Writing local files
[04:14:23] Completed 100000 out of 2000000 steps (5 percent)
[04:29:24] Timered checkpoint triggered.
[04:33:03] Writing local files
[04:33:03] Completed 120000 out of 2000000 steps (6 percent)
[04:48:04] Timered checkpoint triggered.
[04:51:33] Writing local files
[04:51:33] Completed 140000 out of 2000000 steps (7 percent)
[05:02:23] - Autosending finished units... [February 23 05:02:23 UTC]
[05:02:23] Trying to send all finished work units
[05:02:23] + No unsent completed units remaining.
[05:02:23] - Autosend completed
[05:06:33] Timered checkpoint triggered.
[05:10:08] Writing local files
[05:10:08] Completed 160000 out of 2000000 steps (8 percent)
[05:25:09] Timered checkpoint triggered.
[05:28:36] Writing local files
[05:28:36] Completed 180000 out of 2000000 steps (9 percent)
[05:43:36] Timered checkpoint triggered.
[05:46:58] Writing local files
[05:46:58] Completed 200000 out of 2000000 steps (10 percent)
[06:01:59] Timered checkpoint triggered.
[06:05:20] Writing local files
[06:05:20] Completed 220000 out of 2000000 steps (11 percent)
[06:20:21] Timered checkpoint triggered.
[06:23:34] Writing local files
[06:23:34] Completed 240000 out of 2000000 steps (12 percent)
[06:38:35] Timered checkpoint triggered.
[06:41:55] Writing local files
[06:41:55] Completed 260000 out of 2000000 steps (13 percent)
[06:56:56] Timered checkpoint triggered.
[07:00:16] Writing local files
[07:00:16] Completed 280000 out of 2000000 steps (14 percent)
[07:15:17] Timered checkpoint triggered.
[07:18:33] Writing local files
[07:18:33] Completed 300000 out of 2000000 steps (15 percent)
[07:33:33] Timered checkpoint triggered.
[07:36:48] Writing local files
[07:36:48] Completed 320000 out of 2000000 steps (16 percent)
[07:51:49] Timered checkpoint triggered.
[07:55:04] Writing local files
[07:55:04] Completed 340000 out of 2000000 steps (17 percent)
[08:10:05] Timered checkpoint triggered.
[08:13:18] Writing local files
[08:13:18] Completed 360000 out of 2000000 steps (18 percent)
[08:28:19] Timered checkpoint triggered.
[08:31:43] Writing local files
[08:31:43] Completed 380000 out of 2000000 steps (19 percent)
[08:46:44] Timered checkpoint triggered.
[08:50:06] Writing local files
[08:50:06] Completed 400000 out of 2000000 steps (20 percent)
[09:05:06] Timered checkpoint triggered.
[09:08:16] Writing local files
[09:08:16] Completed 420000 out of 2000000 steps (21 percent)
[09:23:17] Timered checkpoint triggered.
[09:26:44] Writing local files
[09:26:44] Completed 440000 out of 2000000 steps (22 percent)
[09:41:43] Timered checkpoint triggered.
[09:45:07] Writing local files
[09:45:07] Completed 460000 out of 2000000 steps (23 percent)
[10:00:08] Timered checkpoint triggered.
[cli_0]: aborting job:
Fatal error in MPI_Sendrecv: Error message texts are not available
[cli_1]: aborting job:
Fatal error in MPI_Alltoallv: Error message texts are not available
[cli_2]: aborting job:
Fatal error in MPI_Alltoallv: Error message texts are not available
[cli_3]: aborting job:
Fatal error in MPI_Alltoallv: Error message texts are not available
[10:02:14] CoreStatus = 1 (1)
[10:02:14] Sending work to server
[10:02:14] Project: 5101 (Run 0, Clone 77, Gen 69)
[10:02:14] - Error: Could not get length of results file work/wuresults_07.dat
[10:02:14] - Error: Could not read unit 07 file. Removing from queue.
[10:02:14] Trying to send all finished work units
[10:02:14] + No unsent completed units remaining.
[10:02:14] - Preparing to get new work unit...
[10:02:14] + Attempting to get work packet
[10:02:14] - Will indicate memory of 16003 MB
[10:02:14] - Connecting to assignment server
[10:02:14] Connecting to http://assign.stanford.edu:8080/
[10:02:15] Posted data.
[10:02:15] Initial: 43AB; - Successful: assigned to (171.67.108.24).
[10:02:15] + News From Folding@Home: Welcome to Folding@Home
[10:02:15] Loaded queue successfully.
[10:02:15] Connecting to http://171.67.108.24:8080/
[10:02:15] Posted data.
[10:02:15] Initial: 0000; + Could not connect to Work Server
[10:02:15] - Attempt #1 to get work failed, and no other work to do.
Waiting before retry.
[10:02:34] + Attempting to get work packet
[10:02:34] - Will indicate memory of 16003 MB
[10:02:34] - Connecting to assignment server
[10:02:34] Connecting to http://assign.stanford.edu:8080/
[10:02:34] Posted data.
[10:02:34] Initial: 43AB; - Successful: assigned to (171.67.108.24).
[10:02:34] + News From Folding@Home: Welcome to Folding@Home
[10:02:34] Loaded queue successfully.
[10:02:34] Connecting to http://171.67.108.24:8080/
[10:02:41] Posted data.
[10:02:41] Initial: 0000; - Receiving payload (expected size: 4855271)
[10:02:54] - Downloaded at ~364 kB/s
[10:02:54] - Averaged speed for that direction ~354 kB/s
[10:02:54] + Received work.
[10:02:54] Trying to send all finished work units
[10:02:54] + No unsent completed units remaining.
[10:02:54] + Closed connections
[10:02:59]
[10:02:59] + Processing work unit
[10:02:59] Core required: FahCore_a2.exe
[10:02:59] Core found.
[10:02:59] Working on queue slot 08 [February 23 10:02:59 UTC]
[10:02:59] + Working ...
[10:02:59] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a2.exe -dir work/ -suffix 08 -checkpoint 15 -verbose -lifeline 18266 -version 624'
[10:02:59]
[10:02:59] *------------------------------*
[10:02:59] Folding@Home Gromacs SMP Core
[10:02:59] Version 2.04 (Thu Jan 29 16:43:57 PST 2009)
[10:02:59]
[10:02:59] Preparing to commence simulation
[10:02:59] - Ensuring status. Please wait.
[10:03:09] - Looking at optimizations...
[10:03:09] - Working with standard loops on this execution.
[10:03:09] - Files status OK
[10:03:10] - Expanded 4854759 -> 24043453 (decompressed 495.2 percent)
[10:03:10] Called DecompressByteArray: compressed_data_size=4854759 data_size=24043453, decompressed_data_size=24043453 diff=0
[10:03:10] - Digital signature verified
[10:03:10]
[10:03:10] Project: 2676 (Run 2, Clone 37, Gen 10)
[10:03:10]
[10:03:10] Entering M.D.
[10:03:16] Will resume from checkpoint file
NNODES=4, MYRANK=0, HOSTNAME=computenode
NNODES=4, MYRANK=1, HOSTNAME=computenode
NNODES=4, MYRANK=3, HOSTNAME=computenode
NNODES=4, MYRANK=2, HOSTNAME=computenode
NODEID=0 argc=20
NODEID=1 argc=20
:-) G R O M A C S (-:
Groningen Machine for Chemical Simulation
:-) VERSION 4.0.3_pre (-:
Written by David van der Spoel, Erik Lindahl, Berk Hess, and others.
Copyright (c) 1991-2000, University of Groningen, The Netherlands.
Copyright (c) 2001-2008, The GROMACS development team,
check out http://www.gromacs.org for more information.
:-) mdrun (-:
NODEID=2 argc=20
NODEID=3 argc=20
Reading file work/wudata_08.tpr, VERSION 3.3.99_development_20070618 (single precision)
Note: tpx file_version 48, software version 58
NOTE: The tpr file used for this simulation is in an old format, for less memory usage and possibly more performance create a new tpr file with an up to date version of grompp
Making 1D domain decomposition 1 x 1 x 4
starting mdrun '23121 system in water'
2750000 steps, 5500.0 ps (continuing from step 2500000, 5000.0 ps).
-------------------------------------------------------
Program mdrun, VERSION 4.0.3_pre
Source code file: md.c, line: 1107
Fatal error:
Checkpoint error on step 2500000
-------------------------------------------------------
Thanx for Using GROMACS - Have a Nice Day
Error on node 1, will try to stop all the nodes
Halting parallel program mdrun on CPU 1 out of 4
-------------------------------------------------------
Program mdrun, VERSION 4.0.3_pre
Source code file: md.c, line: 1107
Fatal error:
Checkpoint error on step 2500000
-------------------------------------------------------
Thanx for Using GROMACS - Have a Nice Day
Error on node 0, will try to stop all the nodes
Halting parallel program mdrun on CPU 0 out of 4
gcq#0: Thanx for Using GROMACS - Have a Nice Day
[cli_0]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, -1) - process 0
gcq#0: Thanx for Using GROMACS - Have a Nice Day
[cli_1]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, -1) - process 1
-------------------------------------------------------
Program mdrun, VERSION 4.0.3_pre
Source code file: md.c, line: 1107
Fatal error:
Checkpoint error on step 2500000
-------------------------------------------------------
Thanx for Using GROMACS - Have a Nice Day
Error on node 2, will try to stop all the nodes
Halting parallel program mdrun on CPU 2 out of 4
gcq#0: Thanx for Using GROMACS - Have a Nice Day
[cli_2]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, -1) - process 2
-------------------------------------------------------
Program mdrun, VERSION 4.0.3_pre
Source code file: md.c, line: 1107
Fatal error:
Checkpoint error on step 2500000
-------------------------------------------------------
Thanx for Using GROMACS - Have a Nice Day
Error on node 3, will try to stop all the nodes
Halting parallel program mdrun on CPU 3 out of 4
gcq#0: Thanx for Using GROMACS - Have a Nice Day
[cli_3]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, -1) - process 3
[10:03:19] fcCheckPointResume: file hashes different -- aborting.
[10:03:19] s different -- aborting.
[10:03:23] CoreStatus = FF (255)
[10:03:23] Sending work to server
[10:03:23] Project: 2676 (Run 2, Clone 37, Gen 10)
[10:03:23] - Error: Could not get length of results file work/wuresults_08.dat
[10:03:23] - Error: Could not read unit 08 file. Removing from queue.
[10:03:23] Trying to send all finished work units
[10:03:23] + No unsent completed units remaining.
[10:03:23] - Preparing to get new work unit...
[10:03:23] + Attempting to get work packet
[10:03:23] - Will indicate memory of 16003 MB
[10:03:23] - Connecting to assignment server
[10:03:23] Connecting to http://assign.stanford.edu:8080/
[10:03:24] Posted data.
[10:03:24] Initial: 43AB; - Successful: assigned to (171.67.108.24).
[10:03:24] + News From Folding@Home: Welcome to Folding@Home
[10:03:24] Loaded queue successfully.
[10:03:24] Connecting to http://171.67.108.24:8080/
[10:03:30] Posted data.
[10:03:30] Initial: 0000; - Receiving payload (expected size: 4855271)
[10:03:42] - Downloaded at ~395 kB/s
[10:03:42] - Averaged speed for that direction ~362 kB/s
[10:03:42] + Received work.
[10:03:42] Trying to send all finished work units
[10:03:42] + No unsent completed units remaining.
[10:03:42] + Closed connections
[10:03:47]
[10:03:47] + Processing work unit
[10:03:47] Core required: FahCore_a2.exe
[10:03:47] Core found.
[10:03:47] Working on queue slot 09 [February 23 10:03:47 UTC]
[10:03:47] + Working ...
[10:03:47] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a2.exe -dir work/ -suffix 09 -checkpoint 15 -verbose -lifeline 18266 -version 624'
[10:03:47]
[10:03:47] *------------------------------*
[10:03:47] Folding@Home Gromacs SMP Core
[10:03:47] Version 2.04 (Thu Jan 29 16:43:57 PST 2009)
[10:03:47]
[10:03:47] Preparing to commence simulation
[10:03:47] - Ensuring status. Please wait.
[10:03:56] - Looking at optimizations...
[10:03:56] - Working with standard loops on this execution.
[10:03:56] - Files status OK
[10:03:57] - Expanded 4854759 -> 24043453 (decompressed 495.2 percent)
[10:03:57] Called DecompressByteArray: compressed_data_size=4854759 data_size=24043453, decompressed_data_size=24043453 diff=0
[10:03:57] - Digital signature verified
[10:03:57]
[10:03:57] Project: 2676 (Run 2, Clone 37, Gen 10)
[10:03:57]
[10:03:58] Entering M.D.
NNODES=4, MYRANK=0, HOSTNAME=computenode
NNODES=4, MYRANK=2, HOSTNAME=computenode
NNODES=4, MYRANK=3, HOSTNAME=computenode
NNODES=4, MYRANK=1, HOSTNAME=computenode
NODEID=0 argc=20
NODEID=1 argc=20
NODEID=2 argc=20
NODEID=3 argc=20
:-) G R O M A C S (-:
Groningen Machine for Chemical Simulation
:-) VERSION 4.0.3_pre (-:
Written by David van der Spoel, Erik Lindahl, Berk Hess, and others.
Copyright (c) 1991-2000, University of Groningen, The Netherlands.
Copyright (c) 2001-2008, The GROMACS development team,
check out http://www.gromacs.org for more information.
:-) mdrun (-:
Reading file work/wudata_09.tpr, VERSION 3.3.99_development_20070618 (single precision)
Note: tpx file_version 48, software version 58
NOTE: The tpr file used for this simulation is in an old format, for less memory usage and possibly more performance create a new tpr file with an up to date version of grompp
Making 1D domain decomposition 1 x 1 x 4
starting mdrun '23121 system in water'
2750000 steps, 5500.0 ps (continuing from step 2500000, 5000.0 ps).
[10:12:48] Completed 2500 out of 250000 steps (1%)
[10:21:30] Completed 5000 out of 250000 steps (2%)
[10:30:10] Completed 7500 out of 250000 steps (3%)
[10:38:50] Completed 10000 out of 250000 steps (4%)
[10:47:30] Completed 12500 out of 250000 steps (5%)
[10:56:10] Completed 15000 out of 250000 steps (6%)
[11:02:23] - Autosending finished units... [February 23 11:02:23 UTC]
[11:02:23] Trying to send all finished work units
[11:02:23] + No unsent completed units remaining.
[11:02:23] - Autosend completed
[11:04:50] Completed 17500 out of 250000 steps (7%)
[0]0:Return code = 0, signaled with Segmentation fault
[0]1:Return code = 0, signaled with Quit
[0]2:Return code = 0, signaled with Quit
[0]3:Return code = 0, signaled with Quit
[11:05:48] CoreStatus = 0 (0)
[11:05:48] Sending work to server
[11:05:48] Project: 2676 (Run 2, Clone 37, Gen 10)
[11:05:48] - Error: Could not get length of results file work/wuresults_09.dat
[11:05:48] - Error: Could not read unit 09 file. Removing from queue.
[11:05:48] Trying to send all finished work units
[11:05:48] + No unsent completed units remaining.
[11:05:48] - Preparing to get new work unit...
[11:05:48] + Attempting to get work packet
[11:05:48] - Will indicate memory of 16003 MB
[11:05:48] - Connecting to assignment server
[11:05:48] Connecting to http://assign.stanford.edu:8080/
[11:05:49] Posted data.
[11:05:49] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[11:05:49] + News From Folding@Home: Welcome to Folding@Home
[11:05:49] Loaded queue successfully.
[11:05:49] Connecting to http://171.64.65.64:8080/
[11:05:50] Posted data.
[11:05:50] Initial: 0000; - Receiving payload (expected size: 741206)
[11:05:53] - Downloaded at ~241 kB/s
[11:05:53] - Averaged speed for that direction ~338 kB/s
[11:05:53] + Received work.
[11:05:53] Trying to send all finished work units
[11:05:53] + No unsent completed units remaining.
[11:05:53] + Closed connections
[11:05:58]
[11:05:58] + Processing work unit
[11:05:58] Work type a1 not eligible for variable processors
[11:05:58] Core required: FahCore_a1.exe
[11:05:58] Core found.
[11:05:58] Working on queue slot 00 [February 23 11:05:58 UTC]
[11:05:58] + Working ...
[11:05:58] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 00 -checkpoint 15 -verbose -lifeline 18266 -version 624'
[11:05:58]
[11:05:58] *------------------------------*
[11:05:58] Folding@Home Gromacs SMP Core
[11:05:58] Version 1.74 (November 27, 2006)
[11:05:58]
[11:05:58] Preparing to commence simulation
[11:05:58] - Ensuring status. Please wait.
[11:06:15] - Looking at optimizations...
[11:06:15] - Working with standard loops on this execution.
[11:06:15] - Previous termination of core was improper.
[11:06:15] - Going to use standard loops.
[11:06:15] - Files status OK
[11:06:16] - Expanded 740694 -> 3855925 (decompressed 520.5 percent)
[11:06:16] - Starting from initial work packet
[11:06:16]
[11:06:16] Project: 5101 (Run 0, Clone 77, Gen 69)
[11:06:16]
[11:06:16] Entering M.D.
NNODES=4, MYRANK=0, HOSTNAME=computenode
NNODES=4, MYRANK=2, HOSTNAME=computenode
NNODES=4, MYRANK=3, HOSTNAME=computenode
NNODES=4, MYRANK=1, HOSTNAME=computenode
NODEID=0 argc=15
NODEID=2 argc=15
NODEID=3 argc=15
NODEID=1 argc=15
Written by David van der Spoel, Erik Lindahl, Berk Hess, and others.
Copyright (c) 1991-2000, University of Groningen, The Netherlands.
Copyright (c) 2001-2004, The GROMACS development team,
check out http://www.gromacs.org for more information.
This inclusion of Gromacs code in the Folding@Home Core is under
a special license (see http://folding.stanford.edu/gromacs.html)
specially granted to Stanford by the copyright holders. If you
are interested in using Gromacs, visit www.gromacs.org where
you can download a free version of Gromacs under
the terms of the GNU General Public License (GPL) as published
by the Free Software Foundation; either version 2 of the License,
or (at your option) any later version.
[11:06:23] ocal files
[11:06:23] F in water
[11:06:23] Writing local files
starting mdrun 'CMF in water'
2000000 steps, 4000.0 ps.
[11:06:23] of 2000000 steps (0 percent)
[11:21:23] Timered checkpoint triggered.
[11:24:47] Writing local files
[11:24:47] Completed 20000 out of 2000000 steps (1 percent)
[11:39:48] Timered checkpoint triggered.
[11:43:21] Writing local files
[11:43:21] Completed 40000 out of 2000000 steps (2 percent)
[11:58:20] Timered checkpoint triggered.
[12:01:55] Writing local files
[12:01:55] Completed 60000 out of 2000000 steps (3 percent)
[12:16:56] Timered checkpoint triggered.
[12:20:32] Writing local files
[12:20:32] Completed 80000 out of 2000000 steps (4 percent)
[12:35:31] Timered checkpoint triggered.
[12:39:12] Writing local files
[12:39:12] Completed 100000 out of 2000000 steps (5 percent)
[12:54:13] Timered checkpoint triggered.
[12:57:53] Writing local files
[12:57:53] Completed 120000 out of 2000000 steps (6 percent)
[13:12:53] Timered checkpoint triggered.
[13:16:35] Writing local files
[13:16:35] Completed 140000 out of 2000000 steps (7 percent)
[13:31:35] Timered checkpoint triggered.
[13:35:07] Writing local files
[13:35:07] Completed 160000 out of 2000000 steps (8 percent)
[13:50:08] Timered checkpoint triggered.
[13:53:40] Writing local files
[13:53:40] Completed 180000 out of 2000000 steps (9 percent)
[14:08:40] Timered checkpoint triggered.
[14:12:13] Writing local files
[14:12:13] Completed 200000 out of 2000000 steps (10 percent)
[14:27:14] Timered checkpoint triggered.
[14:30:48] Writing local files
[14:30:48] Completed 220000 out of 2000000 steps (11 percent)
[14:45:47] Timered checkpoint triggered.
[14:49:23] Writing local files
[14:49:23] Completed 240000 out of 2000000 steps (12 percent)
[15:04:24] Timered checkpoint triggered.
[15:08:00] Writing local files
[15:08:00] Completed 260000 out of 2000000 steps (13 percent)
[15:23:00] Timered checkpoint triggered.
[15:26:38] Writing local files
[15:26:38] Completed 280000 out of 2000000 steps (14 percent)
[15:41:38] Timered checkpoint triggered.
[15:45:12] Writing local files
[15:45:12] Completed 300000 out of 2000000 steps (15 percent)
[16:00:13] Timered checkpoint triggered.
[16:03:52] Writing local files
[16:03:52] Completed 320000 out of 2000000 steps (16 percent)
[16:18:51] Timered checkpoint triggered.
[16:22:24] Writing local files
[16:22:24] Completed 340000 out of 2000000 steps (17 percent)
[16:37:25] Timered checkpoint triggered.
[16:40:52] Writing local files
[16:40:52] Completed 360000 out of 2000000 steps (18 percent)
[16:55:52] Timered checkpoint triggered.
[16:59:21] Writing local files
[16:59:21] Completed 380000 out of 2000000 steps (19 percent)
[17:01:32]
[17:01:32] Folding@home Core Shutdown: INTERRUPTED
[0]0:Return code = 102
[0]1:Return code = 0, signaled with Segmentation fault
[0]2:Return code = 0, signaled with Segmentation fault
[0]3:Return code = 0, signaled with Segmentation fault
[17:01:36] CoreStatus = 66 (102)
[17:01:36] + Shutdown requested by user. Exiting.***** Got a SIGTERM signal (15)[17:01:37] Killing all core threads
Folding@Home Client Shutdown.
Code: Select all
[02:37:39] + Attempting to send results [February 23 02:37:39 UTC]
[02:37:39] - Reading file work/wuresults_06.dat from core
[02:37:39] (Read 5521946 bytes from disk)
[02:37:39] Connecting to http://171.64.65.64:8080/
[02:38:01] Posted data.
[02:38:02] Initial: 0000; - Uploaded at ~234 kB/s
[02:38:02] - Averaged speed for that direction ~151 kB/s
[02:38:02] + Results successfully sent
[02:38:02] Thank you for your contribution to Folding@Home.
[02:38:02] + Number of Units Completed: 30
[02:42:07] - Warning: Could not delete all work unit files (6): Core returned invalid code
[02:42:07] Trying to send all finished work units
[02:42:07] + No unsent completed units remaining.
[02:42:07] - Preparing to get new work unit...
[02:42:07] + Attempting to get work packet
[02:42:07] - Will indicate memory of 16003 MB
[02:42:07] - Connecting to assignment server
[02:42:07] Connecting to http://assign.stanford.edu:8080/
[02:42:08] Posted data.
[02:42:08] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[02:42:08] + News From Folding@Home: Welcome to Folding@Home
[02:42:08] Loaded queue successfully.
[02:42:08] Connecting to http://171.64.65.64:8080/
[02:42:09] Posted data.
[02:42:09] Initial: 0000; - Receiving payload (expected size: 741206)
[02:42:15] - Downloaded at ~120 kB/s
[02:42:15] - Averaged speed for that direction ~351 kB/s
[02:42:15] + Received work.
[02:42:15] Trying to send all finished work units
[02:42:15] + No unsent completed units remaining.
[02:42:15] + Closed connections
[02:42:15]
[02:42:15] + Processing work unit
[02:42:15] Work type a1 not eligible for variable processors
[02:42:15] Core required: FahCore_a1.exe
[02:42:15] Core found.
[02:42:15] Working on queue slot 07 [February 23 02:42:15 UTC]
[02:42:15] + Working ...
[02:42:15] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 07 -checkpoint 15 -verbose -lifeline 18266 -version 624'
[02:42:15]
[02:42:15] *------------------------------*
[02:42:15] Folding@Home Gromacs SMP Core
[02:42:15] Version 1.74 (November 27, 2006)
[02:42:15]
[02:42:15] Preparing to commence simulation
[02:42:15] - Ensuring status. Please wait.
[02:42:16] - Starting from initial work packet
[02:42:16]
[02:42:16] Project: 5101 (Run 0, Clone 77, Gen 69)
[02:42:16]
[02:42:16] Assembly optimizations on if available.
[02:42:16] Entering M.D.
[02:42:33] ial work pa- Starting from initial work packet
[02:42:33]
[02:42:33] Project: 5Entering M.D.
[02:42:33] one 77, Gen 69)
[02:42:33]
[02:42:33] Entering M.D.
[02:42:39] Protein: CMF in water
[02:42:39] Writing local files
[02:42:39] nt)
[02:42:39] a SSE boost OK.
[02:57:40] nt triggered.
[03:01:15] Writing local files
[03:01:15] Completed 20000 out of 2000000 steps (1 percent)
[03:16:15] Timered checkpoint triggered.
[03:19:38] Writing local files
[03:19:38] Completed 40000 out of 2000000 steps (2 percent)
[03:34:39] Timered checkpoint triggered.
[03:37:54] Writing local files
[03:37:54] Completed 60000 out of 2000000 steps (3 percent)
[03:52:55] Timered checkpoint triggered.
[03:56:05] Writing local files
[03:56:05] Completed 80000 out of 2000000 steps (4 percent)
[04:11:06] Timered checkpoint triggered.
[04:14:23] Writing local files
[04:14:23] Completed 100000 out of 2000000 steps (5 percent)
[04:29:24] Timered checkpoint triggered.
[04:33:03] Writing local files
[04:33:03] Completed 120000 out of 2000000 steps (6 percent)
[04:48:04] Timered checkpoint triggered.
[04:51:33] Writing local files
[04:51:33] Completed 140000 out of 2000000 steps (7 percent)
[05:02:23] - Autosending finished units... [February 23 05:02:23 UTC]
[05:02:23] Trying to send all finished work units
[05:02:23] + No unsent completed units remaining.
[05:02:23] - Autosend completed
[05:06:33] Timered checkpoint triggered.
[05:10:08] Writing local files
[05:10:08] Completed 160000 out of 2000000 steps (8 percent)
[05:25:09] Timered checkpoint triggered.
[05:28:36] Writing local files
[05:28:36] Completed 180000 out of 2000000 steps (9 percent)
[05:43:36] Timered checkpoint triggered.
[05:46:58] Writing local files
[05:46:58] Completed 200000 out of 2000000 steps (10 percent)
[06:01:59] Timered checkpoint triggered.
[06:05:20] Writing local files
[06:05:20] Completed 220000 out of 2000000 steps (11 percent)
[06:20:21] Timered checkpoint triggered.
[06:23:34] Writing local files
[06:23:34] Completed 240000 out of 2000000 steps (12 percent)
[06:38:35] Timered checkpoint triggered.
[06:41:55] Writing local files
[06:41:55] Completed 260000 out of 2000000 steps (13 percent)
[06:56:56] Timered checkpoint triggered.
[07:00:16] Writing local files
[07:00:16] Completed 280000 out of 2000000 steps (14 percent)
[07:15:17] Timered checkpoint triggered.
[07:18:33] Writing local files
[07:18:33] Completed 300000 out of 2000000 steps (15 percent)
[07:33:33] Timered checkpoint triggered.
[07:36:48] Writing local files
[07:36:48] Completed 320000 out of 2000000 steps (16 percent)
[07:51:49] Timered checkpoint triggered.
[07:55:04] Writing local files
[07:55:04] Completed 340000 out of 2000000 steps (17 percent)
[08:10:05] Timered checkpoint triggered.
[08:13:18] Writing local files
[08:13:18] Completed 360000 out of 2000000 steps (18 percent)
[08:28:19] Timered checkpoint triggered.
[08:31:43] Writing local files
[08:31:43] Completed 380000 out of 2000000 steps (19 percent)
[08:46:44] Timered checkpoint triggered.
[08:50:06] Writing local files
[08:50:06] Completed 400000 out of 2000000 steps (20 percent)
[09:05:06] Timered checkpoint triggered.
[09:08:16] Writing local files
[09:08:16] Completed 420000 out of 2000000 steps (21 percent)
[09:23:17] Timered checkpoint triggered.
[09:26:44] Writing local files
[09:26:44] Completed 440000 out of 2000000 steps (22 percent)
[09:41:43] Timered checkpoint triggered.
[09:45:07] Writing local files
[09:45:07] Completed 460000 out of 2000000 steps (23 percent)
[10:00:08] Timered checkpoint triggered.
[10:02:14] CoreStatus = 1 (1)
[10:02:14] Sending work to server
[10:02:14] Project: 5101 (Run 0, Clone 77, Gen 69)
[10:02:14] - Error: Could not get length of results file work/wuresults_07.dat
[10:02:14] - Error: Could not read unit 07 file. Removing from queue.
[10:02:14] Trying to send all finished work units
[10:02:14] + No unsent completed units remaining.
[10:02:14] - Preparing to get new work unit...
[10:02:14] + Attempting to get work packet
[10:02:14] - Will indicate memory of 16003 MB
[10:02:14] - Connecting to assignment server
[10:02:14] Connecting to http://assign.stanford.edu:8080/
[10:02:15] Posted data.
[10:02:15] Initial: 43AB; - Successful: assigned to (171.67.108.24).
[10:02:15] + News From Folding@Home: Welcome to Folding@Home
[10:02:15] Loaded queue successfully.
[10:02:15] Connecting to http://171.67.108.24:8080/
[10:02:15] Posted data.
[10:02:15] Initial: 0000; + Could not connect to Work Server
[10:02:15] - Attempt #1 to get work failed, and no other work to do.
Waiting before retry.
[10:02:34] + Attempting to get work packet
[10:02:34] - Will indicate memory of 16003 MB
[10:02:34] - Connecting to assignment server
[10:02:34] Connecting to http://assign.stanford.edu:8080/
[10:02:34] Posted data.
[10:02:34] Initial: 43AB; - Successful: assigned to (171.67.108.24).
[10:02:34] + News From Folding@Home: Welcome to Folding@Home
[10:02:34] Loaded queue successfully.
[10:02:34] Connecting to http://171.67.108.24:8080/
[10:02:41] Posted data.
[10:02:41] Initial: 0000; - Receiving payload (expected size: 4855271)
[10:02:54] - Downloaded at ~364 kB/s
[10:02:54] - Averaged speed for that direction ~354 kB/s
[10:02:54] + Received work.
[10:02:54] Trying to send all finished work units
[10:02:54] + No unsent completed units remaining.
[10:02:54] + Closed connections
[10:02:59]
[10:02:59] + Processing work unit
[10:02:59] Core required: FahCore_a2.exe
[10:02:59] Core found.
[10:02:59] Working on queue slot 08 [February 23 10:02:59 UTC]
[10:02:59] + Working ...
[10:02:59] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a2.exe -dir work/ -suffix 08 -checkpoint 15 -verbose -lifeline 18266 -version 624'
[10:02:59]
[10:02:59] *------------------------------*
[10:02:59] Folding@Home Gromacs SMP Core
[10:02:59] Version 2.04 (Thu Jan 29 16:43:57 PST 2009)
[10:02:59]
[10:02:59] Preparing to commence simulation
[10:02:59] - Ensuring status. Please wait.
[10:03:09] - Looking at optimizations...
[10:03:09] - Working with standard loops on this execution.
[10:03:09] - Files status OK
[10:03:10] - Expanded 4854759 -> 24043453 (decompressed 495.2 percent)
[10:03:10] Called DecompressByteArray: compressed_data_size=4854759 data_size=24043453, decompressed_data_size=24043453 diff=0
[10:03:10] - Digital signature verified
[10:03:10]
[10:03:10] Project: 2676 (Run 2, Clone 37, Gen 10)
[10:03:10]
[10:03:10] Entering M.D.
[10:03:16] Will resume from checkpoint file
[10:03:19] fcCheckPointResume: file hashes different -- aborting.
[10:03:19] s different -- aborting.
[10:03:23] CoreStatus = FF (255)
[10:03:23] Sending work to server
[10:03:23] Project: 2676 (Run 2, Clone 37, Gen 10)
[10:03:23] - Error: Could not get length of results file work/wuresults_08.dat
[10:03:23] - Error: Could not read unit 08 file. Removing from queue.
[10:03:23] Trying to send all finished work units
[10:03:23] + No unsent completed units remaining.
[10:03:23] - Preparing to get new work unit...
[10:03:23] + Attempting to get work packet
[10:03:23] - Will indicate memory of 16003 MB
[10:03:23] - Connecting to assignment server
[10:03:23] Connecting to http://assign.stanford.edu:8080/
[10:03:24] Posted data.
[10:03:24] Initial: 43AB; - Successful: assigned to (171.67.108.24).
[10:03:24] + News From Folding@Home: Welcome to Folding@Home
[10:03:24] Loaded queue successfully.
[10:03:24] Connecting to http://171.67.108.24:8080/
[10:03:30] Posted data.
[10:03:30] Initial: 0000; - Receiving payload (expected size: 4855271)
[10:03:42] - Downloaded at ~395 kB/s
[10:03:42] - Averaged speed for that direction ~362 kB/s
[10:03:42] + Received work.
[10:03:42] Trying to send all finished work units
[10:03:42] + No unsent completed units remaining.
[10:03:42] + Closed connections
[10:03:47]
[10:03:47] + Processing work unit
[10:03:47] Core required: FahCore_a2.exe
[10:03:47] Core found.
[10:03:47] Working on queue slot 09 [February 23 10:03:47 UTC]
[10:03:47] + Working ...
[10:03:47] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a2.exe -dir work/ -suffix 09 -checkpoint 15 -verbose -lifeline 18266 -version 624'
[10:03:47]
[10:03:47] *------------------------------*
[10:03:47] Folding@Home Gromacs SMP Core
[10:03:47] Version 2.04 (Thu Jan 29 16:43:57 PST 2009)
[10:03:47]
[10:03:47] Preparing to commence simulation
[10:03:47] - Ensuring status. Please wait.
[10:03:56] - Looking at optimizations...
[10:03:56] - Working with standard loops on this execution.
[10:03:56] - Files status OK
[10:03:57] - Expanded 4854759 -> 24043453 (decompressed 495.2 percent)
[10:03:57] Called DecompressByteArray: compressed_data_size=4854759 data_size=24043453, decompressed_data_size=24043453 diff=0
[10:03:57] - Digital signature verified
[10:03:57]
[10:03:57] Project: 2676 (Run 2, Clone 37, Gen 10)
[10:03:57]
[10:03:58] Entering M.D.
[10:12:48] Completed 2500 out of 250000 steps (1%)
[10:21:30] Completed 5000 out of 250000 steps (2%)
[10:30:10] Completed 7500 out of 250000 steps (3%)
[10:38:50] Completed 10000 out of 250000 steps (4%)
[10:47:30] Completed 12500 out of 250000 steps (5%)
[10:56:10] Completed 15000 out of 250000 steps (6%)
[11:02:23] - Autosending finished units... [February 23 11:02:23 UTC]
[11:02:23] Trying to send all finished work units
[11:02:23] + No unsent completed units remaining.
[11:02:23] - Autosend completed
[11:04:50] Completed 17500 out of 250000 steps (7%)
[11:05:48] CoreStatus = 0 (0)
[11:05:48] Sending work to server
[11:05:48] Project: 2676 (Run 2, Clone 37, Gen 10)
[11:05:48] - Error: Could not get length of results file work/wuresults_09.dat
[11:05:48] - Error: Could not read unit 09 file. Removing from queue.
[11:05:48] Trying to send all finished work units
[11:05:48] + No unsent completed units remaining.
[11:05:48] - Preparing to get new work unit...
[11:05:48] + Attempting to get work packet
[11:05:48] - Will indicate memory of 16003 MB
[11:05:48] - Connecting to assignment server
[11:05:48] Connecting to http://assign.stanford.edu:8080/
[11:05:49] Posted data.
[11:05:49] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[11:05:49] + News From Folding@Home: Welcome to Folding@Home
[11:05:49] Loaded queue successfully.
[11:05:49] Connecting to http://171.64.65.64:8080/
[11:05:50] Posted data.
[11:05:50] Initial: 0000; - Receiving payload (expected size: 741206)
[11:05:53] - Downloaded at ~241 kB/s
[11:05:53] - Averaged speed for that direction ~338 kB/s
[11:05:53] + Received work.
[11:05:53] Trying to send all finished work units
[11:05:53] + No unsent completed units remaining.
[11:05:53] + Closed connections
[11:05:58]
[11:05:58] + Processing work unit
[11:05:58] Work type a1 not eligible for variable processors
[11:05:58] Core required: FahCore_a1.exe
[11:05:58] Core found.
[11:05:58] Working on queue slot 00 [February 23 11:05:58 UTC]
[11:05:58] + Working ...
[11:05:58] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 00 -checkpoint 15 -verbose -lifeline 18266 -version 624'
[11:05:58]
[11:05:58] *------------------------------*
[11:05:58] Folding@Home Gromacs SMP Core
[11:05:58] Version 1.74 (November 27, 2006)
[11:05:58]
[11:05:58] Preparing to commence simulation
[11:05:58] - Ensuring status. Please wait.
[11:06:15] - Looking at optimizations...
[11:06:15] - Working with standard loops on this execution.
[11:06:15] - Previous termination of core was improper.
[11:06:15] - Going to use standard loops.
[11:06:15] - Files status OK
[11:06:16] - Expanded 740694 -> 3855925 (decompressed 520.5 percent)
[11:06:16] - Starting from initial work packet
[11:06:16]
[11:06:16] Project: 5101 (Run 0, Clone 77, Gen 69)
[11:06:16]
[11:06:16] Entering M.D.
[11:06:23] ocal files
[11:06:23] F in water
[11:06:23] Writing local files
[11:06:23] of 2000000 steps (0 percent)
[11:21:23] Timered checkpoint triggered.
[11:24:47] Writing local files
[11:24:47] Completed 20000 out of 2000000 steps (1 percent)
[11:39:48] Timered checkpoint triggered.
[11:43:21] Writing local files
[11:43:21] Completed 40000 out of 2000000 steps (2 percent)
[11:58:20] Timered checkpoint triggered.
[12:01:55] Writing local files
[12:01:55] Completed 60000 out of 2000000 steps (3 percent)
[12:16:56] Timered checkpoint triggered.
[12:20:32] Writing local files
[12:20:32] Completed 80000 out of 2000000 steps (4 percent)
[12:35:31] Timered checkpoint triggered.
[12:39:12] Writing local files
[12:39:12] Completed 100000 out of 2000000 steps (5 percent)
[12:54:13] Timered checkpoint triggered.
[12:57:53] Writing local files
[12:57:53] Completed 120000 out of 2000000 steps (6 percent)
[13:12:53] Timered checkpoint triggered.
[13:16:35] Writing local files
[13:16:35] Completed 140000 out of 2000000 steps (7 percent)
[13:31:35] Timered checkpoint triggered.
[13:35:07] Writing local files
[13:35:07] Completed 160000 out of 2000000 steps (8 percent)
[13:50:08] Timered checkpoint triggered.
[13:53:40] Writing local files
[13:53:40] Completed 180000 out of 2000000 steps (9 percent)
[14:08:40] Timered checkpoint triggered.
[14:12:13] Writing local files
[14:12:13] Completed 200000 out of 2000000 steps (10 percent)
[14:27:14] Timered checkpoint triggered.
[14:30:48] Writing local files
[14:30:48] Completed 220000 out of 2000000 steps (11 percent)
[14:45:47] Timered checkpoint triggered.
[14:49:23] Writing local files
[14:49:23] Completed 240000 out of 2000000 steps (12 percent)
[15:04:24] Timered checkpoint triggered.
[15:08:00] Writing local files
[15:08:00] Completed 260000 out of 2000000 steps (13 percent)
[15:23:00] Timered checkpoint triggered.
[15:26:38] Writing local files
[15:26:38] Completed 280000 out of 2000000 steps (14 percent)
[15:41:38] Timered checkpoint triggered.
[15:45:12] Writing local files
[15:45:12] Completed 300000 out of 2000000 steps (15 percent)
[16:00:13] Timered checkpoint triggered.
[16:03:52] Writing local files
[16:03:52] Completed 320000 out of 2000000 steps (16 percent)
[16:18:51] Timered checkpoint triggered.
[16:22:24] Writing local files
[16:22:24] Completed 340000 out of 2000000 steps (17 percent)
[16:37:25] Timered checkpoint triggered.
[16:40:52] Writing local files
[16:40:52] Completed 360000 out of 2000000 steps (18 percent)
[16:55:52] Timered checkpoint triggered.
[16:59:21] Writing local files
[16:59:21] Completed 380000 out of 2000000 steps (19 percent)
[17:01:32]
[17:01:32] Folding@home Core Shutdown: INTERRUPTED
[17:01:36] CoreStatus = 66 (102)
[17:01:36] + Shutdown requested by user. Exiting.***** Got a SIGTERM signal (15)
[17:01:37] Killing all core threads
Folding@Home Client Shutdown.
restarting client...