I've got a machine with more than one Nvidia card and used to be able to crunch using both at the same time after adding the use_all_gpus tag in cc_congfig.xml. At some point over the past few weeks this has stopped working and only one of the cards is being used to crunch now.

BOINC still recognizes both cards and knows it is supposed to be using both, but no longer does. I have plenty of work units and nothing else is using the card that I know of. Nvidia's control panel shows utilization at 0%.

Startup event log is shown below. The card that is not being utilized is GPU 1, the Quadro 4000 card. Interestingly, I have the same card in another machine in which it is also recognized as a second card and it works fine. I tried updating the Nvidia drivers but that didn't change anything.

11/8/2016 8:17:09 AM |  | CUDA: NVIDIA GPU 0: Tesla K20c (driver version 375.63, CUDA version 8.0, compute capability 3.5, 4096MB, 4010MB available, 3522 GFLOPS peak)
11/8/2016 8:17:09 AM |  | CUDA: NVIDIA GPU 1: Quadro 4000 (driver version 375.63, CUDA version 8.0, compute capability 2.0, 2048MB, 1955MB available, 486 GFLOPS peak)
11/8/2016 8:17:09 AM |  | OpenCL: NVIDIA GPU 0: Tesla K20c (driver version 375.63, device version OpenCL 1.2 CUDA, 5045MB, 4010MB available, 3522 GFLOPS peak)
11/8/2016 8:17:09 AM |  | OpenCL: NVIDIA GPU 1: Quadro 4000 (driver version 375.63, device version OpenCL 1.1 CUDA, 2048MB, 1955MB available, 486 GFLOPS peak)
11/8/2016 8:17:09 AM |  | Processor: 12 GenuineIntel       Intel(R) Xeon(R) CPU E5-2630 v2 @ 2.60GHz [Family 6 Model 62 Stepping 4]
11/8/2016 8:17:09 AM |  | Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss htt tm pni ssse3 cx16 sse4_1 sse4_2 popcnt aes f16c rdrandsyscall nx lm avx vmx smx tm2 dca pbe fsgsbase smep
11/8/2016 8:17:09 AM |  | OS: Microsoft Windows 7: Enterprise x64 Edition, Service Pack 1, (06.01.7601.00)
11/8/2016 8:17:09 AM |  | Memory: 63.93 GB physical, 64.70 GB virtual
11/8/2016 8:17:09 AM |  | Disk: 1.68 TB total, 1.41 TB free
11/8/2016 8:17:09 AM |  | Config: use all coprocessors

Any suggestions are appreciated.
Thanks,
Mike

use_all_gpus is working right. If it didn't you'd have "(not used)" after the Quadro name.

There must be something else going on. Please see When requesting help on these forums. for what information is needed.

I wonder if it doesn't have to do with drivers, although it seems that the K20c shouldn't be able to work then as its latest driver is 369.49. The 375.63 driver used doesn't seem to support any Tesla, only Quadro's, NVS's and GRID's.

---

Which BOINC version you run (See Help->About BOINC in BOINC Manager). We'd like version number and whether it's 32bit or 64bit (shown by the x86 and x64).
The project(s) that you have the problems with.
What your problem is exactly, write it out in as much detail as you can.
What you have done so far to try to remedy the problem.
Post the first 40 - 100 lines from your BOINC Event Log (CTRL+SHIFT+E), including it showing what your BOINC is doing, which project tasks it is running.

BOINC version is 7.6.22 x64
The problem manifests with any project that has GPU work units, currently Milkyway@home
I've tried deleting and recreating cc_config, reloading the config files, uninstalling and reinstalling BOINC, upgrading the graphics drivers (using Nvidia's suggestion of using the latest Quadro drivers on a system with both Quadro and Tesla hardware), detaching and reattaching the projects, and beating on the keyboard and swearing at the computer. The last one may have helped a little.
First 100 lines of log follows:

11/10/2016 8:04:36 AM |  | Starting BOINC client version 7.6.22 for windows_x86_64
11/10/2016 8:04:36 AM |  | log flags: file_xfer, sched_ops, task
11/10/2016 8:04:36 AM |  | Libraries: libcurl/7.45.0 OpenSSL/1.0.2d zlib/1.2.8
11/10/2016 8:04:36 AM |  | Data directory: C:\ProgramData\BOINC
11/10/2016 8:04:36 AM |  | Running under account 1093546
11/10/2016 8:04:37 AM |  | CUDA: NVIDIA GPU 0: Tesla K20c (driver version 375.63, CUDA version 8.0, compute capability 3.5, 4096MB, 4010MB available, 3522 GFLOPS peak)
11/10/2016 8:04:37 AM |  | CUDA: NVIDIA GPU 1: Quadro 4000 (driver version 375.63, CUDA version 8.0, compute capability 2.0, 2048MB, 953MB available, 486 GFLOPS peak)
11/10/2016 8:04:37 AM |  | OpenCL: NVIDIA GPU 0: Tesla K20c (driver version 375.63, device version OpenCL 1.2 CUDA, 5045MB, 4010MB available, 3522 GFLOPS peak)
11/10/2016 8:04:37 AM |  | OpenCL: NVIDIA GPU 1: Quadro 4000 (driver version 375.63, device version OpenCL 1.1 CUDA, 2048MB, 953MB available, 486 GFLOPS peak)
11/10/2016 8:04:37 AM |  | Host name: AI146349
11/10/2016 8:04:37 AM |  | Processor: 12 GenuineIntel       Intel(R) Xeon(R) CPU E5-2630 v2 @ 2.60GHz [Family 6 Model 62 Stepping 4]
11/10/2016 8:04:37 AM |  | Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss htt tm pni ssse3 cx16 sse4_1 sse4_2 popcnt aes f16c rdrandsyscall nx lm avx vmx smx tm2 dca pbe fsgsbase smep
11/10/2016 8:04:37 AM |  | OS: Microsoft Windows 7: Enterprise x64 Edition, Service Pack 1, (06.01.7601.00)
11/10/2016 8:04:37 AM |  | Memory: 63.93 GB physical, 64.70 GB virtual
11/10/2016 8:04:37 AM |  | Disk: 1.68 TB total, 1.41 TB free
11/10/2016 8:04:37 AM |  | Local time is UTC -5 hours
11/10/2016 8:04:37 AM |  | Config: use all coprocessors
11/10/2016 8:04:37 AM | Cosmology@Home | URL http://www.cosmologyathome.org/; Computer ID 287276; resource share 100
11/10/2016 8:04:37 AM | Milkyway@Home | URL http://milkyway.cs.rpi.edu/milkyway/; Computer ID 695197; resource share 100
11/10/2016 8:04:37 AM | rosetta@home | URL http://boinc.bakerlab.org/rosetta/; Computer ID 2744533; resource share 100
11/10/2016 8:04:37 AM | Universe@Home | URL http://universeathome.pl/universe/; Computer ID 42638; resource share 100
11/10/2016 8:04:37 AM | rosetta@home | General prefs: from rosetta@home (last modified 06-Jan-2006 02:38:01)
11/10/2016 8:04:37 AM | rosetta@home | Host location: none
11/10/2016 8:04:37 AM | rosetta@home | General prefs: using your defaults
11/10/2016 8:04:37 AM |  | Reading preferences override file
11/10/2016 8:04:37 AM |  | Preferences:
11/10/2016 8:04:37 AM |  | max memory usage when active: 58913.76MB
11/10/2016 8:04:37 AM |  | max memory usage when idle: 58913.76MB
11/10/2016 8:04:37 AM |  | max disk usage: 858.48GB
11/10/2016 8:04:37 AM |  | max CPUs used: 11
11/10/2016 8:04:37 AM |  | suspend work if non-BOINC CPU load exceeds 35%
11/10/2016 8:04:37 AM |  | (to change preferences, visit a project web site or select Preferences in the Manager)
11/10/2016 8:04:50 AM | rosetta@home | Sending scheduler request: To fetch work.
11/10/2016 8:04:50 AM | rosetta@home | Requesting new tasks for NVIDIA GPU
11/10/2016 8:05:12 AM | rosetta@home | Computation for task tj_9_24_junc_X_DHR23_DHR79_l2_0_v2_fragments_abinitio_SAVE_ALL_OUT_439037_171_0 finished
11/10/2016 8:05:14 AM | rosetta@home | Starting task rb_11_08_70145_113733_ab_stage0_t000___robetta_IGNORE_THE_REST_10_19_448852_29_0
11/10/2016 8:05:15 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:05:15 AM | rosetta@home | Started upload of tj_9_24_junc_X_DHR23_DHR79_l2_0_v2_fragments_abinitio_SAVE_ALL_OUT_439037_171_0_0
11/10/2016 8:05:15 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints3_4_1478718902_811992_0 finished
11/10/2016 8:05:15 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints3_3_1478718902_811945_0
11/10/2016 8:05:16 AM | rosetta@home | Scheduler request completed: got 0 new tasks
11/10/2016 8:05:20 AM | rosetta@home | Finished upload of tj_9_24_junc_X_DHR23_DHR79_l2_0_v2_fragments_abinitio_SAVE_ALL_OUT_439037_171_0_0
11/10/2016 8:05:22 AM | Milkyway@Home | Sending scheduler request: To fetch work.
11/10/2016 8:05:22 AM | Milkyway@Home | Reporting 6 completed tasks
11/10/2016 8:05:22 AM | Milkyway@Home | Requesting new tasks for NVIDIA GPU
11/10/2016 8:05:26 AM | Milkyway@Home | Scheduler request completed: got 6 new tasks
11/10/2016 8:05:30 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:05:30 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints3_3_1478718902_811945_0 finished
11/10/2016 8:05:30 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints3_4_1478718902_811677_0
11/10/2016 8:05:45 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:05:45 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints3_4_1478718902_811677_0 finished
11/10/2016 8:05:45 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints3_4_1478718902_811994_0
11/10/2016 8:06:05 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:06:05 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints3_4_1478718902_811994_0 finished
11/10/2016 8:06:05 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints3_4_1478718902_811995_0
11/10/2016 8:06:21 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:06:21 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints3_4_1478718902_811995_0 finished
11/10/2016 8:06:21 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints3_2_1478718902_763473_1
11/10/2016 8:06:41 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:06:41 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints3_2_1478718902_763473_1 finished
11/10/2016 8:06:41 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints3_3_1478718902_814621_0
11/10/2016 8:06:57 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:06:57 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints3_3_1478718902_814621_0 finished
11/10/2016 8:06:57 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints3_3_1478718902_814620_0
11/10/2016 8:07:01 AM | Milkyway@Home | Sending scheduler request: To fetch work.
11/10/2016 8:07:01 AM | Milkyway@Home | Reporting 6 completed tasks
11/10/2016 8:07:01 AM | Milkyway@Home | Requesting new tasks for NVIDIA GPU
11/10/2016 8:07:04 AM | Milkyway@Home | Scheduler request completed: got 6 new tasks
11/10/2016 8:07:12 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:07:13 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints3_3_1478718902_814620_0 finished
11/10/2016 8:07:13 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints3_3_1478718902_814618_0
11/10/2016 8:07:27 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:07:27 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints3_3_1478718902_814618_0 finished
11/10/2016 8:07:27 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints3_3_1478718902_814619_0
11/10/2016 8:07:42 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:07:43 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints3_3_1478718902_814619_0 finished
11/10/2016 8:07:43 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints3_3_1478718902_814622_0
11/10/2016 8:07:58 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:07:58 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints3_3_1478718902_814622_0 finished
11/10/2016 8:07:58 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints3_1_1478718902_809107_1
11/10/2016 8:08:12 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:08:12 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints3_1_1478718902_809107_1 finished
11/10/2016 8:08:12 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints3_1_1478718902_803769_1
11/10/2016 8:08:26 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:08:26 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints3_1_1478718902_803769_1 finished
11/10/2016 8:08:26 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints2_2_1478718902_818061_0
11/10/2016 8:08:38 AM | Milkyway@Home | Sending scheduler request: To fetch work.
11/10/2016 8:08:38 AM | Milkyway@Home | Reporting 6 completed tasks
11/10/2016 8:08:38 AM | Milkyway@Home | Requesting new tasks for NVIDIA GPU
11/10/2016 8:08:41 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:08:41 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints2_2_1478718902_818061_0 finished
11/10/2016 8:08:42 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints2_2_1478718902_818070_0
11/10/2016 8:08:42 AM | Milkyway@Home | Scheduler request completed: got 6 new tasks
11/10/2016 8:08:56 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:08:56 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints2_2_1478718902_818070_0 finished
11/10/2016 8:08:56 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints2_2_1478718902_818060_0
11/10/2016 8:09:11 AM | Milkyway@Home | Message from task: 0
11/10/2016 8:09:11 AM | Milkyway@Home | Computation for task de_modfit_fast_19_3s_136_ModfitConstraints2_2_1478718902_818060_0 finished
11/10/2016 8:09:11 AM | Milkyway@Home | Starting task de_modfit_fast_19_3s_136_ModfitConstraints2_2_1478718902_818062_0
11/10/2016 8:09:24 AM | rosetta@home | Sending scheduler request: To report completed tasks.

Thanks for the help,
Mike

Not to mention the 375.63 has had known problems at other DC projects and programs, I would recommend downgrading it and see what happens.

https://hardforum.com/threads/nvidia-375-63-unstable.1915805/

---

I tried downgrading to 369.49 per Ageless' comment but see the same symptoms. I also tried downgrading back to 354.92, which was the version I had back when everything was working (but also the version I had when everything suddenly stopped working) also to no avail.

The Tesla card continues to work under all versions, and there is no discernible change in the log messages during startup to indicate the detection is going differently.

Is there onboard video you can use if you pulled the Quadro out for testing? I would be interested to know if BOINC will go ahead and use the Tesla without it.

---

You'll need to enable some debug flags. I'm not sure which ones so lets go with shotgun approach. Enable coproc_debug, cpu_sched, cpu_sched_debug and cpu_sched_status in Options -> Event Log options.

How much CPU work you have in cache?

I'm not sure what happened over the weekend, but presumably microsoft pushed an update or something and now my symptoms have changed considerably. I don't know if I should open a new thread or what, but I'll describe what I'm seeing here and better minds can make that decision.

I still have the problem that only one GPU task is running at a time, but now I have the additional bizarre problem that the GPU task is not running on the GPU and instead runs entirely on the CPU. I can tell this is the case because the Nvidia control panel shows no GPU utilization and also because the task shows full utilization of a single core in the OS task manager. The tasks also take way longer to complete running on one core vs 2496 (core count of the Tesla K20c).

I thought this may have been a problem related to the project (Milkyway@home) so I reset the project in an attempt to clear the symptoms, but that did not help. I then thought that perhaps all the various different versions of the Nvidia drivers I had been cycling through last week may have left behind something objectionable, so I completely uninstalled the graphics drivers and reinstalled the most recent set with the "reset settings" option checked during the install. This didn't help, either.

There haven't been any changes in the messages within the startup log since the last time I posted a copy.

I'm going to turn on the extra debug logging functions mentioned above and I'll post again when I have more information from that.

Juha: I'm not sure how to get a good count of exactly how many CPU tasks are in the queue, but I have BOINC configured to store at least 3 days worth and up to an additional 5 days, so there are quite a few. I have it configured this way because the internet connection can be fragile at times and it may take that long to get it back up.

Thanks again to all for the help,
Mike

Here's a copy of the log when I start BOINC with the above debugging flags set:

11/15/2016 7:40:35 AM |  | Starting BOINC client version 7.6.22 for windows_x86_64
11/15/2016 7:40:35 AM |  | log flags: file_xfer, sched_ops, task, coproc_debug, cpu_sched, cpu_sched_debug
11/15/2016 7:40:35 AM |  | log flags: cpu_sched_status
11/15/2016 7:40:35 AM |  | Libraries: libcurl/7.45.0 OpenSSL/1.0.2d zlib/1.2.8
11/15/2016 7:40:35 AM |  | Data directory: C:\ProgramData\BOINC
11/15/2016 7:40:35 AM |  | Running under account 1093546
11/15/2016 7:40:35 AM |  | [coproc] launching child process at C:\Program Files\BOINC\boinc.exe
11/15/2016 7:40:35 AM |  | [coproc] relative to directory C:\ProgramData\BOINC
11/15/2016 7:40:35 AM |  | [coproc] with data directory "C:\ProgramData\BOINC"
11/15/2016 7:40:36 AM |  | CUDA: NVIDIA GPU 0: Tesla K20c (driver version 375.63, CUDA version 8.0, compute capability 3.5, 4096MB, 4010MB available, 3522 GFLOPS peak)
11/15/2016 7:40:36 AM |  | CUDA: NVIDIA GPU 1: Quadro 4000 (driver version 375.63, CUDA version 8.0, compute capability 2.0, 2048MB, 343MB available, 486 GFLOPS peak)
11/15/2016 7:40:36 AM |  | OpenCL: NVIDIA GPU 0: Tesla K20c (driver version 375.63, device version OpenCL 1.2 CUDA, 5045MB, 4010MB available, 3522 GFLOPS peak)
11/15/2016 7:40:36 AM |  | OpenCL: NVIDIA GPU 1: Quadro 4000 (driver version 375.63, device version OpenCL 1.1 CUDA, 2048MB, 343MB available, 486 GFLOPS peak)
11/15/2016 7:40:36 AM |  | [coproc] NVIDIA library reports 2 GPUs
11/15/2016 7:40:36 AM |  | [coproc] No ATI library found.
11/15/2016 7:40:36 AM |  | Host name: AI146349
11/15/2016 7:40:36 AM |  | Processor: 12 GenuineIntel       Intel(R) Xeon(R) CPU E5-2630 v2 @ 2.60GHz [Family 6 Model 62 Stepping 4]
11/15/2016 7:40:36 AM |  | Processor features: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss htt tm pni ssse3 cx16 sse4_1 sse4_2 popcnt aes f16c rdrandsyscall nx lm avx vmx smx tm2 dca pbe fsgsbase smep
11/15/2016 7:40:36 AM |  | OS: Microsoft Windows 7: Enterprise x64 Edition, Service Pack 1, (06.01.7601.00)
11/15/2016 7:40:36 AM |  | Memory: 63.93 GB physical, 64.70 GB virtual
11/15/2016 7:40:36 AM |  | Disk: 1.68 TB total, 1.41 TB free
11/15/2016 7:40:36 AM |  | Local time is UTC -5 hours
11/15/2016 7:40:36 AM |  | Config: use all coprocessors
11/15/2016 7:40:36 AM | Cosmology@Home | URL http://www.cosmologyathome.org/; Computer ID 287276; resource share 100
11/15/2016 7:40:36 AM | Milkyway@Home | URL http://milkyway.cs.rpi.edu/milkyway/; Computer ID 695197; resource share 100
11/15/2016 7:40:36 AM | rosetta@home | URL http://boinc.bakerlab.org/rosetta/; Computer ID 2744533; resource share 100
11/15/2016 7:40:36 AM | Universe@Home | URL http://universeathome.pl/universe/; Computer ID 42638; resource share 100
11/15/2016 7:40:36 AM | rosetta@home | General prefs: from rosetta@home (last modified 06-Jan-2006 02:38:01)
11/15/2016 7:40:36 AM | rosetta@home | Host location: none
11/15/2016 7:40:36 AM | rosetta@home | General prefs: using your defaults
11/15/2016 7:40:36 AM |  | Reading preferences override file
11/15/2016 7:40:36 AM |  | Preferences:
11/15/2016 7:40:36 AM |  | max memory usage when active: 58913.76MB
11/15/2016 7:40:36 AM |  | max memory usage when idle: 58913.76MB
11/15/2016 7:40:37 AM |  | max disk usage: 858.48GB
11/15/2016 7:40:37 AM |  | max CPUs used: 11
11/15/2016 7:40:37 AM |  | suspend work if non-BOINC CPU load exceeds 35%
11/15/2016 7:40:37 AM |  | (to change preferences, visit a project web site or select Preferences in the Manager)
11/15/2016 7:40:37 AM |  | [cpu_sched_debug] Request CPU reschedule: Prefs update
11/15/2016 7:40:37 AM |  | [cpu_sched_debug] Request CPU reschedule: Startup
11/15/2016 7:40:37 AM |  | [cpu_sched_debug] Request CPU reschedule: Not idle
11/15/2016 7:40:37 AM |  | [cpu_sched_debug] Request CPU reschedule: periodic CPU scheduling
11/15/2016 7:40:37 AM |  | [cpu_sched_debug] schedule_cpus(): start
11/15/2016 7:40:37 AM | Milkyway@Home | [cpu_sched_debug] reserving 1.000000 of coproc NVIDIA
11/15/2016 7:40:37 AM | Milkyway@Home | [cpu_sched_debug] add to run list: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (NVIDIA GPU, FIFO) (prio -3.913340)
11/15/2016 7:40:37 AM | Milkyway@Home | [cpu_sched_debug] reserving 1.000000 of coproc NVIDIA
11/15/2016 7:40:37 AM | Milkyway@Home | [cpu_sched_debug] add to run list: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (NVIDIA GPU, FIFO) (prio -3.995670)
11/15/2016 7:40:37 AM | Cosmology@Home | [cpu_sched_debug] add to run list: wu_110316_055907_0_0_0 (CPU, EDF) (prio -0.014756)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (CPU, EDF) (prio -0.059719)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] add to run list: EZYnY7vp_fold_and_dock_SAVE_ALL_OUT_449821_130_0 (CPU, EDF) (prio -0.059924)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] add to run list: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (CPU, EDF) (prio -0.060128)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] add to run list: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (CPU, EDF) (prio -0.060332)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (CPU, EDF) (prio -0.060537)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] add to run list: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (CPU, EDF) (prio -0.060741)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (CPU, EDF) (prio -0.060945)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] add to run list: uogD58n7_fold_and_dock_SAVE_ALL_OUT_449844_152_0 (CPU, EDF) (prio -0.061149)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] add to run list: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (CPU, EDF) (prio -0.061354)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (CPU, EDF) (prio -0.061558)
11/15/2016 7:40:37 AM |  | [cpu_sched_debug] enforce_run_list(): start
11/15/2016 7:40:37 AM |  | [cpu_sched_debug] preliminary job list:
11/15/2016 7:40:37 AM | Milkyway@Home | [cpu_sched_debug] 0: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (MD: no; UTS: no)
11/15/2016 7:40:37 AM | Milkyway@Home | [cpu_sched_debug] 1: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (MD: no; UTS: no)
11/15/2016 7:40:37 AM | Cosmology@Home | [cpu_sched_debug] 2: wu_110316_055907_0_0_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 3: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 4: EZYnY7vp_fold_and_dock_SAVE_ALL_OUT_449821_130_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 5: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 6: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 7: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 8: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 9: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 10: uogD58n7_fold_and_dock_SAVE_ALL_OUT_449844_152_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 11: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 12: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM |  | [cpu_sched_debug] final job list:
11/15/2016 7:40:37 AM | Cosmology@Home | [cpu_sched_debug] 0: wu_110316_055907_0_0_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 1: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 2: EZYnY7vp_fold_and_dock_SAVE_ALL_OUT_449821_130_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 3: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 4: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 5: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 6: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 7: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 8: uogD58n7_fold_and_dock_SAVE_ALL_OUT_449844_152_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 9: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] 10: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (MD: yes; UTS: no)
11/15/2016 7:40:37 AM | Milkyway@Home | [cpu_sched_debug] 11: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (MD: no; UTS: no)
11/15/2016 7:40:37 AM | Milkyway@Home | [cpu_sched_debug] 12: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (MD: no; UTS: no)
11/15/2016 7:40:37 AM | Milkyway@Home | [coproc] Assigning NVIDIA instance 0 to de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0
11/15/2016 7:40:37 AM | Milkyway@Home | [coproc] Assigning NVIDIA instance 1 to de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1
11/15/2016 7:40:37 AM | Cosmology@Home | [cpu_sched_debug] scheduling wu_110316_055907_0_0_0 (high priority)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (high priority)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] scheduling EZYnY7vp_fold_and_dock_SAVE_ALL_OUT_449821_130_0 (high priority)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] scheduling 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (high priority)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] scheduling fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (high priority)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (high priority)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] scheduling 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (high priority)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (high priority)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] scheduling uogD58n7_fold_and_dock_SAVE_ALL_OUT_449844_152_0 (high priority)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] scheduling hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (high priority)
11/15/2016 7:40:37 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (high priority)
11/15/2016 7:40:37 AM | Milkyway@Home | [cpu_sched_debug] scheduling de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0
11/15/2016 7:40:37 AM | Milkyway@Home | [cpu_sched_debug] skipping GPU job de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1; CPU committed
11/15/2016 7:40:37 AM | Cosmology@Home | [cpu_sched] Restarting task wu_110316_055907_0_0_0 using camb version 217 in slot 12
11/15/2016 7:40:37 AM | Cosmology@Home | [css] running wu_110316_055907_0_0_0 ()
11/15/2016 7:40:38 AM | rosetta@home | [cpu_sched] Restarting task FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 using minirosetta version 373 in slot 16
11/15/2016 7:40:38 AM | rosetta@home | [css] running FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 ()
11/15/2016 7:40:40 AM | rosetta@home | [cpu_sched] Restarting task hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 using minirosetta version 373 in slot 17
11/15/2016 7:40:40 AM | rosetta@home | [css] running hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 ()
11/15/2016 7:40:42 AM | rosetta@home | [cpu_sched] Restarting task FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 using minirosetta version 373 in slot 18
11/15/2016 7:40:42 AM | rosetta@home | [css] running FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 ()
11/15/2016 7:40:43 AM | rosetta@home | [cpu_sched] Restarting task uogD58n7_fold_and_dock_SAVE_ALL_OUT_449844_152_0 using minirosetta version 373 in slot 19
11/15/2016 7:40:43 AM | rosetta@home | [css] running uogD58n7_fold_and_dock_SAVE_ALL_OUT_449844_152_0 ()
11/15/2016 7:40:45 AM | rosetta@home | [cpu_sched] Restarting task EZYnY7vp_fold_and_dock_SAVE_ALL_OUT_449821_130_0 using minirosetta version 373 in slot 20
11/15/2016 7:40:45 AM | rosetta@home | [css] running EZYnY7vp_fold_and_dock_SAVE_ALL_OUT_449821_130_0 ()
11/15/2016 7:40:46 AM | rosetta@home | [cpu_sched] Restarting task 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 using minirosetta version 373 in slot 6
11/15/2016 7:40:46 AM | rosetta@home | [css] running 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 ()
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched] Restarting task fer2_104_fold_SAVE_ALL_OUT_449276_241_0 using minirosetta version 373 in slot 13
11/15/2016 7:40:48 AM | rosetta@home | [css] running fer2_104_fold_SAVE_ALL_OUT_449276_241_0 ()
11/15/2016 7:40:48 AM |  | [cpu_sched_debug] app startup took 11.145887 secs
11/15/2016 7:40:48 AM |  | [cpu_sched_debug] Request CPU reschedule: slow app startup
11/15/2016 7:40:48 AM |  | [cpu_sched_debug] enforce_run_list: end
11/15/2016 7:40:48 AM |  | [cpu_sched_debug] schedule_cpus(): start
11/15/2016 7:40:48 AM | Milkyway@Home | [cpu_sched_debug] reserving 1.000000 of coproc NVIDIA
11/15/2016 7:40:48 AM | Milkyway@Home | [cpu_sched_debug] add to run list: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (NVIDIA GPU, FIFO) (prio -3.913340)
11/15/2016 7:40:48 AM | Milkyway@Home | [cpu_sched_debug] reserving 1.000000 of coproc NVIDIA
11/15/2016 7:40:48 AM | Milkyway@Home | [cpu_sched_debug] add to run list: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (NVIDIA GPU, FIFO) (prio -3.995669)
11/15/2016 7:40:48 AM | Cosmology@Home | [cpu_sched_debug] add to run list: wu_110316_055907_0_0_0 (CPU, EDF) (prio -0.014756)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (CPU, EDF) (prio -0.059720)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] add to run list: EZYnY7vp_fold_and_dock_SAVE_ALL_OUT_449821_130_0 (CPU, EDF) (prio -0.059924)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] add to run list: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (CPU, EDF) (prio -0.060129)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] add to run list: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (CPU, EDF) (prio -0.060333)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (CPU, EDF) (prio -0.060537)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] add to run list: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (CPU, EDF) (prio -0.060741)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (CPU, EDF) (prio -0.060946)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] add to run list: uogD58n7_fold_and_dock_SAVE_ALL_OUT_449844_152_0 (CPU, EDF) (prio -0.061150)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] add to run list: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (CPU, EDF) (prio -0.061354)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (CPU, EDF) (prio -0.061559)
11/15/2016 7:40:48 AM |  | [cpu_sched_debug] enforce_run_list(): start
11/15/2016 7:40:48 AM |  | [cpu_sched_debug] preliminary job list:
11/15/2016 7:40:48 AM | Milkyway@Home | [cpu_sched_debug] 0: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (MD: no; UTS: no)
11/15/2016 7:40:48 AM | Milkyway@Home | [cpu_sched_debug] 1: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (MD: no; UTS: no)
11/15/2016 7:40:48 AM | Cosmology@Home | [cpu_sched_debug] 2: wu_110316_055907_0_0_0 (MD: yes; UTS: no)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 3: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: no)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 4: EZYnY7vp_fold_and_dock_SAVE_ALL_OUT_449821_130_0 (MD: yes; UTS: no)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 5: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (MD: yes; UTS: no)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 6: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (MD: yes; UTS: no)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 7: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: no)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 8: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (MD: yes; UTS: no)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 9: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: no)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 10: uogD58n7_fold_and_dock_SAVE_ALL_OUT_449844_152_0 (MD: yes; UTS: no)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 11: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (MD: yes; UTS: no)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 12: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (MD: yes; UTS: no)
11/15/2016 7:40:48 AM |  | [cpu_sched_debug] final job list:
11/15/2016 7:40:48 AM | Cosmology@Home | [cpu_sched_debug] 0: wu_110316_055907_0_0_0 (MD: yes; UTS: yes)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 1: EZYnY7vp_fold_and_dock_SAVE_ALL_OUT_449821_130_0 (MD: yes; UTS: yes)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 2: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (MD: yes; UTS: yes)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 3: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (MD: yes; UTS: yes)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 4: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: yes)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 5: uogD58n7_fold_and_dock_SAVE_ALL_OUT_449844_152_0 (MD: yes; UTS: yes)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 6: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (MD: yes; UTS: yes)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 7: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (MD: yes; UTS: yes)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 8: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: no)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 9: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: no)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] 10: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (MD: yes; UTS: no)
11/15/2016 7:40:48 AM | Milkyway@Home | [cpu_sched_debug] 11: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (MD: no; UTS: no)
11/15/2016 7:40:48 AM | Milkyway@Home | [cpu_sched_debug] 12: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (MD: no; UTS: no)
11/15/2016 7:40:48 AM | Milkyway@Home | [coproc] Assigning NVIDIA instance 0 to de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0
11/15/2016 7:40:48 AM | Milkyway@Home | [coproc] Assigning NVIDIA instance 1 to de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1
11/15/2016 7:40:48 AM | Cosmology@Home | [cpu_sched_debug] scheduling wu_110316_055907_0_0_0 (high priority)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] scheduling EZYnY7vp_fold_and_dock_SAVE_ALL_OUT_449821_130_0 (high priority)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] scheduling 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (high priority)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] scheduling fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (high priority)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (high priority)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] scheduling uogD58n7_fold_and_dock_SAVE_ALL_OUT_449844_152_0 (high priority)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] scheduling hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (high priority)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (high priority)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (high priority)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (high priority)
11/15/2016 7:40:48 AM | rosetta@home | [cpu_sched_debug] scheduling 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (high priority)
11/15/2016 7:40:48 AM | Milkyway@Home | [cpu_sched_debug] scheduling de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0
11/15/2016 7:40:48 AM | Milkyway@Home | [cpu_sched_debug] skipping GPU job de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1; CPU committed
11/15/2016 7:40:48 AM | Cosmology@Home | [css] running wu_110316_055907_0_0_0 ()
11/15/2016 7:40:48 AM | rosetta@home | [css] running FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 ()
11/15/2016 7:40:48 AM | rosetta@home | [css] running hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 ()
11/15/2016 7:40:48 AM | rosetta@home | [css] running FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 ()
11/15/2016 7:40:48 AM | rosetta@home | [css] running uogD58n7_fold_and_dock_SAVE_ALL_OUT_449844_152_0 ()
11/15/2016 7:40:48 AM | rosetta@home | [css] running EZYnY7vp_fold_and_dock_SAVE_ALL_OUT_449821_130_0 ()
11/15/2016 7:40:48 AM | rosetta@home | [css] running 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 ()
11/15/2016 7:40:48 AM | rosetta@home | [css] running fer2_104_fold_SAVE_ALL_OUT_449276_241_0 ()
11/15/2016 7:40:49 AM | rosetta@home | [cpu_sched] Restarting task FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 using minirosetta version 373 in slot 11
11/15/2016 7:40:49 AM | rosetta@home | [css] running FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 ()
11/15/2016 7:40:51 AM | rosetta@home | [cpu_sched] Restarting task FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 using minirosetta version 373 in slot 14
11/15/2016 7:40:51 AM | rosetta@home | [css] running FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 ()
11/15/2016 7:40:52 AM | rosetta@home | [cpu_sched] Restarting task 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 using minirosetta version 373 in slot 21
11/15/2016 7:40:52 AM | rosetta@home | [css] running 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 ()
11/15/2016 7:40:52 AM | Milkyway@Home | [cpu_sched] Restarting task de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 using milkyway version 142 (opencl_nvidia_101) in slot 5
11/15/2016 7:40:52 AM | Milkyway@Home | [css] running de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 ()
11/15/2016 7:40:52 AM |  | [cpu_sched_debug] enforce_run_list: end
11/15/2016 7:41:07 AM |  | [cpu_sched_debug] Request CPU reschedule: application exited
11/15/2016 7:41:16 AM |  | [cpu_sched_debug] Request CPU reschedule: application exited
11/15/2016 7:41:16 AM | rosetta@home | Computation for task uogD58n7_fold_and_dock_SAVE_ALL_OUT_449844_152_0 finished
11/15/2016 7:41:16 AM |  | [cpu_sched_debug] Request CPU reschedule: handle_finished_apps
11/15/2016 7:41:16 AM | rosetta@home | Computation for task EZYnY7vp_fold_and_dock_SAVE_ALL_OUT_449821_130_0 finished
11/15/2016 7:41:16 AM |  | [cpu_sched_debug] Request CPU reschedule: handle_finished_apps
11/15/2016 7:41:16 AM |  | [cpu_sched_debug] schedule_cpus(): start
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] reserving 1.000000 of coproc NVIDIA
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] add to run list: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (NVIDIA GPU, FIFO) (prio -3.913339)
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] reserving 1.000000 of coproc NVIDIA
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] add to run list: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (NVIDIA GPU, FIFO) (prio -3.995669)
11/15/2016 7:41:16 AM | Cosmology@Home | [cpu_sched_debug] add to run list: wu_110316_055907_0_0_0 (CPU, EDF) (prio -0.014756)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (CPU, EDF) (prio -0.059720)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (CPU, EDF) (prio -0.059925)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (CPU, EDF) (prio -0.060129)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (CPU, EDF) (prio -0.060333)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (CPU, EDF) (prio -0.060538)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (CPU, EDF) (prio -0.060742)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (CPU, EDF) (prio -0.060946)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (CPU, EDF) (prio -0.061150)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 (CPU, EDF) (prio -0.061355)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 (CPU, EDF) (prio -0.061559)
11/15/2016 7:41:16 AM |  | [cpu_sched_debug] enforce_run_list(): start
11/15/2016 7:41:16 AM |  | [cpu_sched_debug] preliminary job list:
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] 0: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (MD: no; UTS: no)
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] 1: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (MD: no; UTS: no)
11/15/2016 7:41:16 AM | Cosmology@Home | [cpu_sched_debug] 2: wu_110316_055907_0_0_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 3: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 4: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 5: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 6: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 7: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 8: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: no)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 9: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: no)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 10: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (MD: yes; UTS: no)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 11: FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: no)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 12: FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 (MD: yes; UTS: no)
11/15/2016 7:41:16 AM |  | [cpu_sched_debug] final job list:
11/15/2016 7:41:16 AM | Cosmology@Home | [cpu_sched_debug] 0: wu_110316_055907_0_0_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 1: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 2: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 3: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 4: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 5: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 6: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 7: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 8: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 9: FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: no)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 10: FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 (MD: yes; UTS: no)
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] 11: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (MD: no; UTS: yes)
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] 12: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (MD: no; UTS: no)
11/15/2016 7:41:16 AM | Milkyway@Home | [coproc] NVIDIA instance 0; 1.000000 pending for de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0
11/15/2016 7:41:16 AM | Milkyway@Home | [coproc] NVIDIA instance 0: confirming 1.000000 instance for de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0
11/15/2016 7:41:16 AM | Milkyway@Home | [coproc] Assigning NVIDIA instance 1 to de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1
11/15/2016 7:41:16 AM | Cosmology@Home | [cpu_sched_debug] scheduling wu_110316_055907_0_0_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 (high priority)
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] scheduling de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] skipping GPU job de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1; CPU committed
11/15/2016 7:41:16 AM | Cosmology@Home | [css] running wu_110316_055907_0_0_0 ( )
11/15/2016 7:41:16 AM |  | [cpu_sched_debug] app startup took 17.846001 secs
11/15/2016 7:41:16 AM |  | [cpu_sched_debug] Request CPU reschedule: slow app startup
11/15/2016 7:41:16 AM |  | [cpu_sched_debug] enforce_run_list: end
11/15/2016 7:41:16 AM |  | [cpu_sched_debug] schedule_cpus(): start
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] reserving 1.000000 of coproc NVIDIA
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] add to run list: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (NVIDIA GPU, FIFO) (prio -3.913339)
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] reserving 1.000000 of coproc NVIDIA
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] add to run list: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (NVIDIA GPU, FIFO) (prio -3.995669)
11/15/2016 7:41:16 AM | Cosmology@Home | [cpu_sched_debug] add to run list: wu_110316_055907_0_0_0 (CPU, EDF) (prio -0.014756)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (CPU, EDF) (prio -0.059721)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (CPU, EDF) (prio -0.059925)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (CPU, EDF) (prio -0.060129)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (CPU, EDF) (prio -0.060334)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (CPU, EDF) (prio -0.060538)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (CPU, EDF) (prio -0.060742)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (CPU, EDF) (prio -0.060946)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (CPU, EDF) (prio -0.061151)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 (CPU, EDF) (prio -0.061355)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 (CPU, EDF) (prio -0.061559)
11/15/2016 7:41:16 AM |  | [cpu_sched_debug] enforce_run_list(): start
11/15/2016 7:41:16 AM |  | [cpu_sched_debug] preliminary job list:
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] 0: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (MD: no; UTS: yes)
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] 1: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (MD: no; UTS: no)
11/15/2016 7:41:16 AM | Cosmology@Home | [cpu_sched_debug] 2: wu_110316_055907_0_0_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 3: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 4: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 5: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 6: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 7: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 8: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 9: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 10: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 11: FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: no)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 12: FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 (MD: yes; UTS: no)
11/15/2016 7:41:16 AM |  | [cpu_sched_debug] final job list:
11/15/2016 7:41:16 AM | Cosmology@Home | [cpu_sched_debug] 0: wu_110316_055907_0_0_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 1: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 2: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 3: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 4: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 5: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 6: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 7: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 8: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (MD: yes; UTS: yes)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 9: FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: no)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] 10: FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 (MD: yes; UTS: no)
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] 11: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (MD: no; UTS: yes)
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] 12: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (MD: no; UTS: no)
11/15/2016 7:41:16 AM | Milkyway@Home | [coproc] NVIDIA instance 0; 1.000000 pending for de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0
11/15/2016 7:41:16 AM | Milkyway@Home | [coproc] NVIDIA instance 0: confirming 1.000000 instance for de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0
11/15/2016 7:41:16 AM | Milkyway@Home | [coproc] Assigning NVIDIA instance 1 to de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1
11/15/2016 7:41:16 AM | Cosmology@Home | [cpu_sched_debug] scheduling wu_110316_055907_0_0_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 (high priority)
11/15/2016 7:41:16 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 (high priority)
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] scheduling de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0
11/15/2016 7:41:16 AM | Milkyway@Home | [cpu_sched_debug] skipping GPU job de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1; CPU committed
11/15/2016 7:41:16 AM | Cosmology@Home | [css] running wu_110316_055907_0_0_0 ( )
11/15/2016 7:41:16 AM | rosetta@home | [css] running FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 ( )
11/15/2016 7:41:16 AM | rosetta@home | [css] running hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 ( )
11/15/2016 7:41:16 AM | rosetta@home | [css] running FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 ( )
11/15/2016 7:41:16 AM | rosetta@home | [css] running 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 ( )
11/15/2016 7:41:16 AM | rosetta@home | [css] running fer2_104_fold_SAVE_ALL_OUT_449276_241_0 ( )
11/15/2016 7:41:16 AM | rosetta@home | [css] running FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 ( )
11/15/2016 7:41:16 AM | rosetta@home | [css] running FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 ( )
11/15/2016 7:41:16 AM | rosetta@home | [css] running 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 ( )
11/15/2016 7:41:16 AM | Milkyway@Home | [css] running de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (0.587 CPUs + 1 NVIDIA GPU)
11/15/2016 7:41:18 AM | rosetta@home | Starting task FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0
11/15/2016 7:41:18 AM | rosetta@home | [cpu_sched] Starting task FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 using minirosetta version 373 in slot 15
11/15/2016 7:41:18 AM | rosetta@home | [css] running FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 ( )
11/15/2016 7:41:19 AM | rosetta@home | Starting task FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0
11/15/2016 7:41:19 AM | rosetta@home | [cpu_sched] Starting task FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 using minirosetta version 373 in slot 19
11/15/2016 7:41:19 AM | rosetta@home | [css] running FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 ( )
11/15/2016 7:41:19 AM |  | [cpu_sched_debug] enforce_run_list: end
11/15/2016 7:41:19 AM | rosetta@home | Started upload of EZYnY7vp_fold_and_dock_SAVE_ALL_OUT_449821_130_0_0
11/15/2016 7:41:19 AM | rosetta@home | Started upload of uogD58n7_fold_and_dock_SAVE_ALL_OUT_449844_152_0_0
11/15/2016 7:41:23 AM | rosetta@home | Finished upload of EZYnY7vp_fold_and_dock_SAVE_ALL_OUT_449821_130_0_0
11/15/2016 7:41:23 AM | rosetta@home | Finished upload of uogD58n7_fold_and_dock_SAVE_ALL_OUT_449844_152_0_0
11/15/2016 7:42:17 AM |  | [cpu_sched_debug] Request CPU reschedule: periodic CPU scheduling
11/15/2016 7:42:17 AM |  | [cpu_sched_debug] schedule_cpus(): start
11/15/2016 7:42:17 AM | Milkyway@Home | [cpu_sched_debug] reserving 1.000000 of coproc NVIDIA
11/15/2016 7:42:17 AM | Milkyway@Home | [cpu_sched_debug] add to run list: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (NVIDIA GPU, FIFO) (prio -3.913338)
11/15/2016 7:42:17 AM | Milkyway@Home | [cpu_sched_debug] reserving 1.000000 of coproc NVIDIA
11/15/2016 7:42:17 AM | Milkyway@Home | [cpu_sched_debug] add to run list: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (NVIDIA GPU, FIFO) (prio -3.995668)
11/15/2016 7:42:17 AM | Cosmology@Home | [cpu_sched_debug] add to run list: wu_110316_055907_0_0_0 (CPU, EDF) (prio -0.014756)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (CPU, EDF) (prio -0.059723)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] add to run list: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (CPU, EDF) (prio -0.059927)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (CPU, EDF) (prio -0.060131)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] add to run list: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (CPU, EDF) (prio -0.060335)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] add to run list: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (CPU, EDF) (prio -0.060540)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (CPU, EDF) (prio -0.060744)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (CPU, EDF) (prio -0.060948)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] add to run list: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (CPU, EDF) (prio -0.061152)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 (CPU, EDF) (prio -0.061357)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] add to run list: FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 (CPU, EDF) (prio -0.061561)
11/15/2016 7:42:17 AM |  | [cpu_sched_debug] enforce_run_list(): start
11/15/2016 7:42:17 AM |  | [cpu_sched_debug] preliminary job list:
11/15/2016 7:42:17 AM | Milkyway@Home | [cpu_sched_debug] 0: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (MD: no; UTS: yes)
11/15/2016 7:42:17 AM | Milkyway@Home | [cpu_sched_debug] 1: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (MD: no; UTS: no)
11/15/2016 7:42:17 AM | Cosmology@Home | [cpu_sched_debug] 2: wu_110316_055907_0_0_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 3: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 4: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 5: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 6: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 7: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 8: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 9: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 10: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 11: FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: no)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 12: FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 (MD: yes; UTS: no)
11/15/2016 7:42:17 AM |  | [cpu_sched_debug] final job list:
11/15/2016 7:42:17 AM | Cosmology@Home | [cpu_sched_debug] 0: wu_110316_055907_0_0_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 1: FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 2: hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 3: FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 4: 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 5: fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 6: FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 7: FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 8: 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 9: FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] 10: FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 (MD: yes; UTS: yes)
11/15/2016 7:42:17 AM | Milkyway@Home | [cpu_sched_debug] 11: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (MD: no; UTS: yes)
11/15/2016 7:42:17 AM | Milkyway@Home | [cpu_sched_debug] 12: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1 (MD: no; UTS: no)
11/15/2016 7:42:17 AM | Milkyway@Home | [coproc] NVIDIA instance 0; 1.000000 pending for de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0
11/15/2016 7:42:17 AM | Milkyway@Home | [coproc] NVIDIA instance 0: confirming 1.000000 instance for de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0
11/15/2016 7:42:17 AM | Milkyway@Home | [coproc] Assigning NVIDIA instance 1 to de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1
11/15/2016 7:42:17 AM | Cosmology@Home | [cpu_sched_debug] scheduling wu_110316_055907_0_0_0 (high priority)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 (high priority)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] scheduling hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 (high priority)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 (high priority)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] scheduling 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 (high priority)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] scheduling fer2_104_fold_SAVE_ALL_OUT_449276_241_0 (high priority)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 (high priority)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 (high priority)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] scheduling 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 (high priority)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 (high priority)
11/15/2016 7:42:17 AM | rosetta@home | [cpu_sched_debug] scheduling FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 (high priority)
11/15/2016 7:42:17 AM | Milkyway@Home | [cpu_sched_debug] scheduling de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0
11/15/2016 7:42:17 AM | Milkyway@Home | [cpu_sched_debug] skipping GPU job de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_4_1478900148_184963_1; CPU committed
11/15/2016 7:42:17 AM | Cosmology@Home | [css] running wu_110316_055907_0_0_0 ( )
11/15/2016 7:42:17 AM | rosetta@home | [css] running FFF_33b10b1b45f5ebeec42be8c4476c3cad_Ins_memetic_4H_Sun_Nov_13_17_13_34_PST_2016_0001093_relax_SAVE_ALL_OUT_449853_2_0 ( )
11/15/2016 7:42:17 AM | rosetta@home | [css] running hh20v3_rsmn_0018_522_0001_abinitio_1_abinitio_SAVE_ALL_OUT_449061_1441_0 ( )
11/15/2016 7:42:17 AM | rosetta@home | [css] running FFF_e7600ac236927b6a8e1c28a5841ba954_Ins_memetic_4H_Sun_Nov_13_17_32_10_PST_2016_0001295_relax_SAVE_ALL_OUT_449854_2_0 ( )
11/15/2016 7:42:17 AM | rosetta@home | [css] running 161109_zc_fnd-ZCON_62.pdb-fnd_SAVE_ALL_OUT_448976_350_0 ( )
11/15/2016 7:42:17 AM | rosetta@home | [css] running fer2_104_fold_SAVE_ALL_OUT_449276_241_0 ( )
11/15/2016 7:42:17 AM | rosetta@home | [css] running FFF_a7ae9aa1c314312f5ac1d111effe58b1_Ins_memetic_4H_Sun_Nov_13_17_34_53_PST_2016_0001326_relax_SAVE_ALL_OUT_449854_2_0 ( )
11/15/2016 7:42:17 AM | rosetta@home | [css] running FFF_d61daa0b72ed465f050885e785069aa5_Ins_memetic_4H_Sun_Nov_13_20_21_01_PST_2016_0002361_abinitio_SAVE_ALL_OUT_449858_1_0 ( )
11/15/2016 7:42:17 AM | rosetta@home | [css] running 161109_zc_fnd-ZCON_46.pdb-fnd_SAVE_ALL_OUT_448953_347_0 ( )
11/15/2016 7:42:17 AM | Milkyway@Home | [css] running de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (0.587 CPUs + 1 NVIDIA GPU)
11/15/2016 7:42:17 AM | rosetta@home | [css] running FFF_27a037a23d8447518c4575c6264a18a0_Ins_memetic_4H_Sun_Nov_13_20_21_14_PST_2016_0002389_abinitio_SAVE_ALL_OUT_449858_1_0 ( )
11/15/2016 7:42:17 AM | rosetta@home | [css] running FFF_b8a6538dce7c5a3822c0efde2f88c88d_Ins_memetic_4H_Mon_Nov_14_12_05_07_PST_2016_0000613_abinitio_SAVE_ALL_OUT_449876_1_0 ( )
11/15/2016 7:42:17 AM |  | [cpu_sched_debug] enforce_run_list: end
11/15/2016 7:43:18 AM |  | [cpu_sched_debug] Request CPU reschedule: periodic CPU scheduling
11/15/2016 7:43:18 AM |  | [cpu_sched_debug] schedule_cpus(): start
11/15/2016 7:43:18 AM | Milkyway@Home | [cpu_sched_debug] reserving 1.000000 of coproc NVIDIA
11/15/2016 7:43:18 AM | Milkyway@Home | [cpu_sched_debug] add to run list: de_modfit_fast_19_3s_136_bundle5_ModfitConstraints3_1_1478900148_319758_0 (NVIDIA GPU, FIFO) (prio -3.913337)
11/15/2016 7:43:18 AM | Milkyway@Home | [cpu_sched_debug] reserving 1.000000 of coproc NVIDIA

Coleslaw: There is not an onboard video adapter.

I have BOINC configured to store at least 3 days worth and up to an additional 5 days

Right now Rosetta seems to have 7 day deadlines. A while back it had additionally 2 and 5 days deadline tasks, there may still be those. This is somewhat recent change, back in summer they still used the more common 14 day deadline.

When you set Store at least to three days BOINC will try to have all tasks completed three days before deadline. That combined with the eight day cache and Rosetta deadlines results in BOINC panicking about deadlines all the time and switching to earliest deadline first mode.

In EDF mode BOINC runs tasks which might miss deadline first and then others. This means BOINC may run so many CPU tasks that there isn't room for GPU tasks any more (all GPU tasks need some support from CPU). BOINC overcommits CPU up to 0.99 cores. The log doesn't show it but I'd expect Milkyway tasks to use 0.5-0.9 CPU cores which means BOINC can run one such task in addition to the CPU tasks.

Normally BOINC runs as many GPU tasks as it can and then fills the remaining CPU cores.

edit: I just realised I didn't tell you what to do next. Set Store at least to 1 day and if necessary drop additional days a bit too. If you really need one week cache then you need to replace Rosetta with some other project that has longer deadlines.

I'm not sure what happened over the weekend

Milkyway released new application versions on Friday with the intention of supporting longer running tasks. Apparently the Windows OpenCL versions were really CPU versions.

When you are having problems with some project always check their message boards. You might not be the only one.