need to many memory!

Message boards : Number crunching : need to many memory!

To post messages, you must log in.

AuthorMessage
liuming

Send message
Joined: 17 May 12
Posts: 1
Credit: 386,253
RAC: 0
Message 73092 - Posted: 18 May 2012, 2:37:40 UTC

rosetta program need to many memory
ID: 73092 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 73100 - Posted: 18 May 2012, 19:00:08 UTC

Yes, the combination of new protocols and challenging proteins has been requiring more memory than previously.
Rosetta Moderator: Mod.Sense
ID: 73100 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Chilean
Avatar

Send message
Joined: 16 Oct 05
Posts: 711
Credit: 26,694,507
RAC: 0
Message 73104 - Posted: 18 May 2012, 20:00:26 UTC

I see it as a positive thing. It shows real science is being made :D
ID: 73104 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
muddocktor

Send message
Joined: 11 May 07
Posts: 17
Credit: 14,543,886
RAC: 0
Message 73207 - Posted: 4 Jun 2012, 15:53:09 UTC - in response to Message 73104.  

I see it as a positive thing. It shows real science is being made :D


And I see it as a big negative. Either BOINC or the Rosetta app that runs under it doesn't know how to play nice when the work units take up 1/2-1 gig of ram each and will bring even a strong performing machine to it's knees with it killing the hard drive using the swap file. Plus, it is not easy to figure out how to stop this behavior in the client. I have pretty much switched my machines off Rosetta because of this, because I will not tolerate an app that I run out of the kindness of my heart and pocket start making my computing experience with the machine be like dog poo. So now my hex core system and another system now are running Seti because the work units from Rosetta were thrashing the hard drives with swap file usage. The hex core has 6 gigs of ram installed and the other machine had 4 gigs of ram installed, so it's not like they didn't have a good amount of ram in either.
ID: 73207 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 73208 - Posted: 4 Jun 2012, 17:09:24 UTC

The default BOINC Manager settings generally cause BOINC applications to avoid swapping to the page file. The application itself (Rosetta@home) has little control over how memory is handled. It runs at the lowest possible CPU priority to help the operating system understand that other activity is more important.

The way BOINC runs within the memory limits established is that it suspends tasks that push BOINC's total memory usage over the threshold. It then attempts to find another task which might run in less memory. If it cannot find such a task, then BOINC runs less concurrent active tasks, because the BOINC Manager understands how important it is to live within the established memory threshold. This would mean running or only 6 or 7 CPUs when BOINC Manager is configured to use up to all 8.

Some people wish to better balance the optimization of both CPU and memory. For that purpose, I generally recommend attaching to more than one BOINC project. Specifically, one that runs with a smaller memory footprint, such as SETI or WCG. This brings more choices to the BOINC Manager. It will then be able to find other tasks that run in less memory and will tend to keep all of the CPUs you have configured to allow BOINC to use actively running.

If you have questions, please ask.
Rosetta Moderator: Mod.Sense
ID: 73208 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
mikey
Avatar

Send message
Joined: 5 Jan 06
Posts: 1895
Credit: 9,169,305
RAC: 3,857
Message 73225 - Posted: 5 Jun 2012, 11:48:11 UTC - in response to Message 73207.  

I see it as a positive thing. It shows real science is being made :D


And I see it as a big negative. Either BOINC or the Rosetta app that runs under it doesn't know how to play nice when the work units take up 1/2-1 gig of ram each and will bring even a strong performing machine to it's knees with it killing the hard drive using the swap file. Plus, it is not easy to figure out how to stop this behavior in the client. I have pretty much switched my machines off Rosetta because of this, because I will not tolerate an app that I run out of the kindness of my heart and pocket start making my computing experience with the machine be like dog poo. So now my hex core system and another system now are running Seti because the work units from Rosetta were thrashing the hard drives with swap file usage. The hex core has 6 gigs of ram installed and the other machine had 4 gigs of ram installed, so it's not like they didn't have a good amount of ram in either.


Go to my account and then computing preferences and change these settings:
Use at most 75% of page file (swap space)
Use at most
Enforced by version 5.8+ 85% of memory when computer is in use
Use at most
Enforced by version 5.8+ 90% of memory when computer is not in use

Those are my settings and you can compare them to your probably default ones and see the difference. Bigger work units means more work done in less time, time moves forward as must our pc's and their specs. 1gb of ram per cpu is pushing the lowest levels of being enough anymore more.
ID: 73225 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile ]{LiK`RangerS`
Avatar

Send message
Joined: 27 Oct 08
Posts: 39
Credit: 6,552,652
RAC: 0
Message 73229 - Posted: 5 Jun 2012, 18:03:52 UTC

Yea I put definatley recommend putting swap file usage to lower. I personally have mine all at 50% because I dont want to hurt anything, but I also have 8 gigs minimum of ram on my computers. World Community Grid is nice if you dont have alot of memory. One of my computers im rebuilding only has 4gigs, so it might need to do world community grid till i get some more money.
ID: 73229 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile ]{LiK`RangerS`
Avatar

Send message
Joined: 27 Oct 08
Posts: 39
Credit: 6,552,652
RAC: 0
Message 73231 - Posted: 5 Jun 2012, 18:28:46 UTC

Ram really is essential and I would rather have to much than to little. But yea reason 8 gig minimum is because thats all those perticular boards could hold, lol.
ID: 73231 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mod.Sense
Volunteer moderator

Send message
Joined: 22 Aug 06
Posts: 4018
Credit: 0
RAC: 0
Message 73232 - Posted: 5 Jun 2012, 22:37:29 UTC

I'll just make the point that it's not an all or nothing deal on which projects to crunch for. The BOINC Manager will figure out what can run within the memory constraints. I mean if you have 4 CPUs for example and 2 are running R@h and 2 are running a low-memory project, you can still reduce the memory requirement significantly over running all R@h. BOINC settings allow you to establish the resource shares between projects, and that will basically bias BOINC Manager into getting the ratio you desire as to how many of each project run at a time. And for short periods of time, it may run outside of that basic resource share to help accommodate your memory preferences, or to make up time to a project that is currently running in less than it's maximum usage.
Rosetta Moderator: Mod.Sense
ID: 73232 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Michael G.R.

Send message
Joined: 11 Nov 05
Posts: 264
Credit: 11,247,510
RAC: 0
Message 73410 - Posted: 9 Jul 2012, 18:31:02 UTC

One way to fix the problem is to run Rosetta@home on a certain number of cores, and something less memory intensive on the other cores. I'm doing that on an old computers: 1 core is Rosetta, the other is World Computing Grid doing Proteome at Home.
ID: 73410 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
BigBrownBear

Send message
Joined: 4 Nov 05
Posts: 2
Credit: 1,329,437
RAC: 0
Message 73923 - Posted: 28 Sep 2012, 17:17:50 UTC

@msi!, try running Rosetta@Home, or any other BOINC project for that matter, on a Dell Dimension 4100 /w a PIII processor (running @ 866Mhz) an .5 gig of ram. It's the slowest computer in the house & the rare time that my mom is using is, she doesn't even notice that the darn thing is running slow, because I let BOINC run ALL of the time. <8-)
ID: 73923 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : Number crunching : need to many memory!



©2024 University of Washington
https://www.bakerlab.org