Rosetta needs 6675.72 MB RAM: is the restriction really needed?
Message boards : Number crunching : Rosetta needs 6675.72 MB RAM: is the restriction really needed?
Previous · 1 · 2 · 3 · 4 · 5 . . . 6 · Next
| Author | Message |
|---|---|
|
Sid Celery Send message Joined: 11 Feb 08 Posts: 2121 Credit: 41,179,074 RAC: 11,480 
|
last compilation with notepad+ Ugh. If it's any consolation, I'm estimating that when new tasks at the end of the queue arrive at the front of the queue to download, the RAM req't will be nearer 3775Mb... ...but it may take as long as 7 or 8 weeks to reach the front of the queue...  
|
mikey Send message Joined: 5 Jan 06 Posts: 1895 Credit: 9,154,260 RAC: 4,107
|
last compilation with notepad+ So is it simply a matter of setting a 10 day cache and then aborting every one for the next week or so? |
|
Sid Celery Send message Joined: 11 Feb 08 Posts: 2121 Credit: 41,179,074 RAC: 11,480
|
last compilation with notepad+ Err... only if every single person does it. And a lot of current tasks do run on 60%+ of hosts. Maybe not. And there was something about not allowing caches of more days than the deadline, so I'm not sure if the servers would allow anyone to do it either.
|
|
mikey Send message Joined: 5 Jan 06 Posts: 1895 Credit: 9,154,260 RAC: 4,107
|
last compilation with notepad+ I love when you talk techy...I was being silly and yes I know that Rosetta won't send you more work than it thinks you can do by the deadline. My point was though would getting and then aborting all those tasks bring the newer ones to the top of the pile? And if so how many would we have to abort...which you answered by saying "everyone" would have to do it. So in essence we have to just suffer thru the problem tasks, and people complaining about them, until the newer ones bubble up to the top. |
|
Sid Celery Send message Joined: 11 Feb 08 Posts: 2121 Credit: 41,179,074 RAC: 11,480
|
last compilation with notepad+ By techy, I think you meant one of my completely humourless comments. I'm moody like that sometimes I think your last sentence is basically right. That's my assumption anyway. Looking at no earlier than June :(
|
|
mikey Send message Joined: 5 Jan 06 Posts: 1895 Credit: 9,154,260 RAC: 4,107
|
LOL yes that's what I meant. And yes I was afraid that was the timeline you were thinking about...BOOOOO!!! |
|
Sid Celery Send message Joined: 11 Feb 08 Posts: 2121 Credit: 41,179,074 RAC: 11,480
|
I think your last sentence is basically right. That's my assumption anyway. Looking at no earlier than June :( I hope I'm completely wrong. I'm only guessing - I have no info on it. I'd rather give a worst case and beat it than be hopeful and fail over and over again
|
|
Kissagogo27 Send message Joined: 31 Mar 20 Posts: 86 Credit: 2,908,093 RAC: 2,531 
|
Lastest News ... from 2Go pcs.. 24-Apr-2021 08:12:31 [Rosetta@home] Requesting new tasks for CPU 24-Apr-2021 06:58:50 [Rosetta@home] Sending scheduler request: To fetch work. from 4Go PC 24-Apr-2021 07:25:01 [Rosetta@home] Sending scheduler request: To fetch work. new sort of WU downloaded |
|
mikey Send message Joined: 5 Jan 06 Posts: 1895 Credit: 9,154,260 RAC: 4,107
|
I think your last sentence is basically right. That's my assumption anyway. Looking at no earlier than June :( I agree |
|
PorkyPies Send message Joined: 6 Apr 20 Posts: 45 Credit: 1,650,779 RAC: 0 |
Even if the memory requirement drops to 3.75GB free with the later tasks that won't help the Pi4 2GB or 4GB. Looking at a Pi4 4GB it has 3.6GB free memory and its not even running BOINC. The other single board computers like the Pi will have the same issue as they typically come with 2 or 4GB of memory. This means the minimum memory to be able to run Rosetta@home is 8GB. MarksRpiCluster |
 Grant (SSSF)Send message Joined: 28 Mar 20 Posts: 1677 Credit: 17,759,444 RAC: 22,916 
|
This means the minimum memory to be able to run Rosetta@home is 8GB.Yet as Kissagogo27 pointed out in his post before yours, Tasks will run on 4GB system, depending on what it is already doing and your available RAM settings in your computing preferences. Grant Darwin NT |
|
mikey Send message Joined: 5 Jan 06 Posts: 1895 Credit: 9,154,260 RAC: 4,107
|
Even if the memory requirement drops to 3.75GB free with the later tasks that won't help the Pi4 2GB or 4GB. Looking at a Pi4 4GB it has 3.6GB free memory and its not even running BOINC. The other single board computers like the Pi will have the same issue as they typically come with 2 or 4GB of memory. This means the minimum memory to be able to run Rosetta@home is 8GB. So does that mean the newer 8gb Pi might just work? |
|
PorkyPies Send message Joined: 6 Apr 20 Posts: 45 Credit: 1,650,779 RAC: 0 |
So does that mean the newer 8gb Pi might just work? Yes they do. I have 8 running at the moment. MarksRpiCluster |
|
PorkyPies Send message Joined: 6 Apr 20 Posts: 45 Credit: 1,650,779 RAC: 0 |
Yet as Kissagogo27 pointed out in his post before yours, Tasks will run on 4GB system, depending on what it is already doing and your available RAM settings in your computing preferences. The Pi4 4GB has 3845MB after setting the video memory to the minimum. That is its total memory on a head-less machine according to top. After counting BOINC, O/S services and so on its got less than 3814MB available. MarksRpiCluster |
|
Kissagogo27 Send message Joined: 31 Mar 20 Posts: 86 Credit: 2,908,093 RAC: 2,531
|
Windows uses 4Go memory with 4Go swap file ... peharps u needs to do https://pimylifeup.com/raspberry-pi-swap-file/ increase ;) |
|
Sid Celery Send message Joined: 11 Feb 08 Posts: 2121 Credit: 41,179,074 RAC: 11,480
|
Lastest News ... I've been away for a few days - now home - and a quick check on my own machine told me some new RAM limit tasks had already come through. And I arrive here to discover you already know and confirm it. I was guessing 3775Mb would be the demand - very close to 3814.7Mb. Note: the Disk req't is the same, reduced from 8.5Gb I've identified the tasks with the reduced RAM and Disk req'ts as: "miniprotein_relax10" "norn_struct_profile_layered_design" "3cl_10aa_3CL_AVLstub" "10mer_3cl_3CL_AVLstub" While all the "pre_helical_bundles" tasks still require 6675.72Mb RAM (& 8583Mb Disk space) I've got various World Community Grid tasks here and noted what they require, if it's of use to anyone Open Pandemics (CV19) - RAM 240Mb, Disk - 96Mb Mapping Cancer Markers - RAM 400Mb, Disk - 500Mb Microbiome Immunity Project - RAM 650Mb, Disk - 250Mb Africa Rainfall Project - RAM 1024Mb, Disk - 1536Mb So, if you need an alternative project... Glad to be so wrong about when to expect these slightly-reduced but still huge tasks. I also note "In Progress" tasks have increased to 384k - still 30% down from what it was in March, but 20% more than what it dropped to. This may be as good as it gets though... Edit: Correction - In Progress was 384k a few days ago too, but dropped to 350k, so it's just returned to what it was. Hopeful now it may go a little higher still.
|
|
PorkyPies Send message Joined: 6 Apr 20 Posts: 45 Credit: 1,650,779 RAC: 0 |
Windows uses 4Go memory with 4Go swap file ... Indeed Windows and most Linux flavors allocate a swap file the same size as physical memory. For some reason, probably historical, the Raspberry Pi foundation allocate 100MB to this day. Increasing it should allow it to download tasks although I haven't tried it. MarksRpiCluster |
|
Sid Celery Send message Joined: 11 Feb 08 Posts: 2121 Credit: 41,179,074 RAC: 11,480
|
Even if the memory requirement drops to 3.75GB free with the later tasks that won't help the Pi4 2GB or 4GB. Looking at a Pi4 4GB it has 3.6GB free memory and its not even running BOINC. The other single board computers like the Pi will have the same issue as they typically come with 2 or 4GB of memory. This means the minimum memory to be able to run Rosetta@home is 8GB. I've been having a chat about this and I've been asked to do a mini-survey. As the thread title says, RAM req'ts shot up to 6675.72Mb and we've managed to reduce this to 3814.7Mb on the majority of tasks coming down now, but is this enough to allow 4Gb machines to run Rosetta tasks? This question applies to all hosts, but only for people with 4Gb RAM machines - PC or Raspberry Pi (Admission: I don't even know what a Raspberry Pi is, but I'm running with this anyway) There's the possibility that RAM req'ts can be edged down further and if that allows 4Gb RAM machines to run Rosetta that's a whole category of hosts who don't have to abandon the project. Note, there's also the possibility that RAM req'ts <can't> be reduced further, but I've tried to impress on the Project guys that the reason people here get upset is that you want to contribute so much, that if you can scrape into the minimum resource req'ts then you'll hang around and everyone wins. If the Project can't do its work with less RAM then it won't be changed but, while they look to confirm that, they're prepared to show willing. What is the exact free RAM figure you guys have available to Boinc? The line within the Boinc Event log is the most relevant one. I've looked back over several threads where people have copied over their Event log and I've come up with the following figures, but you tell me if you have something different 3653Mb 3972Mb 3700Mb 3460Mb 4060Mb To find this figure, go into your Options/Computing Preferences, select the Disk and Memory tab and set the "When Computer is not in use, use at most" %age to the highest you can afford (like 95% or more), click Ok and in your Event log copy the amount of RAM showing under "max memory usage when idle:" and post it in reply to this message. I only want to get back to them once, so I'll leave this up for a couple of days before collating your replies. After that, if a particularly low figure comes in it may be easier to adjust your Boinc settings than those of the tasks. TIA
|
|
mikey Send message Joined: 5 Jan 06 Posts: 1895 Credit: 9,154,260 RAC: 4,107
|
So does that mean the newer 8gb Pi might just work? WOO HOO!! Thank you very much!! |
|
mikey Send message Joined: 5 Jan 06 Posts: 1895 Credit: 9,154,260 RAC: 4,107
|
Sid Celery said: As the thread title says, RAM req'ts shot up to 6675.72Mb and we've managed to reduce this to 3814.7Mb on the majority of tasks coming down now, but is this enough to allow 4Gb machines to run Rosetta tasks? Here's a link to a search about Raspberry Pi's so you can at least know what they are. Essentially they are Arm cpu's as opposed to AMD or Intel and the current version comes with 4 cpu cores and 4 or 8gb of onboard ram. They are SLOW crunchers only running at @1.6ghz and require some tweaking to make them do exactly what you want them to do for crunching here at Rosetta but they can crunch Einstein and Universe as soon as Boinc is loaded up and running on a 16gb micro SD card. Once setup they are pretty much like any other pc people have except the cost is around $120US to be up and running with the Pi, the case, the heat sinks and all the cables except a standard usb keyboard and mouse. They even have wifi built in but there is also a 1gb plug for an internet cable if you want it that way. If you use VNC they can even be run remotely. https://www.bing.com/search?q=raspberry+pi+4+model+b&qs=HS&pq=raspberry+pi&sk=HS1&sc=8-12&cvid=1B78618E723941D4AB49FB63380AFFC9&FORM=QBLH&sp=2 If you need more info the User PorkyPies is VERY experienced and who unbeknownst to him has helped me alot in getting mine up and running. |
Message boards :
Number crunching :
Rosetta needs 6675.72 MB RAM: is the restriction really needed?
©2024 University of Washington
https://www.bakerlab.org