Problems and Technical Issues with Rosetta@home

Message boards : Number crunching : Problems and Technical Issues with Rosetta@home

To post messages, you must log in.

Previous · 1 . . . 157 · 158 · 159 · 160 · 161 · 162 · 163 . . . 317 · Next

AuthorMessage
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,512,633
RAC: 19,216
Message 104241 - Posted: 14 Jan 2022, 18:55:12 UTC - in response to Message 104239.  
Last modified: 14 Jan 2022, 18:55:21 UTC

Download and install emfer Boinc Tasks program. Then you can look at CPU usage. If its 1% or around that, then the task is stuck in a loop and will not finish and will have to be aborted.
And if you set the task % to x.xx% then you can see each time the program updates (2 seconds or whatever) whether the % increases at all or if only by .02% per 2 second update. Again, if you see that kind of value then you have to abort it.
+1. That program is amazing. I have 9 machines all displayed on one screen, very easy to watch what everything is doing, all colour coded, loads of information, I can control the whole lot very easily.
Very good! I use it to monitor the progress and also the project update feature. Also i like the color coding.
My main use for that program is to monitor RAM and CPU usage and project %.
I have too many cores, the list fell off the screen. I now have a monitor above the other monitor (sat on a stereo speaker) so the list can fit in.
ID: 104241 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,512,633
RAC: 19,216
Message 104242 - Posted: 14 Jan 2022, 18:58:34 UTC - in response to Message 104240.  

Been getting those messages for a while , here
are some I copied, and the first is only ten minits after a reboot, even witn 200GB free

[snip]

26/12/2021 16:31:29 Rosetta@home Message from server:Rosetta needs 1907.35MB more disk space.You currently have 0.00 MB available and it needs 1907.35 MB.
26/12/2021 16:31:29 Rosetta@home Message from server:rosetta python projects needs 19073.49MB more disk space.You currently have 0.00 MB available and it needs 19073.49 MB.

--------------------
and that is with - on the `Disk` tab
used by boinc - 123.97GB
free . available to BOINC - 226.19GB
used by other programs - 114.99GB
-------------------------------------
I got those when I moved Boinc to a larger drive. Apparently it couldn't find anywhere to put 2GB with 2TB free! Presumably some kind of overflow in the calculation came to 0 or a negative number. I believe I fixed it by increasing the limits in Boinc. From memory, I had it set to use 90% of disk space, and changed that to 99%. Just make everything more relaxed.
ID: 104242 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 104243 - Posted: 14 Jan 2022, 18:58:56 UTC - in response to Message 104238.  

WTH? It needs 19 gigs of disk space? No freaking way! That's out of control!

Wow! now LHC it kicking up.

Been there, done that.
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5736&postid=45603#45603


Ok..interesting. So I set it to manually use 200GB and leave 8 free.
But what is interesting even before I did that it went back to 10 python, 1 QuChem (Like ATLAS I can only run one at a time without running into errors), 1 ATLAS and I found a GPU WCG COVID! along with the usual PrimeGrid and now its out of space again...shees. Going to have to put a project restrictor on RAH.

Got enough RAM now. 60% usage. Guess I'll have to up the drive capacity.

What do you think of a WESTERN DIGITAL 1000GB Caviar Blue HDD? $49.50/43.40 Euro
SSD are much more for the same capacity.
Do HDD's hold up better for loads of read/write operations than a SSD?
I think SSD are actually now more reliable than HDDs, so get one if you can afford it, NVME preferably, 8 times faster again - you can get adapter cards if your motherboard doesn't have a connector. And I've bought 4TB Sonnics HDDs for not much more, check on Ebay. They are very good. I've used 7 of them, one was DOA, probably a clumsy postman, but they replaced it immediately, the others have worked flawlessly ever since.


Can't use Ebay here in Belgium. All drives show up from China or the US. Would get hit with import fees which would make it just as expensive as here. I'll have to look around and maybe see if my Dutch friend who shops in Germany can find something less expensive. Onboard SSD is 100+. 1TB SSD is a bit less..60-70 range. HDD's are the most affordable.
ID: 104243 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,512,633
RAC: 19,216
Message 104244 - Posted: 14 Jan 2022, 19:17:18 UTC - in response to Message 104243.  
Last modified: 14 Jan 2022, 19:26:35 UTC

Can't use Ebay here in Belgium. All drives show up from China or the US. Would get hit with import fees which would make it just as expensive as here. I'll have to look around and maybe see if my Dutch friend who shops in Germany can find something less expensive. Onboard SSD is 100+. 1TB SSD is a bit less..60-70 range. HDD's are the most affordable.
Why can you not buy on Ebay from the UK or France or Germany, or the Netherlands? Shouldn't cost much to post to you from there.

Ah, the prices have increased, everything costs more recently. Stupid covid. The best I can see is a WD 4TB, the Sonnics ones have gone, maybe they went bust. Can you buy this?

https://www.befr.ebay.be/itm/353557737108
ID: 104244 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 104245 - Posted: 14 Jan 2022, 19:31:12 UTC - in response to Message 104244.  
Last modified: 14 Jan 2022, 19:39:12 UTC

Can't use Ebay here in Belgium. All drives show up from China or the US. Would get hit with import fees which would make it just as expensive as here. I'll have to look around and maybe see if my Dutch friend who shops in Germany can find something less expensive. Onboard SSD is 100+. 1TB SSD is a bit less..60-70 range. HDD's are the most affordable.
Why can you not buy on Ebay from the UK or France or Germany, or the Netherlands? Shouldn't cost much to post to you from there.

Ah, the prices have increased, everything costs more recently. Stupid covid. The best I can see is a WD 4TB, the Sonnics ones have gone, maybe they went bust. Can you buy this?

https://www.befr.ebay.be/itm/353557737108



Way to much money.
This is the most I would spend and its onboard vs internal.
https://www.amazon.com/Kingston-Internal-Security-SA2000M8-1000G/dp/B07VXC9QMH
This would just be a BOINC drive and nothing else.
But after putting out 160 for new RAM and now 100 for a drive, I'm done spending for BOINC for another 5 years or more.

But does an onboard drive have to be a C: drive or can it be another?
ID: 104245 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,512,633
RAC: 19,216
Message 104246 - Posted: 14 Jan 2022, 19:48:52 UTC - in response to Message 104245.  
Last modified: 14 Jan 2022, 19:51:00 UTC

Way to much money.
This is the most I would spend and its onboard vs internal.
https://www.amazon.com/Kingston-Internal-Security-SA2000M8-1000G/dp/B07VXC9QMH
This would just be a BOINC drive and nothing else.
But after putting out 160 for new RAM and now 100 for a drive, I'm done spending for BOINC for another 5 years or more.

But does an onboard drive have to be a C: drive or can it be another?
I've started Gridcoin, it pays enough to get the hardware free. Now only the electricity has to be paid for.

Your motherboard should let you have it as any drive. And Windows should let you change things too. It's more intelligent than it used to be. For example, if you start up your PC with Windows already on a SATA drive, and a blank brand new NVME on the motherboard, Windows will have C: for the old drive and nothing for the new one, then you call that whatever letter you want.

My computer has "disk 0" as E: and "disk 1" as C:, simply due to which socket I plugged the two SATA drives into. Windows doesn't care, it boots from whatever has the OS on it. If your motherboard is using UEFI (which they have for almost 10 years), the booting is intelligent and you won't get "can't find boot drive" crap anymore.
ID: 104246 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,512,633
RAC: 19,216
Message 104247 - Posted: 14 Jan 2022, 20:23:58 UTC - in response to Message 104245.  
Last modified: 14 Jan 2022, 20:24:23 UTC

Way to much money.
This is the most I would spend and its onboard vs internal.
https://www.amazon.com/Kingston-Internal-Security-SA2000M8-1000G/dp/B07VXC9QMH
For a similar price there are 4TB Seagate rust spinners if you want the capacity:
https://www.befr.ebay.be/itm/304205798631
ID: 104247 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 104248 - Posted: 15 Jan 2022, 0:22:57 UTC
Last modified: 15 Jan 2022, 0:24:57 UTC

That has to be some kind of error in the tasks.
It has settled down and I have 83 Gigs free again out of 208.

So I think I should be able to go with a 500 Gig M.2 and be just fine since only BOINC will be on it.
If Pythons consume more than 450 Gigs of drive then that is just absurd and those tasks should be deleted.

BTW. 3 bombed...

Name aaai-AGLY_pp-mNMPHE_pp-NMPHE-ACBEN2_2_2731360_1_0
Exit status -185 (0xFFFFFF47) ERR_RESULT_START
Stderr output

<core_client_version>7.16.20</core_client_version>
<![CDATA[
<message>
Couldn't copy file: fwrite() failed</message>
]]>


Name aaas-HPR-PHE_pp-SAR-mSUGA_pp_9_2430692_1_0 - same thing
aagb-PHE_pp-mTIC-GPN-B2ALA_0_2688121_1_0 - same

This made a diskfull error on ATLAS
ID: 104248 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,512,633
RAC: 19,216
Message 104249 - Posted: 15 Jan 2022, 0:40:13 UTC - in response to Message 104248.  
Last modified: 15 Jan 2022, 0:41:03 UTC

Make sure it's nvme. There are (or were) some M2 (which is the connector) drives which were sata (electronically). They're about 8 times slower.

Some makes of drive are quite a bit faster than others for a very similar price. Check the specs first.

I'd have been fine on 500GB for Boinc. But only half that was available due to gaming.

I've still not had a single task work on 6 of my 7 PCs. The other one does 99% of them correctly. Very fustrating.
ID: 104249 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 104252 - Posted: 15 Jan 2022, 9:19:59 UTC - in response to Message 104249.  

Make sure it's nvme. There are (or were) some M2 (which is the connector) drives which were sata (electronically). They're about 8 times slower.

Some makes of drive are quite a bit faster than others for a very similar price. Check the specs first.

I'd have been fine on 500GB for Boinc. But only half that was available due to gaming.

I've still not had a single task work on 6 of my 7 PCs. The other one does 99% of them correctly. Very fustrating.



That is very strange.
We have given you every solution we know.
But is it the GRC computers that are having trouble or in the clear computers?
If its GRC, then that is the answer, it is scrambling the data.
ID: 104252 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
rkv_2401

Send message
Joined: 11 Dec 19
Posts: 5
Credit: 1,232,418
RAC: 0
Message 104255 - Posted: 15 Jan 2022, 17:16:58 UTC

Thanks to everyone who pointed out that virtualization was disabled on my Ryzen 3600 machine. I enabled SVM mode and it has been working for a couple of days now.

However, this wasn't an optimal solution for me as I would rather have this computer crunching SiDock/WCG and my 10th gen i5 desktop with 32GB of RAM working on these VBox jobs. In fact, I only enabled SVM mode on the Ryzen desktop because Rosetta kept sending me VBox tasks even after I'd informed them NOT to (with the toggle switch, as I'd posted earlier), and it kept getting WUs that always errored out and clogging up other BOINC projects.

I couldn't understand why a machine with virtualization disabled can doggedly keep getting VBox jobs, but an i5 from 2020 supposedly does not have hardware support for virtualization instructions. I checked again on the Intel desktop, Virtualization is enabled in Windows, VT-d enabled in the BIOS. So I investigated further and eventually realized that turning off Hyper-V on the Intel desktop made the error go away. However, this didn't work for the Surface Pro 2 (which I deleted from my list of computers after a month of no credit, it was a duplicate entry anyway) as Hyper-V was already off.

Anyway, I will now be devoting the i5 desktop purely to Rosetta@home and the Ryzen to share with other projects.

TL;DR - Rosetta@home kept sending me VBox jobs even after being requested not to and annoyed me into finding a solution for my problem :)

Error #1 - Virtualization was disabled on Ryzen desktop.

Solution - Enabled SVM mode in BIOS, ensured Hyper-V was off.

Error #2 - "VirtualBox jobs require hardware acceleration support. Your processor does not support the required instruction set" - on hardware that does support virtualization. (Intel 10th gen i5, 4th gen i5-4300U)

Solution that worked for me : Turn off Hyper-V (worked on 10th gen i5, Hyper-V was already off on Surface Pro 2 and I haven't found a solution for it yet.)

Other suggestion - the 'tasks' part used to have the last 20 tasks per computer up until some point last year. It was useful to determine the performance, runtime, etc. of a computer compared to another one. Now it disappears very quickly. Makes it difficult to debug why a task would have failed and also makes it harder to track the other parameters I've mentioned earlier.
ID: 104255 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
tullio

Send message
Joined: 10 May 20
Posts: 63
Credit: 630,125
RAC: 0
Message 104256 - Posted: 15 Jan 2022, 17:46:11 UTC
Last modified: 15 Jan 2022, 17:47:16 UTC

I have an Intel i5 9400F and it runs rosetta python on it without me making any change.Recently I could not connect neither Firefox nor Edge and I found someone had activated a proxi, I don't know how, I am the only user. I disactivated proxi and everything works on Windows 11. Was one of the frequent Microsoft updates to do it?
Tullio
ID: 104256 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,512,633
RAC: 19,216
Message 104257 - Posted: 15 Jan 2022, 17:46:21 UTC - in response to Message 104252.  
Last modified: 15 Jan 2022, 18:13:27 UTC

Make sure it's nvme. There are (or were) some M2 (which is the connector) drives which were sata (electronically). They're about 8 times slower.

Some makes of drive are quite a bit faster than others for a very similar price. Check the specs first.

I'd have been fine on 500GB for Boinc. But only half that was available due to gaming.

I've still not had a single task work on 6 of my 7 PCs. The other one does 99% of them correctly. Very fustrating.
That is very strange.
We have given you every solution we know.
But is it the GRC computers that are having trouble or in the clear computers?
If its GRC, then that is the answer, it is scrambling the data.
Since there are so few tasks getting done overall, I'm guessing I'm not alone by a longshot.

I have 7 computers all on GRC. One is fine the others are not. I can't see GRC scrambling data, I'm basically just part of a team, where the team controls the settings like which type of tasks to do. My computers do not connect through GRC, they connect to projects like normal. All the project does is check every day what my RAC is on each project.

But just to make sure, I will now connect a dodgy one directly without GRC, this one here, under my own private account, no gridcoin:
https://boinc.bakerlab.org/rosetta/results.php?hostid=6171676
I'll report back in half an hour when I see if they run ok or not.

Although it seems to me since there are complaints in the VB log of access denied, that it's a file it can't get to for some reason, which must be a local problem to my machines or a programming error.
ID: 104257 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,512,633
RAC: 19,216
Message 104258 - Posted: 15 Jan 2022, 18:00:22 UTC - in response to Message 104256.  

I have an Intel i5 9400F and it runs rosetta python on it without me making any change.Recently I could not connect neither Firefox nor Edge and I found someone had activated a proxi, I don't know how, I am the only user. I disactivated proxi and everything works on Windows 11. Was one of the frequent Microsoft updates to do it?
Tullio
That seems very odd and if I were you I'd check for viruses and malware, a proxy should never appear without you doing so, and could be an attempt to reroute your internet traffic to grab passwords - unless you're using some kind of Norton Internet security? What was the address of the proxy? I use AVG for viruses and Malwarebytes for Malware. Both are free.
ID: 104258 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,512,633
RAC: 19,216
Message 104260 - Posted: 15 Jan 2022, 18:26:08 UTC - in response to Message 104256.  
Last modified: 15 Jan 2022, 18:28:07 UTC

I have an Intel i5 9400F and it runs rosetta python on it without me making any change.Recently I could not connect neither Firefox nor Edge and I found someone had activated a proxi, I don't know how, I am the only user. I disactivated proxi and everything works on Windows 11. Was one of the frequent Microsoft updates to do it?
Tullio
One of your computers reports:
Microsoft Windows 11 Core x64 Edition, (10.00.22000.00)
ROTFPMSL, so Windows 11 is actually 10.0.2? This is getting as bad as Firefox version 96.
ID: 104260 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,512,633
RAC: 19,216
Message 104261 - Posted: 15 Jan 2022, 18:51:38 UTC
Last modified: 15 Jan 2022, 18:55:51 UTC

Connecting outside of GRC did not help.

No response from David Baker yet.

Perhaps WUs like this one, where two of us screwed up, they'll see a lot of and look into the problem:
https://boinc.bakerlab.org/rosetta/workunit.php?wuid=1306550771
(Note, "Too many total results")
ID: 104261 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Greg_BE
Avatar

Send message
Joined: 30 May 06
Posts: 5691
Credit: 5,859,226
RAC: 0
Message 104263 - Posted: 15 Jan 2022, 20:24:28 UTC - in response to Message 104261.  
Last modified: 15 Jan 2022, 20:28:30 UTC

Connecting outside of GRC did not help.

No response from David Baker yet.

Perhaps WUs like this one, where two of us screwed up, they'll see a lot of and look into the problem:
https://boinc.bakerlab.org/rosetta/workunit.php?wuid=1306550771
(Note, "Too many total results")



DB....told you..no one and I do mean no one at RAH responds to anything.
Your just SOL until WE figure out the problem.

Have you checked your VM environment and cleaned that up if needed?
The ARC error I already told you what my research came up with and you checked that. So I don't know what else to tell you.
I can only say now its beyond anything we understand here and your better off asking in the BOINC forum over at the Oracle Vbox forum.

But your not alone, due to this nonsense with bloating files I have blown up 10 tasks.
I just put a app_config with project_max in place to stop that.
I just ordered a 500GB m.2 drive that will be here later in the week. That will be dedicated to BOINC. If python blows through that much space then there is some serious BS going on.
ID: 104263 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,512,633
RAC: 19,216
Message 104264 - Posted: 15 Jan 2022, 20:50:00 UTC - in response to Message 104263.  

I can't believe the CEO doesn't care about 6 in 7 machines not doing his research. I'll be emailing the admin dude if I don't get a response soon.

I've tried on many machines reinstalling VB, different versions, cleaning it up (I assume you mean deleting the inaccessible images? Let me know if there's something else I should be doing, this normally fixes the error "VB environment needs cleaning up" I get in Boinc for other projects).

I'd like to know what others are finding. Am I unusual in having 6 machines that simply do not run any of them properly? My 1 good machine only blew up one of them, all the others are fine. Apart from the Ryzen 9, the other bad machines are all quite old (DDR3 spec).
ID: 104264 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Jim1348

Send message
Joined: 19 Jan 06
Posts: 881
Credit: 52,257,545
RAC: 0
Message 104265 - Posted: 15 Jan 2022, 21:06:49 UTC - in response to Message 104264.  

I can't believe the CEO doesn't care about 6 in 7 machines not doing his research. I'll be emailing the admin dude if I don't get a response soon.

I concluded some time ago that the great Dr. David Baker (who should get a Nobel Prize) turned over the management of Rosetta to others a long time ago.
And with the advent of AI, he can do more in-house anyway. As long as enough of the peripheral work is done by others, that is good enough for him.

He has more valuable uses for his time. And we have other projects if we want them.
ID: 104265 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 12 Aug 06
Posts: 1600
Credit: 12,512,633
RAC: 19,216
Message 104266 - Posted: 15 Jan 2022, 21:17:22 UTC - in response to Message 104265.  

I can't believe the CEO doesn't care about 6 in 7 machines not doing his research. I'll be emailing the admin dude if I don't get a response soon.

I concluded some time ago that the great Dr. David Baker (who should get a Nobel Prize) turned over the management of Rosetta to others a long time ago.
And with the advent of AI, he can do more in-house anyway. As long as enough of the peripheral work is done by others, that is good enough for him.

He has more valuable uses for his time. And we have other projects if we want them.


But enough work is not being done. The number of tasks being completed on the server status is abysmal compared to pre-VB.
ID: 104266 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Previous · 1 . . . 157 · 158 · 159 · 160 · 161 · 162 · 163 . . . 317 · Next

Message boards : Number crunching : Problems and Technical Issues with Rosetta@home



©2025 University of Washington
https://www.bakerlab.org