Message boards : Number crunching : Please remove Virtualbox as a dependency.
Previous · 1 · 2 · 3
Author | Message |
---|---|
Mr P Hucker![]() Send message Joined: 12 Aug 06 Posts: 1600 Credit: 12,490,392 RAC: 18,798 ![]() |
The new Python application does more than take 3gb of memory per task. It also chews up your disk drives by checkpointing too frequently. Most of the problems and stalls are related to checkpointing. A checkpoint option on the preferences would help.My SSDs and NVMEs don't mind. |
.clair. Send message Joined: 2 Jan 07 Posts: 274 Credit: 26,399,595 RAC: 0 |
No news?? You can set checkpoint interval in boinc manager prefs to anything you like such as 3600 seconds is once per hour , etc . |
tullio Send message Joined: 10 May 20 Posts: 63 Credit: 630,125 RAC: 0 |
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5594 |
Bryn Mawr Send message Joined: 26 Dec 18 Posts: 412 Credit: 12,568,105 RAC: 11,650 ![]() |
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5594 Sadly, that is very specific to lhc requiring the use of CERN utilities and the project to set up additional servers to provide additional functionality. |
![]() Send message Joined: 1 Dec 05 Posts: 2030 Credit: 10,121,026 RAC: 12,565 ![]() |
You can set checkpoint interval in boinc manager prefs to anything you like I think that vms don't care about checkpoint. |
![]() Send message Joined: 3 Nov 05 Posts: 1832 Credit: 119,939,443 RAC: 3,723 ![]() |
Seeing all tasks saying "Running" whilst having been sat at 0% for a day and needing aborting, and then having the machine blacklisted from running more VBox tasks is getting tedious. The VirtualBox tasks aren't fit to be released. VirtualBox multi-attach would presumably solve this by reducing disk usage massively, especially on machines with more cores. |
![]() Send message Joined: 1 Dec 05 Posts: 2030 Credit: 10,121,026 RAC: 12,565 ![]() |
The VirtualBox tasks aren't fit to be released. VirtualBox multi-attach would presumably solve this by reducing disk usage massively, especially on machines with more cores. Lhc_dev project is testing largely this new wrapper. And seems it works! |
Mr P Hucker![]() Send message Joined: 12 Aug 06 Posts: 1600 Credit: 12,490,392 RAC: 18,798 ![]() |
Seeing all tasks saying "Running" whilst having been sat at 0% for a day and needing aborting, and then having the machine blacklisted from running more VBox tasks is getting tedious. The VirtualBox tasks aren't fit to be released. VirtualBox multi-attach would presumably solve this by reducing disk usage massively, especially on machines with more cores.Not seeing that here, 95% of them work ok. |
![]() Send message Joined: 3 Nov 05 Posts: 1832 Credit: 119,939,443 RAC: 3,723 ![]() |
I'm only seeing it on 8-core machines. The quad-core and older machines are all fine. |
Mr P Hucker![]() Send message Joined: 12 Aug 06 Posts: 1600 Credit: 12,490,392 RAC: 18,798 ![]() |
I'm only seeing it on 8-core machines. The quad-core and older machines are all fine.How much RAM are you using? I find things go belly up if you run short of it. I'm only running it on a 6 core at the moment, the only other one I can run it on is 24 core (which I usually leave off Python due to it being sluggish and I use it for other things), I'll try that one to see what happens. |
Mr P Hucker![]() Send message Joined: 12 Aug 06 Posts: 1600 Credit: 12,490,392 RAC: 18,798 ![]() |
They all got to 2% just fine on my 24 core Ryzen 9 3900XT. But I aborted them there because Virtualbox on a PC you're trying to use for anything else is preposterous. Even the mouse cursor is more sluggish than a 286! I don't know what Oracle are playing at but the whole concept of virtual machines is flawed. I only run it on Boinc only machines. |
![]() Send message Joined: 3 Nov 05 Posts: 1832 Credit: 119,939,443 RAC: 3,723 ![]() |
32GB in the two that have issues. |
![]() Send message Joined: 3 Nov 05 Posts: 1832 Credit: 119,939,443 RAC: 3,723 ![]() |
.. |
Mr P Hucker![]() Send message Joined: 12 Aug 06 Posts: 1600 Credit: 12,490,392 RAC: 18,798 ![]() |
32GB in the two that have issues.Should be ok, you need 3GB per task. I had a 6 core 16GB machine and it would run 5 then refuse to start a 6th. Mind you it never went wrong, it just didn't fill the cores. |
Mr P Hucker![]() Send message Joined: 12 Aug 06 Posts: 1600 Credit: 12,490,392 RAC: 18,798 ![]() |
I only aborted 1 of the last 70 tasks due to sticking. |
![]() Send message Joined: 1 Dec 05 Posts: 2030 Credit: 10,121,026 RAC: 12,565 ![]() |
Pyinstaller new version, 5.7 with a lot of bugfix and new features, for example Support building native ARM applications for Windows. If PyInstaller is ran on an ARM machine with an ARM build of Python, it will prodice an ARM application. |
Message boards :
Number crunching :
Please remove Virtualbox as a dependency.
©2025 University of Washington
https://www.bakerlab.org