Message boards : Number crunching : Please remove Virtualbox as a dependency.
Previous · 1 · 2 · 3
Author | Message |
---|---|
Mr P Hucker Send message Joined: 12 Aug 06 Posts: 1600 Credit: 11,839,945 RAC: 10,299 |
The new Python application does more than take 3gb of memory per task. It also chews up your disk drives by checkpointing too frequently. Most of the problems and stalls are related to checkpointing. A checkpoint option on the preferences would help.My SSDs and NVMEs don't mind. |
.clair. Send message Joined: 2 Jan 07 Posts: 274 Credit: 26,399,595 RAC: 0 |
No news?? You can set checkpoint interval in boinc manager prefs to anything you like such as 3600 seconds is once per hour , etc . |
tullio Send message Joined: 10 May 20 Posts: 63 Credit: 630,125 RAC: 0 |
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5594 |
Bryn Mawr Send message Joined: 26 Dec 18 Posts: 393 Credit: 12,113,928 RAC: 4,486 |
https://lhcathome.cern.ch/lhcathome/forum_thread.php?id=5594 Sadly, that is very specific to lhc requiring the use of CERN utilities and the project to set up additional servers to provide additional functionality. |
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1994 Credit: 9,624,317 RAC: 7,073 |
You can set checkpoint interval in boinc manager prefs to anything you like I think that vms don't care about checkpoint. |
dcdc Send message Joined: 3 Nov 05 Posts: 1832 Credit: 119,655,464 RAC: 11,085 |
Seeing all tasks saying "Running" whilst having been sat at 0% for a day and needing aborting, and then having the machine blacklisted from running more VBox tasks is getting tedious. The VirtualBox tasks aren't fit to be released. VirtualBox multi-attach would presumably solve this by reducing disk usage massively, especially on machines with more cores. |
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1994 Credit: 9,624,317 RAC: 7,073 |
The VirtualBox tasks aren't fit to be released. VirtualBox multi-attach would presumably solve this by reducing disk usage massively, especially on machines with more cores. Lhc_dev project is testing largely this new wrapper. And seems it works! |
Mr P Hucker Send message Joined: 12 Aug 06 Posts: 1600 Credit: 11,839,945 RAC: 10,299 |
Seeing all tasks saying "Running" whilst having been sat at 0% for a day and needing aborting, and then having the machine blacklisted from running more VBox tasks is getting tedious. The VirtualBox tasks aren't fit to be released. VirtualBox multi-attach would presumably solve this by reducing disk usage massively, especially on machines with more cores.Not seeing that here, 95% of them work ok. |
dcdc Send message Joined: 3 Nov 05 Posts: 1832 Credit: 119,655,464 RAC: 11,085 |
I'm only seeing it on 8-core machines. The quad-core and older machines are all fine. |
Mr P Hucker Send message Joined: 12 Aug 06 Posts: 1600 Credit: 11,839,945 RAC: 10,299 |
I'm only seeing it on 8-core machines. The quad-core and older machines are all fine.How much RAM are you using? I find things go belly up if you run short of it. I'm only running it on a 6 core at the moment, the only other one I can run it on is 24 core (which I usually leave off Python due to it being sluggish and I use it for other things), I'll try that one to see what happens. |
Mr P Hucker Send message Joined: 12 Aug 06 Posts: 1600 Credit: 11,839,945 RAC: 10,299 |
They all got to 2% just fine on my 24 core Ryzen 9 3900XT. But I aborted them there because Virtualbox on a PC you're trying to use for anything else is preposterous. Even the mouse cursor is more sluggish than a 286! I don't know what Oracle are playing at but the whole concept of virtual machines is flawed. I only run it on Boinc only machines. |
dcdc Send message Joined: 3 Nov 05 Posts: 1832 Credit: 119,655,464 RAC: 11,085 |
32GB in the two that have issues. |
dcdc Send message Joined: 3 Nov 05 Posts: 1832 Credit: 119,655,464 RAC: 11,085 |
.. |
Mr P Hucker Send message Joined: 12 Aug 06 Posts: 1600 Credit: 11,839,945 RAC: 10,299 |
32GB in the two that have issues.Should be ok, you need 3GB per task. I had a 6 core 16GB machine and it would run 5 then refuse to start a 6th. Mind you it never went wrong, it just didn't fill the cores. |
Mr P Hucker Send message Joined: 12 Aug 06 Posts: 1600 Credit: 11,839,945 RAC: 10,299 |
I only aborted 1 of the last 70 tasks due to sticking. |
[VENETO] boboviz Send message Joined: 1 Dec 05 Posts: 1994 Credit: 9,624,317 RAC: 7,073 |
Pyinstaller new version, 5.7 with a lot of bugfix and new features, for example Support building native ARM applications for Windows. If PyInstaller is ran on an ARM machine with an ARM build of Python, it will prodice an ARM application. |
Message boards :
Number crunching :
Please remove Virtualbox as a dependency.
©2024 University of Washington
https://www.bakerlab.org