Message boards : Cafe Rosetta : Other projects.
Previous · 1 · 2 · 3 · 4
| Author | Message |
|---|---|
|
Bill Swisher Send message Joined: 10 Jun 13 Posts: 100 Credit: 65,715,065 RAC: 36,108 |
Sigh...I saw 11,000+ tasks out for processing earlier. And I didn't get a one of them. My queues are clogged up with WCG, and the occasional Einstein. I say occasional because (excuse the formatting): PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 8991 boinc 39 19 2407100 2.294g 9428 R 92.55 19.78 9,47 einstein_+ Doesn't allow for many of them.
|
ibandersonSend message Joined: 9 Mar 24 Posts: 7 Credit: 219,819 RAC: 333 |
Hi Bill, Maybe you can catch some of those Rosetta Work Units with a Batch file Like this - Upd-Rosetta.bat @echo off cd /d c:Program FilesBOINC :loop cls echo "boinccmd.exe --project https://boinc.bakerlab.org/rosetta/ update" boinccmd.exe --project https://boinc.bakerlab.org/rosetta/ update TIMEOUT /T 600 goto loop Of course you would need to leave a terminal window open for that I tried the Windows Task Scheduler Loop - but the Win 10 task scheduler doesn't seem very reliable. I can't seem to scale to 5 minute intervals very well. Regards, Ian
|
|
Garrulus glandarius Send message Joined: 25 Apr 25 Posts: 24 Credit: 2,719,044 RAC: 22,972 |
Hi Bill, Thanks a lot! Just got it set up on 3 computers, hopefully I'll catch something sometimes... About 2 hours ago I only got tasks on 2 mobile phones despite rushing to press update on several computers.
|
|
Bill Swisher Send message Joined: 10 Jun 13 Posts: 100 Credit: 65,715,065 RAC: 36,108 |
Thanks Ian. I run openSUSE. This is my take on your routine though: bill@opihi:~> cat bin/mowerk # # This doohickie will attempt to get work for the main # projects that I'm supporting. # # set -x # # How many days worth of work... # su and cd to /var/lib/boinc # then vi global_prefs_overide # and modifiy thusly # <work_buf_min_days>0.000000</work_buf_min_days> # <work_buf_additional_days>0.260000</work_buf_additional_days> # Then # systemctl restart boinc-client # cd # # Some interesting things to beat projects up with. # #boinccmd --project https://einstein.phys.uwm.edu allowmorework #boinccmd --project https://einstein.phys.uwm.edu nomorework # # Just touch the projects to gather the statistics. # In alphabetical order no less. Well it was, now it's in my # simple choice of project complettion and not prodding those # other two... # # boinccmd --project https://denis.usj.es/denisathome update sleep 30s boinccmd --project https://boinc.bakerlab.org/rosetta update sleep 30s # boinccmd --project https://einstein.phys.uwm.edu update sleep 1m boinccmd --project https://www.worldcommunitygrid.org update sleep 1m # # OK, is this a one time thing, or what. # If not, rapidly update at a 5 minute interval. # Yeah my math is lousy...it doesn't calculate correctly, but # you know what? I don't care enough to fix it. # if [ "$1" > "" ] ; then Reps=`expr $1 - 1` while [ $Reps -gt 0 ] ; do Ttl=`echo "$Reps * 5" | bc` echo "It's" `date '+%T'` "- on repetition" $Reps "- ttl is $Ttl minutes" boinccmd --project https://denis.usj.es/denisathome update boinccmd --project https://boinc.bakerlab.org/rosetta update sleep 10s # boinccmd --project https://einstein.phys.uwm.edu update boinccmd --project https://www.worldcommunitygrid.org update # Reps=`expr $Reps - 1` if [ $Reps = 0 ] ; then echo "Lightspeed Thumbtwiddling...All Done!" exit fi sleep 5m done else exit fi
|
ibandersonSend message Joined: 9 Mar 24 Posts: 7 Credit: 219,819 RAC: 333 |
On a linux box ( - mine is Linux Mint 22.3), an easy way to poll for new rosetta tasks is using a crontab entry - I use this crontab -e then add - # Update BOINC's Rosetta Project every 2 Minutes to catch stray WUs */2 * * * * /usr/bin/boinccmd --project https://boinc.bakerlab.org/rosetta/ update I see you're trying also trying the Denis project - I don't think I've seen any activity since June 2025 on this one. Einstein always seems to have Work Units available though, as does WCG when it's up. I try to crunch on Cancer oriented research, as my wife, and mom both died of cancer, and I'm also struggling with leukemia. I'm glad research like WCG/Folding@Home are still going strong. FAH even seems to be looking at the KRAS protein involved in a lot of cancers. I hope us crunchers can really help those researchers! Anyway try a simple cron job for updating - no need for scripts on linux! Ian
|
|
Pascal Send message Joined: 5 Oct 19 Posts: 3 Credit: 1,179,200 RAC: 4,317 |
pour windows et tous les projets boinc @echo off pushd "C:Program FilesBOINC" :loop echo [%date% %time%] Debut de la mise a jour automatique... :: On recupere directement la liste des URLs propres for /f "usebackq tokens=*" %%a in (`boinccmd.exe --get_project_urls`) do ( echo Mise a jour en cours : %%a boinccmd.exe --project "%%a" update ) echo. echo [%date% %time%] Fin de session. Prochaine verification dans 30 min. timeout /t 1800 /nobreak >nul goto loop pour windows et un projet boinc @echo off :loop "C:Program FilesBOINCboinccmd.exe" --project https://gpugrid.net/gpugrid/ update timeout /t 900 /nobreak >nul goto loop instruction a mettre dans un fichier.bat et a lancer en mode administrateur |
ibandersonSend message Joined: 9 Mar 24 Posts: 7 Credit: 219,819 RAC: 333 |
@Pascal - looks good though time period of 1800 may miss some work units - but in my poor French - tres bon! I also see that the task scheduler is actually working on my old Win 10 laptop - I was wrong to maligh it! It's running at 5 minute intervals now. Here's my Event Log - 2/13/2026 2:57:22 AM | Rosetta@home | Scheduler request completed 2/13/2026 2:57:22 AM | Rosetta@home | Project requested delay of 31 seconds 2/13/2026 3:02:20 AM | Rosetta@home | update requested by user 2/13/2026 3:02:20 AM | Rosetta@home | Sending scheduler request: Requested by user. 2/13/2026 3:02:20 AM | Rosetta@home | Not requesting tasks: don't need (CPU: job cache full; Intel GPU: no applications) 2/13/2026 3:02:22 AM | Rosetta@home | Scheduler request completed 2/13/2026 3:02:22 AM | Rosetta@home | Project requested delay of 31 seconds 2/13/2026 3:07:19 AM | Rosetta@home | update requested by user 2/13/2026 3:07:20 AM | Rosetta@home | Sending scheduler request: Requested by user. 2/13/2026 3:07:20 AM | Rosetta@home | Not requesting tasks: don't need (CPU: job cache full; Intel GPU: no applications) 2/13/2026 3:07:21 AM | Rosetta@home | Scheduler request completed 2/13/2026 3:07:21 AM | Rosetta@home | Project requested delay of 31 seconds 2/13/2026 3:12:19 AM | Rosetta@home | update requested by user 2/13/2026 3:12:24 AM | Rosetta@home | Sending scheduler request: Requested by user. 2/13/2026 3:12:24 AM | Rosetta@home | Not requesting tasks: don't need (CPU: job cache full; Intel GPU: no applications) 2/13/2026 3:12:25 AM | Rosetta@home | Scheduler request completed 2/13/2026 3:12:25 AM | Rosetta@home | Project requested delay of 31 seconds 2/13/2026 3:17:19 AM | Rosetta@home | update requested by user 2/13/2026 3:17:23 AM | Rosetta@home | Sending scheduler request: Requested by user. 2/13/2026 3:17:23 AM | Rosetta@home | Not requesting tasks: don't need (CPU: job cache full; Intel GPU: no applications) 2/13/2026 3:17:24 AM | Rosetta@home | Scheduler request completed 2/13/2026 3:17:24 AM | Rosetta@home | Project requested delay of 31 seconds 2/13/2026 3:18:04 AM | | Resuming GPU computation 2/13/2026 3:20:49 AM | | Suspending GPU computation - computer is in use 2/13/2026 3:22:19 AM | Rosetta@home | update requested by user 2/13/2026 3:22:22 AM | Rosetta@home | Sending scheduler request: Requested by user. 2/13/2026 3:22:22 AM | Rosetta@home | Not requesting tasks: don't need (CPU: ; Intel GPU: no applications) 2/13/2026 3:22:24 AM | Rosetta@home | Scheduler request completed 2/13/2026 3:22:24 AM | Rosetta@home | Project requested delay of 31 seconds 2/13/2026 3:27:19 AM | Rosetta@home | update requested by user 2/13/2026 3:27:21 AM | Rosetta@home | Sending scheduler request: Requested by user. 2/13/2026 3:27:21 AM | Rosetta@home | Not requesting tasks: don't need (CPU: job cache full; Intel GPU: no applications) 2/13/2026 3:27:22 AM | Rosetta@home | Scheduler request completed 2/13/2026 3:27:22 AM | Rosetta@home | Project requested delay of 31 seconds The Task Scheduler seems to be an easier way to run Rosetta updates every 5 minutes as set and forget! Ian
|
|
UBT - wbiz Send message Joined: 5 Feb 21 Posts: 8 Credit: 3,656,877 RAC: 31,672 |
I run a background script on my main linux computer that polls my boinc computers in a random order using ssh, some are windows, some are linux. Only started this recently, I didn't realise how many others are doing the same. Uses a list file for the target computers that you can update on the fly. It took a while to get the windows ssh syntax working. EDIT: tried to add code but the forum code tags aren't working properly and the escaped characters don't show. https://boincot.uk |
|
Pascal Send message Joined: 5 Oct 19 Posts: 3 Credit: 1,179,200 RAC: 4,317 |
sous linux mint 22 watch -n 300 boinccmd --project https://boinc.bakerlab.org/rosetta/ update watch -n 3600 'for url in $(boinccmd --get_project_status | grep "master URL" | awk "{print $3}"); do echo "→ $url"; boinccmd --project "$url" update; done' a lancer dans terminal ou lanceur terminal |
|
Sid Celery Send message Joined: 11 Feb 08 Posts: 2551 Credit: 47,165,131 RAC: 1,562 |
I went away and forgot to come back, until tonight I don't think I missed anything at WCG that worked, except reduced deadlines from 7 to 3 or 4 days The latest update teases us with possibilities, including stats export, which I'll believe when I see it February 19, 2026
|
|
Sid Celery Send message Joined: 11 Feb 08 Posts: 2551 Credit: 47,165,131 RAC: 1,562 |
An update I missed a few days ago March 6, 2026
|
|
Sid Celery Send message Joined: 11 Feb 08 Posts: 2551 Credit: 47,165,131 RAC: 1,562 |
March 6, 2026 March 16, 2026 Data transfer from legacy MariaDB to Postgres is ongoing for the largest partitioned table in the BOINC database, the result table. All other tables were transferred successfully to the postgres cluster. We tested every component in production, and we expect to bring the system back online for users at the load balancer as soon as the data transfer and final integrity check between the legacy and new database are complete.
|
|
Sid Celery Send message Joined: 11 Feb 08 Posts: 2551 Credit: 47,165,131 RAC: 1,562 |
March 23, 2026 Many issues identified and fixed after bringing the WCG backend online last week Thursday, March 19th, 2026 running the new Postgres-enabled BOINC v1.6.1 backend in production: We found multiple missing indexes in our Postgres schema that the small scale of our staging environment did not reveal as necessary. We also had to setup the Postgres extension pgbouncer to pool connections to on each Postgres worker node to pool the large number of connections, and address multiple oversights in our CDC pipeline that resulted in incorrectly decoding user prefs coming from MariaDB into Citus reference tables, and no stats updates for the first few update windows on the website since we came back online. The credit_flusher that gathers the global view of what results need their state updated in MariaDB from the Citus coordinator was omitting key columns from those updates. We also had to iterate on MariaDB binlog settings together with Kafka to get CDC working in prod. With the bottleneck load now spread across the IOPS available to 6 servers without requiring a full migration of the legacy BOINC database which is under 100% disk utilization for the first time at the new site while under production load, we are now going to be able to clear the validation backlog, launch and resume projects, fix the daily stats on the website, resume the stats dump, and fix the results page so that Volunteers can verify the state of their backlogs. A server status page has been implemented in our staging environment, we plan to push it to the live site this week or next. We have one major issue with one of the six backend servers at the moment (3pm UTC); we have reached out to hosting for assistance: We were able to recover the Postgres cluster morning of March 23rd, 2026 (EST time) from the crash yesterday March 22nd, but this 1/6 postgres worker is behaving differently than the other partitions despite identical config and executables running on it. It has become unresponsive again, and we reached out to hosting about this in case it is hardware or cloud. We have blocked that server at the load balancer from receiving scheduler requests, so the download and reporting path should be functional for all requests now, but uploads mapped to that server will continue to display HTTP transient errors until we resolve the problem.
|
Message boards :
Cafe Rosetta :
Other projects.
©2026 University of Washington
https://www.bakerlab.org