𝕏

Posts by Jean-David Beyer

1) Message boards : Number crunching : Upload errors: server is out of disk space (Message 2186)
Posted 17 Sep 2023 by Jean-David Beyer
Post:
Well, the server seens up again, but still out of space.

Sun 17 Sep 2023 05:58:00 PM EDT | DENIS@home | Started upload of NHuVe_20230915130259640348_NHuVeNLOnlyG_k_14-Pieske_333-conf_946_0_r1758396947_0
Sun 17 Sep 2023 05:58:00 PM EDT | DENIS@home | Started upload of NHuVe_20230915130259640348_NHuVeNLOnlyG_k_14-Pieske_1000-conf_945_1_r1159279011_0
Sun 17 Sep 2023 05:58:01 PM EDT | DENIS@home | [error] Error reported by file upload server: Server is out of disk space
Sun 17 Sep 2023 05:58:01 PM EDT | DENIS@home | [error] Error reported by file upload server: Server is out of disk space
Sun 17 Sep 2023 05:58:01 PM EDT | DENIS@home | Temporarily failed upload of NHuVe_20230915130259640348_NHuVeNLOnlyG_k_14-Pieske_333-conf_946_0_r1758396947_0: transient upload error
Sun 17 Sep 2023 05:58:01 PM EDT | DENIS@home | Backing off 05:51:55 on upload of NHuVe_20230915130259640348_NHuVeNLOnlyG_k_14-Pieske_333-conf_946_0_r1758396947_0
Sun 17 Sep 2023 05:58:01 PM EDT | DENIS@home | Temporarily failed upload of NHuVe_20230915130259640348_NHuVeNLOnlyG_k_14-Pieske_1000-conf_945_1_r1159279011_0: transient upload error
Sun 17 Sep 2023 05:58:01 PM EDT | DENIS@home | Backing off 05:56:33 on upload of NHuVe_20230915130259640348_NHuVeNLOnlyG_k_14-Pieske_1000-conf_945_1_r1159279011_0
2) Message boards : Number crunching : Canceled Work Units by Server (Message 2154)
Posted 23 Jul 2023 by Jean-David Beyer
Post:
To reduce task state "cancelled by server", perhaps the admin can add in some grace period?


Sounds like a good idea to me.
3) Message boards : Number crunching : Canceled Work Units by Server (Message 2152)
Posted 23 Jul 2023 by Jean-David Beyer
Post:
I am getting lots of tasks canceled by server. My machine is 224473. Here ia one of them.

Workunit 7969164
name 	HuVeMOp_20230718132304300078_ORd_k_5-Drouin_MID_5000-conf_907
application 	Human ventricular cell models optimization
created 	18 Jul 2023, 11:26:41 UTC
canonical result 	16968692
granted credit 	48.06
minimum quorum 	2
initial replication 	2
max # of error/total/success tasks 	3, 10, 6
Task
click for details	Computer	Sent	Time reported
or deadline
explain	Status	Run time
(sec)	CPU time
(sec)	Credit	Application
16968692 	224349 	19 Jul 2023, 8:22:35 UTC 	22 Jul 2023, 8:39:49 UTC 	Completed and validated 	2,313.46 	2,279.81 	48.06 	Human ventricular cell models optimization v0.02
windows_x86_64
16968693 	201356 	19 Jul 2023, 8:29:12 UTC 	20 Jul 2023, 4:00:47 UTC 	Completed and validated 	9,879.10 	7,307.09 	48.06 	Human ventricular cell models optimization v0.02
windows_x86_64
17626898 	224473 	22 Jul 2023, 8:22:39 UTC 	22 Jul 2023, 8:49:04 UTC 	Cancelled by server 	0.00 	0.00 	--- 	Human ventricular cell models optimization v0.02
x86_64-pc-linux-gnu


In each case, the server sends out two tasks, but then two day later the server sends me a task for the same work unit. then the second task replies. then my task gets canceled. If the second task is not canceled first, why does the server send me a task, only to cancel it very shortly afterwards, when the second task completes. If this happened only once in a great while, maybe I would not care but 34 in the last few days?
4) Message boards : Cafe : Why DENIS? (Message 2148)
Posted 19 Jul 2023 by Jean-David Beyer
Post:
I already had a stroke and heart attack. But that is not why I run DENIS, since I doubt any results they get will be soon enough to help me. I do it because it may halp others.
And since my machine is up almost 24/7/365, it is better, IMAO, than running amical numbers, prime number searches, and stuff like that.
I currently run ClimatePrediction, World Community Grid, DENIS, Rosetta, Einstein, and Universe and I let Universe run only if there is nothing else available.
5) Message boards : Number crunching : Invalid tasks (Message 2138)
Posted 26 Jun 2023 by Jean-David Beyer
Post:
Noticed that as of this post I have 54 "Invalid" tasks across my various PC's spread over many days of computation.

My question is, what makes them "invalid"?

I have about 10 Invalid tasks at the moment.
I looked up the work units involved to see if there were others with the same work unit, and how they did.

In summary, in each case there were three users (including me) who got each of these work units. Mine was invalid and the other two were successful.

As far as I can tell we all got the work unit about the same time, and usually the other two users got theirs slightly earlier than mine.But not always. But since they returned their results first, my job was canceled by the server.

I am not sure if the server should have sent me the task at all until one of the others failed or timed out. But they did.
6) Message boards : Number crunching : Server Out of Space (Message 2118)
Posted 19 Jun 2023 by Jean-David Beyer
Post:
I have about 585 WUs waiting upload. Getting messages in the the client log about server being out of space. Just posting for the record as I assume the admins know about the problem.


I had about two screens full myself last night. But I could not leave a message because I could not log in to the site.
Message on screen said something about could not connect to database (this is not an exact quote).
This morning, most of them were gone. I retried and the remaining ones went right up.
7) Message boards : Number crunching : Low memory usage (Message 2116)
Posted 18 Jun 2023 by Jean-David Beyer
Post:
Check the link I give above, you'll have an idea for all existing projects and applications, depending on the OS used.


That table seems incomplete and out of date; at least for ClimatePrediction.

Here is a brief description of a CPDN program for a weather prodiction class of tasks. I have run quite a bunch of them on Linux with what I assume is testing data, and it used a trifle less RAM than they suggest here. These took less than a day of computer time, but I assume real data would take longer.

Technical information:

Please ensure 'Leave non-GPU tasks in memory while suspended' is set in Disk/Memory options of boincmgr

CPDN app-name: oifs_43r3_bl
Run time: ~6 hrs/task on a modern CPU
Max memory: ~7Gb
Total number of files: 354 files
Model output: 16Mb per output step (uncompressed)
Total size of uploaded files: 1.5GB
Checkpoint filesize: ~800Mb (these are periodically created & deleted in the slot dir and not uploaded)
8) Message boards : Number crunching : Low memory usage (Message 2114)
Posted 18 Jun 2023 by Jean-David Beyer
Post:

I have been a part of a few boinc projects in the past but I noticed something unique about this projects memory usage. It is very low!

It is, compared to most projects. Nothing to worry about. Some of the ClimatePrediction Oifs work units take almost 8GBytes each.

Here is what my machine is doing for Boinc at the moment. the RES column is the working set size of each of the tasks. The %MEM colun is the precent fo my total RAM that is. At the moment, one of my 8 memory modules quit yesterday, so the numbers are a little different than usual..

    PID    PPID USER      PR  NI S    RES  %MEM  %CPU  P     TIME+ COMMAND                                                                   
 157939    2196 boinc     39  19 S 765680   0.7   0.0  8 161:02.35 ../../projects/einstein.phys.uwm.edu/hsgamma_FGRP5_1.08_x86_64-pc-linux-+ 
 143472    2196 boinc     39  19 S 214084   0.2   0.0 12 373:39.40 ../../projects/einstein.phys.uwm.edu/einsteinbinary_BRP4G_1.33_x86_64-pc+ 
 182447    2196 boinc     39  19 R  78736   0.1  99.7  7  65:23.95 ../../projects/www.worldcommunitygrid.org/wcgrid_mcm1_map_7.61_x86_64-pc+ 
 185461    2196 boinc     39  19 R  71812   0.1  99.2 10  28:37.51 ../../projects/www.worldcommunitygrid.org/wcgrid_mcm1_map_7.61_x86_64-pc+ 
 186259    2196 boinc     39  19 R  68820   0.1  99.6  0  13:12.30 ../../projects/www.worldcommunitygrid.org/wcgrid_mcm1_map_7.61_x86_64-pc+ 
 184957    2196 boinc     39  19 S  51736   0.0  99.6 12  38:26.95 ../../projects/www.worldcommunitygrid.org/wcgrid_scc1_vina_7.18_x86_64-p+ 
   2196       1 boinc     30  10 S  51476   0.0   0.2  2  33435:12 /usr/bin/boinc                                                            
 183436    2196 boinc     39  19 R   2816   0.0  99.3 11  51:29.00 ../../projects/denis.usj.es_denisathome/DENIS_Myocyte_Beta_0.21_x86_64-p+ 
 184785    2196 boinc     39  19 R   2816   0.0  99.4  3  41:04.49 ../../projects/denis.usj.es_denisathome/DENIS_Myocyte_Beta_0.21_x86_64-p+ 
 183485    2196 boinc     39  19 R   2528   0.0  99.5  4  49:55.06 ../../projects/denis.usj.es_denisathome/DENIS_Myocyte_Beta_0.21_x86_64-p+ 
 185677    2196 boinc     39  19 S   2528   0.0  88.6 14  24:29.14 ../../projects/denis.usj.es_denisathome/DENIS_Myocyte_Beta_0.21_x86_64-p+ 
 185878    2196 boinc     39  19 R   2528   0.0  99.6  5  19:55.76 ../../projects/denis.usj.es_denisathome/DENIS_Myocyte_Beta_0.21_x86_64-p+ 
 186012    2196 boinc     39  19 R   2528   0.0  99.6  1  17:41.43 ../../projects/denis.usj.es_denisathome/DENIS_Myocyte_Beta_0.21_x86_64-p+ 
 186542    2196 boinc     39  19 R   2512   0.0  99.5 13   7:23.22 ../../projects/denis.usj.es_denisathome/DENIS_Myocyte_Beta_0.21_x86_64-p+ 
 186290    2196 boinc     39  19 R   2508   0.0  99.6  6  12:22.50 ../../projects/denis.usj.es_denisathome/DENIS_Myocyte_Beta_0.21_x86_64-p+ 

9) Message boards : News : Status of the project // Estado del proyecto (Message 2105)
Posted 15 Jun 2023 by Jean-David Beyer
Post:
So are you looking for tasks which require 20+ hours? :)


Yes, but I am not looking for them here. I have ClimatePrediction for that. Latest ones have taken about 10 days each. But they lately sending out very little work. Here is my latest one.


Task     Work unit Sent     	               Reported	            Status	Run time (sec)	CPU time (sec)	Credit	  Application
22318648 12138603  30 May 2023, 3:38:46 UTC 9 Jun 2023, 1:20:39 UTC Completed 	852,578.34 	843,274.30 	33,854.34 UK Met Office HadAM4 at N216 resolution v8.52
i686-pc-linux-gnu
10) Message boards : News : Status of the project // Estado del proyecto (Message 2101)
Posted 14 Jun 2023 by Jean-David Beyer
Post:
If you're interested, Einstein@Home guarantee constant work for different sub projects. Server status shows that current batches of tasks need at least few months.


Maybe an entire batch requires a few months, but individual tasks require only seven to eight hours on my Linux machine.

Computer 224473
CPU type 	GenuineIntel
Intel(R) Xeon(R) W-2245 CPU @ 3.90GHz [Family 6 Model 85 Stepping 7]
Number of processors 	16
Operating System 	Linux Red Hat Enterprise Linux
Red Hat Enterprise Linux 8.7 (Ootpa) [4.18.0-425.13.1.el8_7.x86_64|libc 2.28]
BOINC version 	7.20.2
Memory 	125.34 GB
Cache 	 16896 KB
Swap space 	15.62 GB
Total disk space 	488.04 GB
Free Disk Space 	473.01 GB
Measured floating point speed 	6.04 billion ops/sec
Measured integer speed 	       25.59 billion ops/sec
11) Message boards : News : Status of the project // Estado del proyecto (Message 2099)
Posted 12 Jun 2023 by Jean-David Beyer
Post:
A lot of that falls under what I meant by other definitions of efficiency. But Jesus explained it better that I ever could.

OTOH:
As already mentioned, luckily there are other projects to which you can give your time. That's why we want to be efficient: If we waste your resources, we don't just take it only from you, we take also from other scientists. This project has had its ups and downs, but we are achieving sustained growth. I think this is the way, although I understand that many of you would like another situation. I also want there to be a more constant flow (and less manual part...)


True, there are other projects, but in the last few months, even about a year, important (to me) projects have been having miserable availability of work. The worst has been WCG that was pretty much down for about year, though with brief intervals where work was available. Right now it is sending work on two of their efforts, but nominally they have five. And ClimatePrediction has not been sending out work for quite a while too although now their web site is up reliably; just no work since April except for a few re-runs that timed out from other users.

As a result, I am now running a lot of MilkyWay and Universe tasks that are of little interest to me, but at least they are pretty reliable about keeping their servers up and supplying work.
12) Message boards : News : Status of the project // Estado del proyecto (Message 2097)
Posted 11 Jun 2023 by Jean-David Beyer
Post:
Why do you wait until the last moron running DENIS on his IBM 8088 green screen PC returns the final task sent out 9 years ago, before you make another batch of tasks? This is HIGHLY INEFFICIENT.


If I have told you once, I have told you a million times, don't exaggerate!

But a bit more seriously, there are more than one way of measuring efficiency, and perhaps the management of this project has a different idea of efficiency than you do. I admit to getting frustrated by running out of work every week, usually after three or four days. So it is not running my machine efficiently (even though I run CPDN, WCG, Rosetta, Einstein, and (grudgingly) MilkyWay and Universe). But maybe management of this project measures efficiency in terms of efficiency of its machines, its people, and other things.
13) Message boards : News : Status of the project // Estado del proyecto (Message 2095)
Posted 31 May 2023 by Jean-David Beyer
Post:
I will publish an update of the results the next week (we are finishing the validation process of the first version of the optimization), and I will explain there the new versions we have started (the validation of the first one does not look good, so we will still need your help).


You will continue getting my help if you continue sending me work units. Currently I have little over 100 DENIS tasks in my machine waiting to go, and I process them four at a time. They seem to take about 65 minutes each on my main machine. And I notice the current batch on your machine is quite large, so I may get some of those too.
14) Message boards : News : Status of the project // Estado del proyecto (Message 2093)
Posted 29 May 2023 by Jean-David Beyer
Post:
I wish there were a way to supply more work, and more evenly.

When work becomes available, usually once a week, my machine downloads about 100 tasks. I could make it get more, but that would risk failure to complete some on time, so that is not the answer. Alternatively, you could send out work twice a week, perhaps every three or four days. As I understand it, this is not practical either because you need the results from one batch of work before you can send out the next set of work.

Perhaps if you had two related projects, each could send out the same size work once a week, but 3 or 4 days apart, so you could be studying the results of one project while we volunteers could be working on the other. That would probably increase the amount of work you would have to do, of course, and that might be too much to ask for.
15) Message boards : Cafe : OS Selection thread (Message 2091)
Posted 4 May 2023 by Jean-David Beyer
Post:
I prefer RHEL derivatives for private and professional use, because it is important for me to have as much practise as i can get.


Me too., Actually I am running Red Hat Enterprise Linux release 8.7 (Ootpa), not a derivatave,

My first home computer ran Windows 95 and I hated it so much that I complained to my computer-knowledgeable nephew (an MIT student at the time) and he recommended Red Hat Linux 5 (current at the time), and it was so much better, and less buggy, and free that I got it. I cannot remember if it fit a floppy disk or a CD. But I added a hard drive to my machine and installed Linux on the new drive as a dual-boot system. I then went to RHL 5.2 on a new machine and later upgraded it to CentOS4.

I run RHEL on my last few machines. I like that it is supported for 10 years because I hate upgrades (although I to keep with the bug fixes).

$ uptime
16:38:49 up 28 days, 6:51, 1 user, load average: 12.07, 12.19, 12.58
$
16) Message boards : Number crunching : What is this? (Message 2086)
Posted 28 Apr 2023 by Jean-David Beyer
Post:
I do not know, but I do not seem to have any trouble downloading them.

[//var/lib/boinc/projects/denis.usj.es_denisathome]$ ls -lrt
total 2576
-rwxr-xr-x. 1 boinc boinc 2371048 Mar  8 09:25 NHuVe_0.03_x86_64-pc-linux-gnu
-rw-r--r--. 1 boinc boinc    3827 Apr 12 05:30 denis_logo_mini.png
-rw-r--r--. 1 boinc boinc      77 Apr 12 05:30 stat_icon
-rw-r--r--. 1 boinc boinc   49237 Apr 12 05:51 Error_evolution_20230411_en.png
-rw-r--r--. 1 boinc boinc      89 Apr 12 05:51 slideshow_NHuVe_00

...
17) Message boards : Number crunching : What does 1 credit equal? (Message 2077)
Posted 18 Apr 2023 by Jean-David Beyer
Post:
I do not know. The number of credits per successfully-completed tasks varies enormously depending on the project.

For example MilkyWay and Universe give out so much credit per work unit that it is embarrassing tp show them. I have generated more credits in a few months of these two than by WCG since 2 Oct 2007. or Rosetta since 2 Nov 2005.

I think it would be better if the number of credits were proportional to the amount of CPU cycles executed per task, or something like that. But that does not seem to be how it is done.
18) Message boards : Number crunching : New tasks? (Message 2066)
Posted 13 Apr 2023 by Jean-David Beyer
Post:
There are plenty of other Boinc Projects you can put your machines on to get credits, some even faster than here. ALL Projects go thru phases where they have tasks or they don't, it's why it's called Distributed Computing and soo many Projects have joined in since Boinc came about way back when, the idea being you get to choose where you want to crunch and if one Project is running low on tasks you can always choose another!!


True enough.. MilkyWay and Universe give out so much credit for so little work that it is embarassing to even run them. I give them my lowest priorities and allow only one task of each to run at a time. I signed up for them to make up for the lack or work from WCG (now p;ossibly almost fixed) and ClimatePrediction that has an extended period of no new work; and not giving credit for the work that is done. The credit for CPDN work does appear once a week (most of the time), on their web site, but it does not seem to make it to the usual web sites.
19) Message boards : Number crunching : New tasks? (Message 2051)
Posted 30 Mar 2023 by Jean-David Beyer
Post:
I too am a new participant at Denis@home.

In my experience, I usually get one big rush of tasks a week, although this week I have gotten two rushes.
It is not my highest priority project, but my system is set up to process up to 4 Denis tasks at a time (while running other processes at the same time, for a total of 12 processes at a time).
On my machine, each DENIS task takes about 65 tp 70 minutes to complete.

(My most important projects are World Community Grid that has been essentially down for over a year, and ClimatePrediction that has not sent out any work in over a month and their web site has a security certificate problem the last few days, so you will frustrate yourself if you try to deal with them.)
20) Questions and Answers : Preferences : Crunch only one project at a time (Message 2047)
Posted 20 Mar 2023 by Jean-David Beyer
Post:
In the boinc manager, there is an option
Switch between tasks every .... minutes. Mine is set to 1187.00
Depending on your needs, setting it higher than my short day might help.


Next 20