𝕏

Posts by TPCBF

1) Message boards : Number crunching : How do I get my stats? (Message 2355)
Posted 8 Apr 2024 by TPCBF
Post:
I have no data for this project but I did find that Rosetta seems to give points based on time and floating point MIPS (Whetstone) per CPU which it finds in in client_state.xml from <p_fpops> and <p_iops>. When you do a Boinc benchmark it stashes it there.

WCG seems to assign credits per job regardless of time.

It's written up in the hardware forum over there.
That is definitely NOT the case. The only project that I am aware of (and at times participate in as backup project) is Einstein@Home.

In general, most projects award points depending on the amount of computations (cobblestones, as you can see for example mentioned on the certificate you can get at some projects, including DENIS). That's why a lot of pointw*****s favoring GPU projects, as there they get the most points in the shortest amount of time due to the high number of floating point operations per second compared to regular CPU/FPU computation...


Ralf
2) Message boards : Number crunching : How do I get my stats? (Message 2354)
Posted 8 Apr 2024 by TPCBF
Post:
WOW that is quick. So I guess, unless you are on the top, you are SOL

I'm trying to figure out how Denis counts points vs WCG vs Rosetta as per my 5950x thread in WCG. I recognise your name and moniker.
Only WCG is "internally" counting different, though it is the same for external stats, as with all BOINC projects. That's due to WCG have started out before BOINC came into existence and they stick to their way of calculating points (7x that of BOINC).

How much each project is "paying" in points varies wildly across BOINC, with some actually inflating the points values, so others (incl, DENIS) look like a rather meager "payout". But then not everyone is one of those pointw****s...

Ralf
3) Message boards : Number crunching : Server is out of work (Message 2353)
Posted 8 Apr 2024 by TPCBF
Post:
Dear all,
Sorry for not notifying you, but last week it was vacation at the university and I couldn't send work. There are times that even in those periods I am attentive, but this time it was not possible.
I'm going to post-process the previous results now and probably this afternoon (it's 10:30 here in Spain), work will appear again.
Thanks for the update!
Thought it might be something like this, not used to the European way of holidays anymore after 27 years in the US of A, here even Easter Monday is not an official holiday...

Ralf
4) Message boards : Number crunching : Server is out of work (Message 2335)
Posted 2 Apr 2024 by TPCBF
Post:
I don't know how long this has been going on...but I finally had a chance to check my stats in BOINC and saw the line going down, plus in my profile, I have all 0's for tasks.


That does not reflect my experience. My experience is that Denis goes up and down so sometimes I have none, and sometimes I have huge number of Denis tasls in my machine. As far as credits are concerned, in the last month the curve for Denis has gone up from 5000 to 5300; a small increase. My WCG has given a consideral increase but with much more variability than Denis. I have received no work at all on my Linux machine since last June for ClimatePrediction.
DENIS always (since I added it in October last year) had bursts of several 100,000 of WUs available, which is followed by several days of no new WUs at all, apparently until all outstanding WUs have been returned.
Right now, it seems that there have been no new WUs for the last two days now, and with the weekend already started in Spain/Europe, I don't expect another heap of new WUs showing up until Monday morning (my time, I am on the US West Coast, that's GMT-9 compared to Spain). Though it had happened a couple of times that there was a refill of WUs over a weekend...
Right now, one of my hosts is just crunching on the last DENIS WU (a slow i7 laptop) while another mobile i7 has 37 WUs left in the queue, which are currently just "ready" as they are due on the 31st and another project has some WUs that were on the back burner and are now due by the 30th...


Ralf



I live in Europe. We all take this Monday off as a holiday after Easter Sunday. So I doubt Jose will be releasing anything Monday. Maybe if he has new work,Tuesday sometime.
That was simply a typo, which should have been obvious out of the context...
5) Message boards : Number crunching : Server is out of work (Message 2327)
Posted 29 Mar 2024 by TPCBF
Post:
I don't know how long this has been going on...but I finally had a chance to check my stats in BOINC and saw the line going down, plus in my profile, I have all 0's for tasks.


That does not reflect my experience. My experience is that Denis goes up and down so sometimes I have none, and sometimes I have huge number of Denis tasls in my machine. As far as credits are concerned, in the last month the curve for Denis has gone up from 5000 to 5300; a small increase. My WCG has given a consideral increase but with much more variability than Denis. I have received no work at all on my Linux machine since last June for ClimatePrediction.
DENIS always (since I added it in October last year) had bursts of several 100,000 of WUs available, which is followed by several days of no new WUs at all, apparently until all outstanding WUs have been returned.
Right now, it seems that there have been no new WUs for the last two days now, and with the weekend already started in Spain/Europe, I don't expect another heap of new WUs showing up until Monday morning (my time, I am on the US West Coast, that's GMT-9 compared to Spain). Though it had happened a couple of times that there was a refill of WUs over a weekend...
Right now, one of my hosts is just crunching on the last DENIS WU (a slow i7 laptop) while another mobile i7 has 37 WUs left in the queue, which are currently just "ready" as they are due on the 31st and another project has some WUs that were on the back burner and are now due by the 30th...


Ralf
6) Message boards : News : Hard drive space crisis solved // Crisis de espacio en el disco duro resuelta (Message 2312)
Posted 20 Mar 2024 by TPCBF
Post:
I should reactivate the different social profiles, at least for this situations.
Thanks, that would be very much appreciated if such a situation arises again (hopefully not, <frantically knocking on wood>)...

Ralf ;-)
7) Message boards : News : Hard drive space crisis solved // Crisis de espacio en el disco duro resuelta (Message 2299)
Posted 15 Mar 2024 by TPCBF
Post:
DENIS doesn't have nearly the number of folks WCG SUPPOSEDLY has. It's a small project in terms of resources. Keep that in mind. The irony is that Jesus is quick to respond to things as soon as he aware of them. I have let him know a few times when the project was down for an extended period and he's been pretty quick to take care of things once he received the message. He's also been fairly responsive to inquiries in the forums.
Yeah, it is a smaller project, but it seems it gained quite a number of crunchers in the last few month. And usually, since I joined here in October, he has indeed been reasonably quick with answering. Just the last weekend it took a while to get the notice that they were out of drive space. The bad thing is that in such a case, everything goes down, including the forum...
I still run a little WCG, although since they keep running out of work or it's allocated to other OS, my systems don't hit them often. It use to be my main project as cancer is a close to home interest. But it's all turned out too little too late. The icing on at all is turning down volunteers and then be unable to report in / respond to the volunteers.
Well, I am still being moderated/censored on the WCG forum for speaking my mind and calling them out for telling even outright lies.
However,...
That they "keep running out of work" is highly exaggerated. Most of the time, WUs are coming just fine, at least if you are running with a default cache and not trying to hoard days worth of WUs.
And with the turning down of volunteers, that is something I can to some degree understand. Being situated in a healthcare network, they are likely to have some level of restriction like HIPAA here in the USA as to who can access what. But then there should also be a way to grant monitoring access to a couple of vetted IT professionals among the volunteers And a lot of the issues that arise are self-inflicted.
Yes, for me cancer research also hits close to home, though I am one of the VERY lucky ones that my stomach cancer was detected very early and was immediately operable and hasn't shown up now in 13 years. That was for me the reason why, after Rosetta had some serious issues back in those days, I ended up joining WCG. And when things are not going well at WCG, I chose DENIS as a backup project an in 4 1/2 months I made it (per BOINC stats) close to the Top 100 list of contributors....

But the main issue with WCG is their utter lack of communication. That's what I mentioned in my first reply in this thread to Jesus. Even reporting honestly some bad/not so good news is better than no info at all or just some platitudes...

Ralf
8) Message boards : News : Hard drive space crisis solved // Crisis de espacio en el disco duro resuelta (Message 2290)
Posted 13 Mar 2024 by TPCBF
Post:
Thanks for the update!
But due to bad experience at the World Community Grid (which, with their handling of their projects, has probably driven a lot of folks over here in recent months, including me), PLEASE, even if things go bad, which is something that can always happen, try to post some update quickly about what is going on. And if the forum is taken down as well, put it up on your FB site or X.
Honest bad news is by the vast majority better received than no news at all.

thanks again,

Ralf
9) Message boards : Number crunching : Database error (Message 2287)
Posted 13 Mar 2024 by TPCBF
Post:
Looks like validating WUs has picked up a bit speed, there are now almost 200 validated in the last 2h....
10) Message boards : Number crunching : Database error (Message 2286)
Posted 13 Mar 2024 by TPCBF
Post:
I am getting a sporadic supply of work units, but that is pretty much expected from this project. At least they have a server status page. The supply from WCG is adequate for the moment. At least they seem to have a handle on the assimilation side. I have seen my numbers go down about 10,000 or so. They are making progress.

I have about 300 awaiting validation here which is a little bit higher than normal after a bit crunching, but I have seen the number slowly decreasing, probably until they dump another big batch into the system.

Cheers
I have +1500 WUs waiting to be validated, and that number is slowly increasing still, it seems only 1 our of 2 or 3 of those "sporadic" new WUs are being quickly validated.
And that status server page is of little help right now, as it is very infrequently updated. It shows 18 WUs "ready to send" for hours now and I have gotten probably more than that just by those 8 or 9 hosts that have DENIS enabled...

As for WCG, yeah, right now the number of valid WUs waiting to be purged as dropped steadily in the last few days, so much that I can actually refresh the Result page one time only, instead of getting repeatedly/for hours those annoying progress bars with nothing to show for. Overall, I would have a different definition of "progress", we are more catching up to the point where we used to be back in October of last year...

Ralf
11) Message boards : Number crunching : Database error (Message 2283)
Posted 12 Mar 2024 by TPCBF
Post:
on WCG...did you read their tweet from last week?
Basically on a wild guess it will be the end of the month or later before they are back.
Not quite sure to whom and what you are referring to...
12) Message boards : Number crunching : Database error (Message 2274)
Posted 11 Mar 2024 by TPCBF
Post:
I have over 130 wus to report and some news will be welcome during these down
Well, I have about 1100 WUs being added to "pending validation" and have yet to see a single new one being downloaded after uploading/reporting.

Some WUs, in the single numbers, are apparently being validated as they are reported in the last couple of hours, but it doesn't look any catch-up on those crunched during the outage has happened yet.
It's now past business hours in Spain, so I think this will be the observed status for the next 12-14h...


Ralf
13) Message boards : Number crunching : Database error (Message 2272)
Posted 11 Mar 2024 by TPCBF
Post:
Server status pages update only every so often for BOINC projects, it's not continuous.
I am well aware of this. And you're are missing the point...

Ralf
14) Message boards : Number crunching : Database error (Message 2269)
Posted 11 Mar 2024 by TPCBF
Post:
Every day, your project is down for hours shortly after midnight.
Well, yes, the "system" is down for about one (1) hour (give or take 15 min), roughly at 3pm (15:00). now 4pm (16:00) here in LA, which seems like daily maintenance. It is certainly NOT "for hours"....
Today, there was a database error for at least 7 hours.
Remember how you crashed the entire system several years ago without being able to recover it fully with results & stats being partly lost?
You need to thoroughly check what is going on there - just a friendly reminder...
Ok, you might wanna try the hot mess that reigns supreme at World Community Grid for comparison. We barely had more than 3-4 weeks where the system was barely running stable.

For all I can tell, here at DENIS, the "system went down" sometime on Saturday (here in Los Angeles, before we switched to Daylight Savings Time on Sunday morning) and it seems barely have come back up early this morning with WUs uploading and reporting (though very slowly, which I take is the result of all clients trying to upload/report all over the world).
Now this is the second time that this happened like this within a month, and for my part, some info from the system admins about what is/was going on and the current status would be nice. And if the website/forum is down, a post on FB and/or X/Twitter would be nice.
What a this point would be appreciated to get at least a quick update about the status would appreciated, as it is a bit concerning that with most of the pending WUs uploaded and reported, the system status page, as well as the personal account info page, show the status from before the "crash". leaving the possibility that all those pending WUs could potentially be lost...

Thanks for any update on the current situation would be highly appreciated...

PS: As soon as I had sent off the above post, the personal account Tasks page finally came up and it shows that all those after the "crash" uploaded and reported WUs are marked as "pending validation", so nothing seems to be lost at this point, just that the system has to do some catch up to do...
Ralf
15) Message boards : Number crunching : Invalid tasks (Message 2262)
Posted 28 Feb 2024 by TPCBF
Post:
No, most of the invalid causes are problems due to differences in the OS we have no considered. We need to still improve the program to avoid them.

Best,
Jesús
Any news on this front?
I get (relatively speaking) a lot of invalid results too, as well as "inconclusive" ones. Certainly at a much higher percentage than on any other project I am crunching for.
All hosts on my side running DENNIS are Windows 10, Windows Server 2016/2019, one MacBook Pro and a couple of Windows 7 hosts still...

Ralf
16) Message boards : Number crunching : Weird issue with "Ghost work units" on one host (Message 2258)
Posted 16 Feb 2024 by TPCBF
Post:
this is an issue with BOINC RPC protocol
if certain packets get lost in transit, the server has sent the tasks to the client and records that fact, the client never got them so they don't show up, and the protocol issue is that there is no acknowledgement to cope with the data loss
i believe there is a server option to resend lost tasks, but that it has been known to be awkward, so it isn't widely used
the "workaround" is just to wait until the server expires them and resends the tasks



This sounds plausible. Remote Procedure Calls (RPC) often use User Datagram Protocol (UPD) which which broadcasts packets and doesn't care if they get to where they should go. It's a well know tradeoff in the IP portion of TCP/IP.
Just rather weird that this happens with only one host out of about a dozen, in the same location, with a very high speed Internet connection.
Haven't seen it since either, though I have been too busy to keep an close eye on those machines. I prefer "fire and forget" ... ;-)

Ralf
17) Message boards : Number crunching : Weird issue with "Ghost work units" on one host (Message 2238)
Posted 12 Dec 2023 by TPCBF
Post:
Don't think that this was related to the time of the DB maintenance/stats update. It has happened only once so far, off by a couple of hours from that, and I didn't notice anything similar on any other BOINC project in the about 15 years that I crunch on several other projects. It might have been a problem +10 years ago on Rosetta, and possibly one of the reasons why I switched away from it 13 years ago and mainly to WCG (which now for +2 years is a completely different can of worms now :( ).
I am fairly new to DENIS, about two months now, as an alternate to WCG, and still try to get used to the project specific peculiarities here. So not sure if something like those ghost WUs is a more common issue.
We will see if it happens again, so far everything works rather smoothly when a new wave of WUs is available...

Ralf
18) Message boards : Number crunching : Weird issue with "Ghost work units" on one host (Message 2234)
Posted 28 Nov 2023 by TPCBF
Post:
Well, the bottom line is that this seems to be something that needs to be fixed on the server side. The possible problem that is see is that the hosts (to none of their faults at all) at some point are going to be considered "unreliable" for the project... :(

Ralf
19) Message boards : Number crunching : Weird issue with "Ghost work units" on one host (Message 2231)
Posted 28 Nov 2023 by TPCBF
Post:
23:00 UTC is about the time they shut down each day for a while so likely an artifact of that.
ISTR uploads complete during downtime but reports/requests get 3600 second backoff.

Sorry Paul, but I don't see how this is related to the actual problem of those ghost WUs?

Ralf
20) Message boards : Number crunching : Weird issue with "Ghost work units" on one host (Message 2229)
Posted 28 Nov 2023 by TPCBF
Post:
Just noticed this morning (Pacific Time) that the web site shows almost 40 WUs, send out on 11/24 23:04UTC for this particular host (Windows 10) as "In progress". However, no such DENIS WUs are actually showing up in the Tasks list of the BOINC client (yes, it is set to show "all" tasks, and it shows task from another BOINC project).

Any ideas what is going on?

Ok, EOD here in LA, 03:07UTC and now all those 38 WUs on this host have been removed and labeled as error "no reply" even though those did never show up on this machine....

:(


Next 20