max number of task in progress

Message boards : Number crunching : max number of task in progress
Message board moderation

To post messages, you must log in.

AuthorMessage
NATE1
Avatar

Send message
Joined: 8 Apr 15
Posts: 15
Credit: 15,562
RAC: 0
Message 24 - Posted: 8 Apr 2015, 22:48:28 UTC

need to set a max number of tasks in progress per host.
just found one host with well over 600 task on it, 4 cores each task takes 30 minutes to run 12 hour deadline and...
looks like you will be getting a lot of them back, starting at about 08:00 utc
on 9 April 2015....

going on that you can not set the flop bound(?) on these tasks yet.
then max in progress would be a big help..
thanks..
ID: 24 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
NATE1
Avatar

Send message
Joined: 8 Apr 15
Posts: 15
Credit: 15,562
RAC: 0
Message 26 - Posted: 8 Apr 2015, 23:50:03 UTC

just aborted over 900 off 3 host.
hope they got the server set up correctly to resend them to new homes to get processed...

your welcome...
ID: 26 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile jcastro
Avatar

Send message
Joined: 16 Mar 15
Posts: 219
Credit: 14,859
RAC: 0
Message 39 - Posted: 9 Apr 2015, 13:22:07 UTC - in response to Message 26.  

Hello,

We are working to solve it. And yes, the aborted task are resend to complete them, thank you for your attention.
ID: 39 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile rebirther
Avatar

Send message
Joined: 8 Apr 15
Posts: 3
Credit: 380
RAC: 0
Message 41 - Posted: 9 Apr 2015, 14:11:12 UTC - in response to Message 39.  

Hello,

We are working to solve it. And yes, the aborted task are resend to complete them, thank you for your attention.


in config.xml add

<max_wus_in_progress>x</max_wus_in_progress>

x is the value for WUs * NCPUs
ID: 41 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile jcastro
Avatar

Send message
Joined: 16 Mar 15
Posts: 219
Credit: 14,859
RAC: 0
Message 43 - Posted: 9 Apr 2015, 14:15:51 UTC - in response to Message 41.  

Hello,

We are working to solve it. And yes, the aborted task are resend to complete them, thank you for your attention.


in config.xml add

<max_wus_in_progress>x</max_wus_in_progress>

x is the value for WUs * NCPUs


Thank you! we have change it one hour ago! we hope you will see that change. We are a small team and these first days are plenty of work!
ID: 43 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
NATE1
Avatar

Send message
Joined: 8 Apr 15
Posts: 15
Credit: 15,562
RAC: 0
Message 44 - Posted: 9 Apr 2015, 14:29:00 UTC - in response to Message 43.  

Hello,

We are working to solve it. And yes, the aborted task are resend to complete them, thank you for your attention.


in config.xml add

<max_wus_in_progress>x</max_wus_in_progress>

x is the value for WUs * NCPUs


Thank you! we have change it one hour ago! we hope you will see that change. We are a small team and these first days are plenty of work!


thanks,
what did you set x to?
I need to know, there maybe a problem with the count if you are running BU with ASIC attached to the same host got 2 host each with 14 ASIC on them running BU and this project, one has over 900 DENIS tasks on it and the other has over 700 DENIS tasks. may have to go back to the boinc dev for a fix. if it is counting the ASIC as cpus (cores)

anybody else seeing this?

thanks..
ID: 44 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile rebirther
Avatar

Send message
Joined: 8 Apr 15
Posts: 3
Credit: 380
RAC: 0
Message 47 - Posted: 9 Apr 2015, 14:50:20 UTC - in response to Message 44.  

Hello,

We are working to solve it. And yes, the aborted task are resend to complete them, thank you for your attention.


in config.xml add

<max_wus_in_progress>x</max_wus_in_progress>

x is the value for WUs * NCPUs


Thank you! we have change it one hour ago! we hope you will see that change. We are a small team and these first days are plenty of work!


thanks,
what did you set x to?
I need to know, there maybe a problem with the count if you are running BU with ASIC attached to the same host got 2 host each with 14 ASIC on them running BU and this project, one has over 900 DENIS tasks on it and the other has over 700 DENIS tasks. may have to go back to the boinc dev for a fix. if it is counting the ASIC as cpus (cores)

anybody else seeing this?

thanks..


For the ASICs you set it in cc_config.xml with <count>1</count>, the rest of the max_wus_in_progress is set in BU only for miners independend from this project.
ID: 47 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
NATE1
Avatar

Send message
Joined: 8 Apr 15
Posts: 15
Credit: 15,562
RAC: 0
Message 49 - Posted: 9 Apr 2015, 15:00:09 UTC

reb, I know
what I am trying to figure out is
did I just run into a case of the boinc client counting the asic not only as coproc but also as cores
so I need to know what this projects set as x for the max number of denis task * ncpu in progress

thanks
ID: 49 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile jcastro
Avatar

Send message
Joined: 16 Mar 15
Posts: 219
Credit: 14,859
RAC: 0
Message 50 - Posted: 9 Apr 2015, 15:15:54 UTC - in response to Message 49.  

reb, I know
what I am trying to figure out is
did I just run into a case of the boinc client counting the asic not only as coproc but also as cores
so I need to know what this projects set as x for the max number of denis task * ncpu in progress

thanks


Hello,

Now we setup the max_wus_in_progress to 3.

I hope this information can be helpful for you. If you have any other question please ask to us!

best regards, Joel.
ID: 50 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
NATE1
Avatar

Send message
Joined: 8 Apr 15
Posts: 15
Credit: 15,562
RAC: 0
Message 53 - Posted: 9 Apr 2015, 16:12:48 UTC - in response to Message 50.  

reb, I know
what I am trying to figure out is
did I just run into a case of the boinc client counting the asic not only as coproc but also as cores
so I need to know what this projects set as x for the max number of denis task * ncpu in progress

thanks


Hello,

Now we setup the max_wus_in_progress to 3.

I hope this information can be helpful for you. If you have any other question please ask to us!

best regards, Joel.


thanks, it does

I'm going to let it run for now the way it is, any not started by deadline will get auto aborted.
at 3 per ncpu I should have max of 9 on one host and 6 on the other,
if I end up with (3 cores + 14 miners) * 3 task max = 51 and
(2 cores + 14 miners) * 3 task max = 48 tasks then yes there is a bug.
stay tuned, same bat-time, same bat-channel
I'll let you know......
ID: 53 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
NATE1
Avatar

Send message
Joined: 8 Apr 15
Posts: 15
Credit: 15,562
RAC: 0
Message 59 - Posted: 9 Apr 2015, 18:39:25 UTC

ok, look like it was one of those one off hic ups things.
has the right number of task per core.

(I'm having a priest come over and do an exorcism on the computers because they must be possessed) :)

thanks.....
There are more things in heaven and earth, Horatio,
Than are dreamt of in your philosophy.
- Hamlet (1.5.167-8), Hamlet to Horatio

my age > Event 1

"Do not meddle in the affairs of Wizards, for they are subtle and quick to anger."
ID: 59 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ChertseyAl

Send message
Joined: 8 Apr 15
Posts: 11
Credit: 101,960
RAC: 0
Message 132 - Posted: 16 Apr 2015, 17:57:58 UTC

Now that the project seems stable (well, it is for me anyway), I wonder if the number of tasks in progress limit could be raised. Perhaps to something like 20 WU per core? Would enable us (or at least me!) to build up a bit of a cache - Just enough work for 12 or 24 hours would be great.
ID: 132 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Werinbert

Send message
Joined: 9 Apr 15
Posts: 1
Credit: 100,138
RAC: 0
Message 148 - Posted: 25 Apr 2015, 18:36:06 UTC

A slightly different problem is now occurring on my computers. I am below the max in progress limit, yet I am getting only a couple of tasks at a time and not enough to bring it up to the limit (either DENIS max or Boinc queue). Consequently my secondary projects jump in and fill my queues to the max. Thus I get 3 30-min tasks for DENIS followed by 4 6-hour tasks from a secondary project.

It could be a scheduler bug in 7.4.42 as it is new enough that I am not sure how it has changed from previous version. But more likely I see this as an issue of the server not sending enough. It may be that the server is overestimating the WU processing time and thus sending out too few WUs.

On a simple test I just did. I increased my work buffer by 1 hour per core on a 4-core machine. The server then sent me only 3 30-min tasks. Shortly there after I got 2 more tasks at 1-min intervals. Again indicating not enough WUs are sent out per request.
ID: 148 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile jcastro
Avatar

Send message
Joined: 16 Mar 15
Posts: 219
Credit: 14,859
RAC: 0
Message 149 - Posted: 27 Apr 2015, 16:28:42 UTC

Hi!

We have increase de number of WUs in progress. We are developing the new version of software which will run 3x and 10x larger simulations, we hope that with the new parameter and the future software version the traffic would be the correct.

Thank you for your help!

PD: The max number of WUs has been set to 10.
ID: 149 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
morgan

Send message
Joined: 10 Apr 15
Posts: 8
Credit: 2,083,146
RAC: 1,127
Message 150 - Posted: 27 Apr 2015, 17:36:43 UTC
Last modified: 27 Apr 2015, 18:01:50 UTC

Nice !
Now i can go to sleep, knowing that iám not running empty on wu´s, during while absent at night!

:)

EDIT
(Got only 2 pr core earlier.. so this is a great improvement )

regards
morgan
ID: 150 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
_
Avatar

Send message
Joined: 9 Apr 15
Posts: 12
Credit: 44,521
RAC: 0
Message 151 - Posted: 28 Apr 2015, 17:32:37 UTC - in response to Message 149.  
Last modified: 28 Apr 2015, 17:35:46 UTC

Thank you very much :) Looking forward to the longer work units.

No rush though. :) I'm enjoying the short ones.
ID: 151 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Trotador

Send message
Joined: 9 Apr 15
Posts: 11
Credit: 10,483,985
RAC: 275,854
Message 509 - Posted: 28 Sep 2015, 19:34:06 UTC

With the optimised applications the tasks are being crunched very quickly and continuos uploads/download occur, which stresses the servers and in some cases produce errors.

I don't know what would be preferable/easier for the project, to increase the 10 wus per thread download limit or to make wus larger. The later is my favorite.
ID: 509 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Greger

Send message
Joined: 10 Apr 15
Posts: 16
Credit: 13,445,975
RAC: 0
Message 514 - Posted: 29 Sep 2015, 16:41:35 UTC
Last modified: 29 Sep 2015, 16:44:53 UTC

I think we could make some change in setting for connection and bigger wu as Trotador saying.

When i take a look at my host they got almost same amount connection as finished task/day. Got over 4200 times per day for one host with 320 task stored. As soon on is completed it´s uploads and then download a new task every time.
Takes about 2 min for size 400 and 6 min for size 1000 to complete.

As mention in the other tread amount of task in /results.php? should have a limit. Amount of task or cleared by time.

A progressbar would be awesome to if possible.
ID: 514 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : Number crunching : max number of task in progress