𝕏

Compression of output files

Message boards : Number crunching : Compression of output files
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Crunch3r

Send message
Joined: 9 Apr 15
Posts: 16
Credit: 20,823,669
RAC: 0
Message 1177 - Posted: 1 Apr 2017, 17:31:20 UTC

Howdy,

can we please have the output files compressed ?
I'm on a very slow DSL connection and having 5 computers upload results at the same time is ..well, draging my internet speed to almost a halt :(

It makes quite a difference uploading an uncompressed result with ~342kb and a compressed one ~71kb.

https://boinc.berkeley.edu/trac/wiki/FileCompression#compress-output

Thanks.
ID: 1177 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Henk Haneveld

Send message
Joined: 31 Jul 15
Posts: 7
Credit: 189,411
RAC: 0
Message 1179 - Posted: 2 Apr 2017, 7:45:44 UTC - in response to Message 1177.  

There is a option in the BOINC computing preferences (network tab) to put a limit on the upload rate.

On the Daily schedules tab you can set transfer time slots. Perhaps a different time for each host.
ID: 1179 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Crunch3r

Send message
Joined: 9 Apr 15
Posts: 16
Credit: 20,823,669
RAC: 0
Message 1180 - Posted: 2 Apr 2017, 16:05:04 UTC - in response to Message 1179.  
Last modified: 2 Apr 2017, 16:06:27 UTC

There is a option in the BOINC computing preferences (network tab) to put a limit on the upload rate.

On the Daily schedules tab you can set transfer time slots. Perhaps a different time for each host.


You're missing the point. Doing what you purpose would limit other projects(running on gpu/asic blocking upload).

I need the output files from DENIS to be compressed to reduce upload overhead.
(don't take it wrong, but please comment only if you're qualified/project admins no noob replies please, thank you).
ID: 1180 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Henk Haneveld

Send message
Joined: 31 Jul 15
Posts: 7
Credit: 189,411
RAC: 0
Message 1184 - Posted: 3 Apr 2017, 8:38:56 UTC - in response to Message 1180.  

There is a option in the BOINC computing preferences (network tab) to put a limit on the upload rate.

On the Daily schedules tab you can set transfer time slots. Perhaps a different time for each host.


You're missing the point. Doing what you purpose would limit other projects(running on gpu/asic blocking upload).

I need the output files from DENIS to be compressed to reduce upload overhead.
(don't take it wrong, but please comment only if you're qualified/project admins no noob replies please, thank you).


I do take this wrong. I am a retired DBA so I know something about computers. I also have been doing this sinds the first SETI classic program.

I was just pointing out options. You can use them or ignore them but there is no need to be insulting in your answer.
ID: 1184 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile jcastro
Avatar

Send message
Joined: 16 Mar 15
Posts: 219
Credit: 14,859
RAC: 0
Message 1188 - Posted: 4 Apr 2017, 8:17:01 UTC

Hello!

we thought that those files were small to uses cpu time to compress them. But yes, it could be an improvement for the next version. We will take it into account, analyze the pros and the cons and release that improvement with new additions for the next version.

Best regards, Joel.
ID: 1188 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : Number crunching : Compression of output files