Compression of output files
log in

Advanced search

Message boards : Number crunching : Compression of output files

Author Message
Profile Crunch3r
Send message
Joined: 9 Apr 15
Posts: 16
Credit: 20,823,669
RAC: 0
Message 1177 - Posted: 1 Apr 2017, 17:31:20 UTC

Howdy,

can we please have the output files compressed ?
I'm on a very slow DSL connection and having 5 computers upload results at the same time is ..well, draging my internet speed to almost a halt :(

It makes quite a difference uploading an uncompressed result with ~342kb and a compressed one ~71kb.

https://boinc.berkeley.edu/trac/wiki/FileCompression#compress-output

Thanks.

Profile Henk Haneveld
Send message
Joined: 31 Jul 15
Posts: 6
Credit: 84,725
RAC: 0
Message 1179 - Posted: 2 Apr 2017, 7:45:44 UTC - in response to Message 1177.

There is a option in the BOINC computing preferences (network tab) to put a limit on the upload rate.

On the Daily schedules tab you can set transfer time slots. Perhaps a different time for each host.

Profile Crunch3r
Send message
Joined: 9 Apr 15
Posts: 16
Credit: 20,823,669
RAC: 0
Message 1180 - Posted: 2 Apr 2017, 16:05:04 UTC - in response to Message 1179.
Last modified: 2 Apr 2017, 16:06:27 UTC

There is a option in the BOINC computing preferences (network tab) to put a limit on the upload rate.

On the Daily schedules tab you can set transfer time slots. Perhaps a different time for each host.


You're missing the point. Doing what you purpose would limit other projects(running on gpu/asic blocking upload).

I need the output files from DENIS to be compressed to reduce upload overhead.
(don't take it wrong, but please comment only if you're qualified/project admins no noob replies please, thank you).

Profile Henk Haneveld
Send message
Joined: 31 Jul 15
Posts: 6
Credit: 84,725
RAC: 0
Message 1184 - Posted: 3 Apr 2017, 8:38:56 UTC - in response to Message 1180.

There is a option in the BOINC computing preferences (network tab) to put a limit on the upload rate.

On the Daily schedules tab you can set transfer time slots. Perhaps a different time for each host.


You're missing the point. Doing what you purpose would limit other projects(running on gpu/asic blocking upload).

I need the output files from DENIS to be compressed to reduce upload overhead.
(don't take it wrong, but please comment only if you're qualified/project admins no noob replies please, thank you).


I do take this wrong. I am a retired DBA so I know something about computers. I also have been doing this sinds the first SETI classic program.

I was just pointing out options. You can use them or ignore them but there is no need to be insulting in your answer.

Profile jcastro
Volunteer developer
Volunteer tester
Project scientist
Avatar
Send message
Joined: 16 Mar 15
Posts: 218
Credit: 14,859
RAC: 0
Message 1188 - Posted: 4 Apr 2017, 8:17:01 UTC

Hello!

we thought that those files were small to uses cpu time to compress them. But yes, it could be an improvement for the next version. We will take it into account, analyze the pros and the cons and release that improvement with new additions for the next version.

Best regards, Joel.


Post to thread

Message boards : Number crunching : Compression of output files


Main page · Your account · Message boards


Copyright © 2019 Universidad San Jorge