𝕏

Beta of DENIS-fiber (beta test) Windows performance

Message boards : Number crunching : Beta of DENIS-fiber (beta test) Windows performance
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
ahorek's team

Send message
Joined: 21 May 15
Posts: 10
Credit: 30,804
RAC: 77
Message 2668 - Posted: 30 Mar 2025, 21:21:12 UTC

The Linux version takes about 10 minutes to run, with most of the time seemingly spent on Math#exp, which is optimized using AVX and FMA (likely by glibc)

However, on similar hardware, the Windows version takes over an hour. At first, I suspected a compiler difference or that Windows libraries might not fully leverage SIMD, but the profiler indicates that most of the time is spent on JSON parsing? Could that be the issue? The CPU utilization is also low.

The compilers should be:
GCC 9.4.0 on Linux
GCC 14.2.0 on Windows

If the source code is available somewhere, I can examine it more closely. Thanks!
ID: 2668 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ahorek's team

Send message
Joined: 21 May 15
Posts: 10
Credit: 30,804
RAC: 77
Message 2669 - Posted: 30 Mar 2025, 22:45:28 UTC
Last modified: 30 Mar 2025, 22:45:41 UTC

ok, I found the code. I'm wondering if this change has already been included: https://bitbucket.org/comba_usj/denis-fiber/commits/f42772aaafa3ae5fa9f6d6fa30c9cff0a02610a2

I need to test it, but it seems that jsoncpp is utilizing the app on Windows when it really shouldn't...
ID: 2669 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 9 Apr 15
Posts: 207
Credit: 1,573,819
RAC: 113
Message 2672 - Posted: 31 Mar 2025, 6:54:18 UTC - in response to Message 2669.  

This could be a breakthrough for the windows app...
ID: 2672 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 9 Apr 15
Posts: 207
Credit: 1,573,819
RAC: 113
Message 2796 - Posted: 8 Apr 2025, 12:14:10 UTC

I hope that admins will read this thread and will contact you...
ID: 2796 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jesús Carro
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 18 Mar 15
Posts: 317
Credit: 3,636,673
RAC: 8,002
Message 2803 - Posted: 9 Apr 2025, 13:03:06 UTC - in response to Message 2796.  

I have read the post and send it to Iván. Thank you!
Jesús Carro
Universidad San Jorge
@InSilicoHeart
ID: 2803 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile ivanbisimbrero
Project developer
Project scientist

Send message
Joined: 21 Nov 24
Posts: 15
Credit: 46,206
RAC: 303
Message 2805 - Posted: 9 Apr 2025, 13:38:32 UTC

Good afternoon everyone!
Jesus told me about the windows problems, and I think I know what the problem is, but I'm going to check it right now to give you a solution!
I think it's because of the way I compile the jsoncpp library in windows, because, due to the lack of documentation for its compilation with cmake, I had to look for a little bit for myself and find the way to compile it. As I have been reading, it is true that in Linux and MacOS it behaves very well, but in windows I don't know why it doesn't behave in the same way.

I'm going to check it to give you a solution as soon as possible, first I'll test it locally before deploying it on the server, but I'll update the repository if somehow I manage to optimize it.

Currently, we are working under the beta_0.02 tag https://bitbucket.org/comba_usj/denis-fiber/src/beta_0.02/ (which I hadn't uploaded and thought I had, but now it should be all up to date).

Greetings to all, I'll keep you informed.
ID: 2805 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 9 Apr 15
Posts: 207
Credit: 1,573,819
RAC: 113
Message 2812 - Posted: 10 Apr 2025, 8:21:24 UTC - in response to Message 2805.  

Great!!
ID: 2812 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile ivanbisimbrero
Project developer
Project scientist

Send message
Joined: 21 Nov 24
Posts: 15
Credit: 46,206
RAC: 303
Message 2813 - Posted: 10 Apr 2025, 9:12:05 UTC - in response to Message 2812.  

Good morning everyone:

I have solved the problem, which was indeed a problem in the performance of the compilation of MinGW. Although it has cost me a kind of hours, I have been able to fix the compilation with the Visual Studio Build Tools, and now it is up to 4 times faster (which makes it similar to the time cost of other platforms). I am now moving the build environment from my machine to Docker, to be consistent, and once that is done, we will generate the new build binaries for windows.

I have contacted Jesus to apply the changes, but it is only a matter of time before we release a new version with this problem solved.

Thank you very much for your patience.

Best regards,

Ivan.
ID: 2813 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
TheFiend

Send message
Joined: 7 Nov 15
Posts: 13
Credit: 30,182,964
RAC: 1,955
Message 2814 - Posted: 10 Apr 2025, 12:56:23 UTC

Great news!!!
ID: 2814 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mmonnin

Send message
Joined: 18 Nov 16
Posts: 24
Credit: 11,532,236
RAC: 4,532
Message 2822 - Posted: 11 Apr 2025, 8:59:48 UTC

Yes great news. I can only connect via a windows PC.
ID: 2822 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 9 Apr 15
Posts: 207
Credit: 1,573,819
RAC: 113
Message 2823 - Posted: 11 Apr 2025, 10:47:15 UTC - in response to Message 2813.  

Well done!!
ID: 2823 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile ivanbisimbrero
Project developer
Project scientist

Send message
Joined: 21 Nov 24
Posts: 15
Credit: 46,206
RAC: 303
Message 2852 - Posted: 14 Apr 2025, 10:08:37 UTC

Good morning!

Finally I have been able to move the compilation of my local machine to Docker, it has cost me because I had problems with the dependencies that were really necessary for the compilation of BOINC, as it is constantly changing the requirements that are asked to compile, the previous simulator was almost obsolete, and as locally with the visual interface is always installed more, I wanted to optimize as much as possible the compilation.

If you want to take a look at the repository, I leave here the link to the new release for you to check it out: https://bitbucket.org/comba_usj/denis-fiber/src/beta_0.03/

Now we simply have to incorporate the new version of the application into the project, but everything is going as expected.

Thanks a lot!

Regards,

Ivan.
ID: 2852 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[VENETO] boboviz

Send message
Joined: 9 Apr 15
Posts: 207
Credit: 1,573,819
RAC: 113
Message 2854 - Posted: 14 Apr 2025, 13:52:09 UTC - in response to Message 2852.  

Good morning!
Finally I have been able to move the compilation of my local machine to Docker, it has cost me because I had problems with the dependencies that were really necessary for the compilation of BOINC, as it is constantly changing the requirements that are asked to compile, the previous simulator was almost obsolete, and as locally with the visual interface is always installed more, I wanted to optimize as much as possible the compilation.


Well done.
I think your hard work will paid off (in Windows environment)!!
ID: 2854 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 6 Mar 23
Posts: 62
Credit: 2,407,120
RAC: 2,283
Message 2867 - Posted: 15 Apr 2025, 18:29:16 UTC - in response to Message 2852.  

I notice that my Windows 11 machine still takes about 1 hour 45 minutes per work unit, where my Linux machine takes just avout 21 minutes. Both are still version 0.02, so I guess the Windows 0.03 version has not yet made it to my machine yet.
ID: 2867 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mmonnin

Send message
Joined: 18 Nov 16
Posts: 24
Credit: 11,532,236
RAC: 4,532
Message 2874 - Posted: 16 Apr 2025, 1:09:14 UTC

https://denis.usj.es/denisathome/apps.php

Apps page says its not released.
ID: 2874 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile ivanbisimbrero
Project developer
Project scientist

Send message
Joined: 21 Nov 24
Posts: 15
Credit: 46,206
RAC: 303
Message 2885 - Posted: 17 Apr 2025, 10:40:31 UTC - in response to Message 2874.  

Hello everybody,

As I don't have direct access to the server (only Jesus has access), and since this week is a holiday in Spain for schools, it might take a bit longer than expected to make the 0.03 version released on the server. Although everything is already prepared, so it will be immediate when upgrading to the new version.

We have had a few days a bit harder, since the university asked me to deliver an intermediate level delivery of the final degree project. Although I'm still developing at full speed, and I don't want to make you spoilers but I think that in 1-2 weeks we will be able to release a new version with the first checkpoints.

We will keep you informed. Sorry for the inconvenience.

Best regards,

Iván.
ID: 2885 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ahorek's team

Send message
Joined: 21 May 15
Posts: 10
Credit: 30,804
RAC: 77
Message 2893 - Posted: 17 Apr 2025, 15:52:39 UTC - in response to Message 2885.  

great news, thanks!
ID: 2893 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
The Real Weasle

Send message
Joined: 25 Dec 23
Posts: 4
Credit: 2,136,117
RAC: 3,471
Message 2921 - Posted: 20 Apr 2025, 8:41:03 UTC

No idea what all that was actually about... but if it makes my windoze machine crunch faster... I'm happy.

Thank you for the amazing work.
ID: 2921 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile ivanbisimbrero
Project developer
Project scientist

Send message
Joined: 21 Nov 24
Posts: 15
Credit: 46,206
RAC: 303
Message 2941 - Posted: 22 Apr 2025, 13:16:50 UTC - in response to Message 2921.  

We have now upgraded to the new version. Jesus has sent some test tasks.

I'm waiting now to see how the performance optimisation of the new compiled version goes.

Best regards,

Ivan.
ID: 2941 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ahorek's team

Send message
Joined: 21 May 15
Posts: 10
Credit: 30,804
RAC: 77
Message 2993 - Posted: 24 Apr 2025, 13:41:19 UTC

The performance issue has been fixed. Thanks!

ID: 2993 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Beta of DENIS-fiber (beta test) Windows performance