Beta of DENIS-fiber (beta test) Windows performance
Message boards :
Number crunching :
Beta of DENIS-fiber (beta test) Windows performance
Message board moderation
Author | Message |
---|---|
Send message Joined: 21 May 15 Posts: 10 Credit: 30,804 RAC: 77 ![]() ![]() |
The Linux version takes about 10 minutes to run, with most of the time seemingly spent on Math#exp, which is optimized using AVX and FMA (likely by glibc) However, on similar hardware, the Windows version takes over an hour. At first, I suspected a compiler difference or that Windows libraries might not fully leverage SIMD, but the profiler indicates that most of the time is spent on JSON parsing? Could that be the issue? The CPU utilization is also low. The compilers should be: GCC 9.4.0 on Linux GCC 14.2.0 on Windows If the source code is available somewhere, I can examine it more closely. Thanks! |
Send message Joined: 21 May 15 Posts: 10 Credit: 30,804 RAC: 77 ![]() ![]() |
ok, I found the code. I'm wondering if this change has already been included: https://bitbucket.org/comba_usj/denis-fiber/commits/f42772aaafa3ae5fa9f6d6fa30c9cff0a02610a2 I need to test it, but it seems that jsoncpp is utilizing the app on Windows when it really shouldn't... |
Send message Joined: 9 Apr 15 Posts: 207 Credit: 1,573,819 RAC: 113 ![]() ![]() ![]() ![]() |
This could be a breakthrough for the windows app... |
Send message Joined: 9 Apr 15 Posts: 207 Credit: 1,573,819 RAC: 113 ![]() ![]() ![]() ![]() |
I hope that admins will read this thread and will contact you... |
![]() ![]() Send message Joined: 18 Mar 15 Posts: 317 Credit: 3,636,673 RAC: 8,002 ![]() ![]() ![]() ![]() ![]() |
I have read the post and send it to Iván. Thank you! Jesús Carro Universidad San Jorge @InSilicoHeart |
![]() Send message Joined: 21 Nov 24 Posts: 15 Credit: 46,206 RAC: 303 ![]() ![]() ![]() |
Good afternoon everyone! Jesus told me about the windows problems, and I think I know what the problem is, but I'm going to check it right now to give you a solution! I think it's because of the way I compile the jsoncpp library in windows, because, due to the lack of documentation for its compilation with cmake, I had to look for a little bit for myself and find the way to compile it. As I have been reading, it is true that in Linux and MacOS it behaves very well, but in windows I don't know why it doesn't behave in the same way. I'm going to check it to give you a solution as soon as possible, first I'll test it locally before deploying it on the server, but I'll update the repository if somehow I manage to optimize it. Currently, we are working under the beta_0.02 tag https://bitbucket.org/comba_usj/denis-fiber/src/beta_0.02/ (which I hadn't uploaded and thought I had, but now it should be all up to date). Greetings to all, I'll keep you informed. |
Send message Joined: 9 Apr 15 Posts: 207 Credit: 1,573,819 RAC: 113 ![]() ![]() ![]() ![]() |
Great!! |
![]() Send message Joined: 21 Nov 24 Posts: 15 Credit: 46,206 RAC: 303 ![]() ![]() ![]() |
Good morning everyone: I have solved the problem, which was indeed a problem in the performance of the compilation of MinGW. Although it has cost me a kind of hours, I have been able to fix the compilation with the Visual Studio Build Tools, and now it is up to 4 times faster (which makes it similar to the time cost of other platforms). I am now moving the build environment from my machine to Docker, to be consistent, and once that is done, we will generate the new build binaries for windows. I have contacted Jesus to apply the changes, but it is only a matter of time before we release a new version with this problem solved. Thank you very much for your patience. Best regards, Ivan. |
Send message Joined: 7 Nov 15 Posts: 13 Credit: 30,182,964 RAC: 1,955 ![]() ![]() ![]() ![]() ![]() |
Great news!!! |
Send message Joined: 18 Nov 16 Posts: 24 Credit: 11,532,236 RAC: 4,532 ![]() ![]() ![]() ![]() ![]() |
Yes great news. I can only connect via a windows PC. |
Send message Joined: 9 Apr 15 Posts: 207 Credit: 1,573,819 RAC: 113 ![]() ![]() ![]() ![]() |
Well done!! |
![]() Send message Joined: 21 Nov 24 Posts: 15 Credit: 46,206 RAC: 303 ![]() ![]() ![]() |
Good morning! Finally I have been able to move the compilation of my local machine to Docker, it has cost me because I had problems with the dependencies that were really necessary for the compilation of BOINC, as it is constantly changing the requirements that are asked to compile, the previous simulator was almost obsolete, and as locally with the visual interface is always installed more, I wanted to optimize as much as possible the compilation. If you want to take a look at the repository, I leave here the link to the new release for you to check it out: https://bitbucket.org/comba_usj/denis-fiber/src/beta_0.03/ Now we simply have to incorporate the new version of the application into the project, but everything is going as expected. Thanks a lot! Regards, Ivan. |
Send message Joined: 9 Apr 15 Posts: 207 Credit: 1,573,819 RAC: 113 ![]() ![]() ![]() ![]() |
Good morning! Well done. I think your hard work will paid off (in Windows environment)!! |
Send message Joined: 6 Mar 23 Posts: 62 Credit: 2,407,120 RAC: 2,283 ![]() ![]() ![]() ![]() ![]() |
I notice that my Windows 11 machine still takes about 1 hour 45 minutes per work unit, where my Linux machine takes just avout 21 minutes. Both are still version 0.02, so I guess the Windows 0.03 version has not yet made it to my machine yet. ![]() |
Send message Joined: 18 Nov 16 Posts: 24 Credit: 11,532,236 RAC: 4,532 ![]() ![]() ![]() ![]() ![]() |
|
![]() Send message Joined: 21 Nov 24 Posts: 15 Credit: 46,206 RAC: 303 ![]() ![]() ![]() |
Hello everybody, As I don't have direct access to the server (only Jesus has access), and since this week is a holiday in Spain for schools, it might take a bit longer than expected to make the 0.03 version released on the server. Although everything is already prepared, so it will be immediate when upgrading to the new version. We have had a few days a bit harder, since the university asked me to deliver an intermediate level delivery of the final degree project. Although I'm still developing at full speed, and I don't want to make you spoilers but I think that in 1-2 weeks we will be able to release a new version with the first checkpoints. We will keep you informed. Sorry for the inconvenience. Best regards, Iván. |
Send message Joined: 21 May 15 Posts: 10 Credit: 30,804 RAC: 77 ![]() ![]() |
great news, thanks! |
Send message Joined: 25 Dec 23 Posts: 4 Credit: 2,136,117 RAC: 3,471 ![]() ![]() ![]() ![]() ![]() |
No idea what all that was actually about... but if it makes my windoze machine crunch faster... I'm happy. Thank you for the amazing work. |
![]() Send message Joined: 21 Nov 24 Posts: 15 Credit: 46,206 RAC: 303 ![]() ![]() ![]() |
We have now upgraded to the new version. Jesus has sent some test tasks. I'm waiting now to see how the performance optimisation of the new compiled version goes. Best regards, Ivan. |
Send message Joined: 21 May 15 Posts: 10 Credit: 30,804 RAC: 77 ![]() ![]() |
|