Status of the project // Estado del proyecto

Message boards : News : Status of the project // Estado del proyecto
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Jesús Carro
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 18 Mar 15
Posts: 240
Credit: 460,552
RAC: 107
Message 2056 - Posted: 11 Apr 2023, 10:01:16 UTC

Dear volunteers,
We update you on the status of the project and how the simulations are going. In recent weeks the search algorithm has been improving the model very little. This indicates us that the optimization is close to be finished. Once this is complete we will pass to the validation phase which we will be done outside of DENIS (DENIS is not yet prepare for the required simulations).

The improvement obtained is very considerable (you can see the graph with the evolution of the error below and we hope that the validation results turn out well). It can be improved, but not all the error can be removed with the optimization (it requires other type of improvements in the model).

On the other hand, looking at the results, last week we started a new optimization by changing an aspect of it. In the initial search, if one of the markers was in the experimentally observed range, we did not allow the algorithm to search where that marker was outside of the experimental range (criterion of keeping at least those markers that were already in the experimental range). In the new search we are allowing it in the hope that even if some marker goes out, the overall behavior will improve. In this case, the uncertainty about the result is higher, but as you can see in the graph below, after the first iterations of the algorithm, the results are quite promising.

Sincerely,
Jesus.





========================================


Estimados voluntarios:
Os actualizamos el estado del proyecto y cómo van las simulaciones. En las últimas semanas el algoritmo de búsqueda ha ido mejorando muy poco el modelo. Esto nos indica que está a punto de terminarse la optimización. Una vez que esto se complete, pasaremos a una fase de validación de la simulación que haremos fuera de DENIS (DENIS no está preparado para ello).

La mejoría obtenida es muy considerable y esperamos que los resultados de la validación salgan bien (podéis ver la gráfica con la evolución del error debajo). Todavía hay margen de mejora, pero no todo el error se puede eliminar en la optimización (requiere otro tipo de mejoras en el modelo).

Por otro lado, viendo los resultados, la semana pasada comenzamos una nueva optimización cambiando un aspecto de la misma. En la búsqueda inicial, si uno de los marcadores estaba en el rango observado experimentalmente, no permitíamos al algoritmo buscar donde ese marcador saliera del rango experimental (criterio de mantener en rango experimental al menos los que ya estaban). En la nueva búsqueda estamos permitiéndolo con la esperanza de que aunque algún marcador salga fuera, el comportamiento global mejore. En este caso la incertidumbre sobre el resultado es algo mayor, pero como podéis ver en la gráfica de debajo, tras las primeras iteraciones del algoritmo, los resultados son bastante prometedores.

Atentamente,
Jesús.


Jesús Carro
Universidad San Jorge
@InSilicoHeart
ID: 2056 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Marcin Szydlowski

Send message
Joined: 24 Sep 22
Posts: 5
Credit: 54,393
RAC: 864
Message 2057 - Posted: 11 Apr 2023, 19:47:26 UTC - in response to Message 2056.  

Good to hear! If I understand correctly, algorithm explores more space than the neighbourhood of local attractors defined by the specific correlation of parameters (correct me if I'm wrong). It looks like the trend will be more smooth and probably will decrease the error. The next weeks will be very exciting!
ID: 2057 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jesús Carro
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 18 Mar 15
Posts: 240
Credit: 460,552
RAC: 107
Message 2070 - Posted: 14 Apr 2023, 9:42:35 UTC - in response to Message 2057.  

Hi Marcin,
Yes, the algorithm now explores more space, but based on an polinomical aproximation of the behavior of the model. The polinomical aproximation within the trust region is fixed with all the simulations you send to us.

I am also looking forward to the results of the third iteration.

Best,
Jesús.
Jesús Carro
Universidad San Jorge
@InSilicoHeart
ID: 2070 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Greg_BE

Send message
Joined: 2 Aug 22
Posts: 20
Credit: 228,373
RAC: 933
Message 2085 - Posted: 27 Apr 2023, 22:31:19 UTC

Jesus, when will there be new work from your project?
ID: 2085 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jesús Carro
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 18 Mar 15
Posts: 240
Credit: 460,552
RAC: 107
Message 2087 - Posted: 28 Apr 2023, 9:34:54 UTC - in response to Message 2085.  

Yesterday... but you are too fast getting the tasks...
Probably, we will send more tasks tomorrow

Best,
Jesús.
Jesús Carro
Universidad San Jorge
@InSilicoHeart
ID: 2087 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Chamiu

Send message
Joined: 26 Jan 23
Posts: 1
Credit: 3,040
RAC: 158
Message 2089 - Posted: 2 May 2023, 7:55:29 UTC - in response to Message 2056.  

Hi, Jesus

I hope WU to dance on Apple Silicon (macOS Ventura).

----
Chamiu (ΦωΦ)
ID: 2089 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 6 Mar 23
Posts: 10
Credit: 177,727
RAC: 2,785
Message 2093 - Posted: 29 May 2023, 16:34:38 UTC

I wish there were a way to supply more work, and more evenly.

When work becomes available, usually once a week, my machine downloads about 100 tasks. I could make it get more, but that would risk failure to complete some on time, so that is not the answer. Alternatively, you could send out work twice a week, perhaps every three or four days. As I understand it, this is not practical either because you need the results from one batch of work before you can send out the next set of work.

Perhaps if you had two related projects, each could send out the same size work once a week, but 3 or 4 days apart, so you could be studying the results of one project while we volunteers could be working on the other. That would probably increase the amount of work you would have to do, of course, and that might be too much to ask for.
ID: 2093 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jesús Carro
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 18 Mar 15
Posts: 240
Credit: 460,552
RAC: 107
Message 2094 - Posted: 31 May 2023, 7:58:20 UTC - in response to Message 2093.  

Hi Jean-David,
This is exactly our idea. Little by little, we want to add more optimizations to mantain an stable load of work. Currently, we are running 3 versions of the model optimization (each one with an small variation on the options of the algorithm). One of the limitations is that the postprocessing of your results is done out of the server, and it requieres a manual step, so the three tend to be synchronized because even if one finishes earlier, if that happens at night or during the weekend, the post-processing is done at the same time. Yesterday we sent a lot of work (from the three of them), but I guess they won't last long :-).

I will publish an update of the results the next week (we are finishing the validation process of the first version of the optimization), and I will explain there the new versions we have started (the validation of the first one does not look good, so we will still need your help).

Best,
Jesús.
Jesús Carro
Universidad San Jorge
@InSilicoHeart
ID: 2094 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jean-David Beyer

Send message
Joined: 6 Mar 23
Posts: 10
Credit: 177,727
RAC: 2,785
Message 2095 - Posted: 31 May 2023, 16:07:32 UTC - in response to Message 2094.  

I will publish an update of the results the next week (we are finishing the validation process of the first version of the optimization), and I will explain there the new versions we have started (the validation of the first one does not look good, so we will still need your help).


You will continue getting my help if you continue sending me work units. Currently I have little over 100 DENIS tasks in my machine waiting to go, and I process them four at a time. They seem to take about 65 minutes each on my main machine. And I notice the current batch on your machine is quite large, so I may get some of those too.
ID: 2095 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : News : Status of the project // Estado del proyecto