𝕏

Stat's Export

Message boards : Number crunching : Stat's Export
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Profile Bill F
Avatar

Send message
Joined: 7 Feb 17
Posts: 21
Credit: 659,316
RAC: 3,102
Message 1558 - Posted: 25 Mar 2022, 13:46:08 UTC

Please restart export of Stat's for those of us that have enabled Stat's export.

Thank you
Bill F
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 1558 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jesús Carro
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 18 Mar 15
Posts: 269
Credit: 494,175
RAC: 78
Message 1560 - Posted: 25 Mar 2022, 15:26:28 UTC

Done!

You are welcome!
Jesús Carro
Universidad San Jorge
@InSilicoHeart
ID: 1560 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 7 Feb 17
Posts: 21
Credit: 659,316
RAC: 3,102
Message 1571 - Posted: 27 Mar 2022, 1:49:53 UTC - in response to Message 1560.  

Done!

You are welcome!


So far the Stat for "Teams" has updated.

Thanks
Bill
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 1571 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 7 Feb 17
Posts: 21
Credit: 659,316
RAC: 3,102
Message 1583 - Posted: 29 Mar 2022, 11:47:11 UTC

The Stat's exports still do not appear to be updating correctly. Here are the current time stamps

Last update user XML 2020-02-24 17:10:09 UTC (763 days 16:18:31 old)
Last update host XML 2020-02-23 17:10:09 UTC (764 days 16:18:31 old)
Last update team XML 2022-03-28 20:45:06 UTC (12:43:34 old)

Thanks
Bill F
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 1583 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jesús Carro
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 18 Mar 15
Posts: 269
Credit: 494,175
RAC: 78
Message 1587 - Posted: 29 Mar 2022, 12:26:03 UTC - in response to Message 1583.  

Hi Bill,
All them are being exported

https://denis.usj.es/denisathome/stats/

Do you need any other type of export?

Thanks,
Jesús.
Jesús Carro
Universidad San Jorge
@InSilicoHeart
ID: 1587 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 7 Feb 17
Posts: 21
Credit: 659,316
RAC: 3,102
Message 1591 - Posted: 29 Mar 2022, 19:45:23 UTC - in response to Message 1587.  

Thank you I have forwarded the Stat's URL to the BOINCStat's Admin

Bill F
ID: 1591 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dirk Broer
Avatar

Send message
Joined: 13 Apr 15
Posts: 13
Credit: 1,493,325
RAC: 5,370
Message 1592 - Posted: 30 Mar 2022, 14:19:55 UTC - in response to Message 1587.  
Last modified: 30 Mar 2022, 14:22:28 UTC

Hi Bill,
All them are being exported

https://denis.usj.es/denisathome/stats/

Do you need any other type of export?

Thanks,
Jesús.


Index of /denisathome/stats
[ICO] Name Last modified Size Description
[PARENTDIR] Parent Directory -
[ ] badge_team.gz 2022-03-29 23:45 3.8K
[ ] badge_user.gz 2022-03-29 23:45 33K
[ ] db_dump.xml 2022-03-29 23:45 1.1K
[ ] host.gz 2022-03-29 23:45 67K
[ ] host_deleted.gz 2022-03-29 23:45 142
[ ] tables.xml 2022-03-29 23:45 6.2K
[ ] team.gz 2022-03-29 23:45 106K
[ ] user.gz 2022-03-29 23:45 4.4K
[ ] user_deleted.gz 2022-03-29 23:45 201


But at BOINCstats:

Last update user XML 2020-02-24 17:10:09 UTC (764 days 01:30:25 old)
Last update host XML 2020-02-23 17:10:09 UTC (765 days 01:30:25 old)
Last update team XML 2022-03-28 20:45:06 UTC (21:55:28 old)

Somehow BOINCstats seems to expect two more/other files
ID: 1592 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dirk Broer
Avatar

Send message
Joined: 13 Apr 15
Posts: 13
Credit: 1,493,325
RAC: 5,370
Message 1593 - Posted: 30 Mar 2022, 18:20:37 UTC - in response to Message 1592.  
Last modified: 30 Mar 2022, 18:21:17 UTC

https://boinc.berkeley.edu/trac/wiki/XmlStats:

tables.xml
This gives the total number of teams, users, and hosts. It also includes the UNIX time when the files were last generated, a list of the project's applications, and the list of badges defined by the project. For example:
<tables>
<update_time>1046220857</update_time>
[ <credit_by_app/> ]
<nusers>127</nusers>
<nteams>14</nteams>
<nhosts>681</nhosts>
<total_credit>1234.234</total_credit>
<applications>
<application>
<name>setiathome</name>
<results_unsent>100</results_unsent>
<results_in_progress>1000</results_in_progress>
<results_over>10000</results_over>
</application>
...
</applications>
<badges>
<badge>
<id>10</id>
<name>user_pct_2</name>
<title>Top 25% in average credit</name>
<image_url>img/pct_25.png</image_url>
</badge>
...
</badges>
</tables>
host.gz
List of hosts
team.gz
List of teams
user.gz
List of users
badge_user.gz
list of user badge assignments
badge_team.gz
list of team badge assignments
If the <credit_by_app/> flag is present in tables.xml, there will also be

user_work.gz
user credit, broken down by app
team_work.gz
team credit, broken down by app
The format of the various XML elements in the output files is as follows.

Notes:

<cpid> ('cross-project identifier') is a unique identifier across multiple projects. Accounts with the same email address on different projects will have the same cross-project identifier (as long as at least one computer is attached to both accounts).
All 'expavg_credit' values were computed at some point in the past (given by 'expavg_time'). To compute their current values, they must be scaled according to the RAC decay formula.
Text fields may contain XML entities. If you aren't using a real XML parser, you need to decode the entities yourself.
Team summary

<team>
<id>2</id>
<type>1</type>
<name>DistributedComputing@P&#197;&#130;ock</name>
<userid>9</userid>
<total_credit>52263.564346</total_credit>
<expavg_credit>0.120263</expavg_credit>
<expavg_time>1218301227.351580</expavg_time>
<founder_name>Piotr Zalewski</founder_name>
<create_time>1094061560</create_time>
[ <url>www.example.com</url> ]
[ <name_html>&lt;b>DistributedComputing@P&#197;&#130;ock&lt;/b></name_html> ]
[ <description>We are crunching...&#13;&#10;to make LHC better :)</description> ]
[ <country>Poland</country> ]
</team>
User summary

<user>
<id>12</id>
<name>John Keck</name>
<country>Uganda</country>
<create_time>1178797286</create_time>
<total_credit>42698.813543</total_credit>
<expavg_credit>117348.653646</expavg_credit>
<expavg_time>1087542007.701900</expavg_time>
<cpid>283472938743489759837498347</cpid>
[ <url>ww.boinc.us</url> ]
[ <teamid>5</teamid> ]
[ <has_profile/> ]
</user>
Host summary

<host>
<id>102</id>
<userid>3</userid>
<total_credit>0.000000</total_credit>
<expavg_credit>0.000000</expavg_credit>
<expavg_time>1087542007.701900</expavg_time>
<p_vendor>GenuineIntel</p_vendor>
<p_model>Pentium</p_model>
<os_name>Windows XP</os_name>
<os_version>5.1</os_version>
<boinc_version>[BOINC|7.4.12|GridRepublic]</boinc_version>
<vbox_version>[vbox|4.3.14]</vbox_version>
<coprocs>[CUDA|GeForce 9500 GT|1|256MB]</coprocs>
<create_time>1040170006</create_time>
<rpc_time>1217799877</rpc_time>
<timezone>28800</timezone>
<ncpus>2</ncpus>
<p_fpops>45724737.082762</p_fpops>
<p_iops>43233895.373973</p_iops>
<p_membw>4032258.064516</p_membw>
<m_nbytes>670478336.000000</m_nbytes>
<m_cache>1000000.000000</m_cache>
<m_swap>1638260736.000000</m_swap>
<d_total>9088008192.000000</d_total>
<d_free>3788505088.000000</d_free>
<n_bwup>24109.794088</n_bwup>
<n_bwdown>57037.049858</n_bwdown>
<avg_turnaround>465609.562145</avg_turnaround>
<credit_per_cpu_sec>0.000526</credit_per_cpu_sec>
<host_cpid>e129b5fa44ed8ba58e41c472822f2807</host_cpid>
</host>
The following fields are of the form [x1|x2|...|xn]. Depending on the client version, only an initial subset of items may be present.

boinc_version
The BOINC client version currently running on the host. The third item is the client "brand", such as "HTC Power to Give" or "Samsung Power Sleep".
vbox_version
The version of VirtualBox installed on the client host.
coprocs
A list of GPU descriptors. The items in each one are:
The manufacturer. "CUDA" means NVIDIA, "CAL" means AMD, and "INTEL" means Intel.
The model name.
The number of GPUs.
The amount of video RAM.
The driver version.
The OpenCL version; 102 means 1.2.
ID: 1593 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 7 Feb 17
Posts: 21
Credit: 659,316
RAC: 3,102
Message 1594 - Posted: 31 Mar 2022, 2:35:46 UTC

The response from Willie the Admin of BOINCStat's regarding the format of the DENIS Stat's Export.

"Yesterday at 14:27:36
It's a good idea to hide "Apache/2.4.41 (Ubuntu) Server at denis.usj.es Port 443" in your Apache config, it gives hackers information about your server which you don't want to share.

Otherwise the contents looks good."

Bill F
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 1594 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jesús Carro
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 18 Mar 15
Posts: 269
Credit: 494,175
RAC: 78
Message 1595 - Posted: 31 Mar 2022, 7:47:14 UTC - in response to Message 1594.  

Thank you! He is completely right. It's done.

Best,
Jesús
Jesús Carro
Universidad San Jorge
@InSilicoHeart
ID: 1595 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dirk Broer
Avatar

Send message
Joined: 13 Apr 15
Posts: 13
Credit: 1,493,325
RAC: 5,370
Message 1596 - Posted: 1 Apr 2022, 19:47:09 UTC

FreeDC has the new scores now, BOINCstats still hasn't.
ID: 1596 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 7 Feb 17
Posts: 21
Credit: 659,316
RAC: 3,102
Message 1597 - Posted: 2 Apr 2022, 0:52:13 UTC - in response to Message 1596.  

FreeDC has the new scores now, BOINCstats still hasn't.


The Admin of BOINCStat's posted this forum update...

Yesterday at 14:01:56

2022-04-01 13:50:27 URL:https://denis.usj.es/denisathome/stats/tables.xml [6396/6396] -> "/projectXML/denis_tables.xml" [1]

Starting download of https://denis.usj.es/denisathome/stats/user.gz at 2022-04-01 13:50:27

2022-04-01 13:50:28 URL:https://denis.usj.es/denisathome/stats/user.gz [5777/5777] -> "/projectXML/denis_user_id.tmp.gz" [1]

DENIS@Home user XML took 1 seconds to download

DENIS@Home user XML too small (5777 < 60683.5).


This usually indicates a problem with the exported file, for example an empty file or a broken off export. Therefor the export is ignored. Are users removed from the project resulting in this smaller file?

I know some of the accounts were lost with the Database crash before the shutdown.

Bill F


Thanks
Bill
ID: 1597 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 7 Feb 17
Posts: 21
Credit: 659,316
RAC: 3,102
Message 1598 - Posted: 2 Apr 2022, 1:01:56 UTC

I would suggest that a "news" item be released publicizing the Requirement of User authorization for stat's to be exported via User project profile. Many returning users will not know to go looking for something that was not there before.

Thanks
Bill F
In October of 1969 I took an oath to support and defend the Constitution of the United States against all enemies, foreign and domestic;
There was no expiration date.


ID: 1598 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Bill F
Avatar

Send message
Joined: 7 Feb 17
Posts: 21
Credit: 659,316
RAC: 3,102
Message 1599 - Posted: 2 Apr 2022, 23:53:22 UTC

The Admin for BOINCStat's wants to give former DENIS users a little more time to update their DENIS profile to allow export of Stat's. If he turns on reporting now anyone that has not "allowed" export of stats to "on" during the DENIS project restart would loose their prior history and points on his BOINCstat's site.

This is another reason that it would be beneficial to post a "News" article about Stat's export. That way you have at least made the attempt.

Bill F
ID: 1599 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jesús Carro
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 18 Mar 15
Posts: 269
Credit: 494,175
RAC: 78
Message 1600 - Posted: 4 Apr 2022, 15:01:00 UTC - in response to Message 1599.  

Thank you for that information, Bill. I will post later this information and I will e-mail also to warning about this new requirement.

Best,
Jesús.
Jesús Carro
Universidad San Jorge
@InSilicoHeart
ID: 1600 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Fardringle

Send message
Joined: 13 Apr 15
Posts: 1
Credit: 3,310,386
RAC: 6,004
Message 1631 - Posted: 28 Apr 2022, 2:15:40 UTC - in response to Message 1560.  

Done!

You are welcome!

Thank you!
ID: 1631 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Conan

Send message
Joined: 9 Apr 15
Posts: 35
Credit: 4,884,233
RAC: 10,212
Message 1971 - Posted: 19 Jan 2023, 6:36:51 UTC

Just wondering if Stats export has been activated now the project is back up and running?

Conan
ID: 1971 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jesús Carro
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 18 Mar 15
Posts: 269
Credit: 494,175
RAC: 78
Message 1972 - Posted: 19 Jan 2023, 10:17:17 UTC - in response to Message 1971.  

We hadn't stopped it during the break. It should be working.

Best,
Jesús
Jesús Carro
Universidad San Jorge
@InSilicoHeart
ID: 1972 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Skillz

Send message
Joined: 24 Apr 18
Posts: 3
Credit: 21,598,637
RAC: 146,369
Message 1974 - Posted: 19 Jan 2023, 15:48:39 UTC - in response to Message 1587.  

Hi Bill,
All them are being exported

https://denis.usj.es/denisathome/stats/

Do you need any other type of export?

Thanks,
Jesús.


That link gives a 404 error. Where are the stats stored?
ID: 1974 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jesús Carro
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 18 Mar 15
Posts: 269
Credit: 494,175
RAC: 78
Message 1979 - Posted: 20 Jan 2023, 9:45:34 UTC - in response to Message 1974.  

They are stored there, but for sequrity the content of the folders now is not listed. You need to request the especific files. For example: https://denis.usj.es/denisathome/stats/user.gz

Best,
Jesús.
Jesús Carro
Universidad San Jorge
@InSilicoHeart
ID: 1979 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Stat's Export