Page 1 of 2

stats.foldingathome.org broken?

Posted: Mon Apr 12, 2021 9:17 pm
by mmou
Hello everybody,

today I noticed a new stats.foldingathome.org -website.
Compared to the "statsclassic.foldingathome.org" it does not look usable / looks unhandy to me.
I.e.: In the past: Click on team-button @fah-control directing to legacy-page showed all important information,
team-users, rankings, practically linked to user-stats...
Today it leaves me with a very poor picture of the team-grand-score and work-units and -- aeh --
mostly nothing? Searching for my Team does not find the results / doesn't work?

May be, there is an issue with the browser (just Firefox/Linux)?
Do I need a bunch of special plugins activated?
Optimized for MS-users only?
Is it an alpha-test-version mistakenly published?

Any hint (instead of clicking on "statsclassic.foldingathome.org" / searching my team manually) ?

Thanks in advance...

Re: stats.foldingathome.org broken?

Posted: Mon Apr 12, 2021 9:39 pm
by JimboPalmer
I use EOC rather than the official stats, I just like it better.

https://folding.extremeoverclocking.com ... =&u=429597
https://folding.extremeoverclocking.com ... hp?s=&t=14

Re: stats.foldingathome.org broken?

Posted: Tue Apr 13, 2021 1:33 pm
by petrkovacs
I noticed the stats URL change because the website http://localhost:7396/ stopped showing me my points. But everything is back to normal and the old website https://stats.foldingathome.org/ looks as usual again.

https://foldingathome.org/statistics/

Re: stats.foldingathome.org broken?

Posted: Tue Apr 13, 2021 6:30 pm
by dan39johnson
I am no longer able to download the stats for my team directly. I have been pulling down the stats a few times per day for 4 active team members directly with a python script from "https://stats.foldingathome.org/api/donor/", but today that doesn't work. I have done it this way as it seems far more efficient than pulling down a 28 mb file and parsing that.

I've used:
with urllib.request.urlopen(strURL_full) as url:
data = json.loads(url.read().decode())
up to today, which now doesn't work.

What is the preferred approach to this?

Thanks in advance...

Re: stats.foldingathome.org broken?

Posted: Tue Apr 13, 2021 6:35 pm
by bruce
The preferred approach is to download the flat files which are provided as an alternative to the global cumulative load that the API puts on the database. The API is being deprecated.

Re: stats.foldingathome.org broken?

Posted: Tue Apr 13, 2021 8:34 pm
by DK-tastrophe
dan39johnson wrote:I have done it this way as it seems far more efficient than pulling down a 28 mb file and parsing that.
Why not download only your team flat file ? https://apps.foldingathome.org/teamstats/team211675.txt

Re: stats.foldingathome.org broken?

Posted: Wed Apr 14, 2021 12:47 am
by dan39johnson
Yes, I'd like to do that! What is the call I can make from python to get that file?

Re: stats.foldingathome.org broken?

Posted: Wed Apr 14, 2021 1:22 am
by dan39johnson
Got it--thank you! Didn't know about that app.

Re: stats.foldingathome.org broken?

Posted: Wed Apr 14, 2021 5:54 am
by DK-tastrophe
I just know that our team (#51, Alliance Francophone) still uses the team flat file since 2001 : https://fah.chezmks.fr/Alliance.html

Re: stats.foldingathome.org broken?

Posted: Wed Apr 14, 2021 3:24 pm
by dan39johnson
That is a great looking file, what do you use to produce it, language, utilities?

Re: stats.foldingathome.org broken?

Posted: Wed Apr 14, 2021 7:45 pm
by Kana-chan
Hello,

DK-tastrophe is asking me to answer you on the languages used behind.
I am the one who maintains the site.

In fact it is an old program started in 2001 by someone else. I have made the new look of the website with friends of our team.
I manage an Access 2010 database for the users and teams, and positions in the lists.
The database is fullfiled by perl scripts.
The database is read by perl scripts too and, in the same time, the website pages are created.
To retrieve the files I need for the creation of the website each day, I use wget and curl programs.

Re: stats.foldingathome.org broken?

Posted: Tue Apr 20, 2021 1:45 pm
by mmou
OK, it looks like, that the legacy version of the stats were replaced permanently?

Regardless if there are better tools like "https://folding.extremeoverclocking.com..." (thx Jimbo Palmer -- very interesting site, nice functions -- see his quote above)
and if there are performance/capacity-issues with the legacy API's and if the legacy pages look a little bit "oldscool"... Personally I think, that the functions of the legacy-version statistics are
much better to give a easy, simple and quick overview what's going on. Search-functions are working properly (including wildcards), you can examine/dig into teams, see their members, have a quick look where these donors come from and who was active for which team before... Just easy. I think, these are good features for persons who are interested in FAH and should be encouraged start folding.

Personally I like the option, that comes with the new stats where you can watch more teams than just the Top100. There are many more teams spending processor-power then just the top 100. They should be recognized as well. But: Searching for team is not possible using wildcards (you have to know the exact name, no opt to search for keywords while looking for a team to join)-- and:
When the team was found, the link leads to a very simple page just showing some points only, no further working links from there (dig into the members-list or i.e.: Jump into the top-table to compare with competing teams in the same level / range would be nice (Of course -- missing in the legacy stats as well, but as a minimum you can compare with teams starting with the same letters or so). Setting the list to 100-entries per page and clicking manually side-by-side through the top-list cant be adequate answer.

If I search for donors using my nickname (including a "_" but should be compliant as described in "https://foldingathome.org/support/faq/s ... usernames/") seems to work only, if I use the search-button a second time (what's this? -- Confusing...) ? When found and clicked, it shows the same behaviour than the teams-page -- simple page, mostly no links from there....

OK -- "the preferred way" -- just download the ASCII-Files with the statistics and building your own scripts/stats -- This may be an answer (if the user can do ...). Usage of different 3rd-party-stats-pages could be an answer --- But personally I think, that these stats-pages are a very important part to motivate people to participate to this project spending CPU/GPU-power.
Therefore -- and for (lets say "motivation+marketing-reasons") -- I suggest to have a proper function on the new stats page when published.

May be, I'm wrong with my opinion. May be there is some scripting-foo, my browser doesn't support or I misunderstood something or there are issues / reasons, I'm not aware about. Please let me know.
Thanks in advance....

Re: stats.foldingathome.org broken?

Posted: Tue Apr 20, 2021 3:02 pm
by gunnarre
The projects links from the GUI (FAHControl) are still broken too.

Re: stats.foldingathome.org broken?

Posted: Tue Apr 20, 2021 3:10 pm
by Joe_H
mmou wrote:OK, it looks like, that the legacy version of the stats were replaced permanently?
It does look like they have made the new stats the default again. The old version of the stats lookup is still available - https://statsclassic.foldingathome.org/. Feedback on design improvements or problem reports can be posted here - https://github.com/FoldingCommunity/fah ... end/issues

Re: stats.foldingathome.org broken?

Posted: Wed Apr 21, 2021 1:08 pm
by mmou
Let me point out, why I assume, that good statistic-tools are very important and are worth to
spend a lot effort .

The goal is, to bring lots of computing-power together to help the scientists doing their important work.
If there is just the main-focus on the top-100 -- where is the motivation to set up a team and start folding?
Today, there are more than some "speed-geeks" who participate to the challenge.

I just wrote some scripts, doing analyzation-stuff. Look at this...

Today:

Wed Apr 21 07:26:16 GMT 2021
-----------------------------------
Overall Points: 15853458051988
Top 100-Points: 8913439317481
56.22 % <--------------------- In fact, the most computing-power spent by the top100-teams only.
"No Team" Points: 3374010782180
21.28 %
Other-team-points: 3566007952327
22.49 % <------------------ all other teams together don't reach this level.

This was the situation about one year ago:

Sat Apr 25 17:35:44 GMT 2020
-----------------------------------
Overall Points: 5190488073985
Top 100-Points: 3912424756116
75.37 %
"No Team" Points: 460795744557
8.87 %
Other-team-points: 817267573312
15.74 %

It looks like that the ratio of the non-top-100-teams is increasing in the meantime....


Let me point out: "Together we are powerful".

Of course -- if my calculations are correct, the top100 high performing teams still spend about 56% of the computing-power.
So -- of course -- they are _very_ important for this project. But: Are the rest unimportant?
Personally I think, everybody who donates power is important .

Where is the motivation -- i.e. for lots of smaller companies, universities, schools, organizations, clubs, couples, friends (...)
to participate ? Even if they never reach the top100 ? I.e.: Why should the manager of a company/organization spend power/resources/money to support
this project? Its not the challenge -- I think, if they participate, they should be noticed+listed - with their individual (possibly strange)
team-names, web-sites and so on. They should be listed/searchable "findable" in the stats in an easy way as well. It must not be
analytic-stuff, "turbo-xxx-diagrams" or so. There should be a an easy way to get listed, to find them -- possibly comparized
with other teams in the same level -- found by keywords or some kind of wildcard-matched substrings.
Regardless, if a team is able to reach the top100 or top 1000 and "enlightened as champions" or so.

The competition for points is not as essential. They're folding, they participate in the battle against diseases/corona
so they ARE important. So they should be noticed.

In this matter, I think, the featureset/functions in the stats-page are very, very important.
And to reach this goals, this is a definitive challenge to the stats-page developers.

Just my opinion.

Thanks to everybody, who is working on this.

Best regards....