Page 2 of 2
Re: Unable to "grab" updated Team stats
Posted: Tue Oct 16, 2012 9:09 pm
by P5-133XL
I thought, from way back when, that grabbing data from the web servers (html links) was a banning offense. They made the flat files downloadable so that the data was available for anyone and the web servers wouldn't get overloaded.
Re: Unable to "grab" updated Team stats
Posted: Tue Oct 16, 2012 9:11 pm
by 7im
P5-133XL wrote:I thought, from way back when, that grabbing data from the web servers (html links) was a banning offense. They made the flat files downloadable so that the data was available for anyone and the web servers wouldn't get overloaded.
Correct.
Re: Unable to "grab" updated Team stats
Posted: Tue Oct 16, 2012 9:15 pm
by sortofageek
P5-133XL wrote:I thought, from way back when, that grabbing data from the web servers (html links) was a banning offense. They made the flat files downloadable so that the data was available for anyone and the web servers wouldn't get overloaded.
We're obviously not trying to get banned. Helix has been a team trying to do things right since nearly day one.
I seem to be communicating badly and I really don't know where to look for the answer other than here. Can you help us out? I see 7im's acceptable URLs for getting all data. Can you tell me the URL to get that only for DSLR Team Helix, Team 4? We'll be compliant, if only we are sure how to be. It's just that, in so doing, we would prefer to only download the team data.

Re: Unable to "grab" updated Team stats
Posted: Tue Oct 16, 2012 9:18 pm
by 7im
http://folding.typepad.com/news/2010/02 ... plete.html
http://folding.typepad.com/news/2010/02 ... ripts.html
You communicated just fine. But you didn't like the first answer, and so you asked the same question again. That answer won't change no matter how many times you ask it.
Any stats grabbing needs to be done using the data in the flat files linked above.
Download the flat files and filter what you want.
Re: Unable to "grab" updated Team stats
Posted: Tue Oct 16, 2012 9:29 pm
by sortofageek
Thanks for the links. February 2010, I'm sure our stats script manager was long gone and I know I was busy planning a trip about then so I see how I might have missed that meeting.
I'm guessing that means it is all or nothing, no place to download only one team's info.
Re: Unable to "grab" updated Team stats
Posted: Tue Oct 16, 2012 9:47 pm
by bollix47
Per Team Stats (team1.txt)
Some clarification might be needed on the above page. As it stands it appears there are team files generated for a set number of teams during the stats run so that cgi-bin links don't have to be used or maybe I'm reading it wrong. Hence the need for clarification.
Re: Unable to "grab" updated Team stats
Posted: Tue Oct 16, 2012 9:58 pm
by P5-133XL
If I remember correctly, the DOS attack wasn't technically an attack but more of a programming mistake by HFM.net -- They released a new version that tried to pull data off the F@H web servers every second or so to update a personalized web page without realizing the effect. A bunch of innocent folders got banned for using the program and it was a short-term mess.
Re: Unable to "grab" updated Team stats
Posted: Tue Oct 16, 2012 9:59 pm
by sortofageek
Thank you, bollix47! Exactly what I wanted to find.
And, 7im, inre your edit, you're right. I wanted a different answer. Got it.

Re: Unable to "grab" updated Team stats
Posted: Tue Oct 16, 2012 10:14 pm
by 7im
sortofageek wrote:Thank you, bollix47! Exactly what I wanted to find.
And, 7im, inre your edit, you're right. I wanted a different answer. Got it.

I didn't think they made those individual team links any more after the 2010 changes.
Wanting a different answer doesn't always bring one. You got lucky.

Re: Unable to "grab" updated Team stats
Posted: Tue Oct 16, 2012 10:22 pm
by bruce
P5-133XL wrote:A bunch of innocent folders got banned for using the program and it was a short-term mess.
It was something like that, but there's a huge difference between and running ad-hoc queries of a really big database and generating answers once per hour when access is restricted and then publishing them for everybody to download.