Page 1 of 1

Stats download policy

Posted: Mon Feb 08, 2010 8:47 pm
by goodyca
Vijay Pande announced on Feb 7, 2010 that the daily_user_summary.txt.bz2 and daily_team_summary.txt.bz2 files will now be updated every hour instead of every 3 hours.

Has the policy to black list ip addresses that attempt to download the above files more than 10 times per day been changed?

Re: Stats download policy

Posted: Mon Feb 08, 2010 9:01 pm
by toTOW
The IP blacklist only affects the dynamic pages (those with cgi-bin in the URL) ...

You can download these files as much as you want.

Re: Stats download policy

Posted: Mon Feb 08, 2010 11:08 pm
by goodyca
The policy I am referring to was not regarding any cgi-bin URL's. Vijay Pande specifically stated that IP addresses that attempted to download, the files that I referred to, more than 10 times per day would be banned. Vijay's policy statement regarding this occurred a couple of years ago, more or less. I searched the forum, but could not find his post.

This policy is still alluded to by with the following statement on the main Stats web page http://folding.stanford.edu/English/Stats :

"Note that the donor and team lists are generated now every 3 hours, with bzip2 versions available as well (just add .bz2 to the url):

* http://fah-web.stanford.edu/daily_user_summary.txt.bz2
* http://fah-web.stanford.edu/daily_team_summary.txt.bz2

However, downloads of the daily donor and team lists should be limited to no more than 10 downloads a day."

Re: Stats download policy

Posted: Mon Feb 08, 2010 11:17 pm
by VijayPande
The download limit is for cgi-bin urls. Flat files can be downloaded more regularly (every hour is fine). Please don't DOS attack our web servers though (eg every minute is bad, esp when multiplied by lots of people).