Bziped summary files corrupted

[Kakao]

The bziped versions of the summary files are corrupted. Don't know if they are generated that way or if the download is so slow that errors are introduced. It has been like this for the last 24 hours.

[HaloJones]

is that's what's breaking your wonderful stats?

[Kakao]

Yes, that is it. And my code is not prepared to handle the uncompressed version as it takes very long to download in my ADSL connection. And thanks for the wonderful.

[sortofageek]

I hear a lot of praise for your stats from my team mates. They really are very well done.

[artoar_11]

Already 30 hours KakaoStats not upgraded. Someone should do something. Very useful and detailed statistics. We lack. Where is the problem, in Stanford or servers Kakao?

[k1wi]

The problem is with the bzip files that Kakao's parsing, as he says it could be the result of the connection between him and Stanford, or it might be a problem @ Stanford's end. Has anyone else tried out the bzip file? (I would attempt to, but my file DL is shaped to 5kB/s during the day).

[shdbcamping]

The problem is with the bzip files that Kakao's parsing, as he says it could be the result of the connection between him and Stanford, or it might be a problem @ Stanford's end. Has anyone else tried out the bzip file? (I would attempt to, but my file DL is shaped to 5kB/s during the day).

Unless Kakao did a dummy thing... My money is on server. I would thing Kakao's connection has not changed. YMMV

[k1wi]

I managed to download the file & didn't get any problems unpacking it; there could be a problem with how it's outputting: I'm hosting the unzipped file if anyone wants to PM me I can give you the link. (don't think you'll get the whole download though - I'm on adsl lol.

[artoar_11]

Maybe the problem is fixed. Now the statistics are updated.
Thanks.

[Kakao]

k1wi, did you download this one:?

http://fah-web.stanford.edu/daily_user_summary.txt.bz2

How did you test it? I do it like this:

$ bzip2 -t daily_user_summary.txt.bz2

Now I suspect the problem is on the path from Stanford to my modem since the download is very slow. This is my traceroute. If someone could interpret it:

Code: Select all

$ traceroute fah-web.stanford.edu
traceroute to fah-web.stanford.edu (171.65.103.94), 30 hops max, 60 byte packets
 1  10.1.1.1 (10.1.1.1)  1.606 ms  2.220 ms  2.831 ms
 2  BrT-L10-bsace704-vrdef.dsl.brasiltelecom.net.br (201.10.168.254)  25.153 ms  29.177 ms  30.635 ms
 3  BrT-V746-bsaco300.brasiltelecom.net.br (201.10.248.133)  33.889 ms  36.019 ms  41.432 ms
 4  po2-2.core02.mia03.atlas.cogentco.com (154.54.11.109)  186.526 ms  190.685 ms  191.641 ms
 5  te4-4.ccr01.mia03.atlas.cogentco.com (154.54.2.42)  195.159 ms  199.537 ms *
 6  te2-3.ccr01.mia01.atlas.cogentco.com (154.54.24.233)  204.658 ms  165.735 ms te4-3.ccr01.mia01.atlas.cogentco.com (154.54.1.185)  166.879 ms
 7  te8-2.ccr01.iah01.atlas.cogentco.com (154.54.24.193)  195.720 ms te8-2.ccr02.iah01.atlas.cogentco.com (154.54.25.74)  197.740 ms te8-2.ccr01.iah01.atlas.cogentco.com (154.54.24.193)  200.513 ms
 8  te2-1.ccr02.lax01.atlas.cogentco.com (154.54.5.194)  240.064 ms te3-2.ccr01.lax01.atlas.cogentco.com (154.54.0.225)  241.837 ms te9-2.mpd02.lax01.atlas.cogentco.com (154.54.0.253)  245.686 ms
 9  te1-7.ccr02.sfo01.atlas.cogentco.com (154.54.5.234)  262.651 ms te4-5.mpd01.sfo01.atlas.cogentco.com (154.54.3.94)  266.343 ms te1-7.ccr02.sfo01.atlas.cogentco.com (154.54.5.234)  268.471 ms
10  * te4-2.mpd01.sjc04.atlas.cogentco.com (154.54.2.166)  273.915 ms *
11  Stanford_University2.demarc.cogentco.com (66.250.7.138)  280.537 ms  283.880 ms  243.465 ms
12  boundarya-rtr.Stanford.EDU (68.65.168.33)  311.614 ms  312.332 ms  312.174 ms
13  * * *
14  * * *
15  * * *
16  * * *
17  * * *
18  * * *
19  * * *
20  * * *
21  * * *
22  * * *
23  * * *
24  * * *
25  * * *
26  * * *
27  * * *
28  * * *
29  * * *
30  * * *

[P5-133XL]

A trace route is not going to be able to find the link that is corrupting a transmission. Too little data is being transfered. All you will be able to determine is the path taken; how long it took; and if someone dropped the ping.

The first thing to be done if you find corruption is simply download it a second time. With a little luck, the issue was temporary and won't happen a second time. If both files are identical then most likely the corruption was from the source (Stanford). If the files differ then it is likely that the problem occurred after the file left Stanford.

[toTOW]

Cogent ... I also have many troubles with many sites hosted on their network ...

My route looks like yours as soon as I get out of my ISP network and move on cogent one :

Code: Select all

Détermination de l'itinéraire vers vspm27.stanford.edu [171.65.103.94]
avec un maximum de 30 sauts :

  1     1 ms    <1 ms    <1 ms  192.168.0.1
  2    43 ms    42 ms    43 ms  ABordeaux-257-1-113-1.w90-55.abo.wanadoo.fr [90.
55.8.1]
  3    43 ms    43 ms    42 ms  10.125.179.206
  4    42 ms    43 ms    42 ms  xe-8-3-0-0.ncbor102.Bordeaux.francetelecom.net [
193.253.94.85]
  5    49 ms    49 ms    49 ms  xe-3-1-0-0.nrpoi202.Poitiers.francetelecom.net [
81.253.131.150]
  6    56 ms    56 ms    57 ms  193.252.161.54
  7    57 ms    56 ms    56 ms  te8-3.parse1.Paris.opentransit.net [193.251.128.
70]
  8    56 ms    55 ms    55 ms  te2-4.parse7.Paris.opentransit.net [193.251.129.
174]
  9    56 ms    56 ms    56 ms  cogent.GW.opentransit.net [193.251.254.242]
 10   137 ms   139 ms   140 ms  te0-3-0-2.mpd21.jfk02.atlas.cogentco.com [154.54
.1.93]
 11   175 ms   177 ms   177 ms  te1-8.mpd01.ord01.atlas.cogentco.com [154.54.29.
157]
 12   181 ms   182 ms   179 ms  te0-3-0-1.mpd21.mci01.atlas.cogentco.com [154.54
.7.138]
 13     *        *        *     Délai d'attente de la demande dépassé.
 14     *      228 ms     *     te7-4.mpd01.sjc04.atlas.cogentco.com [154.54.28.
82]
 15   217 ms   219 ms   220 ms  Stanford_University2.demarc.cogentco.com [66.250
.7.138]
 16   227 ms   228 ms   227 ms  bnda-rtr-1.Stanford.EDU [68.65.168.33]
 17     *        *        *     Délai d'attente de la demande dépassé.
 18     *        *        *     Délai d'attente de la demande dépassé.
 19     *        *        *     Délai d'attente de la demande dépassé.
 20   222 ms   220 ms   219 ms  vspm27.Stanford.EDU [171.65.103.94]

Itinéraire déterminé.

[HaloJones]

Off-topic.

Code: Select all

Délai d'attente de la demande dépassé.

gotta love French computer error messages!

[k1wi]

Hey Kakao - I saw your site's message. I hope you can get it fixed without too much work. It's a great service.

k1wi

[HaloJones]

Ditto. Nothing bad about the other stats sites but I just like yours better. I hope this can be resolved for you. Can you detail the specific problem you have with the downloaded files and maybe someone here can host them for you as a relay to avoid the issue?

try this:

http://www.btinternet.com/~mike.timbers ... ry.txt.bz2