Ticket #1191: test_2_good_8_broken_copied_share.txt

File test_2_good_8_broken_copied_share.txt, 10.4 KB (added by francois, at 2010-09-04T23:22:27Z)
Line 
1StorageServer created
2StorageServer created
3StorageServer created
4StorageServer created
5StorageServer created
6StorageServer created
7StorageServer created
8StorageServer created
9StorageServer created
10StorageServer created
11Node constructed. allmydata-tahoe: 1.8.0c3-r4713, foolscap: 0.5.1, pycryptopp: 0.5.15, zfec: 1.4.5, Twisted: 10.0.0, Nevow: 0.10.0, zope.interface: 3.5.3, python: 2.6.5, platform: Linux-Ubuntu_10.04-i686-32bit_ELF, sqlite: 3.6.22, simplejson: 2.0.9, pycrypto: 2.0.1, pyOpenSSL: 0.10, setuptools: 0.6c16dev, pyasn1: 0.0.8a, pysqlite: 2.4.1
12init_web(webport=%s)
13CHKUploader starting
14starting upload of <allmydata.immutable.upload.EncryptAnUploadable instance at 0x8e9feac>
15creating Encoder <Encoder for unknown storage index>
16file size: 40000
17my encoding parameters: (3, 7, 10, 40002)
18got encoding parameters: 3/7/10 40002
19now setting up codec
20using storage index dglev
21storage: allocate_buckets dglevpj4ueb7e4yn35abfdlp24
22storage: allocate_buckets dglevpj4ueb7e4yn35abfdlp24
23storage: allocate_buckets dglevpj4ueb7e4yn35abfdlp24
24storage: allocate_buckets dglevpj4ueb7e4yn35abfdlp24
25storage: allocate_buckets dglevpj4ueb7e4yn35abfdlp24
26storage: allocate_buckets dglevpj4ueb7e4yn35abfdlp24
27storage: allocate_buckets dglevpj4ueb7e4yn35abfdlp24
28storage: allocate_buckets dglevpj4ueb7e4yn35abfdlp24
29storage: allocate_buckets dglevpj4ueb7e4yn35abfdlp24
30storage: allocate_buckets dglevpj4ueb7e4yn35abfdlp24
31set_shareholders; upload_servers is ['6: k6vb2bpd', '7: b3llgpww', '8: ysbz4st7', '9: xgru5adv', '1: rvsry4kn', '5: fob7vqgd', '0: 6jdspiha', '2: alg6uebm', '3: egjcec7q', '4: 7r4gd6xu'], already_peers is {}
32<Encoder for dglev> starting
33starting shareholders
34 read_encrypted handling 13334B-sized chunk
35 read_encrypted handling 13334B-sized chunk
36 read_encrypted handling 13332B-sized chunk
37send_segment(0)
38put_block to <WriteBucketProxy for node 6jdspiha6nw2az6fqglwfzbu2c2uvnfg>
39put_block done
40put_block to <WriteBucketProxy for node rvsry4knxlbqxae2im6dl7be3tk5hczg>
41put_block done
42put_block to <WriteBucketProxy for node alg6uebme73xaj6cdlyppvxdlbkiskw4>
43put_block done
44put_block to <WriteBucketProxy for node egjcec7q3rdbzkn6w2un6zyi4fnhgk2u>
45put_block done
46put_block to <WriteBucketProxy for node 7r4gd6xuplzuskpfyn5puffxvknl3eel>
47put_block done
48put_block to <WriteBucketProxy for node fob7vqgd74lckwh4o2ld2566ruk5dqgm>
49put_block done
50put_block to <WriteBucketProxy for node k6vb2bpdnqmx3ur2u6xcrrl7ndbx2idj>
51put_block done
52put_block to <WriteBucketProxy for node b3llgpwwqwozijzje7ydgossrdyqig5e>
53put_block done
54put_block to <WriteBucketProxy for node ysbz4st7vr6calwjgd2gfzesx2vomcma>
55put_block done
56put_block to <WriteBucketProxy for node xgru5advtrp7pf2gknj2ppic7ftcioqj>
57put_block done
58<Encoder for dglev> uploaded 40002 / 40002 bytes (100%) of your file.
59sending crypttext hash tree
60sending block hash trees
61sending all share hash trees
62sending uri_extension
63uri_extension_data is {'num_segments': 1, 'crypttext_hash': '6e5j3vvz47hs4vqlg45hvtsgukg7qjt35ywh7t7fksihiz6xpixq', 'tail_codec_params': '40002-3-10', 'share_root_hash': 'hlxqamshvcdshfam43qqj63jvogq5m5vielsm4mv6tqi2qt7eeua', 'crypttext_root_hash': '2o35ay6w6mdw3wi3qqmonlsbut2fnnb7xbppd44qgyja6j5poowa', 'codec_params': '40002-3-10', 'codec_name': 'crs', 'total_shares': 10, 'needed_shares': 3, 'segment_size': 40002, 'size': 40000}
64closing shareholders
65upload done
66Immutable.DownloadNode(dglevpj4ueb7) created: size=40000, guessed_segsize=40002, guessed_numsegs=1
67ShareFinder[si=dglevpj4ueb7] starting
68imm Node(dglevpj4).read(0, 40000)
69_fetch_next(offset=0) probably wants segnum=0
70imm Node(dglevpj4).get_segment(0)
71ImmutableDownloadNode(dglevpj4ueb7)._start_new_segment: segnum=0
72ShareFinder[si=dglevpj4ueb7] hungry
73ShareFinder loop: running=True hungry=True, pending=
74sending DYHB to [6jdspiha]
75got error from [6jdspiha]
76ShareFinder loop: running=True hungry=True, pending=
77sending DYHB to [rvsry4kn]
78ShareFinder loop: running=True hungry=True, pending=rvsry4kn
79sending DYHB to [alg6uebm]
80storage: get_buckets dglevpj4ueb7e4yn35abfdlp24
81got shnums [1,8] from [rvsry4kn]
82Share(sh8-on-rvsry) created
83Share(sh1-on-rvsry) created
84delivering shares: Share(sh8-on-rvsry),Share(sh1-on-rvsry)
85ShareFinder loop: running=True hungry=False, pending=alg6uebm
86got error from [alg6uebm]
87ShareFinder loop: running=True hungry=False, pending=
88ShareFinder loop: running=True hungry=False, pending=
89ShareFinder loop: running=True hungry=False, pending=
90Share(sh1-on-rvsry).get_block(0)
91SegmentFetcher(dglevpj4ueb7) increasing diversity limit to 2
92ShareFinder[si=dglevpj4ueb7] hungry
93Share(sh8-on-rvsry).get_block(0)
94ShareFinder[si=dglevpj4ueb7] hungry
95Share(sh1-on-rvsry).loop, reqs=[0], pending=len=0: , received=len=0: , unavailable=len=0:
96end _desire: want_it=len=3072: [0-1023],[13636-15683] need_it=len=13572: [36-13369],[13402-13639] gotta=len=0:
97Share(sh1-on-rvsry)._send_requests, desired=len=15652: [0-13369],[13402-15683], pending=len=0: , ask=len=15652: [0-13369],[13402-15683]
98Share(sh1-on-rvsry)._send_request [0:+13370]
99Share(sh1-on-rvsry)._send_request [13402:+2282]
100Share(sh1-on-rvsry).loop done, reqs=[0], pending=len=15652: [0-13369],[13402-15683], received=len=0: , unavailable=len=0:
101ShareFinder loop: running=True hungry=True, pending=
102sending DYHB to [egjcec7q]
103Share(sh8-on-rvsry).loop, reqs=[0], pending=len=0: , received=len=0: , unavailable=len=0:
104end _desire: want_it=len=3072: [0-1023],[13636-15683] need_it=len=13572: [36-13369],[13402-13639] gotta=len=0:
105Share(sh8-on-rvsry)._send_requests, desired=len=15652: [0-13369],[13402-15683], pending=len=0: , ask=len=15652: [0-13369],[13402-15683]
106Share(sh8-on-rvsry)._send_request [0:+13370]
107Share(sh8-on-rvsry)._send_request [13402:+2282]
108Share(sh8-on-rvsry).loop done, reqs=[0], pending=len=15652: [0-13369],[13402-15683], received=len=0: , unavailable=len=0:
109ShareFinder loop: running=True hungry=True, pending=egjcec7q
110sending DYHB to [7r4gd6xu]
111Share(sh1-on-rvsry)._got_data [0:+13370] -> 13370
112Share(sh1-on-rvsry)._got_data [13402:+2282] -> 1310
113got error from [egjcec7q]
114ShareFinder loop: running=True hungry=True, pending=7r4gd6xu
115sending DYHB to [fob7vqgd]
116Share(sh8-on-rvsry)._got_data [0:+13370] -> 13370
117Share(sh8-on-rvsry)._got_data [13402:+2282] -> 1310
118got error from [7r4gd6xu]
119ShareFinder loop: running=True hungry=True, pending=fob7vqgd
120sending DYHB to [k6vb2bpd]
121Share(sh1-on-rvsry).loop, reqs=[0], pending=len=0: , received=len=14680: [0-13369],[13402-14711], unavailable=len=972: [14712-15683]
122actual offsets: data=36, plaintext_hash_tree=13370, crypttext_hash_tree=13402, block_hashes=13434, share_hashes=13466, uri_extension=13636
123validate_and_store_UEB
124UEB={'num_segments': 1, 'crypttext_hash': '6e5j3vvz47hs4vqlg45hvtsgukg7qjt35ywh7t7fksihiz6xpixq', 'needed_shares': 3, 'UEB_hash': 'ulcqvxz3esqqwefwd5mvuwcs35khsed7qi4hd2wn4greurhirx6a', 'share_root_hash': 'hlxqamshvcdshfam43qqj63jvogq5m5vielsm4mv6tqi2qt7eeua', 'crypttext_root_hash': '2o35ay6w6mdw3wi3qqmonlsbut2fnnb7xbppd44qgyja6j5poowa', 'tail_codec_params': '40002-3-10', 'codec_name': 'crs', 'total_shares': 10, 'codec_params': '40002-3-10', 'segment_size': 40002, 'size': 40000}, vcap=URI:CHK-Verifier:dglevpj4ueb7e4yn35abfdlp24:ulcqvxz3esqqwefwd5mvuwcs35khsed7qi4hd2wn4greurhirx6a:3:10:40000
125actual sizes: {'tail_block_size': 13334, 'num_segments': 1, 'tail_segment_padded': 40002, 'block_size': 13334, 'tail_segment_size': 40000}
126my guess was right!
127Share(sh1-on-rvsry)._satisfy_data_block [36:+13334]
128end _desire: want_it=len=0:  need_it=len=0:  gotta=len=0:
129Share(sh1-on-rvsry)._send_requests, desired=len=0: , pending=len=0: , ask=len=0:
130Share(sh1-on-rvsry).loop done, reqs=[], pending=len=0: , received=len=0: , unavailable=len=972: [14712-15683]
131Share(sh1-on-rvsry).loop, reqs=[], pending=len=0: , received=len=0: , unavailable=len=972: [14712-15683]
132end _desire: want_it=len=0:  need_it=len=0:  gotta=len=0:
133Share(sh1-on-rvsry)._send_requests, desired=len=0: , pending=len=0: , ask=len=0:
134Share(sh1-on-rvsry).loop done, reqs=[], pending=len=0: , received=len=0: , unavailable=len=972: [14712-15683]
135ShareFinder loop: running=True hungry=True, pending=k6vb2bpd,fob7vqgd
136sending DYHB to [b3llgpww]
137got error from [fob7vqgd]
138ShareFinder loop: running=True hungry=True, pending=k6vb2bpd,b3llgpww
139sending DYHB to [ysbz4st7]
140Share(sh8-on-rvsry).loop, reqs=[0], pending=len=0: , received=len=14680: [0-13369],[13402-14711], unavailable=len=972: [14712-15683]
141actual offsets: data=36, plaintext_hash_tree=13370, crypttext_hash_tree=13402, block_hashes=13434, share_hashes=13466, uri_extension=13636
142Share(sh8-on-rvsry)._satisfy_data_block [36:+13334]
143end _desire: want_it=len=0:  need_it=len=0:  gotta=len=0:
144Share(sh8-on-rvsry)._send_requests, desired=len=0: , pending=len=0: , ask=len=0:
145Share(sh8-on-rvsry).loop done, reqs=[], pending=len=0: , received=len=0: , unavailable=len=972: [14712-15683]
146Share(sh8-on-rvsry).loop, reqs=[], pending=len=0: , received=len=0: , unavailable=len=972: [14712-15683]
147end _desire: want_it=len=0:  need_it=len=0:  gotta=len=0:
148Share(sh8-on-rvsry)._send_requests, desired=len=0: , pending=len=0: , ask=len=0:
149Share(sh8-on-rvsry).loop done, reqs=[], pending=len=0: , received=len=0: , unavailable=len=972: [14712-15683]
150ShareFinder loop: running=True hungry=True, pending=k6vb2bpd,b3llgpww,ysbz4st7
151sending DYHB to [xgru5adv]
152got error from [k6vb2bpd]
153ShareFinder loop: running=True hungry=True, pending=b3llgpww,ysbz4st7,xgru5adv
154SegmentFetcher(dglevpj4ueb7)._block_request_activity: Share(sh1-on-rvsry) -> COMPLETE
155got error from [b3llgpww]
156ShareFinder loop: running=True hungry=True, pending=ysbz4st7,xgru5adv
157ShareFinder loop: running=True hungry=True, pending=ysbz4st7,xgru5adv
158got error from [ysbz4st7]
159ShareFinder loop: running=True hungry=True, pending=xgru5adv
160SegmentFetcher(dglevpj4ueb7)._block_request_activity: Share(sh8-on-rvsry) -> COMPLETE
161storage: get_buckets dglevpj4ueb7e4yn35abfdlp24
162got shnums [9] from [xgru5adv]
163Share(sh9-on-xgru5) created
164delivering shares: Share(sh9-on-xgru5)
165ShareFinder loop: running=True hungry=False, pending=
166ShareFinder loop: running=True hungry=False, pending=
167ShareFinder[si=dglevpj4ueb7] hungry
168ShareFinder loop: running=True hungry=True, pending=
169ShareFinder.loop: no_more_shares, ever
170ShareFinder loop: running=True hungry=True, pending=
171ShareFinder.loop: no_more_shares, ever
172ran out of shares: complete=sh1,sh8 pending= overdue= unused= need 3. Last failure: None
173SegmentFetcher(dglevpj4ueb7).stop
174ShareFinder loop: running=True hungry=True, pending=
175ShareFinder.loop: no_more_shares, ever
176ShareFinder loop: running=True hungry=True, pending=
177ShareFinder.loop: no_more_shares, ever
178Error in Segmentation