#2254 new defect

Can't backup still suffering from allmydata.interfaces.UploadUnhappinessError

Reported by: CyberAxe Owned by: daira
Priority: normal Milestone: undecided
Component: unknown Version: 1.10.0
Keywords: unhappy Cc:
Launchpad Bug:

Description (last modified by CyberAxe)

C:\Users\Jeremy>backup-now

C:\Users\Jeremy>ECHO OFF
Traceback (most recent call last):
  File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\runner.py", line 156, in run
    rc = runner(sys.argv[1:], install_node_control=install_node_control)
  File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\runner.py", line 141, in runner
    rc = cli.dispatch[command](so)
  File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\cli.py", line 574, in backup
    rc = tahoe_backup.backup(options)
  File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\tahoe_backup.py", line 325, in backup
    return bu.run()
  File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\tahoe_backup.py", line 118, in run
    new_backup_dircap = self.process(options.from_dir)
  File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\tahoe_backup.py", line 211, in process
    newdircap = mkdir(create_contents, self.options)
  File "c:\allmydata-tahoe-1.10.0\src\allmydata\scripts\tahoe_backup.py", line 47, in mkdir
    raise HTTPError("Error during mkdir", resp)
HTTPError: Error during mkdir: 500 Internal Server Error
Traceback (most recent call last):
  File "C:\allmydata-tahoe-1.10.0\support\Lib\site-packages\foolscap-0.6.4-py2.7.egg\foolscap\call.py", line 677, in _done
    self.request.complete(res)
  File "C:\allmydata-tahoe-1.10.0\support\Lib\site-packages\foolscap-0.6.4-py2.7.egg\foolscap\call.py", line 60, in complete
    self.deferred.callback(res)
  File "C:\allmydata-tahoe-1.10.0\support\Lib\site-packages\twisted-12.3.0-py2.7-win-amd64.egg\twisted\internet\defer.py", line 381, in call
back
    self._startRunCallbacks(result)
  File "C:\allmydata-tahoe-1.10.0\support\Lib\site-packages\twisted-12.3.0-py2.7-win-amd64.egg\twisted\internet\defer.py", line 489, in _sta
rtRunCallbacks
    self._runCallbacks()
--- <exception caught here> ---
  File "C:\allmydata-tahoe-1.10.0\support\Lib\site-packages\twisted-12.3.0-py2.7-win-amd64.egg\twisted\internet\defer.py", line 576, in _run
Callbacks
    current.result = callback(current.result, *args, **kw)
  File "c:\allmydata-tahoe-1.10.0\src\allmydata\immutable\upload.py", line 604, in _got_response
    return self._loop()
  File "c:\allmydata-tahoe-1.10.0\src\allmydata\immutable\upload.py", line 516, in _loop
    return self._failed(msg)
  File "c:\allmydata-tahoe-1.10.0\src\allmydata\immutable\upload.py", line 617, in _failed
    raise UploadUnhappinessError(msg)
allmydata.interfaces.UploadUnhappinessError: server selection failed for <Tahoe2ServerSelector for upload 66ww6>: shares could be placed or
found on only 0 server(s). We were asked to place shares on at least 1 server(s) such that any 1 of them have enough shares to recover the f
ile. (placed 0 shares out of 1 total (1 homeless), want to place shares on at least 1 servers such that any 1 of them have enough shares to
recover the file, sent 1 queries to 1 servers, 0 queries placed some shares, 1 placed none (of which 1 placed none due to the server being f
ull and 0 placed none due to an error))

Change History (5)

comment:1 Changed at 2014-06-30T16:50:17Z by CyberAxe

  • Description modified (diff)

comment:2 Changed at 2014-06-30T16:54:44Z by CyberAxe

Pastebin messed this up so I just posted it here. This is what http://127.0.0.1:3456/status/ shows

Recent and Active Operations

Active Operations:


Type

Storage Index

Helper?

Total Size

Progress

Status

download 237wxxkhajakzxovgg7nk7g5z4 No 264B 0.0% fetching segment 0 
publish o2ofk2psfahdhyf5uq3nqdmrwe No 82.7kB 0.0% Pushing shares 
publish o2ofk2psfahdhyf5uq3nqdmrwe No 82.3kB 0.0% Pushing shares 
publish o2ofk2psfahdhyf5uq3nqdmrwe No 82.0kB 0.0% Pushing shares 
publish o2ofk2psfahdhyf5uq3nqdmrwe No 82.9kB 0.0% Pushing shares 
publish o2ofk2psfahdhyf5uq3nqdmrwe No 82.2kB 0.0% Pushing shares 
publish o2ofk2psfahdhyf5uq3nqdmrwe No 82.5kB 0.0% Pushing shares 


Recent Operations:


Started

Type

Storage Index

Helper?

Total Size

Progress

Status

10:50:30 30-Jun-2014 download p2b7vjrr5h2kfqgesvvdcsbmwm No 262B 100.0% idle 
10:50:30 30-Jun-2014 download bcqjwcahp5jj2mxaa3rv5aoqxq No 269B 100.0% idle 
10:50:30 30-Jun-2014 download vhai3izeqb24bmn665aheornk4 No 260B 100.0% idle 
10:50:29 30-Jun-2014 download zhgstjc4j27fkkhqq5fk5df6s4 No 264B 100.0% idle 
10:50:29 30-Jun-2014 download fgzrrwx5ih2crcy4lbxisgqdi4 No 256B 100.0% idle 
10:50:28 30-Jun-2014 download btlideqgllqg4p6autx433h7gy No 260B 100.0% idle 
10:50:28 30-Jun-2014 download 443pwmte56qoyj3qcryn57sdfi No 260B 100.0% idle 
10:50:28 30-Jun-2014 download axgs233tjwxvzayeubahw6ul7m No 257B 100.0% idle 
10:50:27 30-Jun-2014 download y64wr3cqud4b446uydvzz6dsga No 252B 100.0% idle 
10:50:25 30-Jun-2014 download k5fffnvz6jlespiklyrd573dzq No 254B 100.0% idle 
10:50:21 30-Jun-2014 download 3iiqh2fgdend7r53om2vy7dome No 259B 100.0% idle 
10:50:16 30-Jun-2014 download ck5puuz4ca5ouxjlrawwon6kaa No 260B 100.0% idle 
10:50:12 30-Jun-2014 download ta3puwxsbqv7ocqnlv7liuy6d4 No 259B 100.0% idle 
10:50:08 30-Jun-2014 download rquyu6m6g4nrgavxujnulopzlq No 253B 100.0% idle 
10:50:03 30-Jun-2014 download bxigk3uryyxtfhmvhlnrdjxucm No 253B 100.0% idle 
10:49:04 30-Jun-2014 download jcpu6n4xlxkybnysgndlliqooa No 258B 100.0% idle 
10:48:22 30-Jun-2014 download anq5bd5iolh23s4aob3e2ofcty No 265B 100.0% idle 
10:48:21 30-Jun-2014 download jit4gs5ykyuqwrujvyx3mdxoqu No 148.3kB 100.0% idle 
10:48:13 30-Jun-2014 retrieve o2ofk2psfahdhyf5uq3nqdmrwe No 82.9kB 100.0% Finished 
10:48:13 30-Jun-2014 mapupdate MODE_READ o2ofk2psfahdhyf5uq3nqdmrwe No -NA- 100.0% Finished 
10:48:13 30-Jun-2014 retrieve acbv6l7p3wqrcaxgcskc5tmxgy No 483B 100.0% Finished 
10:48:13 30-Jun-2014 retrieve 6d5v4v7pwp7s3d2jqpbxhzl3du No 344B 100.0% Finished 
10:48:13 30-Jun-2014 mapupdate MODE_READ acbv6l7p3wqrcaxgcskc5tmxgy No -NA- 100.0% Finished 
10:48:13 30-Jun-2014 retrieve jt2i3vx46n6rmqr75xkdf3qnyq No 485B 100.0% Finished 
10:48:13 30-Jun-2014 mapupdate MODE_READ 6d5v4v7pwp7s3d2jqpbxhzl3du No -NA- 100.0% Finished 
10:48:13 30-Jun-2014 mapupdate MODE_READ jt2i3vx46n6rmqr75xkdf3qnyq No -NA- 100.0% Finished 
10:48:12 30-Jun-2014 retrieve nhvn7qzi22moe7zv7bwuaaujne No 3.6kB 100.0% Finished 
10:48:12 30-Jun-2014 mapupdate MODE_READ nhvn7qzi22moe7zv7bwuaaujne No -NA- 100.0% Finished 
10:48:10 30-Jun-2014 retrieve acbv6l7p3wqrcaxgcskc5tmxgy No 483B 100.0% Finished 
10:48:09 30-Jun-2014 mapupdate MODE_READ acbv6l7p3wqrcaxgcskc5tmxgy No -NA- 100.0% Finished 
10:48:09 30-Jun-2014 retrieve nhvn7qzi22moe7zv7bwuaaujne No 3.6kB 100.0% Finished 
10:48:09 30-Jun-2014 mapupdate MODE_READ nhvn7qzi22moe7zv7bwuaaujne No -NA- 100.0% Finished 
10:48:06 30-Jun-2014 upload 66ww6ucvq2vvdzmo34bh52m4ui No 162B hash: 100.0%, ciphertext: 0.0%, encode: 0.0% Contacting Servers [xfia4afr] (first query), 0 shares left.. 
10:48:05 30-Jun-2014 retrieve o2ofk2psfahdhyf5uq3nqdmrwe No 82.9kB 100.0% Finished 
10:48:05 30-Jun-2014 retrieve acbv6l7p3wqrcaxgcskc5tmxgy No 483B 100.0% Finished 
10:48:05 30-Jun-2014 mapupdate MODE_READ o2ofk2psfahdhyf5uq3nqdmrwe No -NA- 100.0% Finished 
10:48:05 30-Jun-2014 mapupdate MODE_READ acbv6l7p3wqrcaxgcskc5tmxgy No -NA- 100.0% Finished 
10:48:04 30-Jun-2014 retrieve nhvn7qzi22moe7zv7bwuaaujne No 3.6kB 100.0% Finished 
10:48:04 30-Jun-2014 mapupdate MODE_READ nhvn7qzi22moe7zv7bwuaaujne No -NA- 100.0% Finished 
03:59:42 30-Jun-2014 retrieve zaxvcnwdmm6rhg72qc4ejnp2se No 783B 100.0% Finished 
03:59:42 30-Jun-2014 retrieve jmshvsxziv2cwf3yhpylw32xbu No 573B 100.0% Finished 
03:59:42 30-Jun-2014 mapupdate MODE_READ zaxvcnwdmm6rhg72qc4ejnp2se No -NA- 100.0% Finished 
03:59:42 30-Jun-2014 retrieve un2x33ow5bricsn55pv2yka5pa No 0B 100.0% Finished 
03:59:42 30-Jun-2014 mapupdate MODE_READ jmshvsxziv2cwf3yhpylw32xbu No -NA- 100.0% Finished 
03:59:42 30-Jun-2014 retrieve 4d3prv6dtpppjuu22k4f357wbq No 325B 100.0% Finished 
03:59:42 30-Jun-2014 mapupdate MODE_READ un2x33ow5bricsn55pv2yka5pa No -NA- 100.0% Finished 
03:59:42 30-Jun-2014 retrieve 5vm5vov6fy6xkegjlgr5wozvse No 0B 100.0% Finished 
03:59:42 30-Jun-2014 mapupdate MODE_READ 4d3prv6dtpppjuu22k4f357wbq No -NA- 100.0% Finished 
03:59:41 30-Jun-2014 retrieve pznlk5yygmqhvt5zonewxsqjwy No 0B 100.0% Finished 
03:59:41 30-Jun-2014 mapupdate MODE_READ 5vm5vov6fy6xkegjlgr5wozvse No -NA- 100.0% Finished 
03:59:41 30-Jun-2014 retrieve 4kehqzl63v2dprvqilb64k47te No 0B 100.0% Finished 
03:59:41 30-Jun-2014 mapupdate MODE_READ pznlk5yygmqhvt5zonewxsqjwy No -NA- 100.0% Finished 
03:59:41 30-Jun-2014 retrieve otf4uknynut5mfidu7gwterws4 No 242B 100.0% Finished 
03:59:41 30-Jun-2014 mapupdate MODE_READ 4kehqzl63v2dprvqilb64k47te No -NA- 100.0% Finished 
03:59:41 30-Jun-2014 retrieve izfttnqwb54w5qdxl7g7nasl3a No 0B 100.0% Finished 
03:59:41 30-Jun-2014 mapupdate MODE_READ otf4uknynut5mfidu7gwterws4 No -NA- 100.0% Finished 
03:59:41 30-Jun-2014 retrieve i7itavqndhts3encq3ocerulo4 No 0B 100.0% Finished 
03:59:41 30-Jun-2014 mapupdate MODE_READ izfttnqwb54w5qdxl7g7nasl3a No -NA- 100.0% Finished 
03:59:41 30-Jun-2014 mapupdate MODE_READ i7itavqndhts3encq3ocerulo4 No -NA- 100.0% Finished 
02:26:18 30-Jun-2014 upload 66ww6ucvq2vvdzmo34bh52m4ui No 162B hash: 100.0%, ciphertext: 0.0%, encode: 0.0% Contacting Servers [xfia4afr] (first query), 0 shares left.. 
21:36:07 29-Jun-2014 upload 66ww6ucvq2vvdzmo34bh52m4ui No 162B hash: 100.0%, ciphertext: 0.0%, encode: 0.0% Contacting Servers [xfia4afr] (first query), 0 shares left.. 
02:59:00 29-Jun-2014 upload 66ww6ucvq2vvdzmo34bh52m4ui No 162B hash: 100.0%, ciphertext: 0.0%, encode: 0.0% Contacting Servers [xfia4afr] (first query), 0 shares left.. 
02:57:59 28-Jun-2014 upload 66ww6ucvq2vvdzmo34bh52m4ui No 162B hash: 100.0%, ciphertext: 0.0%, encode: 0.0% Contacting Servers [xfia4afr] (first query), 0 shares left.. 
13:14:49 27-Jun-2014 upload 66ww6ucvq2vvdzmo34bh52m4ui No 162B hash: 100.0%, ciphertext: 0.0%, encode: 0.0% Contacting Servers [xfia4afr] (first query), 0 shares left.. 
12:50:41 27-Jun-2014 upload 66ww6ucvq2vvdzmo34bh52m4ui No 162B hash: 100.0%, ciphertext: 0.0%, encode: 0.0% Contacting Servers [xfia4afr] (first query), 0 shares left.. 


Return to the Welcome Page

comment:3 follow-up: Changed at 2014-06-30T19:47:59Z by zooko

This is probably related to #2251 -- it is happening on the same server as #2251 is and both error messages have to do with the server's filesystem being full.

comment:4 in reply to: ↑ 3 ; follow-up: Changed at 2014-06-30T22:54:01Z by Zancas

Replying to zooko:

This is probably related to #2251 -- it is happening on the same server as #2251 is and both error messages have to do with the server's filesystem being full.

Version 0, edited at 2014-06-30T22:54:01Z by Zancas (next)

comment:5 in reply to: ↑ 4 Changed at 2014-07-01T15:49:46Z by zooko

Replying to Zancas:

Replying to zooko:

This is probably related to #2251 -- it is happening on the same server as #2251 is and both error messages have to do with the server's filesystem being full.

As mentioned in #2251 the SSEC2 filesystem was _not_ full after June 28.

Okay, then I suspect this issue -- #2254 -- may be due to corruption caused by the filesystem-full condition but not cured by the freeing-up of filesystem space. We need to look for incident report files and other evidence from the affected storage server.

Note: See TracTickets for help on using tickets.