Ticket #534: credit.patch

File credit.patch, 84.3 KB (added by francois, at 2008-11-14T14:07:56Z)

Add credit entry

Line 
1
2New patches:
3
4[New credit file entry
5francois@ctrlaltdel.ch**20081114140548] {
6hunk ./CREDITS 54
7+N: François Deppierraz
8+D: bug fix, testing
9+E: francois@ctrlaltdel.ch
10+
11}
12
13Context:
14
15[CLI: add 'tahoe stats', to run start-deep-stats and print the results
16warner@allmydata.com**20081114014350]
17[test_system.py: fix new 'tahoe manifest' tests to not break on windows, by providing --node-directory instead of --node-url
18warner@allmydata.com**20081113212748]
19[test for bug #534, unicode filenames
20francois@ctrlaltdel.ch**20081113111951
21 
22 This test assure that uploading a file whose name contains unicode character
23 doesn't prevent further uploads in the same directory.
24]
25[Fix an filename encoding issue with "tahoe cp"
26francois@ctrlaltdel.ch**20081111200803]
27[web/info.py: use 128-bit ophandles instead of 64-bit
28warner@allmydata.com**20081113021842]
29[CLI: add 'tahoe manifest', which takes a directory and returns a list of things you can reach from it
30warner@allmydata.com**20081113021725]
31[create_node.py: also remove now-unused import of pkg_resources
32warner@allmydata.com**20081113004716]
33[tahoe.cfg: add tub.location, to override the location hints we include in our FURL. This replaces advertised_ip_addresses, which doesn't remain useful enough to retain it. Helps with #517 (Tor).
34warner@allmydata.com**20081113004458]
35[setup: remove pkg_resources.require() from create_node.py and add it to runner.py
36zooko@zooko.com**20081112212503
37 Ignore-this: 763324202456a59b833b14eb4027171
38 Brian correctly points out that the latter is an entry point.
39]
40[docs: fix cutnpasto in source:docs/logging.txt
41zooko@zooko.com**19700105140422
42 Ignore-this: de0f9ceb8e0ca4c158492ad2f9a6ba6f
43]
44[tests: fix comment
45zooko@zooko.com**19700105101055
46 Ignore-this: fabedea917895568b1fca75a480111b9
47]
48[tests: add tahoe_cp to the list of scripts that we don't actually have tests for yet
49zooko@zooko.com**19700105100058
50 Ignore-this: ac89583992fb1b48d9a4680344569d91
51]
52[setup: the .tac files created by create_node.py call pkg_resources.require() so that they can load tahoe and twisted packages which were installed with setuptools multi-version mode
53zooko@zooko.com**19700101235005
54 Ignore-this: e1db03f86e0407a91087d8ada6b477fd
55 Also the create_node.py script itself uses pkg_resources.require() for the same reason.
56]
57[web/info: don't let an unrecoverable file break the page (show ? instead of a size)
58warner@allmydata.com**20081107045117]
59[checker: add is_recoverable() to checker results, make our stub immutable-verifier not throw an exception on unrecoverable files, add tests
60warner@allmydata.com**20081107043547]
61[monitor: update interface definition: get_status() can return a Failure
62warner@allmydata.com**20081107035452]
63[web/operations.py: if the operation failed, render the Failure
64warner@allmydata.com**20081107035309]
65[undoing test change for native_client.php
66secorp@allmydata.com**20081106220310]
67[NEWS: more minor edits
68warner@allmydata.com**20081106223517]
69[NEWS: minor edits
70warner@allmydata.com**20081106223356]
71[NEWS: mention SFTP server
72warner@allmydata.com**20081106014153]
73[client.py: oops, update FTP/SFTP config names to match current docs
74warner@allmydata.com**20081106013442]
75[remove duplicate+old docs/NEWS. The top-level NEWS file is the canonical one.
76warner@allmydata.com**20081106013224]
77[SFTP/FTP: merge user/account code, merge docs
78warner@allmydata.com**20081106012558]
79[docs: move webapi/ftp/sftp into a new frontends/ directory
80warner@allmydata.com**20081105233050]
81[ftp/sftp: move to a new frontends/ directory in preparation for factoring out password-auth component
82warner@allmydata.com**20081105200733]
83[sftpd: minor debug-logging tweak
84warner@allmydata.com**20081105194511]
85[confwiz.py - trying out a new configuration site
86secorp@allmydata.com**20081105011830]
87[ftpd: include an (unused) avatar logout callback
88warner@allmydata.com**20081105000104]
89[#531: implement an SFTP frontend. Mostly works, still lots of debug messages. Still needs tests and auth-by-pubkey in accounts.file
90warner@allmydata.com**20081105000022]
91[docs/ftp.txt: correct Twisted dependency: we don't need VFS, we can use a release, as long as you apply the patch
92warner@allmydata.com**20081104235840]
93[shebang: replace "/usr/bin/python" with "/usr/bin/env python"
94zooko@zooko.com**20081105000306
95 Ignore-this: 8ae33a8a7828fa7423422e252f2cfd74
96]
97[misc/fixshebangs.py
98zooko@zooko.com**20081105000130
99 Ignore-this: 13b03ea2d2ed8982f8346a827b46bd2e
100]
101[util: copy in pyutil.fileutil.ReopenableNamedTemporaryFile
102zooko@zooko.com**20081104234715
103 Ignore-this: f1131e9b8f249b5f10be4cba2aeb6118
104]
105[immutable: tolerate filenode.read() with a size= that's too big, rather than hanging
106warner@allmydata.com**20081104212919]
107[util: copy in nummedobj from pyutil
108zooko@zooko.com**20081104195550]
109[util: copy in dictutil from pyutil
110zooko@zooko.com**20081104195327]
111[rollback change... move allmydatacontextmenu registration to installer.tmpl in tahoe-w32-client\installer
112booker@allmydata.com**20081103213647]
113[register the AllmydataContextMenu.dll for the context menu handler file sharing shell extension
114booker@allmydata.com**20081103200027]
115[debug catalog-shares: tolerate even more errors on bad files/directories
116warner@allmydata.com**20081030215447]
117[NEWS: update with all user-visible changes since the last update
118warner@allmydata.com**20081030213604]
119[#527: expire the cached files that are used to support Range: headers, every hour, when the file is unused and older than an hour
120warner@allmydata.com**20081030203909]
121[util/cachedir.py: add a cache-directory manager class, which expires+deletes unused files after a while
122warner@allmydata.com**20081030200120]
123[test_cli: try to fix windows again
124warner@allmydata.com**20081030193204]
125[debug/test_cli: fix error handling for catalog-shares, to make the test stop failing on windows
126warner@allmydata.com**20081030190651]
127[web: add 'Repair' button to checker results when they indicate unhealthyness. Also add the object's uri to the CheckerResults instance.
128warner@allmydata.com**20081030010917]
129[create_node.py: add 'web.static = public_html' to the initial tahoe.cfg
130warner@allmydata.com**20081030001336]
131[webapi: serve the /static URL tree from /public_html (configurable)
132warner@allmydata.com**20081029223431]
133[catalog-shares command: tolerate errors, log them to stderr, handle v2-immutable shares
134warner@allmydata.com**20081029221010]
135[test_web.py: one more line of test coverage
136warner@allmydata.com**20081029050015]
137[test_web: improve test coverage of PUT DIRURL t=uri replace=false
138warner@allmydata.com**20081029045744]
139[web: test (and fix) PUT DIRURL t=uri, which replaces a directory in-place with some other cap
140warner@allmydata.com**20081029045446]
141[web/directory.py: slight shuffle to improve test coverage
142warner@allmydata.com**20081029045406]
143[test_client.py: improve test coverage a bit
144warner@allmydata.com**20081029044335]
145[node.py: remove unused old_log() function
146warner@allmydata.com**20081029043558]
147[node.py: remove support for the old BASEDIR/authorized_keys.PORT file
148warner@allmydata.com**20081029043420]
149[move testutil into test/common_util.py, since it doesn't count as 'code under test' for our pyflakes numbers
150warner@allmydata.com**20081029042831]
151[util: move PollMixin to a separate file (pollmixin.py), so testutil can be moved into test/
152warner@allmydata.com**20081029041548]
153[control.py: removed unused testutil.PollMixin
154warner@allmydata.com**20081029040359]
155[web/filenode: oops, fix test failures, not everything has a storage index
156warner@allmydata.com**20081029011720]
157[web/filenode: add Accept-Ranges and ETag (for immutable files) headers to GET responses
158warner@allmydata.com**20081029010103]
159[#527: respond to GETs with early ranges quickly, without waiting for the whole file to download. Fixes the alacrity problems with the earlier code. Still needs cache expiration.
160warner@allmydata.com**20081029005618]
161[#527: support HTTP 'Range:' requests, using a cachefile. Adds filenode.read(consumer, offset, size) method. Still needs: cache expiration, reduced alacrity.
162warner@lothar.com**20081028204104]
163[iputil.py: avoid a DNS lookup at startup (which may timeout tests when run on a partially-offline host) by using 198.41.0.4 instead of A.ROOT-SERVERS.NET
164warner@lothar.com**20081028203646]
165[interfaces.py: promote immutable.encode.NotEnoughSharesError.. it isn't just for immutable files any more
166warner@lothar.com**20081027203449]
167[interfaces.IMutableFileNode.download_best_version(): fix return value
168warner@lothar.com**20081027202046]
169[dirnode lookup: use distinct NoSuchChildError instead of the generic KeyError when a child can't be found
170warner@lothar.com**20081027201525]
171[storage: don't use colons in the corruption-advisory filename, since windows can't tolerate them
172warner@lothar.com**20081026024633]
173[mutable: call remove_advise_corrupt_share when we see share corruption in mapupdate/download/check, tolerate servers that do not implement it
174warner@lothar.com**20081024202128]
175[storage: add remote_advise_corrupt_share, for clients to tell storage servers about share corruption that they've discovered. The server logs the report.
176warner@lothar.com**20081024185248]
177[mutable/servermap.py: fix needs_merge(), it was incorrectly claiming that mixed shares with distinct seqnums needed a merge, causing repair(force=False) to fail
178warner@lothar.com**20081024040024]
179[test_web.test_POST_DIRURL_deepcheck: confirm that /operations/HANDLE/ works with or without the slash
180warner@lothar.com**20081024021759]
181[web/checker_results.py: remove dead code
182warner@lothar.com**20081024001717]
183[test_web: more test coverage
184warner@lothar.com**20081024001118]
185[webapi: fix t=rename from==to, it used to delete the file
186warner@lothar.com**20081023233236]
187[test_system: update test to match web checker results
188warner@lothar.com**20081023233202]
189[webapi deep-check: show the root as <root>, rather than an empty path string
190warner@lothar.com**20081023230359]
191[mutable/checker: announce the mapupdate op on the 'recent uploads+downloads' page
192warner@lothar.com**20081023230319]
193[scripts/create_node.py: remove empty-string defaults for --introducer= and --nickname=
194warner@lothar.com**20081023230235]
195[deep-check: add webapi links to detailed per-file/dir results
196warner@lothar.com**20081023230031]
197[interface.py: fix typo
198warner@lothar.com**20081023225936]
199[webapi: make the /operations/ 't=status' qualifier optional, remove it from examples
200warner@lothar.com**20081023225658]
201[setup: require the latest version of the setuptools bootstrap egg
202zooko@zooko.com**20081025152858
203 Ignore-this: c0c9923ba3008f410d5cc56f2236edb9
204]
205[setup: include _pkgutil.py in setuptools bootstrap egg so that it will work on Python 2.4
206zooko@zooko.com**20081025152839
207 Ignore-this: 38d81a037c1a3413d69d580ccb13fd67
208]
209[setup: pretend the tahoe requires twisted to set up, so that twisted will be there for nevow
210zooko@zooko.com**20081025135042
211 Ignore-this: 4e6c7e580f7e30df571e2e63be663734
212]
213[setup: require the SVN snapshot of setuptools to build
214zooko@zooko.com**20081025134959
215 Ignore-this: f68077dd10d85a71a1e06678365e6753
216]
217[setup: remove old bundled setuptools-0.6c9
218zooko@zooko.com**20081025134947
219 Ignore-this: 3a95dd72346a60b39ffd6ddfadd1b3a8
220]
221[setup: bundle an SVN snapshot of setuptools instead of the most recent stable release of setuptools
222zooko@zooko.com**20081025134837
223 Ignore-this: 9a0c9a34b186b972650cf9455edb0d28
224 This SVN snapshot fixes a problem that prevents the setting up of nevow:
225 http://bugs.python.org/setuptools/issue20
226]
227[setup: reorder dependencies to be sort of increasing order of how much they depend on other stuff
228zooko@zooko.com**20081025134739
229 Ignore-this: 6d636aaf5deb37cbf18172824b0bbf87
230 Not that the order makes any different to how it gets installed, as far as I can tell.
231]
232[docs: add a note that when you make a new tahoe release, you should send the announcement to fuse-devel@lists.sourceforge.net
233zooko@zooko.com**20081023213658]
234[web/info.py: fix 'Check This Object' link, for files it was checking the parent directory by mistake
235warner@lothar.com**20081022171056]
236[#514: add meta-refresh=60 tag to t=status page for incomplete operations
237warner@lothar.com**20081022164842]
238[test_dirnode.py: oops, missed a Monitor(), unbreak tests
239warner@lothar.com**20081022085054]
240[immutable/filenode.py: add TODO note about the #514 monitor to check(), rather than going through the checker/verifier code and adding it, since Zooko is currently working on that code
241warner@lothar.com**20081022084237]
242[more #514: pass a Monitor to all checker operations, make mutable-checker honor the cancel flag
243warner@lothar.com**20081022083818]
244[dirnode.py: check for cancel during deep-traverse operations, and don't initiate any new ones if we've been cancelled. Gets us closer to #514.
245warner@lothar.com**20081022075552]
246[more #514 log-webop status/cancel: add handle-expiration, test coverage
247warner@lothar.com**20081022051354]
248[webapi.txt: improve t=deep-size output docs
249warner@lothar.com**20081022005331]
250[#514: improve test coverage
251warner@lothar.com**20081022005256]
252[Change deep-size/stats/check/manifest to a start+poll model instead of a single long-running synchronous operation. No cancel or handle-expiration yet. #514.
253warner@lothar.com**20081022000307]
254[setup: change ez_setup.py to install setuptools-0.6c9
255zooko@zooko.com**20080930200502]
256[setup: bundle setuptools-0.6c9
257zooko@zooko.com**20080930200448]
258[setup: remove bundled setuptools-0.6c8
259zooko@zooko.com**20080930200336]
260[setup: remove the developer note about doing without GNU make (the GNU make requirement is about to hurt Peter if he tries to follow this doc, by the way)
261zooko@zooko.com**20081021163200
262 add classifiers showing with which versions of Python it is known to work.
263]
264[* fuse/runtests: added --catch-up-pause option
265robk-tahoe@allmydata.com**20081021002902
266 
267 On linux, write tests are failing because data written to fuse isn't showing
268 up in tahoe by the time it's checked.  it's not clear where this is originating,
269 since the fuse implementation [should be] waiting for completion of tahoe
270 operations before returning from its calls.  This adds an option to control the
271 duration of a pause between the fuse write and the check of tahoe, which is by
272 default set to 2s on linux, which - somewhat inexplicably - seems to 'fix' the
273 problem, in as far as it allows tests to complete.
274 
275]
276[fuse/runtests: include length in drepr() output
277robk-tahoe@allmydata.com**20081021000159]
278[fuse/runtests: make exceptions in 'read_in_random_order' into TestFailures
279robk-tahoe@allmydata.com**20081020235235]
280[fuse/blackmatch: added asynchronous (background) file download
281robk-tahoe@allmydata.com**20081020233333
282 
283 previously, upon opening a file for reading, the open() call would block
284 while the entire file was retrieved from tahoe into the cache directory.
285 This change adds a DownloaderWithReadQueue class, and associated plumbing,
286 such that an open() will return promptly with the download initiated 'in
287 the background'.  Subsequent read() operations will block until enough
288 data has been downloaded to satisfy that request.  This provides a behaviour
289 similar to streaming, i.e. the client application will be able to read
290 data from the fuse interface while the remainder of the file is still being
291 downloaded.
292 
293]
294[fuse/runtests: added 'read_in_random_order' test
295robk-tahoe@allmydata.com**20081020232427
296 
297 this test uploads a test file to tahoe, and then reads the file from fuse,
298 but reads the blocks of the file in a random order; this is designed to
299 exercise the asynchronous download feature of blackmatch - where the file
300 is downloaded from tahoe asynchronously, and rather than blocking open()
301 for the entirety of the download, instead individual read() calls are
302 blocked until enough of the file has been downloaded to satisfy them
303]
304[fuse/runtests: added a --no-cleanup option
305robk-tahoe@allmydata.com**20081020155120
306 
307 the code had a 'fullcleanup' flag internally which controlled whether
308 working directories were cleaned up.  this promotes that to a command
309 line option (negated) '--no-cleanup' defaulting to False, i.e. do cleanup
310]
311[fuse/runtests: truncate expected file contents in reported error message
312robk-tahoe@allmydata.com**20081020144523
313 
314 this avoids dumping the repr of 1Mb of random data to stdout in the event
315 of a test failure, but rather just dumps the start/end of the errant strings
316 if the amount of data is > 200 chars repr'd
317]
318[fuse/blackmatch: fix platform specific problems in repr_flags
319robk-tahoe@allmydata.com**20081020143052
320 
321 the repr_flags debug/logging function had a list of fields from the os
322 module that might be passed into an open() call, but it included at
323 least one which was available on the mac but not on linux. symmetrically
324 linux has numerous flags which are not present on the mac. the repr_flags
325 function is now tolerant of flags not being present, and has an expanded
326 list of flags
327]
328[makefile: added 'fuse-test' target to makefile, to run 'runtests'
329robk-tahoe@allmydata.com**20081019132518]
330[fuse/runtests: added a 'todo' flag, surpressing failure for implementations not expected to pass
331robk-tahoe@allmydata.com**20081019131600
332 
333 since the current tests assume that the implementation responds to changes made
334 to tahoe after mount, and impl_b prefetches and cached directory data, impl_b
335 fails the current 'read' test suite.
336 
337 rather than reflect that problem in the overall failure of the runtests exit
338 code, this adds a 'todo' flag to the implementations table, and sets the todo
339 flag for impl_b.  Thus errors will therein be reported in output, but not cause
340 a failing exit code.
341]
342[fuse/runtests: made runtests exit code depend on success
343robk-tahoe@allmydata.com**20081017180058
344 
345 return an exit code of 0 only if no tests failed, and 1 in the case of
346 linkage error, test setup failure, or individual test case failure
347 
348]
349[storage.py: assert that immutable share size will fit in the 4-byte v1 container (see #346). The struct module in py2.4 raises an error on overflow, but py2.5 merely emits a warning
350warner@lothar.com**20081020172208]
351[NEWS: update to summarize all changes since the last update
352warner@lothar.com**20081020164047]
353[fuse/runtest: make removal of webport file soft
354robk-tahoe@allmydata.com**20081017030154
355 
356 previously the runtests suite removed the webport file created by
357 tahoe create-client in all but the first node.  now that the node config
358 is in tahoe.cfg by default this file might not exist.
359]
360[fuse/blackmatch: update json handling to support simplejson v2
361robk-tahoe@allmydata.com**20081017025931
362 
363 simplejson v2 returns strings as either unicode or str, depending upon its
364 mood.  thus the interpretation of the node's json repr of a directory, and
365 the serialisation of strings in the json based rpc both exploded when built
366 against simplejson v2.  this makes both of these places liberal in their
367 acceptance of either str or unicode.
368]
369[fuse/blackmatch: log exception in server startup
370robk-tahoe@allmydata.com**20081017014650
371 
372 humphf.  my build runs the fuse stuff fine, but the build from the buildslave
373 doesn't seem to start up properly.  hopefully this will elicit some useful info
374]
375[fuse/blackmatch: add readability to some logging, fix a permissions problem
376robk-tahoe@allmydata.com**20081017004421
377 
378 adds a couple of functions to unpack 'mode' and 'flags' for open() calls, to
379 facilitate debugging.
380 
381 adds a fix to ensure that all tmp files created for writing are opened with
382 permissions 0600 - one problem I had with testing with the Finder was that
383 files were being opened write only (0200) and were then failing to upload
384 to tahoe due to internal permission denied errors.
385 
386 there remain a variety of problems with finder access which I'm unable to
387 comprehend at this time.  sometimes copies to tahoe will work fine, sometimes
388 they yield "the finder cannot complete the operation because some data ...
389 could not be read or written. (Error code -36)" sometimes "You may need to
390 enter the name and password for an administrator on this computer to change
391 the item" sometimes "The operation cannot be completed because an item with
392 the name ... already exists." and sometimes "The operation cannot be completed
393 because the item ... is locked."  What seems to be absent is rhyme or reason.
394 
395 unix operations (cp, mv) work fine, rsync works fine.
396 
397]
398[fuse/blackmatch: fix linkage problems with daemonize
399robk-tahoe@allmydata.com**20081016163637
400 
401 the daemonize() function imported from twisted was causing problems when
402 run from a frozen (py2app) build.  I simply copied the daemonize function
403 into this file, and that fixes the problem.
404 
405 also removed a couple of lines of debugging spam that slipped through.
406 
407]
408[gui/macapp: minor bugfixes
409robk-tahoe@allmydata.com**20081016163052
410 
411 though it seemed to work before the 'fstype' passed to fuse of 'allmydata' was
412 today throwing errors that len(fstype) must be at most 7.
413 
414 fixed a typo in changes to 'mount_filesystem()' args
415 
416 bumped the delay between mounting a filesystem and 'open'ing it in Finder to
417 4s, as it seems to take a little longer to mount now the client and server
418 fuse processes need to coordinate.
419]
420[fuse/blackmatch: split into client/server (twisted server)
421robk-tahoe@allmydata.com**20081016150846
422 
423 This implements a client/server split for blackmatch, where the client
424 implements the fuse_main bindings and a simple blocking rpc client mechanism.
425 The server implements the other half of that rpc mechanism, and contains all
426 the actual logic for interpreting fuse requests in the context of the on disk
427 cache and requests to the tahoe node.  The server is based on a twisted reactor.
428 
429 The rpc mechanism implements a simple method dispatch including marshalling,
430 using json, of basic inert data types, in a flat namespace (no objects).
431 The client side is written in a blocking idiom, to interface with the threading
432 model used by the fuse_main bindings, whereas the server side is written for a
433 twisted reactor-based environment, intended to facilitate implementing more
434 sophisticated logic in that paradigm.  The two communicate over a unix domain
435 socket, allocated within the nodedir.
436 
437 Command line usage is unchanged; the server is launched automatically by the
438 client. The server daemonizes itself, to avoid preventing the original parent
439 process (e.g. 'runtests') from waiting upon the server exiting.
440 
441 The client keeps open a 'keepalive' connection to the server; upon loss thereof
442 the server will exit. This addresses the fact that the python-fuse bindings
443 provide no notification of exit of the client process upon unmount.
444 
445 The client thus provides a relatively thin 'shim' proxying requests from the
446 fuse_main bindings across the rpc to the server process, which handles the
447 logic behind each request. 
448 
449 For the time being, a '--no-split' option is provided to surpress the splitting
450 into client/server, yielding the prior behaviour.  Once the server logic gets
451 more complex and more entrenched in a twisted idiom, this might be removed.
452 The 'runtests' test harness currently tests both modes, as 'impl_c' and
453 'impl_c_no_split'
454 
455]
456[fuse/blackmatch: 'flatten' the fuse api implementation
457robk-tahoe@allmydata.com**20081016143547
458 
459 the previous revision of blackmatch used a file_class to delegate all fuse
460 api operations on files to a specific per-file class, which is an option
461 given by the python-fuse bindings.
462 
463 this is a pre-cursor to the 'split' client/server version, which uses a
464 simple, moreover flat, rpc mechanism to broker access to methods.
465]
466[fuse/runtests: disable impl_a/impl_b on mac, as they don't actually work.
467robk-tahoe@allmydata.com**20081016143232]
468[fuse/runtests: added write_partial_overwrite test
469robk-tahoe@allmydata.com**20081016142926
470 
471 this tests opening a file for update, overwriting a small part of it, and
472 ensuring that the end result constitutes an overwrite of the original file.
473 This tests, e.g. the implementation doesn' open a 'fresh' file but does in
474 fact initialise the file to be uploaded with the contents of any extant
475 file before applying updates
476 
477]
478[fuse/runtests: added --tests, renamed --suites
479robk-tahoe@allmydata.com**20081016142836
480 
481 changed the --tests option to be --suites, as it takes a prefix, e.g. 'read'
482 'write' (or 'all', the default) and runs those suites which are applicable to
483 each implementation being tested.
484 
485 added a --tests option, which takes a list of tests, e.g. 'read_file_contents'
486 'write_overlapping_large_writes' and runs all tests specified without regard
487 to whether the implementation(s) under test are declared to support them.
488 
489 this is basically to allow a specific test or two to be run, saving time
490 during development and debugging by not running the entire suite
491]
492[fuse/runtests: added 'random scatter' write test
493robk-tahoe@allmydata.com**20081003233436
494 
495 this writes the test file in a randomised order, with randomly sized writes.
496 also for each 'slice' of the file written, a randomly chosen overlapping
497 write is also made to the file.  this ensures that the file will be written
498 in its entirety in a thoroughly random order, with many overlapping writes.
499]
500[fuse/runtests: add overlapping write tests
501robk-tahoe@allmydata.com**20081003224833
502 
503 using both small and large blocksizes for writes, write a 1Mb file to fuse
504 where every write overlaps another.
505 
506 This serves a useful purpose - in manual testing of blackmatch some time ago
507 most operations e.g. bulk copies, worked fine, but using rsync caused data
508 corruption on most files.  it turned out to be that rsync writes in 64K blocks,
509 but rather than making the last block short, the last block instead overlaps
510 the preceding (already written) block.  This revealed a problem where cache
511 files were being opened 'append' rather than 'write' and hence the overlapping
512 write to the fuse layer caused the overlapping portion of the file to be
513 duplicated in cache, leading to oversized and corrupt files being uploaded.
514]
515[fuse/runtests: remove write small file test, as it's subsumed by the tiny_file test
516robk-tahoe@allmydata.com**20081003223944]
517[fuse/runtests: added linear write tests for various block sizes
518robk-tahoe@allmydata.com**20081003223550
519 
520 unit tests to test writing contiguous blocks linearly through the file,
521 for a variety of block sizes;  'tiny_file' is an entire file fitting within
522 a single io block / write operation.  'linear_{small,large}_writes' test
523 a 1Mb file written with each write operation containing significantly less
524 or more, respecitvely, data than fuse will pass into the implementation as
525 a single operation (which on the mac at least is 64Kib)
526]
527[fuse/runtests: add a very simple 'write' test
528robk-tahoe@allmydata.com**20081003172044
529 
530 this performs a very simple write through the fuse layer and confirms that
531 the file is stored correctly into the tahoe mesh.  ('simple' in the sense
532 that the entire file body fits trivially in a single write() operation,
533 disk block etc)
534]
535[fuse/runtests: added a --web-open option
536robk-tahoe@allmydata.com**20081003172026
537 
538 similar to the --debug-wait option which causes the test harness to
539 pause at various stages of the process to facilitate debugging, this
540 option simplifies that debugging by automatically opening a web browser
541 to the root dir of that implementation's tests when tests are commenced.
542 
543 in addition, if --web-open is specfied but --debug-wait is not, the
544 harness will still pause after running tests but before tearing down
545 the tahoe grid - this allows all tests to run to completion, but
546 provide a debugging hook to investigate the end state of the grid's
547 contents thereafter.
548]
549[fuse/impl_a: fix a suspected bug in caching
550robk-tahoe@allmydata.com**20081003171309
551 
552 from my examination of the tahoe_fuse ('impl_a') code, it looks like
553 the intention is to cache the file contents in memory while it's open,
554 since it does in fact do that.  however it looks like it also ignored
555 that cache entirely, and made an individual tahoe webapi GET request
556 for each and every read() operation regardless of the relative size of
557 the read block and the file in question.
558 
559 this changes that to make read() use the data in memory rather than
560 fetch the data over again.   if there's something more subtle going
561 on, please let me know.
562]
563[gui/macapp: slew of code cleanup; unmount filesystems on quit
564robk-tahoe@allmydata.com**20080925233235
565 
566 a handful of code cleanup, renaming and refactoring.  basically consolidating
567 'application logic' (mount/unmount fs) into the 'MacGuiApp' class (the wx.App)
568 and cleaning up various scoping things around that.  renamed all references to
569 'app' to refer more clearly to the 'AppContainer' or to the guiapp.
570 
571 globally renamed basedir -> nodedir
572 
573 also made the guiapp keep a note of each filesystem it mounts, and unmount
574 them upon 'quit' so as to cleanup the user's environment before the tahoe node
575 vanishes from out underneath the orphaned tahoe fuse processes
576 
577]
578[gui/macapp: make submenu of aliases for 'webopen'
579robk-tahoe@allmydata.com**20080925163919
580 
581 this changes the 'open webroot' menu item to be a submenu listing all aliases
582 defined in ~/.tahoe.  Note that the dock menu does not support submenus, so it
583 only offers a single 'open webroot' option for the default tahoe: alias.
584 
585 I had trouble with this at first and concluded that the submenus didn't work,
586 and made it a distinct 'WebUI' menu in it's own right.  on further inspection,
587 there are still problems but they seem to be something like once the dock menu
588 has been used, sometimes the app's main menubar menus will cease to function,
589 and this happens regardless of whether submenus or plain simple menus are used.
590 I have no idea what the peoblem is, but it's not submenu specific.
591]
592[repairer: fix flaw in testutil.flip_one_bit() that Brian pointed out
593zooko@zooko.com**20081016194848]
594[misc/incident-gatherer: add classify_tahoe.py: a foolscap incident-gatherer classification plugin
595warner@allmydata.com**20081015220940]
596[repairer: test all different kinds of corruption that can happen to share files on disk
597zooko@zooko.com**20081014230920]
598[util/time_format.py: accept space separator, add unit tests
599warner@allmydata.com**20081013225258]
600[test_storage: use different filenames, poor stupid windows
601warner@allmydata.com**20081010021139]
602[scripts/debug.py: emit the immutable-share version number, tolerate v2
603warner@allmydata.com**20081010013422]
604[storage.py: improve some precondition() error messages
605warner@allmydata.com**20081010011425]
606[storage: introduce v2 immutable shares, with 8-byte offsets fields, to remove two of the three size limitations in #346. This code handles v2 shares but does not generate them. We'll make a release with this v2-tolerance, wait a while, then make a second release that actually generates v2 shares, to avoid compatibility problems.
607warner@allmydata.com**20081010011327]
608[debug.py: oops, add missing import for ReadBucketProxy
609warner@allmydata.com**20081010002922]
610[storage: split WriteBucketProxy and ReadBucketProxy out into immutable/layout.py . No behavioral changes.
611warner@allmydata.com**20081010000800]
612[interfaces: loosen a few max-size constraints which would limit us to a mere 1.09 TB maximum file size
613zooko@zooko.com**20081009191357
614 
615 These constraints were originally intended to protect against attacks on the
616 storage server protocol layer which exhaust memory in the peer.  However,
617 defending against that sort of DoS is hard -- probably it isn't completely
618 achieved -- and it costs development time to think about it, and it sometimes
619 imposes limits on legitimate users which we don't necessarily want to impose.
620 So, for now we forget about limiting the amount of RAM that a foolscap peer can
621 cause you to start using.
622 
623]
624[util/limiter: add a repr
625warner@allmydata.com**20081007201945]
626[dirnode.build_manifest: include node.list in the limiter, that's the most important thing to slow down
627warner@allmydata.com**20081007201929]
628[web/directory: t=manifest output=html: make the caps into clickable hrefs
629warner@allmydata.com**20081007201845]
630[web/directory: factor out the get_root function
631warner@allmydata.com**20081007201742]
632[web/directory.py: remove unused imports
633warner@allmydata.com**20081007194820]
634[test_web: deep-size is more variable than I thought, so assert less
635warner@allmydata.com**20081007051147]
636[web: change t=manifest to return a list of (path,read/writecap) tuples, instead of a list of verifycaps. Add output=html,text,json.
637warner@allmydata.com**20081007043618]
638[web: rewrite t=deep-size in terms of deep-stats, update test to match inclusion of directory sizes
639warner@allmydata.com**20081007043539]
640[ftpd: hush pyflakes
641warner@allmydata.com**20081007014513]
642[ftpd: make sure we're using a patched/fixed Twisted, to avoid confusion later
643warner@allmydata.com**20081007011411]
644[ftp: change the twisted hack necessary for async-write-close, to one more agreeable to the twisted-dev folks, add a copy of the necessary patch to docs/ftp.txt
645warner@allmydata.com**20081007010605]
646[ftpd: remove debug messages
647warner@allmydata.com**20081006231620]
648[ftpd: add native_client.php -based HTTP authentication scheme
649warner@allmydata.com**20081006231511]
650[ftpd: add ftp.accounts checker, remove InMemoryPasswordChecker
651warner@allmydata.com**20081006225124]
652[test_system: add test coverage for immutable download.ConsumerAdapter, remove debug messages
653warner@allmydata.com**20081006225037]
654[ftp server: initial implementation. Still needs unit tests, custom Twisted patches. For #512
655warner@allmydata.com**20081006195236]
656[test_cli.py: remove unused imports
657warner@allmydata.com**20081007004204]
658[CLI: remove 'tahoe admin generate-keypair', since the pycryptopp ecdsa API is about to change incompatibly. We'll undo this once pycryptopp is updated
659warner@allmydata.com**20081007002320]
660[docs: update architecture.txt 's section on the vdrive a.k.a. filesystem layer
661zooko@zooko.com**20081006210500
662 Remove some obsolete parts (correct at the time, now incorrect), change terminology to reflect my preference: s/vdrive/filesystem/ and s/dirnode/directory/, and make a few other small changes.
663]
664[dirnode: fix my remarkably-consistent 'metdadata' typo
665warner@allmydata.com**20081003010845]
666[interfaces: fix minor typo
667warner@allmydata.com**20081003005249]
668[dirnode: add get_child_and_metadata_at_path
669warner@allmydata.com**20081003005203]
670[stop using 'as' as an identifier: as with 'with', 'as' has become a reserved word in python 2.6
671warner@allmydata.com**20081003002749]
672[scripts/admin: split up generate_keypair code so that unit tests can use it more easily
673warner@allmydata.com**20081001235238]
674[docs: add some notes about things to do for a Tahoe release on pypi, freshmeat, and launchpad
675zooko@zooko.com**20081001210703]
676[misc/cpu-watcher.tac: use writeaside-and-rename for the history.pickle file
677warner@allmydata.com**20081001003053]
678[misc/spacetime: use async polling so we can add a 60-second timeout, add an index to the 'url' Axiom column for 2x speedup
679warner@allmydata.com**20080930233448]
680[#518: replace various BASEDIR/* config files with a single BASEDIR/tahoe.cfg, with backwards-compatibility of course
681warner@allmydata.com**20080930232149]
682[tolerate simplejson-2.0.0 and newer, which frequently return bytestrings instead of unicode objects. Closes #523
683warner@allmydata.com**20080930222106]
684[munin/tahoe_doomsday: oops, tolerate 'null' in the timeleft results, to unbreak the 2wk/4wk graphs
685warner@allmydata.com**20080930202051]
686[test_node: improve coverage of advertised_ip_addresses a bit
687warner@allmydata.com**20080930060816]
688[testutil.PollMixin: set default timeout (to 100s), emit a more helpful error when the timeout is hit
689warner@allmydata.com**20080930052309]
690[repair: fix test to map from storage index to directory structure properly (thanks, cygwin buildbot, for being so kloodgey that you won't accept random binary filenames and thus making me notice this bug)
691zooko@zooko.com**20080926224913]
692[repairer: assert that the test code isn't accidentally allowing the repairer code which is being tested to do impossible things
693zooko@zooko.com**20080926222353]
694[repairer: enhance the repairer tests
695zooko@zooko.com**20080926174719
696 Make sure the file can actually be downloaded afterward, that it used one of the
697 deleted and then repaired shares to do so, and that it repairs from multiple
698 deletions at once (without using more than a reasonable amount of calls to
699 storage server allocate).
700]
701[netstring: add required_trailer= argument
702warner@allmydata.com**20080926165754]
703[test_netstring.py: move netstring tests to a separate file
704warner@allmydata.com**20080926165526]
705[move netstring() and split_netstring() into a separate util.netstring module
706warner@allmydata.com**20080926043824]
707[repairer: remove a test that doesn't apply to the repair-from-corruption case
708zooko@zooko.com**20080925220954]
709[repairer: add a test that repairer fixes corrupted shares (in addition to the test that it fixes deleted shares)
710zooko@zooko.com**20080925220712]
711[docs: proposed mutable file crypto design with ECDSA, 96-bit private keys, and semi-private keys (from http://allmydata.org/~zooko/lafs.pdf )
712zooko@zooko.com**20080925213457]
713[docs: mutable file crypto design (from http://allmydata.org/~zooko/lafs.pdf )
714zooko@zooko.com**20080925213433]
715[repairer: fix swapped docstrings; thanks Brian
716zooko@zooko.com**20080925182436]
717[trivial: remove unused imports; thanks, pyflakes
718zooko@zooko.com**20080925180422]
719[trivial: remove unused imports -- thanks, pyflakes
720zooko@zooko.com**20080925173453]
721[repairer: add basic test of repairer, move tests of immutable checker/repairer from test_system to test_immutable_checker, remove obsolete test helper code from test_filenode
722zooko@zooko.com**20080925171653
723 Hm...  "Checker" ought to be renamed to "CheckerRepairer" or "Repairer" at some point...
724]
725[setup: remove a few minimal unit tests from test_filenode which have been obviated by much better tests in test_mutable and test_system
726zooko@zooko.com**20080925161544]
727[gui/macapp: rough cut of ui tweaks; configurability, auto-mount
728robk-tahoe@allmydata.com**20080925141224
729 
730 chatting with peter, two things the mac gui needed were the ability to mount
731 the 'allmydata drive' automatically upon launching the app, and open the
732 Finder to reveal it.  (also a request to hide the debug 'open webroot' stuff)
733 
734 this (somewhat rough) patch implements all the above as default behaviour
735 
736 it also contains a quick configuration mechanism for the gui - rather than a
737 preferences gui, running with a more 'tahoe' styled mechanism, the contents
738 of a few optional files can modify the default behaviour, specifically file
739 in ~/.tahoe/gui.conf control behaviour as follows:
740 
741 auto-mount (bool): if set (the default) then the mac app will, upon launch
742 automatically mount the 'tahoe:' alias with the display name 'Allmydata'
743 using a mountpoint of ~/.tahoe/mnt/__auto__
744 
745 auto-open (bool): if set (the default) then upon mounting a file system
746 (including the auto-mount if set) finder will be opened to the mountpoint
747 of the filesystem, which essentially reveals the newly mounted drive in a
748 Finder window
749 
750 show-webopen (bool): if set (false by default) then the 'open webroot'
751 action will be made available in both the dock and file menus of the app
752 
753 daemon-timout (int): sets the daemon-timeout option passed into tahoe fuse
754 when a filesystem is mounted. this defaults to 5 min
755 
756 files of type (int) much, naturally contain a parsable int representation.
757 files of type (bool) are considered true if their (case-insensitive) contents
758 are any of ['y', 'yes', 'true', 'on', '1'] and considered false otherwise.
759 
760]
761[gui/macapp: improve 'about' box
762robk-tahoe@allmydata.com**20080925135415
763 
764 adds exactly 1 metric dollop of professionalism to the previously
765 rather amateurish looking about box.
766]
767[fuse/impl_c: UNDO --auto-fsid option
768robk-tahoe@allmydata.com**20080925134730
769 
770 rolling back:
771 
772 Thu Sep 25 14:42:23 BST 2008  robk-tahoe@allmydata.com
773   * fuse/impl_c: add --auto-fsid option
774   
775   this was inspired by reading the fuse docs and discovering the 'fsid' option
776   to fuse_main, and was _intended_ to support a sort of 'stability' to the
777   filesystem (specifically derived from the root-uri mounted, whether directly
778   or via an alias) to support mac aliases across unmount/remount etc.
779   
780   some experimentation shows that that doesn't actually work, and that, at
781   least for mac aliases in my testing, they're tied to path-to-mountpoint and
782   not to the fsid - which seems to have no bearing.  perhaps the 'local' flag
783   is causing weirdness therein.
784   
785   at any rate, I'm recording it simply for posterity, in case it turns out to
786   be useful after all somewhere down the road.
787   
788 
789     M ./contrib/fuse/impl_c/blackmatch.py +13
790]
791[fuse/impl_c: add --auto-fsid option
792robk-tahoe@allmydata.com**20080925134223
793 
794 this was inspired by reading the fuse docs and discovering the 'fsid' option
795 to fuse_main, and was _intended_ to support a sort of 'stability' to the
796 filesystem (specifically derived from the root-uri mounted, whether directly
797 or via an alias) to support mac aliases across unmount/remount etc.
798 
799 some experimentation shows that that doesn't actually work, and that, at
800 least for mac aliases in my testing, they're tied to path-to-mountpoint and
801 not to the fsid - which seems to have no bearing.  perhaps the 'local' flag
802 is causing weirdness therein.
803 
804 at any rate, I'm recording it simply for posterity, in case it turns out to
805 be useful after all somewhere down the road.
806 
807]
808[manhole: be more tolerant of authorized_keys. files in .tahoe
809robk-tahoe@allmydata.com**20080925031149
810 
811 both peter and I independently tried to do the same thing to eliminate the
812 authorized_keys file which was causing problems with the broken mac build
813 (c.f. #522) namely mv authorized_keys.8223{,.bak}  but the node is, ahem,
814 let's say 'intolerant' of the trailing .bak - rather than disable the
815 manhole as one might expect, it instead causes the node to explode on
816 startup.  this patch makes it skip over anything that doesn't pass the
817 'parse this trailing stuff as an int' test.
818]
819[fuse/impl_c: move mac tahoefuse impl out into contrib/fuse
820robk-tahoe@allmydata.com**20080925014214
821 
822 For a variety of reasons, high amongst them the fact that many people
823 interested in fuse support for tahoe seem to have missed its existence,
824 the existing fuse implementation for tahoe, previously 'mac/tahoefuse.py'
825 has been renamed and moved.
826 
827 It was suggested that, even though the mac build depends upon it, that
828 the mac/tahoefuse implementation be moved into contrib/fuse along with
829 the other fuse implementations.  The fact that it's not as extensively
830 covered by unit tests as mainline tahoe was given as corroboration.
831 
832 In a bid to try and stem the confusion inherent in having tahoe_fuse,
833 tfuse and tahoefuse jumbled together (not necessarily helped by
834 referring to them as impl_a, b and c respectively) I'm hereby renaming
835 tahoefuse as 'blackmatch'  (black match is, per wikipedia "a type of
836 crude fuse" hey, I'm a punny guy)  Maybe one day it'll be promoted to
837 be 'quickmatch' instead...
838 
839 Anyway, this patch moves mac/tahoefuse.py out to contrib/fuse/impl_c/
840 as blackmatch.py, and makes appropriate changes to the mac build process
841 to transclude blackmatch therein.  this leaves the extant fuse.py and
842 fuseparts business in mac/ as-is and doesn't attempt to address such
843 issues in contrib/fuse/impl_c.
844 
845 it is left as an exercise to the reader (or the reader of a message
846 to follow) as to how to deal with the 'fuse' python module on the mac.
847 
848 as of this time, blackmatch should work on both mac and linux, and
849 passes the four extant tests in runtests.  (fwiw neither impl_a nor
850 impl_b have I managed to get working on the mac yet)
851 
852 since blackmatch supports a read-write and caching fuse interface to
853 tahoe, some write tests obviously need to be added to runtests.
854 
855]
856[macapp: changes to support aliases, updated tahoefuse command line options
857robk-tahoe@allmydata.com**20080925010128
858 
859 the tahoefuse command line options changed to support the runtests harness,
860 and as part of that gained support for named aliases via --alias
861 
862 this changes the mac app's invocation of tahoefuse to match that, and also
863 changes the gui to present the list of defined aliases as valid mounts
864 
865 this replaces the previous logic which examined the ~/.tahoe/private directory
866 looking for files ending in '.cap' - an ad-hoc alias mechanism.
867 
868 if a file is found matching ~/.tahoe/private/ALIASNAME.icns then that will still
869 be passed to tahoefuse as the icon to display for that filesystem. if no such
870 file is found, the allmydata icon will be used by default.
871 
872 the '-olocal' option is passed to tahoefuse.  this is potentially contentious.
873 specifically this is telling the OS that this is a 'local' filesystem, which is
874 intended to be used to locally attached devices.  however leopard (OSX 10.5)
875 will only display non-local filesystems in the Finder's side bar if they are of
876 fs types specifically known by Finder to be network file systems (nfs, cifs,
877 webdav, afp)  hence the -olocal flag is the only way on leopard to cause finder
878 to display the mounted filesystem in the sidebar, but it displays as a 'device'.
879 there is a potential (i.e. the fuse docs carry warnings) that this may cause
880 vague and unspecified undesirable behaviour.
881 (c.f. http://code.google.com/p/macfuse/wiki/FAQ specifically Q4.3 and Q4.1)
882 
883 
884]
885[fuse/impl_c: reworking of mac/tahoefuse, command line options, test integration
886robk-tahoe@allmydata.com**20080925001535
887 
888 a handful of changes to the tahoefuse implementation used by the mac build, to
889 make command line option parsing more flexible and robust, and moreover to
890 facilitate integration of this implementation with the 'runtests' test harness
891 used to test the other two implementations.
892 
893 this patch includes;
894 - improvements to command line option parsing [ see below ]
895 - support for 'aliases' akin to other tahoe tools
896 - tweaks to support linux (ubuntu hardy)
897 
898 the linux support tweaks are, or at least seem to be, a result of the fact that
899 hardy ships with fuse 0.2pre3, as opposed to the fuse0.2 that macfuse is based
900 upon.  at least the versions I was working with have discrepencies in their
901 interfaces, but on reflection this is probably a 'python-fuse' version issue
902 rather than fuse per se.  At any rate, the fixes to handling the Stat objects
903 should be safe against either version, it's just that the bindings on hardy
904 lacked code that was in the 'fuse' python module on the mac...
905 
906 command line options:
907 
908 the need for more flexible invocation in support of the runtests harness led
909 me to rework the argument parsing from some simple positional hacks with a
910 pass-through of the remainder to the fuse binding's 'fuse_main' to a system
911 using twisted.usage to parse arguments, and having just one option '-o' being
912 explicitly a pass-through for -o options to fuse_main. the options are now:
913 
914 --node-directory NODEDIR : this is used to look up the node-url to connect
915 to if that's not specified concretely on the command line, and also used to
916 determine the location of the cache directory used by the implementation,
917 specifically '_cache' within the nodedir.  default value: ~/.tahoe
918 
919 --node-url NODEURL : specify a node-url taking precendence over that found
920 in the node.url file within the nodedir
921 
922 --alias ALIAS : specifies the named alias should be mounted. a lookup is
923 performed in the alias table within 'nodedir' to find the root dir cap
924 the named alias must exist in the alias table of the specified nodedir
925 
926 --root-uri ROOTURI : specifies that the given directory uri should be mounted
927 
928 at least one of --alias and --root-uri must be given (which directory to mount
929 must be specified somehow)  if both are given --alias takes precedence.
930 
931 --cache-timeout TIMEOUTSECS : specifies the number of seconds that cached
932 directory data should be considered valid for.  this tahoefuse implementation
933 implements directory caching for a limited time; largely because the mac (i.e.
934 the Finder in particular) tends to make a large number of requests in quick
935 successsion when browsing the filesystem.  on the flip side, the 'runtests'
936 unit tests fail in the face of such caching because the changes made to the
937 underlying tahoe directories are not reflected in the fuse presentation.  by
938 specifying a cache-timeout of 0 seconds, runtests can force the fuse layer
939 into refetching directory data upon each request.
940 
941 any number of -oname=value options may be specified on the command line,
942 and they will all be passed into the underlying fuse_main call.
943 
944 a single non-optional argument, the mountpoint, must also be given.
945 
946 
947 
948]
949[fuse/tests: slew of changes to fuse 'runtests'
950robk-tahoe@allmydata.com**20080924183601
951 
952 This patch makes a significant number of changes to the fuse 'runtests' script
953 which stem from my efforts to integrate the third fuse implementation into this
954 framework.  Perhaps not all were necessary to that end, and I beg nejucomo's
955 forebearance if I got too carried away.
956 
957 - cleaned up the blank lines; imho blank lines should be empty
958 
959 - made the unmount command switch based on platform, since macfuse just uses
960 'umount' not the 'fusermount' command (which doesn't exist)
961 
962 - made the expected working dir for runtests the contrib/fuse dir, not the
963 top-level tahoe source tree - see also discussion of --path-to-tahoe below
964 
965 - significantly reworked the ImplProcManager class.  rather than subclassing
966 for each fuse implementation to be tested, the new version is based on
967 instantiating objects and providing relevant config info to the constructor.
968 this was motivated by a desire to eliminate the duplication of similar but
969 subtly different code between instances, framed by consideration of increasing
970 the number of platforms and implementations involved. each implementation to
971 test is thus reduced to the pertinent import and an entry in the
972 'implementations' table defining how to handle that implementation. this also
973 provides a way to specify which sets of tests to run for each implementation,
974 more on that below.
975 
976 
977 - significantly reworked the command line options parsing, using twisted.usage;
978 
979 what used to be a single optional argument is now represented by the
980 --test-type option which allows one to choose between running unittests, the
981 system tests, or both.
982 
983 the --implementations option allows for a specific (comma-separated) list of
984 implemenations to be tested, or the default 'all'
985 
986 the --tests option allows for a specific (comma-separated) list of tests sets
987 to be run, or the default 'all'.  note that only the intersection of tests
988 requested on the command line and tests relevant to each implementation will
989 be run. see below for more on tests sets.
990 
991 the --path-to-tahoe open allows for the path to the 'tahoe' executable to be
992 specified. it defaults to '../../bin/tahoe' which is the location of the tahoe
993 script in the source tree relative to the contrib/fuse dir by default.
994 
995 the --tmp-dir option controls where temporary directories (and hence
996 mountpoints) are created during the test.  this defaults to /tmp - a change
997 from the previous behaviour of using the system default dir for calls to
998 tempfile.mkdtemp(), a behaviour which can be obtained by providing an empty
999 value, e.g. "--tmp-dir="
1000 
1001 the --debug-wait flag causes the test runner to pause waiting upon user
1002 input at various stages through the testing, which facilitates debugging e.g.
1003 by allowing the user to open a browser and explore or modify the contents of
1004 the ephemeral grid after it has been instantiated but before tests are run,
1005 or make environmental adjustments before actually triggering fuse mounts etc.
1006 note that the webapi url for the first client node is printed out upon its
1007 startup to facilitate this sort of debugging also.
1008 
1009 
1010 - the default tmp dir was changed, and made configurable. previously the
1011 default behaviour of tempfile.mkdtemp() was used.  it turns out that, at least
1012 on the mac, that led to temporary directories to be created in a location
1013 which ultimately led to mountpoint paths longer than could be handled by
1014 macfuse - specifically mounted filesystems could not be unmounted and would
1015 'leak'. by changing the default location to be rooted at /tmp this leads to
1016 mountpoint paths short enough to be supported without problems.
1017 
1018 - tests are now grouped into 'sets' by method name prefix.  all the existing
1019 tests have been moved into the 'read' set, i.e. with method names starting
1020 'test_read_'. this is intended to facilitate the fact that some implementations
1021 are read-only, and some support write, so the applicability of tests will vary
1022 by implementation. the 'implementations' table, which governs the configuration
1023 of the ImplProcManager responsible for a given implementation, provides a list
1024 of 'test' (i.e test set names) which are applicable to that implementation.
1025 note no 'write' tests yet exist, this is merely laying the groundwork.
1026 
1027 - the 'expected output' of the tahoe command, which is checked for 'surprising'
1028 output by regex match, can be confused by spurious output from libraries.
1029 specfically, testing on the mac produced a warning message about zope interface
1030 resolution various multiple eggs.  the 'check_tahoe_output()' function now has
1031 a list of 'ignorable_lines' (each a regex) which will be discarded before the
1032 remainder of the output of the tahoe script is matched against expectation.
1033 
1034 - cleaned up a typo, and a few spurious imports caught by pyflakes
1035 
1036]
1037[fuse/impl_{a,b}: improve node-url handling
1038robk-tahoe@allmydata.com**20080924182854
1039   
1040 specifically change the expectation of the code to be such that the node-url
1041 (self.url) always includes the trailing slash to be a correctly formed url
1042 
1043 moreover read the node-url from the 'node.url' file found in the node 'basedir'
1044 and only if that doesn't exist, then fall back to reading the 'webport' file
1045 from therein and assuming localhost.  This then supports the general tahoe
1046 pattern that tools needing only a webapi server can be pointed at a directory
1047 containing the node.url file, which can optionally point to another server,
1048 rather than requiring a complete node dir and locally running node instance.
1049 
1050]
1051[fuse/impl_b: tweaks from testing on hardy
1052robk-tahoe@allmydata.com**20080924180738
1053 
1054 from testing on linux (specifically ubuntu hardy) the libfuse dll has a
1055 different name, specifically libfuse.so.2. this patch tries libfuse.so
1056 and then falls back to trying .2 if the former fails.
1057 
1058 it also changes the unmount behaviour, to simply return from the handler's
1059 loop_forever() loop upon being unmounted, rather than raising an EOFError,
1060 since none of the client code I looked at actually handled that exception,
1061 but did seem to expect to fall off of main() when loop_forever() returned.
1062 Additionally, from my testing unmount typically led to an OSError from the
1063 fuse fd read, rather than an empty read, as the code seemed to expect.
1064 
1065 also removed a spurious import pyflakes quibbled about.
1066]
1067[setup: fix site-dirs to find system installed twisted on mac.
1068robk-tahoe@allmydata.com**20080924174255
1069 
1070 zooko helped me unravel a build weirdness today.  somehow the system installed
1071 twisted (/System/Library) was pulling in parts of the other twisted (/Library)
1072 which had been installed by easy_install, and exploding.
1073 
1074 getting rid of the latter helped, but it took this change to get the tahoe
1075 build to stop trying to rebuild twisted and instead use the one that was
1076 already installed. c.f. tkt #229
1077]
1078[CLI: rework webopen, and moreover its tests w.r.t. path handling
1079robk-tahoe@allmydata.com**20080924164523
1080 
1081 in the recent reconciliation of webopen patches, I wound up adjusting
1082 webopen to 'pass through' the state of the trailing slash on the given
1083 argument to the resultant url passed to the browser.  this change
1084 removes the requirement that arguments must be directories, and allows
1085 webopen to be used with files.  it also broke the tests that assumed
1086 that webopen would always normalise the url to have a trailing slash.
1087 
1088 in fixing the tests, I realised that, IMHO, there's something deeply
1089 awry with the way tahoe handles paths; specifically in the combination
1090 of '/' being the name of the root path within an alias, but a leading
1091 slash on paths, e.g. 'alias:/path', is catagorically incorrect. i.e.
1092  'tahoe:' == 'tahoe:/' == '/'
1093 but 'tahoe:/foo' is an invalid path, and must be 'tahoe:foo'
1094 
1095 I wound up making the internals of webopen simply spot a 'path' of
1096 '/' and smash it to '', which 'fixes' webopen to match the behaviour
1097 of tahoe's path handling elsewhere, but that special case sort of
1098 points to the weirdness.
1099 
1100 (fwiw, I personally found the fact that the leading / in a path was
1101 disallowed to be weird - I'm just used to seeing paths qualified by
1102 the leading / I guess - so in a debate about normalising path handling
1103 I'd vote to include the /)
1104 
1105]
1106[CLI: reconcile webopen changes
1107robk-tahoe@allmydata.com**20080924152002
1108 
1109 I think this is largely attributable to a cleanup patch I'd made
1110 which never got committed upstream somehow, but at any rate various
1111 conflicting changes to webopen had been made. This cleans up the
1112 conflicts therein, and hopefully brings 'tahoe webopen' in line with
1113 other cli commands.
1114]
1115[cli: cleanup webopen command
1116robk-tahoe@allmydata.com**20080618201940
1117 
1118 moved the body of webopen out of cli.py into tahoe_webopen.py
1119 
1120 made its invocation consistent with the other cli commands, most
1121 notably replacing its 'vdrive path' with the same alias parsing,
1122 allowing usage such as 'tahoe webopen private:Pictures/xti'
1123]
1124[macapp: changed to remove 'Tahoe' from .app name
1125robk-tahoe@allmydata.com**20080611003145
1126 
1127 Change the build product from 'Allmydata Tahoe' to 'Allmydata'
1128 more inkeeping with the branding of the Allmydata product
1129]
1130[add --syslog argument to 'tahoe start' and 'tahoe restart', used to pass --syslog to twistd for non-Tahoe nodes (like cpu-watcher)
1131warner@allmydata.com**20080925010302]
1132[misc/make-canary-files.py: tool to create 'canary files', explained in the docstring
1133warner@allmydata.com**20080925004716]
1134[webapi: survive slashes in filenames better: make t=info and t=delete to work, and let t=rename fix the problem
1135warner@allmydata.com**20080924203505]
1136[setup: when detecting platform, ask the Python Standard Library's platform.dist() before executing lsb_release, and cache the result in global (module) variables
1137zooko@zooko.com**20080924180922
1138 This should make it sufficiently fast, while still giving a better answer on Ubuntu than platform.dist() currently does, and also falling back to lsb_release if platform.dist() says that it doesn't know.
1139]
1140[node.py: add BASEDIR/keepalive_timeout and BASEDIR/disconnect_timeout, to set/enable the foolscap timers, for #521
1141warner@allmydata.com**20080924175112]
1142[setup: stop catching EnvironmentError when attempting to copy ./_auto_deps.py to ./src/allmydata/_auto_deps.py
1143zooko@zooko.com**20080924000402
1144 It is no longer the case that we can run okay without _auto_deps.py being in place in ./src/allmydata, so if that cp fails then the build should fail.
1145]
1146[immutable: remove unused imports (thanks, pyflakes)
1147zooko@zooko.com**20080923192610]
1148[immutable: refactor immutable filenodes and comparison thereof
1149zooko@zooko.com**20080923185249
1150 * the two kinds of immutable filenode now have a common base class
1151 * they store only an instance of their URI, not both an instance and a string
1152 * they delegate comparison to that instance
1153]
1154[setup: try parsing /etc/lsb-release first, then invoking lsb_release, because the latter takes half-a-second on my workstation, which is too long
1155zooko@zooko.com**20080923171431
1156 Also because in some cases the former will work and the latter won't.
1157 This patch also tightens the regexes so it won't match random junk.
1158]
1159[setup: fix a cut-and-paste error in the fallback to parsing /etc/lsb-release
1160zooko@zooko.com**20080923165551]
1161[setup: if executing lsb_release doesn't work, fall back to parsing /etc/lsb-release before falling back to platform.dist()
1162zooko@zooko.com**20080923162858
1163 An explanatio of why we do it this way is in the docstring.
1164]
1165[setup: if invoking lsb_release doesn't work (which it doesn't on our etch buildslave), then fall back to the Python Standard Library's platform.dist() function
1166zooko@zooko.com**20080923154820]
1167[setup: fix bug in recent patch to use allmydata.get_package_versions() to tell the foolscap app-version-tracking what's what
1168zooko@zooko.com**20080923001347]
1169[setup: when using the foolscap "what versions are here?" feature, use allmydata.get_package_versions() instead of specifically importing allmydata, pycryptopp, and zfec
1170zooko@zooko.com**20080923000351]
1171[setup: simplify the implementation of allmydata.get_package_versions() and add "platform" which is a human-oriented summary of the underlying operating system and machine
1172zooko@zooko.com**20080922235354]
1173[misc/make_umid: change docs, make elisp code easier to grab
1174warner@lothar.com**20080920183933]
1175[use foolscap's new app_versions API, require foolscap-0.3.1
1176warner@lothar.com**20080920183853]
1177[BASEDIR/nickname is now UTF-8 encoded
1178warner@lothar.com**20080920183713]
1179[various: use util.log.err instead of twisted.log.err, so we get both Incidents and trial-test-flunking
1180warner@lothar.com**20080920173545]
1181[logging.txt: explain how to put log.err at the end of Deferred chains, explain FLOGTOTWISTED=1
1182warner@lothar.com**20080920173500]
1183[util.log: send log.err to Twisted too, so that Trial tests are flunked
1184warner@lothar.com**20080920173427]
1185[setup.py trial: improve --verbose suggestion a bit
1186warner@lothar.com**20080919193922]
1187[test_cli: disable generate-keypair test on OS-X, pycryptopp still has a bug
1188warner@lothar.com**20080919193855]
1189[NEWS: finish editing for the upcoming 1.3.0 release
1190warner@lothar.com**20080919193053]
1191[NEWS: more edits, almost done
1192warner@lothar.com**20080919010036]
1193[NEWS: describe all changes since the last release. Still needs editing.
1194warner@lothar.com**20080919002755]
1195[CLI: add 'tahoe admin generate-keypair' command
1196warner@lothar.com**20080919001133]
1197[web: add 'more info' pages for files and directories, move URI/checker-buttons/deep-size/etc off to them
1198warner@lothar.com**20080918050041]
1199[setup.py: remove unused 'Extension' import
1200warner@lothar.com**20080917230829]
1201[setup.py,Makefile: move the 'chmod +x bin/tahoe' into setup.py
1202warner@lothar.com**20080917230756]
1203[docs/install.html: reference InstallDetails instead of debian-specific stuff
1204warner@lothar.com**20080917225742]
1205[Makefile,docs: tahoe-deps.tar.gz now lives in separate source/deps/ directory on http://allmydata.org
1206warner@lothar.com**20080917204452]
1207[docs: mention -SUMO tarballs, point users at release tarballs instead of development ones
1208warner@lothar.com**20080917203631]
1209[setup.py,Makefile: teat sdist --sumo about tahoe-deps/, use -SUMO suffix on tarballs, add sumo to 'make tarballs' target
1210warner@lothar.com**20080917200119]
1211[.darcs-boringfile ignore tahoe-deps and tahoe-deps.tar.gz
1212warner@lothar.com**20080917195938]
1213[docs: add a note about the process of making a new Tahoe release
1214zooko@zooko.com**20080917170839]
1215[Makefile: pyutil from a dependent lib causes a #455-ish problem, the workaround is to run build-once *three* times
1216warner@lothar.com**20080917053643]
1217[Makefile: desert-island: don't re-fetch tahoe-deps.tar.gz if it's already there, remove the tahoe-deps/ before untarring directory to avoid unpacking weirdness
1218warner@lothar.com**20080917052204]
1219[misc/check-build.py: ignore the 'Downloading file:..' line that occurs for the setup_requires= -triggered handling of the setuptools egg
1220warner@lothar.com**20080917051725]
1221[#249: add 'test-desert-island', to assert that a tahoe-deps.tar.gz -enabled build does not download anything
1222warner@lothar.com**20080917013702]
1223[#249: get dependent libs from tahoe-deps and ../tahoe-deps
1224warner@lothar.com**20080917013627]
1225[#249: move dependent libs out of misc/dependencies/, get them from tahoe-deps.tar.gz instead
1226warner@allmydata.com**20080917012545]
1227[conf_wiz.py - updating version numbers in file, should really get these from a TAG or conf file
1228secorp@allmydata.com**20080917004547]
1229[webish: add an extra newline to JSON output
1230warner@lothar.com**20080915204314]
1231[windows/Makefile: fix dependencies: windows-installer must cause windows-exe to run
1232warner@allmydata.com**20080912052151]
1233[Makefile: fix windows issues
1234warner@allmydata.com**20080912050919]
1235[Makefile: use run_with_pythonpath, move windows targets into a separate Makefile
1236warner@allmydata.com**20080912044508]
1237[setup.py: add 'setup.py run_with_pythonpath', to run other commands with PYTHONPATH set usefully
1238warner@allmydata.com**20080912044418]
1239[Makefile: convert check-auto-deps target into 'setup.py check_auto_deps'
1240warner@allmydata.com**20080912035904]
1241[startstop_node.py: find twistd in our supportlib if we had to build Twisted as a setuptools dependency. This is a form of cgalvan's #505 patch, simplified because now 'setup.py trial' takes care of sys.path and PYTHONPATH
1242warner@allmydata.com**20080912025138]
1243[rewrite parts of the Makefile in setup.py. Add 'build_tahoe' and 'trial' subcommands.
1244warner@allmydata.com**20080912010321
1245 
1246 The 'make build' target now runs 'setup.py build_tahoe', which figures out
1247 where the target 'supportlib' directory should go, and invokes 'setup.py
1248 develop' with the appropriate arguments.
1249 
1250 The 'make test' target now runs 'setup.py trial', which manages sys.path and
1251 runs trial as a subroutine instead of spawning an external process. This
1252 simplifies the case where Twisted was built as a dependent library (and thus
1253 the 'trial' executable is not on PATH).
1254 
1255 setup.py now manages sys.path and PYTHONPATH for its internal subcommands, so
1256 the $(PP) prefix was removed from all Makefile targets that invoke setup.py .
1257 For the remaining ones, the 'setup.py -q show_pythonpath' subcommand was
1258 added to compute this prefix with python rather than with fragile
1259 shell/Makefile syntax.
1260 
1261 
1262]
1263[bin/tahoe: reflow error messages
1264warner@allmydata.com**20080912010225]
1265[mac/Makefile: remove the verbose hdiutil diagnostics now that we resolved the problem
1266warner@allmydata.com**20080912004622]
1267[Makefile: give setup.py develop a '--site-dirs' arg to work around the #249 setuptools bug which causes us to unnecessarily rebuild pyopenssl and other support libs installed via debian's python-support. Should be harmless on other platforms.
1268warner@allmydata.com**20080910233432]
1269[web: fix output=JSON, add buttons for repair/json to the 'run deep-check' form
1270warner@allmydata.com**20080910211137]
1271[disallow deep-check on non-directories, simplifies the code a bit
1272warner@allmydata.com**20080910204458]
1273[dirnode: refactor recursive-traversal methods, add stats to deep_check() method results and t=deep-check webapi
1274warner@lothar.com**20080910084504]
1275[dirnode: cleanup, make get_verifier() always return a URI instance, not a string
1276warner@lothar.com**20080910083755]
1277[test_system: check t=deep-stats too
1278warner@lothar.com**20080910065457]
1279[test_system: add deep-check-JSON tests, fix a bug
1280warner@lothar.com**20080910061416]
1281[test_system: oops, re-enable some tests that got bypassed
1282warner@lothar.com**20080910060245]
1283[test_system: add deep-stats test
1284warner@lothar.com**20080910055634]
1285[hush pyflakes
1286warner@allmydata.com**20080910025017]
1287[checker results: add output=JSON to webapi, add tests, clean up APIs
1288warner@allmydata.com**20080910024517
1289 to make the internal ones use binary strings (nodeid, storage index) and
1290 the web/JSON ones use base32-encoded strings. The immutable verifier is
1291 still incomplete (it returns imaginary healty results).
1292]
1293[immutable verifier: provide some dummy results so deep-check works, make the tests ignore these results until we finish it off
1294warner@allmydata.com**20080910010827]
1295[mutable checker: even more tests. Everything in ICheckerResults should be covered now, except for immutable-verify which is incomplete
1296warner@allmydata.com**20080910005706]
1297[checker results: more tests, update interface docs
1298warner@allmydata.com**20080910003010]
1299[mutable checker: oops, fix redefinition of 'healthy' (numshares < N, not numshares < k, which is 'recoverable' not 'healthy')
1300warner@allmydata.com**20080910002853]
1301[checker results: more tests, more results. immutable verifier tests are disabled until they emit more complete results
1302warner@allmydata.com**20080910001546]
1303[checker: add tests, add stub for immutable check_and_repair
1304warner@allmydata.com**20080909233449]
1305[interfaces.py: minor improvement to IDirectoryNode.set_node
1306warner@allmydata.com**20080909233416]
1307[mac/Makefile: upload the .dmg file with foolscap xfer-client.py instead of scp
1308warner@allmydata.com**20080908231943]
1309[misc/xfer-client.py: small foolscap utility to transfer a file to a waiting server
1310warner@allmydata.com**20080908231903]
1311[setup: add excited DEVELOPER NOTE to install.html
1312zooko@zooko.com**20080908215603
1313 It should be removed before 1.3.0 release, of course...
1314]
1315[setup: edit the text of install.html
1316zooko@zooko.com**20080908215549]
1317[setup: add link to the DownloadDebianPackages page
1318zooko@zooko.com**20080908215451
1319 Because I want that link off of the front page of the wiki...
1320]
1321[setup: change URL from which to get source tarballs
1322zooko@zooko.com**20080908215409
1323 So that when you look at that directory you won't see distracting other things such as darcs repositories.
1324]
1325[test_system: make log() tolerate the format= form
1326warner@lothar.com**20080908030336]
1327[immutable/checker: make log() tolerate the format= form
1328warner@lothar.com**20080908030308]
1329[checker: overhaul checker results, split check/check_and_repair into separate methods, improve web displays
1330warner@allmydata.com**20080907194456]
1331[webapi.txt: explain that t=manifest gives verifycaps
1332warner@allmydata.com**20080907192950]
1333[introducer: add get_nickname_for_peerid
1334warner@allmydata.com**20080906050700]
1335[docs/logging.txt: explain tahoe/foolscap logging. Addresses #239.
1336warner@allmydata.com**20080904002531]
1337[setup: don't assert that trial is present when the Makefile is evaluated
1338zooko@zooko.com**20080903171837
1339 This should fix #506, but it means that if (for some weird reason) Twisted can't be auto-installed and the find_trial.py script doesn't work, the user will get a weird failure message instead of a clean failure message explaining that trial couldn't be found.  Oh well.
1340 
1341 Chris Galvan is working on a much nicer fix to all these issues -- see #505.
1342 
1343]
1344[testutil.PollMixin: use a custom exception (and convert it) to avoid the ugly 'stash' cycle
1345warner@allmydata.com**20080903033251]
1346[mac/Makefile: more attempts to debug the buildslave failure
1347warner@allmydata.com**20080829220614]
1348[mac: add -verbose to the hdiutil call, to figure out why it's failing on the buildslave
1349warner@allmydata.com**20080829205243]
1350[setup: simplify parsing of python version number
1351zooko@zooko.com**20080829000045]
1352[setup: emit the version of python in the list of versions
1353zooko@zooko.com**20080828220454]
1354[munin: add tahoe_diskleft plugin, update spacetime/diskwatcher.tac to support it
1355warner@allmydata.com**20080828203236]
1356[docs: how_to_make_a_tahoe_release.txt
1357zooko@zooko.com**20080828202109
1358 Just some cryptic notes to self, but if I get hit by a truck then someone else might be able to decode them.
1359]
1360[debian: include misc/cpu-watcher.tac in the debian package
1361warner@allmydata.com**20080827223026]
1362[munin/tahoe_doomsday: change the graph title, 'time predictor' is more accurate than 'space predictor'
1363warner@allmydata.com**20080827213013]
1364[munin/tahoe_diskusage: clip the graph at zero, to prevent transient negative excursions (such as when a lot of old logfiles are deleted from a storage server's disk) from scaling the graph into unusability
1365warner@allmydata.com**20080827193543]
1366[CREDITS: thanks to Chris Galvan
1367zooko@zooko.com**20080827183950]
1368[setup: patch from Chris Galvan to build sdists with no deps in them normally, but include deps if --sumo
1369zooko@zooko.com**20080827182644]
1370[servermap: don't log late arrivals, and don't log DeadReferenceError at log.WEIRD
1371warner@allmydata.com**20080827003729]
1372[mutable: make mutable-repair work for non-verifier runs, add tests
1373warner@allmydata.com**20080826233454]
1374[mutable: remove work-around for a flaw in an older version of foolscap
1375zooko@zooko.com**20080826155055
1376 We now require "foolscap[secure_connections] >= 0.3.0", per [source:_auto_deps.py].
1377]
1378[docs: edit install.html a tad
1379zooko@zooko.com**20080826154929]
1380[misc/make_umid: little script and elisp fragment to insert umid= arguments
1381warner@allmydata.com**20080826015918]
1382[logging: add 'unique-message-ids' (or 'umids') to each WEIRD-or-higher log.msg call, to make it easier to correlate log message with source code
1383warner@allmydata.com**20080826015759]
1384[logging cleanups: lower DeadReferenceError from WEIRD (which provokes Incidents) to merely UNUSUAL, don't pre-format Failures in others
1385warner@allmydata.com**20080826005155]
1386[checker: make the log() function of SimpleCHKFileVerifier compatible with the log() function of its superclasses and subclasses
1387zooko@zooko.com**20080825214407]
1388[docs: warn that the "garbage-collection and accounting" section of architecture.txt is out of date, and clarify that "deleted" therein means ciphertext getting garbage-collected
1389zooko@zooko.com**20080822154605]
1390[docs/filesystem-notes.txt: add notes about enabling the 'directory index' feature on ext3 filesystems for storage server lookup speed
1391warner@allmydata.com**20080821205901]
1392[setup: doc string describing what the require_auto_deps() function is for
1393zooko@zooko.com**20080815172234]
1394[mutable/checker: log a WEIRD-level event when we see a hash failure, to trigger an Incident
1395warner@allmydata.com**20080813035020]
1396[immutable checker: add a status_report field
1397warner@allmydata.com**20080813033530]
1398[mutable/servermap: lower the priority of many log messages
1399warner@allmydata.com**20080813033506]
1400[web/deep-check: show the webapi runtime at the bottom of the page
1401warner@allmydata.com**20080813033426]
1402[CLI: tolerate blank lines in the aliases file
1403warner@allmydata.com**20080813025050]
1404[test_web: workaround broken HEAD behavior in twisted-2.5.0 and earlier
1405warner@allmydata.com**20080813024520]
1406[test_web: oops, actually use HEAD (instead of GET) in the HEAD test
1407warner@allmydata.com**20080813020451]
1408[web: use get_size_of_best_version for HEAD requests, provide correct content-type
1409warner@allmydata.com**20080813020410]
1410[mutable: add get_size_of_best_version to the interface, to simplify the web HEAD code, and tests
1411warner@allmydata.com**20080813020252]
1412[CLI: add 'tahoe debug corrupt-share', and use it for deep-verify tests, and fix non-deep web checker API to pass verify=true into node
1413warner@allmydata.com**20080813000501]
1414[IFilesystemNode: add get_storage_index(), it makes tests easier
1415warner@allmydata.com**20080812231407]
1416[test_system: rename Checker to ImmutableChecker, to make room for a mutable one
1417warner@allmydata.com**20080812225932]
1418['tahoe debug dump-share': add --offsets, to show section offsets
1419warner@allmydata.com**20080812214656]
1420[test_cli: oops, fix tests after recent stdout/stderr cleanup
1421warner@allmydata.com**20080812214634]
1422[scripts/debug: split out dump_immutable_share
1423warner@allmydata.com**20080812205517]
1424[scripts/debug: clean up use of stdout/stderr
1425warner@allmydata.com**20080812205242]
1426[CLI: move the 'repl' command to 'tahoe debug repl'
1427warner@allmydata.com**20080812204017]
1428[CLI: move all debug commands (dump-share, dump-cap, find-shares, catalog-shares) into a 'debug' subcommand, and improve --help output
1429warner@allmydata.com**20080812203732]
1430[hush a pyflakes warning
1431warner@allmydata.com**20080812042423]
1432[web/directory: enable verify=true in t=deep-check
1433warner@allmydata.com**20080812042409]
1434[dirnode: add some deep-check logging
1435warner@allmydata.com**20080812042338]
1436[checker_results.problems: don't str the whole Failure, just extract the reason string
1437warner@allmydata.com**20080812042306]
1438[checker: add information to results, add some deep-check tests, fix a bug in which unhealthy files were not counted
1439warner@allmydata.com**20080812040326]
1440[mutable/checker: rearrange a bit, change checker-results to have a status_report string
1441warner@allmydata.com**20080812032033]
1442[mutable/servermap: add summarize_version
1443warner@allmydata.com**20080812031930]
1444[CLI: make 'tahoe webopen' command accept aliases like 'tahoe ls'
1445warner@allmydata.com**20080812012023]
1446[munin diskusage/doomsday: oops, fix labels, everything was reported in the 1hr column
1447warner@allmydata.com**20080811203431]
1448[munin/tahoe_overhead: don't emit non-sensicial numbers
1449warner@lothar.com**20080807214008]
1450[munin: add tahoe_overhead plugin, to measure effectiveness of GC and deleting data from inactive accounts
1451warner@lothar.com**20080807203925]
1452[diskwatcher.tac: include total-bytes-used
1453warner@lothar.com**20080807201214]
1454[setup: remove accidentally duplicated lines from Makefile
1455zooko@zooko.com**20080807193029]
1456[misc/dependencies: remove the no-longer-useful foolscap-0.2.5 tarball
1457warner@lothar.com**20080807184546]
1458[Makefile: avoid bare quotes, since the emacs syntax-highlighter gets confused by them
1459warner@lothar.com**20080807183001]
1460[diskwatcher.tac: don't report negative timeleft
1461warner@lothar.com**20080807173433]
1462[diskwatcher.tac: reduce the polling rate to once per hour
1463warner@lothar.com**20080807062021]
1464[misc/spacetime: add munin plugins, add everything to .deb
1465warner@lothar.com**20080807060003]
1466[diskwatcher.tac: hush pyflakes
1467warner@lothar.com**20080807050427]
1468[diskwatcher.tac: add async-GET code, but leave it commented out: urlopen() seems to work better for now
1469warner@lothar.com**20080807050327]
1470[cpu-watcher.tac: improve error message
1471warner@lothar.com**20080807043801]
1472[disk-watcher: first draft of a daemon to use the HTTP stats interface and its new storage_server.disk_avail feature, to track changes in disk space over time
1473warner@lothar.com**20080807042222]
1474[misc/cpu-watcher.tac: tolerate missing pidfiles, just skip over that sample
1475warner@lothar.com**20080807041705]
1476[setup: don't attempt to escape quote marks, just delete them.  Ugly, but it works okay.
1477zooko@zooko.com**20080806232742]
1478[setup: escape any double-quote chars in the PATH before using the PATH to find and invoke trial
1479zooko@zooko.com**20080806231143]
1480[storage: include disk-free information in the stats-gatherer output
1481warner@lothar.com**20080806210602]
1482[mutable: more repair tests, one with force=True to check out merging
1483warner@lothar.com**20080806190607]
1484[test/common: add ShouldFailMixin
1485warner@lothar.com**20080806190552]
1486[test_mutable: add comment about minimal-bandwidth repairer, comma lack of
1487warner@lothar.com**20080806173850]
1488[test_mutable: factor out common setup code
1489warner@lothar.com**20080806173804]
1490[mutable: start adding Repair tests, fix a simple bug
1491warner@lothar.com**20080806061239]
1492[mutable.txt: add warning about out-of-date section
1493warner@lothar.com**20080806061219]
1494[test_system: factor out find_shares/replace_shares to a common class, so they can be used by other tests
1495warner@lothar.com**20080806014958]
1496[debian/control: update dependencies to match _auto_deps: foolscap-0.3.0, pycryptopp-0.5
1497warner@lothar.com**20080806013222]
1498[bump foolscap dependency to 0.3.0, for the new incident-gathering interfaces
1499warner@lothar.com**20080805235828]
1500[web: add 'report incident' button at the bottom of the welcome page
1501warner@lothar.com**20080805190921]
1502[test_cli: more coverage for 'tahoe put' modifying a mutable file in-place, by filename, closes #441
1503warner@lothar.com**20080804202643]
1504[check_grid.py: update to match new CLI: 'put - TARGET' instead of 'put TARGET'
1505warner@lothar.com**20080802024856]
1506[test_cli: remove windows-worrying newlines from test data
1507warner@lothar.com**20080802024734]
1508[test_cli.py: factor out CLITestMixin
1509warner@lothar.com**20080802022938]
1510[CLI: change one-arg forms of 'tahoe put' to make an unlinked file, fix replace-mutable #441
1511warner@lothar.com**20080802022729]
1512[CLI: add create-alias command, to merge mkdir and add-alias into a single (secure-from-argv-snooping) step
1513warner@lothar.com**20080802021041]
1514[test_cli: add system-based tests for PUT, including a mutable put that fails/todo (#441)
1515warner@lothar.com**20080801221009]
1516[tests: simplify CLI tests that use stdin, now that runner supports it
1517warner@lothar.com**20080801220514]
1518[CLI: simplify argument-passing, use options= for everthing, including stdout
1519warner@lothar.com**20080801184624]
1520[tests: add test that verifier notices any (randomly chosen) bit flipped in the verifiable part of any (randomly chosen) share
1521zooko@zooko.com**20080731002015
1522 The currently verifier doesn't (usually) pass this randomized test, hence the TODO.
1523]
1524[tests: test that checker doesn't cause reads on the storage servers
1525zooko@zooko.com**20080730235420
1526 It would still pass the test if it noticed a corrupted share.  (It won't
1527 notice, of course.)  But it is required to do its work without causing storage
1528 servers to read blocks from the filesystem.
1529 
1530]
1531[storage: make storage servers declare oldest supported version == 1.0, and storage clients declare oldest supported version == 1.0
1532zooko@zooko.com**20080730225107
1533 See comments in patch for intended semantics.
1534]
1535[tests: use the handy dandy TestCase.mktemp() function from trial to give unique and nicely named directories for each testcase
1536zooko@zooko.com**20080730224920]
1537[tests: don't use SignalMixin
1538zooko@zooko.com**20080730223536
1539 It seems like we no longer need it, and it screws up something internal in
1540 trial which causes trial's TestCase.mktemp() method to exhibit wrong behavior
1541 (always using a certain test method name instead of using the current test
1542 method name), and I wish to use TestCase.mktemp().
1543 
1544 Of course, it is possible that the buildbot is about to tell me that we do
1545 still require SignalMixin on some of our platforms...
1546 
1547]
1548[setup: if the user passes a TRIALOPT env var then pass that on to trial
1549zooko@zooko.com**20080730205806
1550 This is useful for --reporter=bwverbose, for example.
1551]
1552[setup: turn back on reactor=poll for cygwin trial (else it runs out of fds)
1553zooko@zooko.com**20080730181217]
1554[setup: fix bug in Makefile -- ifeq, not ifneq -- so that now it sets poll reactor only if the user hasn't specified a REACTOR variable, instead of setting poll reactor only if the user has specified a REACTOR variable
1555zooko@zooko.com**20080730160429]
1556[setup: whoops, really remove the default reactor=poll this time
1557zooko@zooko.com**20080730032358]
1558[setup: instead of setting --reactor=poll for trial in all cases (which fails on platforms that don't have poll reactor, such as Windows and some Mac OS X), just set --reactor=poll for linux2.
1559zooko@zooko.com**20080730031656
1560 
1561]
1562[setup: pass --reactor=poll to trial unless REACTOR variable is set, in which case pass --reactor=$(REACTOR)
1563zooko@zooko.com**20080730023906
1564 This hopefully works around the problem that Twisted v8.1.0 has a bug when used
1565 with pyOpenSSL v0.7 which bug causes some unit tests to spuriously fail -- see
1566 known_issues.txt r2788:
1567 
1568 http://allmydata.org/trac/tahoe/browser/docs/known_issues.txt?rev=2788#L122
1569 
1570 Also it matches with the fact that --reactor=poll is required on cygwin.
1571 
1572]
1573[setup: require secure_connections from foolscap
1574zooko@zooko.com**20080730021041
1575 This causes a problem on debian sid, since the pyOpenSSL v0.6 .deb doesn't come
1576 with .egg-info, so setuptools will not know that it is already installed and
1577 will try to install pyOpenSSL, and if it installs pyOpenSSL v0.7, then this
1578 will trigger the bug in Twisted v8.1.0 when used with pyOpenSSL v0.7.
1579 
1580 http://twistedmatrix.com/trac/ticket/3218
1581 
1582 Now the comments in twisted #3218 suggest that it happens only with the select
1583 reactor, so maybe using --reactor=poll will avoid it.
1584 
1585]
1586[tests: add test_system.Checker which tests basic checking (without verification) functionality
1587zooko@zooko.com**20080728234317]
1588[test: add testutil.flip_one_bit which flips a randomly chosen bit of the input string
1589zooko@zooko.com**20080728234217]
1590[tests: make it so that you can use common.py's SystemTestMixin.set_up_nodes() more than once with the same introducer
1591zooko@zooko.com**20080728234029]
1592[download.py: set up self._paused before registering the producer, since they might call pauseProducing right away
1593warner@lothar.com**20080728215731]
1594[test/common.py: use pre-computed Tub certificates for the system-test mixin, to speed such tests up by maybe 15%. The goal is to encourage more full-grid tests.
1595warner@allmydata.com**20080728194421]
1596[munin/tahoe_spacetime: show 2wk data even if 4wk data is unavailable
1597warner@allmydata.com**20080728194233]
1598[web: add /status/?t=json, with active upload/download ops. Addresses #493.
1599warner@allmydata.com**20080726004110]
1600[web: make t=json stats pages use text/plain, instead of leaving it at text/html
1601warner@allmydata.com**20080726002427]
1602[test_system.py: factor SystemTestMixin out of SystemTest
1603warner@allmydata.com**20080725223349]
1604[test_system.py: modify system-test setup code in preparation for merge with common.SystemTestMixin
1605warner@allmydata.com**20080725222931]
1606[test_system.py: move SystemTestMixin out into common.py, where further improvements will occur
1607warner@allmydata.com**20080725221758]
1608[test_system.py: create SystemTestMixin, with less cruft, for faster system-like tests
1609warner@allmydata.com**20080725221300]
1610[TAG allmydata-tahoe-1.2.0
1611zooko@zooko.com**20080722014608]
1612Patch bundle hash:
161318de68f402677061070f4e2980fa146860351ec9