1 | |
---|
2 | New patches: |
---|
3 | |
---|
4 | [New credit file entry |
---|
5 | francois@ctrlaltdel.ch**20081114140548] { |
---|
6 | hunk ./CREDITS 54 |
---|
7 | +N: François Deppierraz |
---|
8 | +D: bug fix, testing |
---|
9 | +E: francois@ctrlaltdel.ch |
---|
10 | + |
---|
11 | } |
---|
12 | |
---|
13 | Context: |
---|
14 | |
---|
15 | [CLI: add 'tahoe stats', to run start-deep-stats and print the results |
---|
16 | warner@allmydata.com**20081114014350] |
---|
17 | [test_system.py: fix new 'tahoe manifest' tests to not break on windows, by providing --node-directory instead of --node-url |
---|
18 | warner@allmydata.com**20081113212748] |
---|
19 | [test for bug #534, unicode filenames |
---|
20 | francois@ctrlaltdel.ch**20081113111951 |
---|
21 | |
---|
22 | This test assure that uploading a file whose name contains unicode character |
---|
23 | doesn't prevent further uploads in the same directory. |
---|
24 | ] |
---|
25 | [Fix an filename encoding issue with "tahoe cp" |
---|
26 | francois@ctrlaltdel.ch**20081111200803] |
---|
27 | [web/info.py: use 128-bit ophandles instead of 64-bit |
---|
28 | warner@allmydata.com**20081113021842] |
---|
29 | [CLI: add 'tahoe manifest', which takes a directory and returns a list of things you can reach from it |
---|
30 | warner@allmydata.com**20081113021725] |
---|
31 | [create_node.py: also remove now-unused import of pkg_resources |
---|
32 | warner@allmydata.com**20081113004716] |
---|
33 | [tahoe.cfg: add tub.location, to override the location hints we include in our FURL. This replaces advertised_ip_addresses, which doesn't remain useful enough to retain it. Helps with #517 (Tor). |
---|
34 | warner@allmydata.com**20081113004458] |
---|
35 | [setup: remove pkg_resources.require() from create_node.py and add it to runner.py |
---|
36 | zooko@zooko.com**20081112212503 |
---|
37 | Ignore-this: 763324202456a59b833b14eb4027171 |
---|
38 | Brian correctly points out that the latter is an entry point. |
---|
39 | ] |
---|
40 | [docs: fix cutnpasto in source:docs/logging.txt |
---|
41 | zooko@zooko.com**19700105140422 |
---|
42 | Ignore-this: de0f9ceb8e0ca4c158492ad2f9a6ba6f |
---|
43 | ] |
---|
44 | [tests: fix comment |
---|
45 | zooko@zooko.com**19700105101055 |
---|
46 | Ignore-this: fabedea917895568b1fca75a480111b9 |
---|
47 | ] |
---|
48 | [tests: add tahoe_cp to the list of scripts that we don't actually have tests for yet |
---|
49 | zooko@zooko.com**19700105100058 |
---|
50 | Ignore-this: ac89583992fb1b48d9a4680344569d91 |
---|
51 | ] |
---|
52 | [setup: the .tac files created by create_node.py call pkg_resources.require() so that they can load tahoe and twisted packages which were installed with setuptools multi-version mode |
---|
53 | zooko@zooko.com**19700101235005 |
---|
54 | Ignore-this: e1db03f86e0407a91087d8ada6b477fd |
---|
55 | Also the create_node.py script itself uses pkg_resources.require() for the same reason. |
---|
56 | ] |
---|
57 | [web/info: don't let an unrecoverable file break the page (show ? instead of a size) |
---|
58 | warner@allmydata.com**20081107045117] |
---|
59 | [checker: add is_recoverable() to checker results, make our stub immutable-verifier not throw an exception on unrecoverable files, add tests |
---|
60 | warner@allmydata.com**20081107043547] |
---|
61 | [monitor: update interface definition: get_status() can return a Failure |
---|
62 | warner@allmydata.com**20081107035452] |
---|
63 | [web/operations.py: if the operation failed, render the Failure |
---|
64 | warner@allmydata.com**20081107035309] |
---|
65 | [undoing test change for native_client.php |
---|
66 | secorp@allmydata.com**20081106220310] |
---|
67 | [NEWS: more minor edits |
---|
68 | warner@allmydata.com**20081106223517] |
---|
69 | [NEWS: minor edits |
---|
70 | warner@allmydata.com**20081106223356] |
---|
71 | [NEWS: mention SFTP server |
---|
72 | warner@allmydata.com**20081106014153] |
---|
73 | [client.py: oops, update FTP/SFTP config names to match current docs |
---|
74 | warner@allmydata.com**20081106013442] |
---|
75 | [remove duplicate+old docs/NEWS. The top-level NEWS file is the canonical one. |
---|
76 | warner@allmydata.com**20081106013224] |
---|
77 | [SFTP/FTP: merge user/account code, merge docs |
---|
78 | warner@allmydata.com**20081106012558] |
---|
79 | [docs: move webapi/ftp/sftp into a new frontends/ directory |
---|
80 | warner@allmydata.com**20081105233050] |
---|
81 | [ftp/sftp: move to a new frontends/ directory in preparation for factoring out password-auth component |
---|
82 | warner@allmydata.com**20081105200733] |
---|
83 | [sftpd: minor debug-logging tweak |
---|
84 | warner@allmydata.com**20081105194511] |
---|
85 | [confwiz.py - trying out a new configuration site |
---|
86 | secorp@allmydata.com**20081105011830] |
---|
87 | [ftpd: include an (unused) avatar logout callback |
---|
88 | warner@allmydata.com**20081105000104] |
---|
89 | [#531: implement an SFTP frontend. Mostly works, still lots of debug messages. Still needs tests and auth-by-pubkey in accounts.file |
---|
90 | warner@allmydata.com**20081105000022] |
---|
91 | [docs/ftp.txt: correct Twisted dependency: we don't need VFS, we can use a release, as long as you apply the patch |
---|
92 | warner@allmydata.com**20081104235840] |
---|
93 | [shebang: replace "/usr/bin/python" with "/usr/bin/env python" |
---|
94 | zooko@zooko.com**20081105000306 |
---|
95 | Ignore-this: 8ae33a8a7828fa7423422e252f2cfd74 |
---|
96 | ] |
---|
97 | [misc/fixshebangs.py |
---|
98 | zooko@zooko.com**20081105000130 |
---|
99 | Ignore-this: 13b03ea2d2ed8982f8346a827b46bd2e |
---|
100 | ] |
---|
101 | [util: copy in pyutil.fileutil.ReopenableNamedTemporaryFile |
---|
102 | zooko@zooko.com**20081104234715 |
---|
103 | Ignore-this: f1131e9b8f249b5f10be4cba2aeb6118 |
---|
104 | ] |
---|
105 | [immutable: tolerate filenode.read() with a size= that's too big, rather than hanging |
---|
106 | warner@allmydata.com**20081104212919] |
---|
107 | [util: copy in nummedobj from pyutil |
---|
108 | zooko@zooko.com**20081104195550] |
---|
109 | [util: copy in dictutil from pyutil |
---|
110 | zooko@zooko.com**20081104195327] |
---|
111 | [rollback change... move allmydatacontextmenu registration to installer.tmpl in tahoe-w32-client\installer |
---|
112 | booker@allmydata.com**20081103213647] |
---|
113 | [register the AllmydataContextMenu.dll for the context menu handler file sharing shell extension |
---|
114 | booker@allmydata.com**20081103200027] |
---|
115 | [debug catalog-shares: tolerate even more errors on bad files/directories |
---|
116 | warner@allmydata.com**20081030215447] |
---|
117 | [NEWS: update with all user-visible changes since the last update |
---|
118 | warner@allmydata.com**20081030213604] |
---|
119 | [#527: expire the cached files that are used to support Range: headers, every hour, when the file is unused and older than an hour |
---|
120 | warner@allmydata.com**20081030203909] |
---|
121 | [util/cachedir.py: add a cache-directory manager class, which expires+deletes unused files after a while |
---|
122 | warner@allmydata.com**20081030200120] |
---|
123 | [test_cli: try to fix windows again |
---|
124 | warner@allmydata.com**20081030193204] |
---|
125 | [debug/test_cli: fix error handling for catalog-shares, to make the test stop failing on windows |
---|
126 | warner@allmydata.com**20081030190651] |
---|
127 | [web: add 'Repair' button to checker results when they indicate unhealthyness. Also add the object's uri to the CheckerResults instance. |
---|
128 | warner@allmydata.com**20081030010917] |
---|
129 | [create_node.py: add 'web.static = public_html' to the initial tahoe.cfg |
---|
130 | warner@allmydata.com**20081030001336] |
---|
131 | [webapi: serve the /static URL tree from /public_html (configurable) |
---|
132 | warner@allmydata.com**20081029223431] |
---|
133 | [catalog-shares command: tolerate errors, log them to stderr, handle v2-immutable shares |
---|
134 | warner@allmydata.com**20081029221010] |
---|
135 | [test_web.py: one more line of test coverage |
---|
136 | warner@allmydata.com**20081029050015] |
---|
137 | [test_web: improve test coverage of PUT DIRURL t=uri replace=false |
---|
138 | warner@allmydata.com**20081029045744] |
---|
139 | [web: test (and fix) PUT DIRURL t=uri, which replaces a directory in-place with some other cap |
---|
140 | warner@allmydata.com**20081029045446] |
---|
141 | [web/directory.py: slight shuffle to improve test coverage |
---|
142 | warner@allmydata.com**20081029045406] |
---|
143 | [test_client.py: improve test coverage a bit |
---|
144 | warner@allmydata.com**20081029044335] |
---|
145 | [node.py: remove unused old_log() function |
---|
146 | warner@allmydata.com**20081029043558] |
---|
147 | [node.py: remove support for the old BASEDIR/authorized_keys.PORT file |
---|
148 | warner@allmydata.com**20081029043420] |
---|
149 | [move testutil into test/common_util.py, since it doesn't count as 'code under test' for our pyflakes numbers |
---|
150 | warner@allmydata.com**20081029042831] |
---|
151 | [util: move PollMixin to a separate file (pollmixin.py), so testutil can be moved into test/ |
---|
152 | warner@allmydata.com**20081029041548] |
---|
153 | [control.py: removed unused testutil.PollMixin |
---|
154 | warner@allmydata.com**20081029040359] |
---|
155 | [web/filenode: oops, fix test failures, not everything has a storage index |
---|
156 | warner@allmydata.com**20081029011720] |
---|
157 | [web/filenode: add Accept-Ranges and ETag (for immutable files) headers to GET responses |
---|
158 | warner@allmydata.com**20081029010103] |
---|
159 | [#527: respond to GETs with early ranges quickly, without waiting for the whole file to download. Fixes the alacrity problems with the earlier code. Still needs cache expiration. |
---|
160 | warner@allmydata.com**20081029005618] |
---|
161 | [#527: support HTTP 'Range:' requests, using a cachefile. Adds filenode.read(consumer, offset, size) method. Still needs: cache expiration, reduced alacrity. |
---|
162 | warner@lothar.com**20081028204104] |
---|
163 | [iputil.py: avoid a DNS lookup at startup (which may timeout tests when run on a partially-offline host) by using 198.41.0.4 instead of A.ROOT-SERVERS.NET |
---|
164 | warner@lothar.com**20081028203646] |
---|
165 | [interfaces.py: promote immutable.encode.NotEnoughSharesError.. it isn't just for immutable files any more |
---|
166 | warner@lothar.com**20081027203449] |
---|
167 | [interfaces.IMutableFileNode.download_best_version(): fix return value |
---|
168 | warner@lothar.com**20081027202046] |
---|
169 | [dirnode lookup: use distinct NoSuchChildError instead of the generic KeyError when a child can't be found |
---|
170 | warner@lothar.com**20081027201525] |
---|
171 | [storage: don't use colons in the corruption-advisory filename, since windows can't tolerate them |
---|
172 | warner@lothar.com**20081026024633] |
---|
173 | [mutable: call remove_advise_corrupt_share when we see share corruption in mapupdate/download/check, tolerate servers that do not implement it |
---|
174 | warner@lothar.com**20081024202128] |
---|
175 | [storage: add remote_advise_corrupt_share, for clients to tell storage servers about share corruption that they've discovered. The server logs the report. |
---|
176 | warner@lothar.com**20081024185248] |
---|
177 | [mutable/servermap.py: fix needs_merge(), it was incorrectly claiming that mixed shares with distinct seqnums needed a merge, causing repair(force=False) to fail |
---|
178 | warner@lothar.com**20081024040024] |
---|
179 | [test_web.test_POST_DIRURL_deepcheck: confirm that /operations/HANDLE/ works with or without the slash |
---|
180 | warner@lothar.com**20081024021759] |
---|
181 | [web/checker_results.py: remove dead code |
---|
182 | warner@lothar.com**20081024001717] |
---|
183 | [test_web: more test coverage |
---|
184 | warner@lothar.com**20081024001118] |
---|
185 | [webapi: fix t=rename from==to, it used to delete the file |
---|
186 | warner@lothar.com**20081023233236] |
---|
187 | [test_system: update test to match web checker results |
---|
188 | warner@lothar.com**20081023233202] |
---|
189 | [webapi deep-check: show the root as <root>, rather than an empty path string |
---|
190 | warner@lothar.com**20081023230359] |
---|
191 | [mutable/checker: announce the mapupdate op on the 'recent uploads+downloads' page |
---|
192 | warner@lothar.com**20081023230319] |
---|
193 | [scripts/create_node.py: remove empty-string defaults for --introducer= and --nickname= |
---|
194 | warner@lothar.com**20081023230235] |
---|
195 | [deep-check: add webapi links to detailed per-file/dir results |
---|
196 | warner@lothar.com**20081023230031] |
---|
197 | [interface.py: fix typo |
---|
198 | warner@lothar.com**20081023225936] |
---|
199 | [webapi: make the /operations/ 't=status' qualifier optional, remove it from examples |
---|
200 | warner@lothar.com**20081023225658] |
---|
201 | [setup: require the latest version of the setuptools bootstrap egg |
---|
202 | zooko@zooko.com**20081025152858 |
---|
203 | Ignore-this: c0c9923ba3008f410d5cc56f2236edb9 |
---|
204 | ] |
---|
205 | [setup: include _pkgutil.py in setuptools bootstrap egg so that it will work on Python 2.4 |
---|
206 | zooko@zooko.com**20081025152839 |
---|
207 | Ignore-this: 38d81a037c1a3413d69d580ccb13fd67 |
---|
208 | ] |
---|
209 | [setup: pretend the tahoe requires twisted to set up, so that twisted will be there for nevow |
---|
210 | zooko@zooko.com**20081025135042 |
---|
211 | Ignore-this: 4e6c7e580f7e30df571e2e63be663734 |
---|
212 | ] |
---|
213 | [setup: require the SVN snapshot of setuptools to build |
---|
214 | zooko@zooko.com**20081025134959 |
---|
215 | Ignore-this: f68077dd10d85a71a1e06678365e6753 |
---|
216 | ] |
---|
217 | [setup: remove old bundled setuptools-0.6c9 |
---|
218 | zooko@zooko.com**20081025134947 |
---|
219 | Ignore-this: 3a95dd72346a60b39ffd6ddfadd1b3a8 |
---|
220 | ] |
---|
221 | [setup: bundle an SVN snapshot of setuptools instead of the most recent stable release of setuptools |
---|
222 | zooko@zooko.com**20081025134837 |
---|
223 | Ignore-this: 9a0c9a34b186b972650cf9455edb0d28 |
---|
224 | This SVN snapshot fixes a problem that prevents the setting up of nevow: |
---|
225 | http://bugs.python.org/setuptools/issue20 |
---|
226 | ] |
---|
227 | [setup: reorder dependencies to be sort of increasing order of how much they depend on other stuff |
---|
228 | zooko@zooko.com**20081025134739 |
---|
229 | Ignore-this: 6d636aaf5deb37cbf18172824b0bbf87 |
---|
230 | Not that the order makes any different to how it gets installed, as far as I can tell. |
---|
231 | ] |
---|
232 | [docs: add a note that when you make a new tahoe release, you should send the announcement to fuse-devel@lists.sourceforge.net |
---|
233 | zooko@zooko.com**20081023213658] |
---|
234 | [web/info.py: fix 'Check This Object' link, for files it was checking the parent directory by mistake |
---|
235 | warner@lothar.com**20081022171056] |
---|
236 | [#514: add meta-refresh=60 tag to t=status page for incomplete operations |
---|
237 | warner@lothar.com**20081022164842] |
---|
238 | [test_dirnode.py: oops, missed a Monitor(), unbreak tests |
---|
239 | warner@lothar.com**20081022085054] |
---|
240 | [immutable/filenode.py: add TODO note about the #514 monitor to check(), rather than going through the checker/verifier code and adding it, since Zooko is currently working on that code |
---|
241 | warner@lothar.com**20081022084237] |
---|
242 | [more #514: pass a Monitor to all checker operations, make mutable-checker honor the cancel flag |
---|
243 | warner@lothar.com**20081022083818] |
---|
244 | [dirnode.py: check for cancel during deep-traverse operations, and don't initiate any new ones if we've been cancelled. Gets us closer to #514. |
---|
245 | warner@lothar.com**20081022075552] |
---|
246 | [more #514 log-webop status/cancel: add handle-expiration, test coverage |
---|
247 | warner@lothar.com**20081022051354] |
---|
248 | [webapi.txt: improve t=deep-size output docs |
---|
249 | warner@lothar.com**20081022005331] |
---|
250 | [#514: improve test coverage |
---|
251 | warner@lothar.com**20081022005256] |
---|
252 | [Change deep-size/stats/check/manifest to a start+poll model instead of a single long-running synchronous operation. No cancel or handle-expiration yet. #514. |
---|
253 | warner@lothar.com**20081022000307] |
---|
254 | [setup: change ez_setup.py to install setuptools-0.6c9 |
---|
255 | zooko@zooko.com**20080930200502] |
---|
256 | [setup: bundle setuptools-0.6c9 |
---|
257 | zooko@zooko.com**20080930200448] |
---|
258 | [setup: remove bundled setuptools-0.6c8 |
---|
259 | zooko@zooko.com**20080930200336] |
---|
260 | [setup: remove the developer note about doing without GNU make (the GNU make requirement is about to hurt Peter if he tries to follow this doc, by the way) |
---|
261 | zooko@zooko.com**20081021163200 |
---|
262 | add classifiers showing with which versions of Python it is known to work. |
---|
263 | ] |
---|
264 | [* fuse/runtests: added --catch-up-pause option |
---|
265 | robk-tahoe@allmydata.com**20081021002902 |
---|
266 | |
---|
267 | On linux, write tests are failing because data written to fuse isn't showing |
---|
268 | up in tahoe by the time it's checked. it's not clear where this is originating, |
---|
269 | since the fuse implementation [should be] waiting for completion of tahoe |
---|
270 | operations before returning from its calls. This adds an option to control the |
---|
271 | duration of a pause between the fuse write and the check of tahoe, which is by |
---|
272 | default set to 2s on linux, which - somewhat inexplicably - seems to 'fix' the |
---|
273 | problem, in as far as it allows tests to complete. |
---|
274 | |
---|
275 | ] |
---|
276 | [fuse/runtests: include length in drepr() output |
---|
277 | robk-tahoe@allmydata.com**20081021000159] |
---|
278 | [fuse/runtests: make exceptions in 'read_in_random_order' into TestFailures |
---|
279 | robk-tahoe@allmydata.com**20081020235235] |
---|
280 | [fuse/blackmatch: added asynchronous (background) file download |
---|
281 | robk-tahoe@allmydata.com**20081020233333 |
---|
282 | |
---|
283 | previously, upon opening a file for reading, the open() call would block |
---|
284 | while the entire file was retrieved from tahoe into the cache directory. |
---|
285 | This change adds a DownloaderWithReadQueue class, and associated plumbing, |
---|
286 | such that an open() will return promptly with the download initiated 'in |
---|
287 | the background'. Subsequent read() operations will block until enough |
---|
288 | data has been downloaded to satisfy that request. This provides a behaviour |
---|
289 | similar to streaming, i.e. the client application will be able to read |
---|
290 | data from the fuse interface while the remainder of the file is still being |
---|
291 | downloaded. |
---|
292 | |
---|
293 | ] |
---|
294 | [fuse/runtests: added 'read_in_random_order' test |
---|
295 | robk-tahoe@allmydata.com**20081020232427 |
---|
296 | |
---|
297 | this test uploads a test file to tahoe, and then reads the file from fuse, |
---|
298 | but reads the blocks of the file in a random order; this is designed to |
---|
299 | exercise the asynchronous download feature of blackmatch - where the file |
---|
300 | is downloaded from tahoe asynchronously, and rather than blocking open() |
---|
301 | for the entirety of the download, instead individual read() calls are |
---|
302 | blocked until enough of the file has been downloaded to satisfy them |
---|
303 | ] |
---|
304 | [fuse/runtests: added a --no-cleanup option |
---|
305 | robk-tahoe@allmydata.com**20081020155120 |
---|
306 | |
---|
307 | the code had a 'fullcleanup' flag internally which controlled whether |
---|
308 | working directories were cleaned up. this promotes that to a command |
---|
309 | line option (negated) '--no-cleanup' defaulting to False, i.e. do cleanup |
---|
310 | ] |
---|
311 | [fuse/runtests: truncate expected file contents in reported error message |
---|
312 | robk-tahoe@allmydata.com**20081020144523 |
---|
313 | |
---|
314 | this avoids dumping the repr of 1Mb of random data to stdout in the event |
---|
315 | of a test failure, but rather just dumps the start/end of the errant strings |
---|
316 | if the amount of data is > 200 chars repr'd |
---|
317 | ] |
---|
318 | [fuse/blackmatch: fix platform specific problems in repr_flags |
---|
319 | robk-tahoe@allmydata.com**20081020143052 |
---|
320 | |
---|
321 | the repr_flags debug/logging function had a list of fields from the os |
---|
322 | module that might be passed into an open() call, but it included at |
---|
323 | least one which was available on the mac but not on linux. symmetrically |
---|
324 | linux has numerous flags which are not present on the mac. the repr_flags |
---|
325 | function is now tolerant of flags not being present, and has an expanded |
---|
326 | list of flags |
---|
327 | ] |
---|
328 | [makefile: added 'fuse-test' target to makefile, to run 'runtests' |
---|
329 | robk-tahoe@allmydata.com**20081019132518] |
---|
330 | [fuse/runtests: added a 'todo' flag, surpressing failure for implementations not expected to pass |
---|
331 | robk-tahoe@allmydata.com**20081019131600 |
---|
332 | |
---|
333 | since the current tests assume that the implementation responds to changes made |
---|
334 | to tahoe after mount, and impl_b prefetches and cached directory data, impl_b |
---|
335 | fails the current 'read' test suite. |
---|
336 | |
---|
337 | rather than reflect that problem in the overall failure of the runtests exit |
---|
338 | code, this adds a 'todo' flag to the implementations table, and sets the todo |
---|
339 | flag for impl_b. Thus errors will therein be reported in output, but not cause |
---|
340 | a failing exit code. |
---|
341 | ] |
---|
342 | [fuse/runtests: made runtests exit code depend on success |
---|
343 | robk-tahoe@allmydata.com**20081017180058 |
---|
344 | |
---|
345 | return an exit code of 0 only if no tests failed, and 1 in the case of |
---|
346 | linkage error, test setup failure, or individual test case failure |
---|
347 | |
---|
348 | ] |
---|
349 | [storage.py: assert that immutable share size will fit in the 4-byte v1 container (see #346). The struct module in py2.4 raises an error on overflow, but py2.5 merely emits a warning |
---|
350 | warner@lothar.com**20081020172208] |
---|
351 | [NEWS: update to summarize all changes since the last update |
---|
352 | warner@lothar.com**20081020164047] |
---|
353 | [fuse/runtest: make removal of webport file soft |
---|
354 | robk-tahoe@allmydata.com**20081017030154 |
---|
355 | |
---|
356 | previously the runtests suite removed the webport file created by |
---|
357 | tahoe create-client in all but the first node. now that the node config |
---|
358 | is in tahoe.cfg by default this file might not exist. |
---|
359 | ] |
---|
360 | [fuse/blackmatch: update json handling to support simplejson v2 |
---|
361 | robk-tahoe@allmydata.com**20081017025931 |
---|
362 | |
---|
363 | simplejson v2 returns strings as either unicode or str, depending upon its |
---|
364 | mood. thus the interpretation of the node's json repr of a directory, and |
---|
365 | the serialisation of strings in the json based rpc both exploded when built |
---|
366 | against simplejson v2. this makes both of these places liberal in their |
---|
367 | acceptance of either str or unicode. |
---|
368 | ] |
---|
369 | [fuse/blackmatch: log exception in server startup |
---|
370 | robk-tahoe@allmydata.com**20081017014650 |
---|
371 | |
---|
372 | humphf. my build runs the fuse stuff fine, but the build from the buildslave |
---|
373 | doesn't seem to start up properly. hopefully this will elicit some useful info |
---|
374 | ] |
---|
375 | [fuse/blackmatch: add readability to some logging, fix a permissions problem |
---|
376 | robk-tahoe@allmydata.com**20081017004421 |
---|
377 | |
---|
378 | adds a couple of functions to unpack 'mode' and 'flags' for open() calls, to |
---|
379 | facilitate debugging. |
---|
380 | |
---|
381 | adds a fix to ensure that all tmp files created for writing are opened with |
---|
382 | permissions 0600 - one problem I had with testing with the Finder was that |
---|
383 | files were being opened write only (0200) and were then failing to upload |
---|
384 | to tahoe due to internal permission denied errors. |
---|
385 | |
---|
386 | there remain a variety of problems with finder access which I'm unable to |
---|
387 | comprehend at this time. sometimes copies to tahoe will work fine, sometimes |
---|
388 | they yield "the finder cannot complete the operation because some data ... |
---|
389 | could not be read or written. (Error code -36)" sometimes "You may need to |
---|
390 | enter the name and password for an administrator on this computer to change |
---|
391 | the item" sometimes "The operation cannot be completed because an item with |
---|
392 | the name ... already exists." and sometimes "The operation cannot be completed |
---|
393 | because the item ... is locked." What seems to be absent is rhyme or reason. |
---|
394 | |
---|
395 | unix operations (cp, mv) work fine, rsync works fine. |
---|
396 | |
---|
397 | ] |
---|
398 | [fuse/blackmatch: fix linkage problems with daemonize |
---|
399 | robk-tahoe@allmydata.com**20081016163637 |
---|
400 | |
---|
401 | the daemonize() function imported from twisted was causing problems when |
---|
402 | run from a frozen (py2app) build. I simply copied the daemonize function |
---|
403 | into this file, and that fixes the problem. |
---|
404 | |
---|
405 | also removed a couple of lines of debugging spam that slipped through. |
---|
406 | |
---|
407 | ] |
---|
408 | [gui/macapp: minor bugfixes |
---|
409 | robk-tahoe@allmydata.com**20081016163052 |
---|
410 | |
---|
411 | though it seemed to work before the 'fstype' passed to fuse of 'allmydata' was |
---|
412 | today throwing errors that len(fstype) must be at most 7. |
---|
413 | |
---|
414 | fixed a typo in changes to 'mount_filesystem()' args |
---|
415 | |
---|
416 | bumped the delay between mounting a filesystem and 'open'ing it in Finder to |
---|
417 | 4s, as it seems to take a little longer to mount now the client and server |
---|
418 | fuse processes need to coordinate. |
---|
419 | ] |
---|
420 | [fuse/blackmatch: split into client/server (twisted server) |
---|
421 | robk-tahoe@allmydata.com**20081016150846 |
---|
422 | |
---|
423 | This implements a client/server split for blackmatch, where the client |
---|
424 | implements the fuse_main bindings and a simple blocking rpc client mechanism. |
---|
425 | The server implements the other half of that rpc mechanism, and contains all |
---|
426 | the actual logic for interpreting fuse requests in the context of the on disk |
---|
427 | cache and requests to the tahoe node. The server is based on a twisted reactor. |
---|
428 | |
---|
429 | The rpc mechanism implements a simple method dispatch including marshalling, |
---|
430 | using json, of basic inert data types, in a flat namespace (no objects). |
---|
431 | The client side is written in a blocking idiom, to interface with the threading |
---|
432 | model used by the fuse_main bindings, whereas the server side is written for a |
---|
433 | twisted reactor-based environment, intended to facilitate implementing more |
---|
434 | sophisticated logic in that paradigm. The two communicate over a unix domain |
---|
435 | socket, allocated within the nodedir. |
---|
436 | |
---|
437 | Command line usage is unchanged; the server is launched automatically by the |
---|
438 | client. The server daemonizes itself, to avoid preventing the original parent |
---|
439 | process (e.g. 'runtests') from waiting upon the server exiting. |
---|
440 | |
---|
441 | The client keeps open a 'keepalive' connection to the server; upon loss thereof |
---|
442 | the server will exit. This addresses the fact that the python-fuse bindings |
---|
443 | provide no notification of exit of the client process upon unmount. |
---|
444 | |
---|
445 | The client thus provides a relatively thin 'shim' proxying requests from the |
---|
446 | fuse_main bindings across the rpc to the server process, which handles the |
---|
447 | logic behind each request. |
---|
448 | |
---|
449 | For the time being, a '--no-split' option is provided to surpress the splitting |
---|
450 | into client/server, yielding the prior behaviour. Once the server logic gets |
---|
451 | more complex and more entrenched in a twisted idiom, this might be removed. |
---|
452 | The 'runtests' test harness currently tests both modes, as 'impl_c' and |
---|
453 | 'impl_c_no_split' |
---|
454 | |
---|
455 | ] |
---|
456 | [fuse/blackmatch: 'flatten' the fuse api implementation |
---|
457 | robk-tahoe@allmydata.com**20081016143547 |
---|
458 | |
---|
459 | the previous revision of blackmatch used a file_class to delegate all fuse |
---|
460 | api operations on files to a specific per-file class, which is an option |
---|
461 | given by the python-fuse bindings. |
---|
462 | |
---|
463 | this is a pre-cursor to the 'split' client/server version, which uses a |
---|
464 | simple, moreover flat, rpc mechanism to broker access to methods. |
---|
465 | ] |
---|
466 | [fuse/runtests: disable impl_a/impl_b on mac, as they don't actually work. |
---|
467 | robk-tahoe@allmydata.com**20081016143232] |
---|
468 | [fuse/runtests: added write_partial_overwrite test |
---|
469 | robk-tahoe@allmydata.com**20081016142926 |
---|
470 | |
---|
471 | this tests opening a file for update, overwriting a small part of it, and |
---|
472 | ensuring that the end result constitutes an overwrite of the original file. |
---|
473 | This tests, e.g. the implementation doesn' open a 'fresh' file but does in |
---|
474 | fact initialise the file to be uploaded with the contents of any extant |
---|
475 | file before applying updates |
---|
476 | |
---|
477 | ] |
---|
478 | [fuse/runtests: added --tests, renamed --suites |
---|
479 | robk-tahoe@allmydata.com**20081016142836 |
---|
480 | |
---|
481 | changed the --tests option to be --suites, as it takes a prefix, e.g. 'read' |
---|
482 | 'write' (or 'all', the default) and runs those suites which are applicable to |
---|
483 | each implementation being tested. |
---|
484 | |
---|
485 | added a --tests option, which takes a list of tests, e.g. 'read_file_contents' |
---|
486 | 'write_overlapping_large_writes' and runs all tests specified without regard |
---|
487 | to whether the implementation(s) under test are declared to support them. |
---|
488 | |
---|
489 | this is basically to allow a specific test or two to be run, saving time |
---|
490 | during development and debugging by not running the entire suite |
---|
491 | ] |
---|
492 | [fuse/runtests: added 'random scatter' write test |
---|
493 | robk-tahoe@allmydata.com**20081003233436 |
---|
494 | |
---|
495 | this writes the test file in a randomised order, with randomly sized writes. |
---|
496 | also for each 'slice' of the file written, a randomly chosen overlapping |
---|
497 | write is also made to the file. this ensures that the file will be written |
---|
498 | in its entirety in a thoroughly random order, with many overlapping writes. |
---|
499 | ] |
---|
500 | [fuse/runtests: add overlapping write tests |
---|
501 | robk-tahoe@allmydata.com**20081003224833 |
---|
502 | |
---|
503 | using both small and large blocksizes for writes, write a 1Mb file to fuse |
---|
504 | where every write overlaps another. |
---|
505 | |
---|
506 | This serves a useful purpose - in manual testing of blackmatch some time ago |
---|
507 | most operations e.g. bulk copies, worked fine, but using rsync caused data |
---|
508 | corruption on most files. it turned out to be that rsync writes in 64K blocks, |
---|
509 | but rather than making the last block short, the last block instead overlaps |
---|
510 | the preceding (already written) block. This revealed a problem where cache |
---|
511 | files were being opened 'append' rather than 'write' and hence the overlapping |
---|
512 | write to the fuse layer caused the overlapping portion of the file to be |
---|
513 | duplicated in cache, leading to oversized and corrupt files being uploaded. |
---|
514 | ] |
---|
515 | [fuse/runtests: remove write small file test, as it's subsumed by the tiny_file test |
---|
516 | robk-tahoe@allmydata.com**20081003223944] |
---|
517 | [fuse/runtests: added linear write tests for various block sizes |
---|
518 | robk-tahoe@allmydata.com**20081003223550 |
---|
519 | |
---|
520 | unit tests to test writing contiguous blocks linearly through the file, |
---|
521 | for a variety of block sizes; 'tiny_file' is an entire file fitting within |
---|
522 | a single io block / write operation. 'linear_{small,large}_writes' test |
---|
523 | a 1Mb file written with each write operation containing significantly less |
---|
524 | or more, respecitvely, data than fuse will pass into the implementation as |
---|
525 | a single operation (which on the mac at least is 64Kib) |
---|
526 | ] |
---|
527 | [fuse/runtests: add a very simple 'write' test |
---|
528 | robk-tahoe@allmydata.com**20081003172044 |
---|
529 | |
---|
530 | this performs a very simple write through the fuse layer and confirms that |
---|
531 | the file is stored correctly into the tahoe mesh. ('simple' in the sense |
---|
532 | that the entire file body fits trivially in a single write() operation, |
---|
533 | disk block etc) |
---|
534 | ] |
---|
535 | [fuse/runtests: added a --web-open option |
---|
536 | robk-tahoe@allmydata.com**20081003172026 |
---|
537 | |
---|
538 | similar to the --debug-wait option which causes the test harness to |
---|
539 | pause at various stages of the process to facilitate debugging, this |
---|
540 | option simplifies that debugging by automatically opening a web browser |
---|
541 | to the root dir of that implementation's tests when tests are commenced. |
---|
542 | |
---|
543 | in addition, if --web-open is specfied but --debug-wait is not, the |
---|
544 | harness will still pause after running tests but before tearing down |
---|
545 | the tahoe grid - this allows all tests to run to completion, but |
---|
546 | provide a debugging hook to investigate the end state of the grid's |
---|
547 | contents thereafter. |
---|
548 | ] |
---|
549 | [fuse/impl_a: fix a suspected bug in caching |
---|
550 | robk-tahoe@allmydata.com**20081003171309 |
---|
551 | |
---|
552 | from my examination of the tahoe_fuse ('impl_a') code, it looks like |
---|
553 | the intention is to cache the file contents in memory while it's open, |
---|
554 | since it does in fact do that. however it looks like it also ignored |
---|
555 | that cache entirely, and made an individual tahoe webapi GET request |
---|
556 | for each and every read() operation regardless of the relative size of |
---|
557 | the read block and the file in question. |
---|
558 | |
---|
559 | this changes that to make read() use the data in memory rather than |
---|
560 | fetch the data over again. if there's something more subtle going |
---|
561 | on, please let me know. |
---|
562 | ] |
---|
563 | [gui/macapp: slew of code cleanup; unmount filesystems on quit |
---|
564 | robk-tahoe@allmydata.com**20080925233235 |
---|
565 | |
---|
566 | a handful of code cleanup, renaming and refactoring. basically consolidating |
---|
567 | 'application logic' (mount/unmount fs) into the 'MacGuiApp' class (the wx.App) |
---|
568 | and cleaning up various scoping things around that. renamed all references to |
---|
569 | 'app' to refer more clearly to the 'AppContainer' or to the guiapp. |
---|
570 | |
---|
571 | globally renamed basedir -> nodedir |
---|
572 | |
---|
573 | also made the guiapp keep a note of each filesystem it mounts, and unmount |
---|
574 | them upon 'quit' so as to cleanup the user's environment before the tahoe node |
---|
575 | vanishes from out underneath the orphaned tahoe fuse processes |
---|
576 | |
---|
577 | ] |
---|
578 | [gui/macapp: make submenu of aliases for 'webopen' |
---|
579 | robk-tahoe@allmydata.com**20080925163919 |
---|
580 | |
---|
581 | this changes the 'open webroot' menu item to be a submenu listing all aliases |
---|
582 | defined in ~/.tahoe. Note that the dock menu does not support submenus, so it |
---|
583 | only offers a single 'open webroot' option for the default tahoe: alias. |
---|
584 | |
---|
585 | I had trouble with this at first and concluded that the submenus didn't work, |
---|
586 | and made it a distinct 'WebUI' menu in it's own right. on further inspection, |
---|
587 | there are still problems but they seem to be something like once the dock menu |
---|
588 | has been used, sometimes the app's main menubar menus will cease to function, |
---|
589 | and this happens regardless of whether submenus or plain simple menus are used. |
---|
590 | I have no idea what the peoblem is, but it's not submenu specific. |
---|
591 | ] |
---|
592 | [repairer: fix flaw in testutil.flip_one_bit() that Brian pointed out |
---|
593 | zooko@zooko.com**20081016194848] |
---|
594 | [misc/incident-gatherer: add classify_tahoe.py: a foolscap incident-gatherer classification plugin |
---|
595 | warner@allmydata.com**20081015220940] |
---|
596 | [repairer: test all different kinds of corruption that can happen to share files on disk |
---|
597 | zooko@zooko.com**20081014230920] |
---|
598 | [util/time_format.py: accept space separator, add unit tests |
---|
599 | warner@allmydata.com**20081013225258] |
---|
600 | [test_storage: use different filenames, poor stupid windows |
---|
601 | warner@allmydata.com**20081010021139] |
---|
602 | [scripts/debug.py: emit the immutable-share version number, tolerate v2 |
---|
603 | warner@allmydata.com**20081010013422] |
---|
604 | [storage.py: improve some precondition() error messages |
---|
605 | warner@allmydata.com**20081010011425] |
---|
606 | [storage: introduce v2 immutable shares, with 8-byte offsets fields, to remove two of the three size limitations in #346. This code handles v2 shares but does not generate them. We'll make a release with this v2-tolerance, wait a while, then make a second release that actually generates v2 shares, to avoid compatibility problems. |
---|
607 | warner@allmydata.com**20081010011327] |
---|
608 | [debug.py: oops, add missing import for ReadBucketProxy |
---|
609 | warner@allmydata.com**20081010002922] |
---|
610 | [storage: split WriteBucketProxy and ReadBucketProxy out into immutable/layout.py . No behavioral changes. |
---|
611 | warner@allmydata.com**20081010000800] |
---|
612 | [interfaces: loosen a few max-size constraints which would limit us to a mere 1.09 TB maximum file size |
---|
613 | zooko@zooko.com**20081009191357 |
---|
614 | |
---|
615 | These constraints were originally intended to protect against attacks on the |
---|
616 | storage server protocol layer which exhaust memory in the peer. However, |
---|
617 | defending against that sort of DoS is hard -- probably it isn't completely |
---|
618 | achieved -- and it costs development time to think about it, and it sometimes |
---|
619 | imposes limits on legitimate users which we don't necessarily want to impose. |
---|
620 | So, for now we forget about limiting the amount of RAM that a foolscap peer can |
---|
621 | cause you to start using. |
---|
622 | |
---|
623 | ] |
---|
624 | [util/limiter: add a repr |
---|
625 | warner@allmydata.com**20081007201945] |
---|
626 | [dirnode.build_manifest: include node.list in the limiter, that's the most important thing to slow down |
---|
627 | warner@allmydata.com**20081007201929] |
---|
628 | [web/directory: t=manifest output=html: make the caps into clickable hrefs |
---|
629 | warner@allmydata.com**20081007201845] |
---|
630 | [web/directory: factor out the get_root function |
---|
631 | warner@allmydata.com**20081007201742] |
---|
632 | [web/directory.py: remove unused imports |
---|
633 | warner@allmydata.com**20081007194820] |
---|
634 | [test_web: deep-size is more variable than I thought, so assert less |
---|
635 | warner@allmydata.com**20081007051147] |
---|
636 | [web: change t=manifest to return a list of (path,read/writecap) tuples, instead of a list of verifycaps. Add output=html,text,json. |
---|
637 | warner@allmydata.com**20081007043618] |
---|
638 | [web: rewrite t=deep-size in terms of deep-stats, update test to match inclusion of directory sizes |
---|
639 | warner@allmydata.com**20081007043539] |
---|
640 | [ftpd: hush pyflakes |
---|
641 | warner@allmydata.com**20081007014513] |
---|
642 | [ftpd: make sure we're using a patched/fixed Twisted, to avoid confusion later |
---|
643 | warner@allmydata.com**20081007011411] |
---|
644 | [ftp: change the twisted hack necessary for async-write-close, to one more agreeable to the twisted-dev folks, add a copy of the necessary patch to docs/ftp.txt |
---|
645 | warner@allmydata.com**20081007010605] |
---|
646 | [ftpd: remove debug messages |
---|
647 | warner@allmydata.com**20081006231620] |
---|
648 | [ftpd: add native_client.php -based HTTP authentication scheme |
---|
649 | warner@allmydata.com**20081006231511] |
---|
650 | [ftpd: add ftp.accounts checker, remove InMemoryPasswordChecker |
---|
651 | warner@allmydata.com**20081006225124] |
---|
652 | [test_system: add test coverage for immutable download.ConsumerAdapter, remove debug messages |
---|
653 | warner@allmydata.com**20081006225037] |
---|
654 | [ftp server: initial implementation. Still needs unit tests, custom Twisted patches. For #512 |
---|
655 | warner@allmydata.com**20081006195236] |
---|
656 | [test_cli.py: remove unused imports |
---|
657 | warner@allmydata.com**20081007004204] |
---|
658 | [CLI: remove 'tahoe admin generate-keypair', since the pycryptopp ecdsa API is about to change incompatibly. We'll undo this once pycryptopp is updated |
---|
659 | warner@allmydata.com**20081007002320] |
---|
660 | [docs: update architecture.txt 's section on the vdrive a.k.a. filesystem layer |
---|
661 | zooko@zooko.com**20081006210500 |
---|
662 | Remove some obsolete parts (correct at the time, now incorrect), change terminology to reflect my preference: s/vdrive/filesystem/ and s/dirnode/directory/, and make a few other small changes. |
---|
663 | ] |
---|
664 | [dirnode: fix my remarkably-consistent 'metdadata' typo |
---|
665 | warner@allmydata.com**20081003010845] |
---|
666 | [interfaces: fix minor typo |
---|
667 | warner@allmydata.com**20081003005249] |
---|
668 | [dirnode: add get_child_and_metadata_at_path |
---|
669 | warner@allmydata.com**20081003005203] |
---|
670 | [stop using 'as' as an identifier: as with 'with', 'as' has become a reserved word in python 2.6 |
---|
671 | warner@allmydata.com**20081003002749] |
---|
672 | [scripts/admin: split up generate_keypair code so that unit tests can use it more easily |
---|
673 | warner@allmydata.com**20081001235238] |
---|
674 | [docs: add some notes about things to do for a Tahoe release on pypi, freshmeat, and launchpad |
---|
675 | zooko@zooko.com**20081001210703] |
---|
676 | [misc/cpu-watcher.tac: use writeaside-and-rename for the history.pickle file |
---|
677 | warner@allmydata.com**20081001003053] |
---|
678 | [misc/spacetime: use async polling so we can add a 60-second timeout, add an index to the 'url' Axiom column for 2x speedup |
---|
679 | warner@allmydata.com**20080930233448] |
---|
680 | [#518: replace various BASEDIR/* config files with a single BASEDIR/tahoe.cfg, with backwards-compatibility of course |
---|
681 | warner@allmydata.com**20080930232149] |
---|
682 | [tolerate simplejson-2.0.0 and newer, which frequently return bytestrings instead of unicode objects. Closes #523 |
---|
683 | warner@allmydata.com**20080930222106] |
---|
684 | [munin/tahoe_doomsday: oops, tolerate 'null' in the timeleft results, to unbreak the 2wk/4wk graphs |
---|
685 | warner@allmydata.com**20080930202051] |
---|
686 | [test_node: improve coverage of advertised_ip_addresses a bit |
---|
687 | warner@allmydata.com**20080930060816] |
---|
688 | [testutil.PollMixin: set default timeout (to 100s), emit a more helpful error when the timeout is hit |
---|
689 | warner@allmydata.com**20080930052309] |
---|
690 | [repair: fix test to map from storage index to directory structure properly (thanks, cygwin buildbot, for being so kloodgey that you won't accept random binary filenames and thus making me notice this bug) |
---|
691 | zooko@zooko.com**20080926224913] |
---|
692 | [repairer: assert that the test code isn't accidentally allowing the repairer code which is being tested to do impossible things |
---|
693 | zooko@zooko.com**20080926222353] |
---|
694 | [repairer: enhance the repairer tests |
---|
695 | zooko@zooko.com**20080926174719 |
---|
696 | Make sure the file can actually be downloaded afterward, that it used one of the |
---|
697 | deleted and then repaired shares to do so, and that it repairs from multiple |
---|
698 | deletions at once (without using more than a reasonable amount of calls to |
---|
699 | storage server allocate). |
---|
700 | ] |
---|
701 | [netstring: add required_trailer= argument |
---|
702 | warner@allmydata.com**20080926165754] |
---|
703 | [test_netstring.py: move netstring tests to a separate file |
---|
704 | warner@allmydata.com**20080926165526] |
---|
705 | [move netstring() and split_netstring() into a separate util.netstring module |
---|
706 | warner@allmydata.com**20080926043824] |
---|
707 | [repairer: remove a test that doesn't apply to the repair-from-corruption case |
---|
708 | zooko@zooko.com**20080925220954] |
---|
709 | [repairer: add a test that repairer fixes corrupted shares (in addition to the test that it fixes deleted shares) |
---|
710 | zooko@zooko.com**20080925220712] |
---|
711 | [docs: proposed mutable file crypto design with ECDSA, 96-bit private keys, and semi-private keys (from http://allmydata.org/~zooko/lafs.pdf ) |
---|
712 | zooko@zooko.com**20080925213457] |
---|
713 | [docs: mutable file crypto design (from http://allmydata.org/~zooko/lafs.pdf ) |
---|
714 | zooko@zooko.com**20080925213433] |
---|
715 | [repairer: fix swapped docstrings; thanks Brian |
---|
716 | zooko@zooko.com**20080925182436] |
---|
717 | [trivial: remove unused imports; thanks, pyflakes |
---|
718 | zooko@zooko.com**20080925180422] |
---|
719 | [trivial: remove unused imports -- thanks, pyflakes |
---|
720 | zooko@zooko.com**20080925173453] |
---|
721 | [repairer: add basic test of repairer, move tests of immutable checker/repairer from test_system to test_immutable_checker, remove obsolete test helper code from test_filenode |
---|
722 | zooko@zooko.com**20080925171653 |
---|
723 | Hm... "Checker" ought to be renamed to "CheckerRepairer" or "Repairer" at some point... |
---|
724 | ] |
---|
725 | [setup: remove a few minimal unit tests from test_filenode which have been obviated by much better tests in test_mutable and test_system |
---|
726 | zooko@zooko.com**20080925161544] |
---|
727 | [gui/macapp: rough cut of ui tweaks; configurability, auto-mount |
---|
728 | robk-tahoe@allmydata.com**20080925141224 |
---|
729 | |
---|
730 | chatting with peter, two things the mac gui needed were the ability to mount |
---|
731 | the 'allmydata drive' automatically upon launching the app, and open the |
---|
732 | Finder to reveal it. (also a request to hide the debug 'open webroot' stuff) |
---|
733 | |
---|
734 | this (somewhat rough) patch implements all the above as default behaviour |
---|
735 | |
---|
736 | it also contains a quick configuration mechanism for the gui - rather than a |
---|
737 | preferences gui, running with a more 'tahoe' styled mechanism, the contents |
---|
738 | of a few optional files can modify the default behaviour, specifically file |
---|
739 | in ~/.tahoe/gui.conf control behaviour as follows: |
---|
740 | |
---|
741 | auto-mount (bool): if set (the default) then the mac app will, upon launch |
---|
742 | automatically mount the 'tahoe:' alias with the display name 'Allmydata' |
---|
743 | using a mountpoint of ~/.tahoe/mnt/__auto__ |
---|
744 | |
---|
745 | auto-open (bool): if set (the default) then upon mounting a file system |
---|
746 | (including the auto-mount if set) finder will be opened to the mountpoint |
---|
747 | of the filesystem, which essentially reveals the newly mounted drive in a |
---|
748 | Finder window |
---|
749 | |
---|
750 | show-webopen (bool): if set (false by default) then the 'open webroot' |
---|
751 | action will be made available in both the dock and file menus of the app |
---|
752 | |
---|
753 | daemon-timout (int): sets the daemon-timeout option passed into tahoe fuse |
---|
754 | when a filesystem is mounted. this defaults to 5 min |
---|
755 | |
---|
756 | files of type (int) much, naturally contain a parsable int representation. |
---|
757 | files of type (bool) are considered true if their (case-insensitive) contents |
---|
758 | are any of ['y', 'yes', 'true', 'on', '1'] and considered false otherwise. |
---|
759 | |
---|
760 | ] |
---|
761 | [gui/macapp: improve 'about' box |
---|
762 | robk-tahoe@allmydata.com**20080925135415 |
---|
763 | |
---|
764 | adds exactly 1 metric dollop of professionalism to the previously |
---|
765 | rather amateurish looking about box. |
---|
766 | ] |
---|
767 | [fuse/impl_c: UNDO --auto-fsid option |
---|
768 | robk-tahoe@allmydata.com**20080925134730 |
---|
769 | |
---|
770 | rolling back: |
---|
771 | |
---|
772 | Thu Sep 25 14:42:23 BST 2008 robk-tahoe@allmydata.com |
---|
773 | * fuse/impl_c: add --auto-fsid option |
---|
774 | |
---|
775 | this was inspired by reading the fuse docs and discovering the 'fsid' option |
---|
776 | to fuse_main, and was _intended_ to support a sort of 'stability' to the |
---|
777 | filesystem (specifically derived from the root-uri mounted, whether directly |
---|
778 | or via an alias) to support mac aliases across unmount/remount etc. |
---|
779 | |
---|
780 | some experimentation shows that that doesn't actually work, and that, at |
---|
781 | least for mac aliases in my testing, they're tied to path-to-mountpoint and |
---|
782 | not to the fsid - which seems to have no bearing. perhaps the 'local' flag |
---|
783 | is causing weirdness therein. |
---|
784 | |
---|
785 | at any rate, I'm recording it simply for posterity, in case it turns out to |
---|
786 | be useful after all somewhere down the road. |
---|
787 | |
---|
788 | |
---|
789 | M ./contrib/fuse/impl_c/blackmatch.py +13 |
---|
790 | ] |
---|
791 | [fuse/impl_c: add --auto-fsid option |
---|
792 | robk-tahoe@allmydata.com**20080925134223 |
---|
793 | |
---|
794 | this was inspired by reading the fuse docs and discovering the 'fsid' option |
---|
795 | to fuse_main, and was _intended_ to support a sort of 'stability' to the |
---|
796 | filesystem (specifically derived from the root-uri mounted, whether directly |
---|
797 | or via an alias) to support mac aliases across unmount/remount etc. |
---|
798 | |
---|
799 | some experimentation shows that that doesn't actually work, and that, at |
---|
800 | least for mac aliases in my testing, they're tied to path-to-mountpoint and |
---|
801 | not to the fsid - which seems to have no bearing. perhaps the 'local' flag |
---|
802 | is causing weirdness therein. |
---|
803 | |
---|
804 | at any rate, I'm recording it simply for posterity, in case it turns out to |
---|
805 | be useful after all somewhere down the road. |
---|
806 | |
---|
807 | ] |
---|
808 | [manhole: be more tolerant of authorized_keys. files in .tahoe |
---|
809 | robk-tahoe@allmydata.com**20080925031149 |
---|
810 | |
---|
811 | both peter and I independently tried to do the same thing to eliminate the |
---|
812 | authorized_keys file which was causing problems with the broken mac build |
---|
813 | (c.f. #522) namely mv authorized_keys.8223{,.bak} but the node is, ahem, |
---|
814 | let's say 'intolerant' of the trailing .bak - rather than disable the |
---|
815 | manhole as one might expect, it instead causes the node to explode on |
---|
816 | startup. this patch makes it skip over anything that doesn't pass the |
---|
817 | 'parse this trailing stuff as an int' test. |
---|
818 | ] |
---|
819 | [fuse/impl_c: move mac tahoefuse impl out into contrib/fuse |
---|
820 | robk-tahoe@allmydata.com**20080925014214 |
---|
821 | |
---|
822 | For a variety of reasons, high amongst them the fact that many people |
---|
823 | interested in fuse support for tahoe seem to have missed its existence, |
---|
824 | the existing fuse implementation for tahoe, previously 'mac/tahoefuse.py' |
---|
825 | has been renamed and moved. |
---|
826 | |
---|
827 | It was suggested that, even though the mac build depends upon it, that |
---|
828 | the mac/tahoefuse implementation be moved into contrib/fuse along with |
---|
829 | the other fuse implementations. The fact that it's not as extensively |
---|
830 | covered by unit tests as mainline tahoe was given as corroboration. |
---|
831 | |
---|
832 | In a bid to try and stem the confusion inherent in having tahoe_fuse, |
---|
833 | tfuse and tahoefuse jumbled together (not necessarily helped by |
---|
834 | referring to them as impl_a, b and c respectively) I'm hereby renaming |
---|
835 | tahoefuse as 'blackmatch' (black match is, per wikipedia "a type of |
---|
836 | crude fuse" hey, I'm a punny guy) Maybe one day it'll be promoted to |
---|
837 | be 'quickmatch' instead... |
---|
838 | |
---|
839 | Anyway, this patch moves mac/tahoefuse.py out to contrib/fuse/impl_c/ |
---|
840 | as blackmatch.py, and makes appropriate changes to the mac build process |
---|
841 | to transclude blackmatch therein. this leaves the extant fuse.py and |
---|
842 | fuseparts business in mac/ as-is and doesn't attempt to address such |
---|
843 | issues in contrib/fuse/impl_c. |
---|
844 | |
---|
845 | it is left as an exercise to the reader (or the reader of a message |
---|
846 | to follow) as to how to deal with the 'fuse' python module on the mac. |
---|
847 | |
---|
848 | as of this time, blackmatch should work on both mac and linux, and |
---|
849 | passes the four extant tests in runtests. (fwiw neither impl_a nor |
---|
850 | impl_b have I managed to get working on the mac yet) |
---|
851 | |
---|
852 | since blackmatch supports a read-write and caching fuse interface to |
---|
853 | tahoe, some write tests obviously need to be added to runtests. |
---|
854 | |
---|
855 | ] |
---|
856 | [macapp: changes to support aliases, updated tahoefuse command line options |
---|
857 | robk-tahoe@allmydata.com**20080925010128 |
---|
858 | |
---|
859 | the tahoefuse command line options changed to support the runtests harness, |
---|
860 | and as part of that gained support for named aliases via --alias |
---|
861 | |
---|
862 | this changes the mac app's invocation of tahoefuse to match that, and also |
---|
863 | changes the gui to present the list of defined aliases as valid mounts |
---|
864 | |
---|
865 | this replaces the previous logic which examined the ~/.tahoe/private directory |
---|
866 | looking for files ending in '.cap' - an ad-hoc alias mechanism. |
---|
867 | |
---|
868 | if a file is found matching ~/.tahoe/private/ALIASNAME.icns then that will still |
---|
869 | be passed to tahoefuse as the icon to display for that filesystem. if no such |
---|
870 | file is found, the allmydata icon will be used by default. |
---|
871 | |
---|
872 | the '-olocal' option is passed to tahoefuse. this is potentially contentious. |
---|
873 | specifically this is telling the OS that this is a 'local' filesystem, which is |
---|
874 | intended to be used to locally attached devices. however leopard (OSX 10.5) |
---|
875 | will only display non-local filesystems in the Finder's side bar if they are of |
---|
876 | fs types specifically known by Finder to be network file systems (nfs, cifs, |
---|
877 | webdav, afp) hence the -olocal flag is the only way on leopard to cause finder |
---|
878 | to display the mounted filesystem in the sidebar, but it displays as a 'device'. |
---|
879 | there is a potential (i.e. the fuse docs carry warnings) that this may cause |
---|
880 | vague and unspecified undesirable behaviour. |
---|
881 | (c.f. http://code.google.com/p/macfuse/wiki/FAQ specifically Q4.3 and Q4.1) |
---|
882 | |
---|
883 | |
---|
884 | ] |
---|
885 | [fuse/impl_c: reworking of mac/tahoefuse, command line options, test integration |
---|
886 | robk-tahoe@allmydata.com**20080925001535 |
---|
887 | |
---|
888 | a handful of changes to the tahoefuse implementation used by the mac build, to |
---|
889 | make command line option parsing more flexible and robust, and moreover to |
---|
890 | facilitate integration of this implementation with the 'runtests' test harness |
---|
891 | used to test the other two implementations. |
---|
892 | |
---|
893 | this patch includes; |
---|
894 | - improvements to command line option parsing [ see below ] |
---|
895 | - support for 'aliases' akin to other tahoe tools |
---|
896 | - tweaks to support linux (ubuntu hardy) |
---|
897 | |
---|
898 | the linux support tweaks are, or at least seem to be, a result of the fact that |
---|
899 | hardy ships with fuse 0.2pre3, as opposed to the fuse0.2 that macfuse is based |
---|
900 | upon. at least the versions I was working with have discrepencies in their |
---|
901 | interfaces, but on reflection this is probably a 'python-fuse' version issue |
---|
902 | rather than fuse per se. At any rate, the fixes to handling the Stat objects |
---|
903 | should be safe against either version, it's just that the bindings on hardy |
---|
904 | lacked code that was in the 'fuse' python module on the mac... |
---|
905 | |
---|
906 | command line options: |
---|
907 | |
---|
908 | the need for more flexible invocation in support of the runtests harness led |
---|
909 | me to rework the argument parsing from some simple positional hacks with a |
---|
910 | pass-through of the remainder to the fuse binding's 'fuse_main' to a system |
---|
911 | using twisted.usage to parse arguments, and having just one option '-o' being |
---|
912 | explicitly a pass-through for -o options to fuse_main. the options are now: |
---|
913 | |
---|
914 | --node-directory NODEDIR : this is used to look up the node-url to connect |
---|
915 | to if that's not specified concretely on the command line, and also used to |
---|
916 | determine the location of the cache directory used by the implementation, |
---|
917 | specifically '_cache' within the nodedir. default value: ~/.tahoe |
---|
918 | |
---|
919 | --node-url NODEURL : specify a node-url taking precendence over that found |
---|
920 | in the node.url file within the nodedir |
---|
921 | |
---|
922 | --alias ALIAS : specifies the named alias should be mounted. a lookup is |
---|
923 | performed in the alias table within 'nodedir' to find the root dir cap |
---|
924 | the named alias must exist in the alias table of the specified nodedir |
---|
925 | |
---|
926 | --root-uri ROOTURI : specifies that the given directory uri should be mounted |
---|
927 | |
---|
928 | at least one of --alias and --root-uri must be given (which directory to mount |
---|
929 | must be specified somehow) if both are given --alias takes precedence. |
---|
930 | |
---|
931 | --cache-timeout TIMEOUTSECS : specifies the number of seconds that cached |
---|
932 | directory data should be considered valid for. this tahoefuse implementation |
---|
933 | implements directory caching for a limited time; largely because the mac (i.e. |
---|
934 | the Finder in particular) tends to make a large number of requests in quick |
---|
935 | successsion when browsing the filesystem. on the flip side, the 'runtests' |
---|
936 | unit tests fail in the face of such caching because the changes made to the |
---|
937 | underlying tahoe directories are not reflected in the fuse presentation. by |
---|
938 | specifying a cache-timeout of 0 seconds, runtests can force the fuse layer |
---|
939 | into refetching directory data upon each request. |
---|
940 | |
---|
941 | any number of -oname=value options may be specified on the command line, |
---|
942 | and they will all be passed into the underlying fuse_main call. |
---|
943 | |
---|
944 | a single non-optional argument, the mountpoint, must also be given. |
---|
945 | |
---|
946 | |
---|
947 | |
---|
948 | ] |
---|
949 | [fuse/tests: slew of changes to fuse 'runtests' |
---|
950 | robk-tahoe@allmydata.com**20080924183601 |
---|
951 | |
---|
952 | This patch makes a significant number of changes to the fuse 'runtests' script |
---|
953 | which stem from my efforts to integrate the third fuse implementation into this |
---|
954 | framework. Perhaps not all were necessary to that end, and I beg nejucomo's |
---|
955 | forebearance if I got too carried away. |
---|
956 | |
---|
957 | - cleaned up the blank lines; imho blank lines should be empty |
---|
958 | |
---|
959 | - made the unmount command switch based on platform, since macfuse just uses |
---|
960 | 'umount' not the 'fusermount' command (which doesn't exist) |
---|
961 | |
---|
962 | - made the expected working dir for runtests the contrib/fuse dir, not the |
---|
963 | top-level tahoe source tree - see also discussion of --path-to-tahoe below |
---|
964 | |
---|
965 | - significantly reworked the ImplProcManager class. rather than subclassing |
---|
966 | for each fuse implementation to be tested, the new version is based on |
---|
967 | instantiating objects and providing relevant config info to the constructor. |
---|
968 | this was motivated by a desire to eliminate the duplication of similar but |
---|
969 | subtly different code between instances, framed by consideration of increasing |
---|
970 | the number of platforms and implementations involved. each implementation to |
---|
971 | test is thus reduced to the pertinent import and an entry in the |
---|
972 | 'implementations' table defining how to handle that implementation. this also |
---|
973 | provides a way to specify which sets of tests to run for each implementation, |
---|
974 | more on that below. |
---|
975 | |
---|
976 | |
---|
977 | - significantly reworked the command line options parsing, using twisted.usage; |
---|
978 | |
---|
979 | what used to be a single optional argument is now represented by the |
---|
980 | --test-type option which allows one to choose between running unittests, the |
---|
981 | system tests, or both. |
---|
982 | |
---|
983 | the --implementations option allows for a specific (comma-separated) list of |
---|
984 | implemenations to be tested, or the default 'all' |
---|
985 | |
---|
986 | the --tests option allows for a specific (comma-separated) list of tests sets |
---|
987 | to be run, or the default 'all'. note that only the intersection of tests |
---|
988 | requested on the command line and tests relevant to each implementation will |
---|
989 | be run. see below for more on tests sets. |
---|
990 | |
---|
991 | the --path-to-tahoe open allows for the path to the 'tahoe' executable to be |
---|
992 | specified. it defaults to '../../bin/tahoe' which is the location of the tahoe |
---|
993 | script in the source tree relative to the contrib/fuse dir by default. |
---|
994 | |
---|
995 | the --tmp-dir option controls where temporary directories (and hence |
---|
996 | mountpoints) are created during the test. this defaults to /tmp - a change |
---|
997 | from the previous behaviour of using the system default dir for calls to |
---|
998 | tempfile.mkdtemp(), a behaviour which can be obtained by providing an empty |
---|
999 | value, e.g. "--tmp-dir=" |
---|
1000 | |
---|
1001 | the --debug-wait flag causes the test runner to pause waiting upon user |
---|
1002 | input at various stages through the testing, which facilitates debugging e.g. |
---|
1003 | by allowing the user to open a browser and explore or modify the contents of |
---|
1004 | the ephemeral grid after it has been instantiated but before tests are run, |
---|
1005 | or make environmental adjustments before actually triggering fuse mounts etc. |
---|
1006 | note that the webapi url for the first client node is printed out upon its |
---|
1007 | startup to facilitate this sort of debugging also. |
---|
1008 | |
---|
1009 | |
---|
1010 | - the default tmp dir was changed, and made configurable. previously the |
---|
1011 | default behaviour of tempfile.mkdtemp() was used. it turns out that, at least |
---|
1012 | on the mac, that led to temporary directories to be created in a location |
---|
1013 | which ultimately led to mountpoint paths longer than could be handled by |
---|
1014 | macfuse - specifically mounted filesystems could not be unmounted and would |
---|
1015 | 'leak'. by changing the default location to be rooted at /tmp this leads to |
---|
1016 | mountpoint paths short enough to be supported without problems. |
---|
1017 | |
---|
1018 | - tests are now grouped into 'sets' by method name prefix. all the existing |
---|
1019 | tests have been moved into the 'read' set, i.e. with method names starting |
---|
1020 | 'test_read_'. this is intended to facilitate the fact that some implementations |
---|
1021 | are read-only, and some support write, so the applicability of tests will vary |
---|
1022 | by implementation. the 'implementations' table, which governs the configuration |
---|
1023 | of the ImplProcManager responsible for a given implementation, provides a list |
---|
1024 | of 'test' (i.e test set names) which are applicable to that implementation. |
---|
1025 | note no 'write' tests yet exist, this is merely laying the groundwork. |
---|
1026 | |
---|
1027 | - the 'expected output' of the tahoe command, which is checked for 'surprising' |
---|
1028 | output by regex match, can be confused by spurious output from libraries. |
---|
1029 | specfically, testing on the mac produced a warning message about zope interface |
---|
1030 | resolution various multiple eggs. the 'check_tahoe_output()' function now has |
---|
1031 | a list of 'ignorable_lines' (each a regex) which will be discarded before the |
---|
1032 | remainder of the output of the tahoe script is matched against expectation. |
---|
1033 | |
---|
1034 | - cleaned up a typo, and a few spurious imports caught by pyflakes |
---|
1035 | |
---|
1036 | ] |
---|
1037 | [fuse/impl_{a,b}: improve node-url handling |
---|
1038 | robk-tahoe@allmydata.com**20080924182854 |
---|
1039 | |
---|
1040 | specifically change the expectation of the code to be such that the node-url |
---|
1041 | (self.url) always includes the trailing slash to be a correctly formed url |
---|
1042 | |
---|
1043 | moreover read the node-url from the 'node.url' file found in the node 'basedir' |
---|
1044 | and only if that doesn't exist, then fall back to reading the 'webport' file |
---|
1045 | from therein and assuming localhost. This then supports the general tahoe |
---|
1046 | pattern that tools needing only a webapi server can be pointed at a directory |
---|
1047 | containing the node.url file, which can optionally point to another server, |
---|
1048 | rather than requiring a complete node dir and locally running node instance. |
---|
1049 | |
---|
1050 | ] |
---|
1051 | [fuse/impl_b: tweaks from testing on hardy |
---|
1052 | robk-tahoe@allmydata.com**20080924180738 |
---|
1053 | |
---|
1054 | from testing on linux (specifically ubuntu hardy) the libfuse dll has a |
---|
1055 | different name, specifically libfuse.so.2. this patch tries libfuse.so |
---|
1056 | and then falls back to trying .2 if the former fails. |
---|
1057 | |
---|
1058 | it also changes the unmount behaviour, to simply return from the handler's |
---|
1059 | loop_forever() loop upon being unmounted, rather than raising an EOFError, |
---|
1060 | since none of the client code I looked at actually handled that exception, |
---|
1061 | but did seem to expect to fall off of main() when loop_forever() returned. |
---|
1062 | Additionally, from my testing unmount typically led to an OSError from the |
---|
1063 | fuse fd read, rather than an empty read, as the code seemed to expect. |
---|
1064 | |
---|
1065 | also removed a spurious import pyflakes quibbled about. |
---|
1066 | ] |
---|
1067 | [setup: fix site-dirs to find system installed twisted on mac. |
---|
1068 | robk-tahoe@allmydata.com**20080924174255 |
---|
1069 | |
---|
1070 | zooko helped me unravel a build weirdness today. somehow the system installed |
---|
1071 | twisted (/System/Library) was pulling in parts of the other twisted (/Library) |
---|
1072 | which had been installed by easy_install, and exploding. |
---|
1073 | |
---|
1074 | getting rid of the latter helped, but it took this change to get the tahoe |
---|
1075 | build to stop trying to rebuild twisted and instead use the one that was |
---|
1076 | already installed. c.f. tkt #229 |
---|
1077 | ] |
---|
1078 | [CLI: rework webopen, and moreover its tests w.r.t. path handling |
---|
1079 | robk-tahoe@allmydata.com**20080924164523 |
---|
1080 | |
---|
1081 | in the recent reconciliation of webopen patches, I wound up adjusting |
---|
1082 | webopen to 'pass through' the state of the trailing slash on the given |
---|
1083 | argument to the resultant url passed to the browser. this change |
---|
1084 | removes the requirement that arguments must be directories, and allows |
---|
1085 | webopen to be used with files. it also broke the tests that assumed |
---|
1086 | that webopen would always normalise the url to have a trailing slash. |
---|
1087 | |
---|
1088 | in fixing the tests, I realised that, IMHO, there's something deeply |
---|
1089 | awry with the way tahoe handles paths; specifically in the combination |
---|
1090 | of '/' being the name of the root path within an alias, but a leading |
---|
1091 | slash on paths, e.g. 'alias:/path', is catagorically incorrect. i.e. |
---|
1092 | 'tahoe:' == 'tahoe:/' == '/' |
---|
1093 | but 'tahoe:/foo' is an invalid path, and must be 'tahoe:foo' |
---|
1094 | |
---|
1095 | I wound up making the internals of webopen simply spot a 'path' of |
---|
1096 | '/' and smash it to '', which 'fixes' webopen to match the behaviour |
---|
1097 | of tahoe's path handling elsewhere, but that special case sort of |
---|
1098 | points to the weirdness. |
---|
1099 | |
---|
1100 | (fwiw, I personally found the fact that the leading / in a path was |
---|
1101 | disallowed to be weird - I'm just used to seeing paths qualified by |
---|
1102 | the leading / I guess - so in a debate about normalising path handling |
---|
1103 | I'd vote to include the /) |
---|
1104 | |
---|
1105 | ] |
---|
1106 | [CLI: reconcile webopen changes |
---|
1107 | robk-tahoe@allmydata.com**20080924152002 |
---|
1108 | |
---|
1109 | I think this is largely attributable to a cleanup patch I'd made |
---|
1110 | which never got committed upstream somehow, but at any rate various |
---|
1111 | conflicting changes to webopen had been made. This cleans up the |
---|
1112 | conflicts therein, and hopefully brings 'tahoe webopen' in line with |
---|
1113 | other cli commands. |
---|
1114 | ] |
---|
1115 | [cli: cleanup webopen command |
---|
1116 | robk-tahoe@allmydata.com**20080618201940 |
---|
1117 | |
---|
1118 | moved the body of webopen out of cli.py into tahoe_webopen.py |
---|
1119 | |
---|
1120 | made its invocation consistent with the other cli commands, most |
---|
1121 | notably replacing its 'vdrive path' with the same alias parsing, |
---|
1122 | allowing usage such as 'tahoe webopen private:Pictures/xti' |
---|
1123 | ] |
---|
1124 | [macapp: changed to remove 'Tahoe' from .app name |
---|
1125 | robk-tahoe@allmydata.com**20080611003145 |
---|
1126 | |
---|
1127 | Change the build product from 'Allmydata Tahoe' to 'Allmydata' |
---|
1128 | more inkeeping with the branding of the Allmydata product |
---|
1129 | ] |
---|
1130 | [add --syslog argument to 'tahoe start' and 'tahoe restart', used to pass --syslog to twistd for non-Tahoe nodes (like cpu-watcher) |
---|
1131 | warner@allmydata.com**20080925010302] |
---|
1132 | [misc/make-canary-files.py: tool to create 'canary files', explained in the docstring |
---|
1133 | warner@allmydata.com**20080925004716] |
---|
1134 | [webapi: survive slashes in filenames better: make t=info and t=delete to work, and let t=rename fix the problem |
---|
1135 | warner@allmydata.com**20080924203505] |
---|
1136 | [setup: when detecting platform, ask the Python Standard Library's platform.dist() before executing lsb_release, and cache the result in global (module) variables |
---|
1137 | zooko@zooko.com**20080924180922 |
---|
1138 | This should make it sufficiently fast, while still giving a better answer on Ubuntu than platform.dist() currently does, and also falling back to lsb_release if platform.dist() says that it doesn't know. |
---|
1139 | ] |
---|
1140 | [node.py: add BASEDIR/keepalive_timeout and BASEDIR/disconnect_timeout, to set/enable the foolscap timers, for #521 |
---|
1141 | warner@allmydata.com**20080924175112] |
---|
1142 | [setup: stop catching EnvironmentError when attempting to copy ./_auto_deps.py to ./src/allmydata/_auto_deps.py |
---|
1143 | zooko@zooko.com**20080924000402 |
---|
1144 | It is no longer the case that we can run okay without _auto_deps.py being in place in ./src/allmydata, so if that cp fails then the build should fail. |
---|
1145 | ] |
---|
1146 | [immutable: remove unused imports (thanks, pyflakes) |
---|
1147 | zooko@zooko.com**20080923192610] |
---|
1148 | [immutable: refactor immutable filenodes and comparison thereof |
---|
1149 | zooko@zooko.com**20080923185249 |
---|
1150 | * the two kinds of immutable filenode now have a common base class |
---|
1151 | * they store only an instance of their URI, not both an instance and a string |
---|
1152 | * they delegate comparison to that instance |
---|
1153 | ] |
---|
1154 | [setup: try parsing /etc/lsb-release first, then invoking lsb_release, because the latter takes half-a-second on my workstation, which is too long |
---|
1155 | zooko@zooko.com**20080923171431 |
---|
1156 | Also because in some cases the former will work and the latter won't. |
---|
1157 | This patch also tightens the regexes so it won't match random junk. |
---|
1158 | ] |
---|
1159 | [setup: fix a cut-and-paste error in the fallback to parsing /etc/lsb-release |
---|
1160 | zooko@zooko.com**20080923165551] |
---|
1161 | [setup: if executing lsb_release doesn't work, fall back to parsing /etc/lsb-release before falling back to platform.dist() |
---|
1162 | zooko@zooko.com**20080923162858 |
---|
1163 | An explanatio of why we do it this way is in the docstring. |
---|
1164 | ] |
---|
1165 | [setup: if invoking lsb_release doesn't work (which it doesn't on our etch buildslave), then fall back to the Python Standard Library's platform.dist() function |
---|
1166 | zooko@zooko.com**20080923154820] |
---|
1167 | [setup: fix bug in recent patch to use allmydata.get_package_versions() to tell the foolscap app-version-tracking what's what |
---|
1168 | zooko@zooko.com**20080923001347] |
---|
1169 | [setup: when using the foolscap "what versions are here?" feature, use allmydata.get_package_versions() instead of specifically importing allmydata, pycryptopp, and zfec |
---|
1170 | zooko@zooko.com**20080923000351] |
---|
1171 | [setup: simplify the implementation of allmydata.get_package_versions() and add "platform" which is a human-oriented summary of the underlying operating system and machine |
---|
1172 | zooko@zooko.com**20080922235354] |
---|
1173 | [misc/make_umid: change docs, make elisp code easier to grab |
---|
1174 | warner@lothar.com**20080920183933] |
---|
1175 | [use foolscap's new app_versions API, require foolscap-0.3.1 |
---|
1176 | warner@lothar.com**20080920183853] |
---|
1177 | [BASEDIR/nickname is now UTF-8 encoded |
---|
1178 | warner@lothar.com**20080920183713] |
---|
1179 | [various: use util.log.err instead of twisted.log.err, so we get both Incidents and trial-test-flunking |
---|
1180 | warner@lothar.com**20080920173545] |
---|
1181 | [logging.txt: explain how to put log.err at the end of Deferred chains, explain FLOGTOTWISTED=1 |
---|
1182 | warner@lothar.com**20080920173500] |
---|
1183 | [util.log: send log.err to Twisted too, so that Trial tests are flunked |
---|
1184 | warner@lothar.com**20080920173427] |
---|
1185 | [setup.py trial: improve --verbose suggestion a bit |
---|
1186 | warner@lothar.com**20080919193922] |
---|
1187 | [test_cli: disable generate-keypair test on OS-X, pycryptopp still has a bug |
---|
1188 | warner@lothar.com**20080919193855] |
---|
1189 | [NEWS: finish editing for the upcoming 1.3.0 release |
---|
1190 | warner@lothar.com**20080919193053] |
---|
1191 | [NEWS: more edits, almost done |
---|
1192 | warner@lothar.com**20080919010036] |
---|
1193 | [NEWS: describe all changes since the last release. Still needs editing. |
---|
1194 | warner@lothar.com**20080919002755] |
---|
1195 | [CLI: add 'tahoe admin generate-keypair' command |
---|
1196 | warner@lothar.com**20080919001133] |
---|
1197 | [web: add 'more info' pages for files and directories, move URI/checker-buttons/deep-size/etc off to them |
---|
1198 | warner@lothar.com**20080918050041] |
---|
1199 | [setup.py: remove unused 'Extension' import |
---|
1200 | warner@lothar.com**20080917230829] |
---|
1201 | [setup.py,Makefile: move the 'chmod +x bin/tahoe' into setup.py |
---|
1202 | warner@lothar.com**20080917230756] |
---|
1203 | [docs/install.html: reference InstallDetails instead of debian-specific stuff |
---|
1204 | warner@lothar.com**20080917225742] |
---|
1205 | [Makefile,docs: tahoe-deps.tar.gz now lives in separate source/deps/ directory on http://allmydata.org |
---|
1206 | warner@lothar.com**20080917204452] |
---|
1207 | [docs: mention -SUMO tarballs, point users at release tarballs instead of development ones |
---|
1208 | warner@lothar.com**20080917203631] |
---|
1209 | [setup.py,Makefile: teat sdist --sumo about tahoe-deps/, use -SUMO suffix on tarballs, add sumo to 'make tarballs' target |
---|
1210 | warner@lothar.com**20080917200119] |
---|
1211 | [.darcs-boringfile ignore tahoe-deps and tahoe-deps.tar.gz |
---|
1212 | warner@lothar.com**20080917195938] |
---|
1213 | [docs: add a note about the process of making a new Tahoe release |
---|
1214 | zooko@zooko.com**20080917170839] |
---|
1215 | [Makefile: pyutil from a dependent lib causes a #455-ish problem, the workaround is to run build-once *three* times |
---|
1216 | warner@lothar.com**20080917053643] |
---|
1217 | [Makefile: desert-island: don't re-fetch tahoe-deps.tar.gz if it's already there, remove the tahoe-deps/ before untarring directory to avoid unpacking weirdness |
---|
1218 | warner@lothar.com**20080917052204] |
---|
1219 | [misc/check-build.py: ignore the 'Downloading file:..' line that occurs for the setup_requires= -triggered handling of the setuptools egg |
---|
1220 | warner@lothar.com**20080917051725] |
---|
1221 | [#249: add 'test-desert-island', to assert that a tahoe-deps.tar.gz -enabled build does not download anything |
---|
1222 | warner@lothar.com**20080917013702] |
---|
1223 | [#249: get dependent libs from tahoe-deps and ../tahoe-deps |
---|
1224 | warner@lothar.com**20080917013627] |
---|
1225 | [#249: move dependent libs out of misc/dependencies/, get them from tahoe-deps.tar.gz instead |
---|
1226 | warner@allmydata.com**20080917012545] |
---|
1227 | [conf_wiz.py - updating version numbers in file, should really get these from a TAG or conf file |
---|
1228 | secorp@allmydata.com**20080917004547] |
---|
1229 | [webish: add an extra newline to JSON output |
---|
1230 | warner@lothar.com**20080915204314] |
---|
1231 | [windows/Makefile: fix dependencies: windows-installer must cause windows-exe to run |
---|
1232 | warner@allmydata.com**20080912052151] |
---|
1233 | [Makefile: fix windows issues |
---|
1234 | warner@allmydata.com**20080912050919] |
---|
1235 | [Makefile: use run_with_pythonpath, move windows targets into a separate Makefile |
---|
1236 | warner@allmydata.com**20080912044508] |
---|
1237 | [setup.py: add 'setup.py run_with_pythonpath', to run other commands with PYTHONPATH set usefully |
---|
1238 | warner@allmydata.com**20080912044418] |
---|
1239 | [Makefile: convert check-auto-deps target into 'setup.py check_auto_deps' |
---|
1240 | warner@allmydata.com**20080912035904] |
---|
1241 | [startstop_node.py: find twistd in our supportlib if we had to build Twisted as a setuptools dependency. This is a form of cgalvan's #505 patch, simplified because now 'setup.py trial' takes care of sys.path and PYTHONPATH |
---|
1242 | warner@allmydata.com**20080912025138] |
---|
1243 | [rewrite parts of the Makefile in setup.py. Add 'build_tahoe' and 'trial' subcommands. |
---|
1244 | warner@allmydata.com**20080912010321 |
---|
1245 | |
---|
1246 | The 'make build' target now runs 'setup.py build_tahoe', which figures out |
---|
1247 | where the target 'supportlib' directory should go, and invokes 'setup.py |
---|
1248 | develop' with the appropriate arguments. |
---|
1249 | |
---|
1250 | The 'make test' target now runs 'setup.py trial', which manages sys.path and |
---|
1251 | runs trial as a subroutine instead of spawning an external process. This |
---|
1252 | simplifies the case where Twisted was built as a dependent library (and thus |
---|
1253 | the 'trial' executable is not on PATH). |
---|
1254 | |
---|
1255 | setup.py now manages sys.path and PYTHONPATH for its internal subcommands, so |
---|
1256 | the $(PP) prefix was removed from all Makefile targets that invoke setup.py . |
---|
1257 | For the remaining ones, the 'setup.py -q show_pythonpath' subcommand was |
---|
1258 | added to compute this prefix with python rather than with fragile |
---|
1259 | shell/Makefile syntax. |
---|
1260 | |
---|
1261 | |
---|
1262 | ] |
---|
1263 | [bin/tahoe: reflow error messages |
---|
1264 | warner@allmydata.com**20080912010225] |
---|
1265 | [mac/Makefile: remove the verbose hdiutil diagnostics now that we resolved the problem |
---|
1266 | warner@allmydata.com**20080912004622] |
---|
1267 | [Makefile: give setup.py develop a '--site-dirs' arg to work around the #249 setuptools bug which causes us to unnecessarily rebuild pyopenssl and other support libs installed via debian's python-support. Should be harmless on other platforms. |
---|
1268 | warner@allmydata.com**20080910233432] |
---|
1269 | [web: fix output=JSON, add buttons for repair/json to the 'run deep-check' form |
---|
1270 | warner@allmydata.com**20080910211137] |
---|
1271 | [disallow deep-check on non-directories, simplifies the code a bit |
---|
1272 | warner@allmydata.com**20080910204458] |
---|
1273 | [dirnode: refactor recursive-traversal methods, add stats to deep_check() method results and t=deep-check webapi |
---|
1274 | warner@lothar.com**20080910084504] |
---|
1275 | [dirnode: cleanup, make get_verifier() always return a URI instance, not a string |
---|
1276 | warner@lothar.com**20080910083755] |
---|
1277 | [test_system: check t=deep-stats too |
---|
1278 | warner@lothar.com**20080910065457] |
---|
1279 | [test_system: add deep-check-JSON tests, fix a bug |
---|
1280 | warner@lothar.com**20080910061416] |
---|
1281 | [test_system: oops, re-enable some tests that got bypassed |
---|
1282 | warner@lothar.com**20080910060245] |
---|
1283 | [test_system: add deep-stats test |
---|
1284 | warner@lothar.com**20080910055634] |
---|
1285 | [hush pyflakes |
---|
1286 | warner@allmydata.com**20080910025017] |
---|
1287 | [checker results: add output=JSON to webapi, add tests, clean up APIs |
---|
1288 | warner@allmydata.com**20080910024517 |
---|
1289 | to make the internal ones use binary strings (nodeid, storage index) and |
---|
1290 | the web/JSON ones use base32-encoded strings. The immutable verifier is |
---|
1291 | still incomplete (it returns imaginary healty results). |
---|
1292 | ] |
---|
1293 | [immutable verifier: provide some dummy results so deep-check works, make the tests ignore these results until we finish it off |
---|
1294 | warner@allmydata.com**20080910010827] |
---|
1295 | [mutable checker: even more tests. Everything in ICheckerResults should be covered now, except for immutable-verify which is incomplete |
---|
1296 | warner@allmydata.com**20080910005706] |
---|
1297 | [checker results: more tests, update interface docs |
---|
1298 | warner@allmydata.com**20080910003010] |
---|
1299 | [mutable checker: oops, fix redefinition of 'healthy' (numshares < N, not numshares < k, which is 'recoverable' not 'healthy') |
---|
1300 | warner@allmydata.com**20080910002853] |
---|
1301 | [checker results: more tests, more results. immutable verifier tests are disabled until they emit more complete results |
---|
1302 | warner@allmydata.com**20080910001546] |
---|
1303 | [checker: add tests, add stub for immutable check_and_repair |
---|
1304 | warner@allmydata.com**20080909233449] |
---|
1305 | [interfaces.py: minor improvement to IDirectoryNode.set_node |
---|
1306 | warner@allmydata.com**20080909233416] |
---|
1307 | [mac/Makefile: upload the .dmg file with foolscap xfer-client.py instead of scp |
---|
1308 | warner@allmydata.com**20080908231943] |
---|
1309 | [misc/xfer-client.py: small foolscap utility to transfer a file to a waiting server |
---|
1310 | warner@allmydata.com**20080908231903] |
---|
1311 | [setup: add excited DEVELOPER NOTE to install.html |
---|
1312 | zooko@zooko.com**20080908215603 |
---|
1313 | It should be removed before 1.3.0 release, of course... |
---|
1314 | ] |
---|
1315 | [setup: edit the text of install.html |
---|
1316 | zooko@zooko.com**20080908215549] |
---|
1317 | [setup: add link to the DownloadDebianPackages page |
---|
1318 | zooko@zooko.com**20080908215451 |
---|
1319 | Because I want that link off of the front page of the wiki... |
---|
1320 | ] |
---|
1321 | [setup: change URL from which to get source tarballs |
---|
1322 | zooko@zooko.com**20080908215409 |
---|
1323 | So that when you look at that directory you won't see distracting other things such as darcs repositories. |
---|
1324 | ] |
---|
1325 | [test_system: make log() tolerate the format= form |
---|
1326 | warner@lothar.com**20080908030336] |
---|
1327 | [immutable/checker: make log() tolerate the format= form |
---|
1328 | warner@lothar.com**20080908030308] |
---|
1329 | [checker: overhaul checker results, split check/check_and_repair into separate methods, improve web displays |
---|
1330 | warner@allmydata.com**20080907194456] |
---|
1331 | [webapi.txt: explain that t=manifest gives verifycaps |
---|
1332 | warner@allmydata.com**20080907192950] |
---|
1333 | [introducer: add get_nickname_for_peerid |
---|
1334 | warner@allmydata.com**20080906050700] |
---|
1335 | [docs/logging.txt: explain tahoe/foolscap logging. Addresses #239. |
---|
1336 | warner@allmydata.com**20080904002531] |
---|
1337 | [setup: don't assert that trial is present when the Makefile is evaluated |
---|
1338 | zooko@zooko.com**20080903171837 |
---|
1339 | This should fix #506, but it means that if (for some weird reason) Twisted can't be auto-installed and the find_trial.py script doesn't work, the user will get a weird failure message instead of a clean failure message explaining that trial couldn't be found. Oh well. |
---|
1340 | |
---|
1341 | Chris Galvan is working on a much nicer fix to all these issues -- see #505. |
---|
1342 | |
---|
1343 | ] |
---|
1344 | [testutil.PollMixin: use a custom exception (and convert it) to avoid the ugly 'stash' cycle |
---|
1345 | warner@allmydata.com**20080903033251] |
---|
1346 | [mac/Makefile: more attempts to debug the buildslave failure |
---|
1347 | warner@allmydata.com**20080829220614] |
---|
1348 | [mac: add -verbose to the hdiutil call, to figure out why it's failing on the buildslave |
---|
1349 | warner@allmydata.com**20080829205243] |
---|
1350 | [setup: simplify parsing of python version number |
---|
1351 | zooko@zooko.com**20080829000045] |
---|
1352 | [setup: emit the version of python in the list of versions |
---|
1353 | zooko@zooko.com**20080828220454] |
---|
1354 | [munin: add tahoe_diskleft plugin, update spacetime/diskwatcher.tac to support it |
---|
1355 | warner@allmydata.com**20080828203236] |
---|
1356 | [docs: how_to_make_a_tahoe_release.txt |
---|
1357 | zooko@zooko.com**20080828202109 |
---|
1358 | Just some cryptic notes to self, but if I get hit by a truck then someone else might be able to decode them. |
---|
1359 | ] |
---|
1360 | [debian: include misc/cpu-watcher.tac in the debian package |
---|
1361 | warner@allmydata.com**20080827223026] |
---|
1362 | [munin/tahoe_doomsday: change the graph title, 'time predictor' is more accurate than 'space predictor' |
---|
1363 | warner@allmydata.com**20080827213013] |
---|
1364 | [munin/tahoe_diskusage: clip the graph at zero, to prevent transient negative excursions (such as when a lot of old logfiles are deleted from a storage server's disk) from scaling the graph into unusability |
---|
1365 | warner@allmydata.com**20080827193543] |
---|
1366 | [CREDITS: thanks to Chris Galvan |
---|
1367 | zooko@zooko.com**20080827183950] |
---|
1368 | [setup: patch from Chris Galvan to build sdists with no deps in them normally, but include deps if --sumo |
---|
1369 | zooko@zooko.com**20080827182644] |
---|
1370 | [servermap: don't log late arrivals, and don't log DeadReferenceError at log.WEIRD |
---|
1371 | warner@allmydata.com**20080827003729] |
---|
1372 | [mutable: make mutable-repair work for non-verifier runs, add tests |
---|
1373 | warner@allmydata.com**20080826233454] |
---|
1374 | [mutable: remove work-around for a flaw in an older version of foolscap |
---|
1375 | zooko@zooko.com**20080826155055 |
---|
1376 | We now require "foolscap[secure_connections] >= 0.3.0", per [source:_auto_deps.py]. |
---|
1377 | ] |
---|
1378 | [docs: edit install.html a tad |
---|
1379 | zooko@zooko.com**20080826154929] |
---|
1380 | [misc/make_umid: little script and elisp fragment to insert umid= arguments |
---|
1381 | warner@allmydata.com**20080826015918] |
---|
1382 | [logging: add 'unique-message-ids' (or 'umids') to each WEIRD-or-higher log.msg call, to make it easier to correlate log message with source code |
---|
1383 | warner@allmydata.com**20080826015759] |
---|
1384 | [logging cleanups: lower DeadReferenceError from WEIRD (which provokes Incidents) to merely UNUSUAL, don't pre-format Failures in others |
---|
1385 | warner@allmydata.com**20080826005155] |
---|
1386 | [checker: make the log() function of SimpleCHKFileVerifier compatible with the log() function of its superclasses and subclasses |
---|
1387 | zooko@zooko.com**20080825214407] |
---|
1388 | [docs: warn that the "garbage-collection and accounting" section of architecture.txt is out of date, and clarify that "deleted" therein means ciphertext getting garbage-collected |
---|
1389 | zooko@zooko.com**20080822154605] |
---|
1390 | [docs/filesystem-notes.txt: add notes about enabling the 'directory index' feature on ext3 filesystems for storage server lookup speed |
---|
1391 | warner@allmydata.com**20080821205901] |
---|
1392 | [setup: doc string describing what the require_auto_deps() function is for |
---|
1393 | zooko@zooko.com**20080815172234] |
---|
1394 | [mutable/checker: log a WEIRD-level event when we see a hash failure, to trigger an Incident |
---|
1395 | warner@allmydata.com**20080813035020] |
---|
1396 | [immutable checker: add a status_report field |
---|
1397 | warner@allmydata.com**20080813033530] |
---|
1398 | [mutable/servermap: lower the priority of many log messages |
---|
1399 | warner@allmydata.com**20080813033506] |
---|
1400 | [web/deep-check: show the webapi runtime at the bottom of the page |
---|
1401 | warner@allmydata.com**20080813033426] |
---|
1402 | [CLI: tolerate blank lines in the aliases file |
---|
1403 | warner@allmydata.com**20080813025050] |
---|
1404 | [test_web: workaround broken HEAD behavior in twisted-2.5.0 and earlier |
---|
1405 | warner@allmydata.com**20080813024520] |
---|
1406 | [test_web: oops, actually use HEAD (instead of GET) in the HEAD test |
---|
1407 | warner@allmydata.com**20080813020451] |
---|
1408 | [web: use get_size_of_best_version for HEAD requests, provide correct content-type |
---|
1409 | warner@allmydata.com**20080813020410] |
---|
1410 | [mutable: add get_size_of_best_version to the interface, to simplify the web HEAD code, and tests |
---|
1411 | warner@allmydata.com**20080813020252] |
---|
1412 | [CLI: add 'tahoe debug corrupt-share', and use it for deep-verify tests, and fix non-deep web checker API to pass verify=true into node |
---|
1413 | warner@allmydata.com**20080813000501] |
---|
1414 | [IFilesystemNode: add get_storage_index(), it makes tests easier |
---|
1415 | warner@allmydata.com**20080812231407] |
---|
1416 | [test_system: rename Checker to ImmutableChecker, to make room for a mutable one |
---|
1417 | warner@allmydata.com**20080812225932] |
---|
1418 | ['tahoe debug dump-share': add --offsets, to show section offsets |
---|
1419 | warner@allmydata.com**20080812214656] |
---|
1420 | [test_cli: oops, fix tests after recent stdout/stderr cleanup |
---|
1421 | warner@allmydata.com**20080812214634] |
---|
1422 | [scripts/debug: split out dump_immutable_share |
---|
1423 | warner@allmydata.com**20080812205517] |
---|
1424 | [scripts/debug: clean up use of stdout/stderr |
---|
1425 | warner@allmydata.com**20080812205242] |
---|
1426 | [CLI: move the 'repl' command to 'tahoe debug repl' |
---|
1427 | warner@allmydata.com**20080812204017] |
---|
1428 | [CLI: move all debug commands (dump-share, dump-cap, find-shares, catalog-shares) into a 'debug' subcommand, and improve --help output |
---|
1429 | warner@allmydata.com**20080812203732] |
---|
1430 | [hush a pyflakes warning |
---|
1431 | warner@allmydata.com**20080812042423] |
---|
1432 | [web/directory: enable verify=true in t=deep-check |
---|
1433 | warner@allmydata.com**20080812042409] |
---|
1434 | [dirnode: add some deep-check logging |
---|
1435 | warner@allmydata.com**20080812042338] |
---|
1436 | [checker_results.problems: don't str the whole Failure, just extract the reason string |
---|
1437 | warner@allmydata.com**20080812042306] |
---|
1438 | [checker: add information to results, add some deep-check tests, fix a bug in which unhealthy files were not counted |
---|
1439 | warner@allmydata.com**20080812040326] |
---|
1440 | [mutable/checker: rearrange a bit, change checker-results to have a status_report string |
---|
1441 | warner@allmydata.com**20080812032033] |
---|
1442 | [mutable/servermap: add summarize_version |
---|
1443 | warner@allmydata.com**20080812031930] |
---|
1444 | [CLI: make 'tahoe webopen' command accept aliases like 'tahoe ls' |
---|
1445 | warner@allmydata.com**20080812012023] |
---|
1446 | [munin diskusage/doomsday: oops, fix labels, everything was reported in the 1hr column |
---|
1447 | warner@allmydata.com**20080811203431] |
---|
1448 | [munin/tahoe_overhead: don't emit non-sensicial numbers |
---|
1449 | warner@lothar.com**20080807214008] |
---|
1450 | [munin: add tahoe_overhead plugin, to measure effectiveness of GC and deleting data from inactive accounts |
---|
1451 | warner@lothar.com**20080807203925] |
---|
1452 | [diskwatcher.tac: include total-bytes-used |
---|
1453 | warner@lothar.com**20080807201214] |
---|
1454 | [setup: remove accidentally duplicated lines from Makefile |
---|
1455 | zooko@zooko.com**20080807193029] |
---|
1456 | [misc/dependencies: remove the no-longer-useful foolscap-0.2.5 tarball |
---|
1457 | warner@lothar.com**20080807184546] |
---|
1458 | [Makefile: avoid bare quotes, since the emacs syntax-highlighter gets confused by them |
---|
1459 | warner@lothar.com**20080807183001] |
---|
1460 | [diskwatcher.tac: don't report negative timeleft |
---|
1461 | warner@lothar.com**20080807173433] |
---|
1462 | [diskwatcher.tac: reduce the polling rate to once per hour |
---|
1463 | warner@lothar.com**20080807062021] |
---|
1464 | [misc/spacetime: add munin plugins, add everything to .deb |
---|
1465 | warner@lothar.com**20080807060003] |
---|
1466 | [diskwatcher.tac: hush pyflakes |
---|
1467 | warner@lothar.com**20080807050427] |
---|
1468 | [diskwatcher.tac: add async-GET code, but leave it commented out: urlopen() seems to work better for now |
---|
1469 | warner@lothar.com**20080807050327] |
---|
1470 | [cpu-watcher.tac: improve error message |
---|
1471 | warner@lothar.com**20080807043801] |
---|
1472 | [disk-watcher: first draft of a daemon to use the HTTP stats interface and its new storage_server.disk_avail feature, to track changes in disk space over time |
---|
1473 | warner@lothar.com**20080807042222] |
---|
1474 | [misc/cpu-watcher.tac: tolerate missing pidfiles, just skip over that sample |
---|
1475 | warner@lothar.com**20080807041705] |
---|
1476 | [setup: don't attempt to escape quote marks, just delete them. Ugly, but it works okay. |
---|
1477 | zooko@zooko.com**20080806232742] |
---|
1478 | [setup: escape any double-quote chars in the PATH before using the PATH to find and invoke trial |
---|
1479 | zooko@zooko.com**20080806231143] |
---|
1480 | [storage: include disk-free information in the stats-gatherer output |
---|
1481 | warner@lothar.com**20080806210602] |
---|
1482 | [mutable: more repair tests, one with force=True to check out merging |
---|
1483 | warner@lothar.com**20080806190607] |
---|
1484 | [test/common: add ShouldFailMixin |
---|
1485 | warner@lothar.com**20080806190552] |
---|
1486 | [test_mutable: add comment about minimal-bandwidth repairer, comma lack of |
---|
1487 | warner@lothar.com**20080806173850] |
---|
1488 | [test_mutable: factor out common setup code |
---|
1489 | warner@lothar.com**20080806173804] |
---|
1490 | [mutable: start adding Repair tests, fix a simple bug |
---|
1491 | warner@lothar.com**20080806061239] |
---|
1492 | [mutable.txt: add warning about out-of-date section |
---|
1493 | warner@lothar.com**20080806061219] |
---|
1494 | [test_system: factor out find_shares/replace_shares to a common class, so they can be used by other tests |
---|
1495 | warner@lothar.com**20080806014958] |
---|
1496 | [debian/control: update dependencies to match _auto_deps: foolscap-0.3.0, pycryptopp-0.5 |
---|
1497 | warner@lothar.com**20080806013222] |
---|
1498 | [bump foolscap dependency to 0.3.0, for the new incident-gathering interfaces |
---|
1499 | warner@lothar.com**20080805235828] |
---|
1500 | [web: add 'report incident' button at the bottom of the welcome page |
---|
1501 | warner@lothar.com**20080805190921] |
---|
1502 | [test_cli: more coverage for 'tahoe put' modifying a mutable file in-place, by filename, closes #441 |
---|
1503 | warner@lothar.com**20080804202643] |
---|
1504 | [check_grid.py: update to match new CLI: 'put - TARGET' instead of 'put TARGET' |
---|
1505 | warner@lothar.com**20080802024856] |
---|
1506 | [test_cli: remove windows-worrying newlines from test data |
---|
1507 | warner@lothar.com**20080802024734] |
---|
1508 | [test_cli.py: factor out CLITestMixin |
---|
1509 | warner@lothar.com**20080802022938] |
---|
1510 | [CLI: change one-arg forms of 'tahoe put' to make an unlinked file, fix replace-mutable #441 |
---|
1511 | warner@lothar.com**20080802022729] |
---|
1512 | [CLI: add create-alias command, to merge mkdir and add-alias into a single (secure-from-argv-snooping) step |
---|
1513 | warner@lothar.com**20080802021041] |
---|
1514 | [test_cli: add system-based tests for PUT, including a mutable put that fails/todo (#441) |
---|
1515 | warner@lothar.com**20080801221009] |
---|
1516 | [tests: simplify CLI tests that use stdin, now that runner supports it |
---|
1517 | warner@lothar.com**20080801220514] |
---|
1518 | [CLI: simplify argument-passing, use options= for everthing, including stdout |
---|
1519 | warner@lothar.com**20080801184624] |
---|
1520 | [tests: add test that verifier notices any (randomly chosen) bit flipped in the verifiable part of any (randomly chosen) share |
---|
1521 | zooko@zooko.com**20080731002015 |
---|
1522 | The currently verifier doesn't (usually) pass this randomized test, hence the TODO. |
---|
1523 | ] |
---|
1524 | [tests: test that checker doesn't cause reads on the storage servers |
---|
1525 | zooko@zooko.com**20080730235420 |
---|
1526 | It would still pass the test if it noticed a corrupted share. (It won't |
---|
1527 | notice, of course.) But it is required to do its work without causing storage |
---|
1528 | servers to read blocks from the filesystem. |
---|
1529 | |
---|
1530 | ] |
---|
1531 | [storage: make storage servers declare oldest supported version == 1.0, and storage clients declare oldest supported version == 1.0 |
---|
1532 | zooko@zooko.com**20080730225107 |
---|
1533 | See comments in patch for intended semantics. |
---|
1534 | ] |
---|
1535 | [tests: use the handy dandy TestCase.mktemp() function from trial to give unique and nicely named directories for each testcase |
---|
1536 | zooko@zooko.com**20080730224920] |
---|
1537 | [tests: don't use SignalMixin |
---|
1538 | zooko@zooko.com**20080730223536 |
---|
1539 | It seems like we no longer need it, and it screws up something internal in |
---|
1540 | trial which causes trial's TestCase.mktemp() method to exhibit wrong behavior |
---|
1541 | (always using a certain test method name instead of using the current test |
---|
1542 | method name), and I wish to use TestCase.mktemp(). |
---|
1543 | |
---|
1544 | Of course, it is possible that the buildbot is about to tell me that we do |
---|
1545 | still require SignalMixin on some of our platforms... |
---|
1546 | |
---|
1547 | ] |
---|
1548 | [setup: if the user passes a TRIALOPT env var then pass that on to trial |
---|
1549 | zooko@zooko.com**20080730205806 |
---|
1550 | This is useful for --reporter=bwverbose, for example. |
---|
1551 | ] |
---|
1552 | [setup: turn back on reactor=poll for cygwin trial (else it runs out of fds) |
---|
1553 | zooko@zooko.com**20080730181217] |
---|
1554 | [setup: fix bug in Makefile -- ifeq, not ifneq -- so that now it sets poll reactor only if the user hasn't specified a REACTOR variable, instead of setting poll reactor only if the user has specified a REACTOR variable |
---|
1555 | zooko@zooko.com**20080730160429] |
---|
1556 | [setup: whoops, really remove the default reactor=poll this time |
---|
1557 | zooko@zooko.com**20080730032358] |
---|
1558 | [setup: instead of setting --reactor=poll for trial in all cases (which fails on platforms that don't have poll reactor, such as Windows and some Mac OS X), just set --reactor=poll for linux2. |
---|
1559 | zooko@zooko.com**20080730031656 |
---|
1560 | |
---|
1561 | ] |
---|
1562 | [setup: pass --reactor=poll to trial unless REACTOR variable is set, in which case pass --reactor=$(REACTOR) |
---|
1563 | zooko@zooko.com**20080730023906 |
---|
1564 | This hopefully works around the problem that Twisted v8.1.0 has a bug when used |
---|
1565 | with pyOpenSSL v0.7 which bug causes some unit tests to spuriously fail -- see |
---|
1566 | known_issues.txt r2788: |
---|
1567 | |
---|
1568 | http://allmydata.org/trac/tahoe/browser/docs/known_issues.txt?rev=2788#L122 |
---|
1569 | |
---|
1570 | Also it matches with the fact that --reactor=poll is required on cygwin. |
---|
1571 | |
---|
1572 | ] |
---|
1573 | [setup: require secure_connections from foolscap |
---|
1574 | zooko@zooko.com**20080730021041 |
---|
1575 | This causes a problem on debian sid, since the pyOpenSSL v0.6 .deb doesn't come |
---|
1576 | with .egg-info, so setuptools will not know that it is already installed and |
---|
1577 | will try to install pyOpenSSL, and if it installs pyOpenSSL v0.7, then this |
---|
1578 | will trigger the bug in Twisted v8.1.0 when used with pyOpenSSL v0.7. |
---|
1579 | |
---|
1580 | http://twistedmatrix.com/trac/ticket/3218 |
---|
1581 | |
---|
1582 | Now the comments in twisted #3218 suggest that it happens only with the select |
---|
1583 | reactor, so maybe using --reactor=poll will avoid it. |
---|
1584 | |
---|
1585 | ] |
---|
1586 | [tests: add test_system.Checker which tests basic checking (without verification) functionality |
---|
1587 | zooko@zooko.com**20080728234317] |
---|
1588 | [test: add testutil.flip_one_bit which flips a randomly chosen bit of the input string |
---|
1589 | zooko@zooko.com**20080728234217] |
---|
1590 | [tests: make it so that you can use common.py's SystemTestMixin.set_up_nodes() more than once with the same introducer |
---|
1591 | zooko@zooko.com**20080728234029] |
---|
1592 | [download.py: set up self._paused before registering the producer, since they might call pauseProducing right away |
---|
1593 | warner@lothar.com**20080728215731] |
---|
1594 | [test/common.py: use pre-computed Tub certificates for the system-test mixin, to speed such tests up by maybe 15%. The goal is to encourage more full-grid tests. |
---|
1595 | warner@allmydata.com**20080728194421] |
---|
1596 | [munin/tahoe_spacetime: show 2wk data even if 4wk data is unavailable |
---|
1597 | warner@allmydata.com**20080728194233] |
---|
1598 | [web: add /status/?t=json, with active upload/download ops. Addresses #493. |
---|
1599 | warner@allmydata.com**20080726004110] |
---|
1600 | [web: make t=json stats pages use text/plain, instead of leaving it at text/html |
---|
1601 | warner@allmydata.com**20080726002427] |
---|
1602 | [test_system.py: factor SystemTestMixin out of SystemTest |
---|
1603 | warner@allmydata.com**20080725223349] |
---|
1604 | [test_system.py: modify system-test setup code in preparation for merge with common.SystemTestMixin |
---|
1605 | warner@allmydata.com**20080725222931] |
---|
1606 | [test_system.py: move SystemTestMixin out into common.py, where further improvements will occur |
---|
1607 | warner@allmydata.com**20080725221758] |
---|
1608 | [test_system.py: create SystemTestMixin, with less cruft, for faster system-like tests |
---|
1609 | warner@allmydata.com**20080725221300] |
---|
1610 | [TAG allmydata-tahoe-1.2.0 |
---|
1611 | zooko@zooko.com**20080722014608] |
---|
1612 | Patch bundle hash: |
---|
1613 | 18de68f402677061070f4e2980fa146860351ec9 |
---|