[tahoe-dev] plans for tahoe-1.3.1

[Andrej Falout]

Hi guys,

(beware: crude end-user logic ahead :-)

In your plans, is there something you can do to improve upload speed?
Directory creation speed?

I'm currently working around this performance issues by running backup of
several locations in parallel, which clearly shows that the bandwidth is
there, but not being utilized.

Also, some kind of progress indicator/statistics for 'tahoe backup' would be
great.

I'm currently using my script that collects bandwidth stats using ntop, and
calculates completed files and there sizes from --verbose output, to get
remaining time/size etc. like this:

andrej at polar:/media> obackup.sh tbprog
INFO: Running backup operations: 2 All logs to:/data-local/logs/obackup
INFO: ======================================================================
INFO: Elapsed since backup started: 2:15:57:46
INFO: Logfile: 'backup-data-audio-Loops%and%Samples_09-03-02_19-31.log'
INFO: Backup of: '/data/audio/Loops and Samples' D:5072 F:54532 S:51597MB
INFO: Completed:39130/41429MB Skipped:30509/35897MB Uploaded:8621/5532MB
INFO: Remains: 19.00% F:15402/10168MB(9GB) 5:0:30:25
INFO: ======================================================================
INFO: ======================================================================
INFO: Elapsed since backup started: 2:15:57:25
INFO: Logfile: 'backup-data-audio-AUDIO%BOOKS_09-03-02_19-38.log'
INFO: Backup of: '/data/audio/AUDIO BOOKS' D:131 F:2820 S:10150MB
INFO: Completed:2703/9060MB Skipped:7/1067MB Uploaded:2696/7993MB
INFO: Remains: 10.00% F:117/1090MB(1GB) 0:8:51:06
INFO: ======================================================================
INFO:
INFO: Traffic with 'allmydata.com' domain, 5 mintes blocks, newer to older:
INFO: ----------------------------------------------------
INFO:  Domain sent to us        Domain received from us
INFO: --------------------      -------------------
INFO: kb        mb      gb      kb      MB      GB
INFO: 496       0       0       15777   15      0
INFO: 658       0       0       21216   20      0
INFO: 512       0       0       15883   15      0
INFO: 511       0       0       16030   15      0
INFO: 669       0       0       21387   20      0
INFO: 548       0       0       16180   15      0
INFO: 662       0       0       21529   21      0
INFO: 614       0       0       20189   19      0
INFO: 673       0       0       21363   20      0
INFO: 622       0       0       20284   19      0
INFO: 766       0       0       24618   24      0
INFO: 597       0       0       20009   19      0
INFO: ----------------------------------------------------
INFO: 7328      7       0       234465  228     0       Last hour total
INFO: 610       0       0       19538   19      0       Last 1h 5 min avg
INFO: 639       0       0       22497   21      0       Last 6h 5 min avg
INFO: ----------------------------------------------------
INFO: 94%       99%     Of all network traffic on last record (09-03-05
11-35)


Cheers,
-- 
Andrej Falout
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://allmydata.org/pipermail/tahoe-dev/attachments/20090305/f0dc27e1/attachment.htm