#394 new task

mutable publish: add timing charts to measure RTT

Reported by: warner Owned by:
Priority: major Milestone: soon
Component: code-mutable Version: 1.0.0
Keywords: performance statistics Cc:
Launchpad Bug:

Description

We should examine the mutable-file publish process to try and get small files to do read-modify-write in two RTT. Large files should be three RTT (one to update the servermap, a second to read the data, a third to write the data).

The first step for this will be better status/visualization tools. Servermap update has a little diagram (using the Google Chart API) of how the queries are spaced out. I'd like to:

  • make these charts for all mutable file operations
  • for retrieve, show both the mapupdate queries and the retrieve queries on the same chart
  • for publish, show mapupdate and publish on the same chart
  • (maybe) for modify, show everything on the same chart
  • switch to PIL to get better diagrams and show overlapping queries

I think we may be at 3RTT already, but I'm not sure, and better tools would help me be sure.

Change History (5)

comment:1 Changed at 2008-06-01T20:45:59Z by warner

  • Milestone changed from eventually to undecided
  • Summary changed from mutable: publish should take two RTT to mutable publish: add timing charts to measure RTT

I think we're at two RTT for small files, but I still want better diagrams, so I'm changing the title of this ticket.

comment:2 Changed at 2009-12-04T05:07:13Z by davidsarah

  • Component changed from code-performance to code-mutable
  • Keywords performance added; mutable removed

comment:3 Changed at 2010-05-26T14:51:17Z by zooko

  • Milestone changed from undecided to 1.8.0

It's really bothering me that mutable file upload and download behavior is so finicky, buggy, inefficient, hard to understand, different from immutable file upload and download behavior, etc. So I'm putting a bunch of tickets into the "1.8" Milestone. I am not, however, at this time, volunteering to work on these tickets, so it might be a mistake to put them into the 1.8 Milestone, but I really hope that someone else will volunteer or that I will decide to do it myself. :-)

comment:4 Changed at 2010-08-10T03:53:20Z by davidsarah

  • Milestone changed from 1.8.0 to soon

comment:5 Changed at 2010-08-10T03:53:33Z by davidsarah

  • Keywords statistics added
Note: See TracTickets for help on using tickets.