Version 89 (modified by zooko, at 2010-03-16T17:16:31Z) (diff) |
---|
Tahoe-LAFS Summer-of-Code Projects
This page contains specific suggestions for projects we would like to see in the Summer of Code. Note that they vary a lot in required skills and difficulty. We hope to get applications with a broad spectrum.
If you are interested in working on any of these projects, please contact the Mentors listed at the bottom of the page.
In addition, you may wish to discuss your proposal on IRC—join us on #tahoe-lafs on irc.freenode.net.
We encourage you to come up with your own suggestions, if you cannot find a suitable project here. You can find more project ideas by exploring the issue tracker. Especially see tickets labelled 'gsoc' (developers: please add this label to any tickets that might make a good GSoC project). You may also want to read this mailing list thread about GSoC ideas.
Deadlines and directions for students' applications to the Google Summer-of-Code can be found on the Google pages.
Project | Difficulty | Contact |
Redundant Array of Independent Clouds | Medium | Zooko Wilcox-O'Hearn or any mentor |
Share Migration | Medium | any mentor |
Cloud Apps | Easy–Hard | Jack Lloyd or any mentor |
WebDAV | Medium | David-Sarah Hopwood or any mentor |
Distributed Introduction | Easy | Zooko Wilcox-O'Hearn or any mentor |
Redundant Array of Independent Clouds
Add backends to the storage servers so that they store their shares on a cloud storage system instead of on their local filesystem. This means that you can get all of the availability and scalability of services such as Amazon S3 or Rackspace CloudFiles combined with the security properties of Tahoe-LAFS. See the RAIC diagram. For details read ticket #999 which including pointers to the relevant source code and instructions on how to begin writing the code.
Share Migration
When uploading a file to a grid, Tahoe-LAFS will make sure that the file is healthy (a good discussion of what healthy means is found in #778) before reporting that the file is uploaded successfully. Tools to effectively maintain file health (or to adapt to new definitions of health) aren't quite complete, however -- our users have had several use cases that aren't easily addressed with what we have. Students taking this project would be building tools to address those use cases.
A good starting point would be to become familiar with how files are placed on a grid. architecture.txt, file-encoding.txt, mutable.txt, the immutable file upload code, and the mutable file upload code are good places to do that. Also, you might want to look at the storage server code to understand that better. Some good tickets to start looking at are #699, #543, and #232; you'll find that those link to other tickets.
There are many ways to help address these issues. Some ideas:
- Alter the CLI and the WUI to give users the ability to rebalance files that they've uploaded already. (#699)
- Build tools that allow node administrators to moves shares around a grid (#543, #864)
- Alter Tahoe-LAFS to rebalance mutable files when uploading a new version of them. (#232)
Any one of these projects is probably too small to fill a summer, but combining a few of them would be a big usability improvement for Tahoe-LAFS.
Depending on how you address this, this is tightly integrated with ideas of file health and accounting, so prospective students would do well to explore those open issues, too. A good accounting jumping-off point is #666. A good jumping-off point for health is #778.
Cloud Apps
Difficulty: easy to hard, depending on project choice and how far you want to push it
There are a lot of applications that could potentially make good use of Tahoe-LAFS replacing the typical centralized storage of flat files or SQL databases. Currently supported projects include TiddlyWiki (one of the Tahoe-LAFS developers hosts his blog using TiddlyWiki stored in Tahoe-LAFS), Hadoop, and a number of others.
There are still many useful and interesting things that have yet to be built using Tahoe-LAFS. Perhaps the most promising is in the area of web applications; what applications can you think of that could make use of a highly reliable filesystem accessible from both desktops and handheld devices? Keep in mind that Tahoe-LAFS's architecture allows sharing and delegation opportunities that are difficult or impossible to implement using other backends. Some ideas people have suggested include a calender or photo album, or porting Mozilla's Bespin editor).
Nathan Wilcox wrote most of interactive tree browser frontend in JavaScript (see the RelatedProjects page); Toby Murray wrote a front-end in Cajita; what interesting ways might this be extended?
This is in some ways the most interesting area for development as it combines security and distributed systems problems with providing a user interface that lets a person who isn't particularly security minded operate safely by default. This is a hard problem, but offers great rewards in terms of learning, and even the ability to break new ground in safe-by-default interface design.
Required skills: HTML and JavaScript for web applications. For other tie-ins, will depend on the base project (for instance porting the git DVCS to run on Tahoe would good C-fu, with git experience helpful).
WebDAV
Implement a WebDAV front-end for Tahoe-LAFS so that files and directories stored in a distributed grid can be accessed by operating systems (including Windows, Mac, and Linux) and applications that speak the WebDAV protocol. For details see #451 which describes what the Tahoe-LAFS web server does now, how this differs from what a WebDAV web server does, and how to get started experimenting with the relevant source code.
Distributed Introduction
Implement a protocol for distributed introduction, thus removing the only remaining Single Point of Failure (SPoF) in the Tahoe-LAFS system. For details see ticket #68 which describes the distributed notification algorithm and points to the relevant source code.
Mentors
Who is willing to spend about five hours a week (estimated) helping a student do it right?
- Zooko Wilcox-O'Hearn blog (Python/C/C++/JavaScript, security+cryptography)
- Jack Lloyd blog (C/C++/Python, security+cryptography)
- David-Sarah Hopwood (Python/C/JavaScript, SFTP frontend, security+cryptography)
- Brian Warner (Python/C/JavaScript, security+cryptography)
This page was modelled on the NetBSD Summer-of-Code page.