#348 closed enhancement (fixed)

BuildBot step to run tests from package

Reported by: zooko Owned by: cgalvan
Priority: major Milestone: undecided
Component: dev-infrastructure Version: 0.8.0
Keywords: Cc:
Launchpad Bug:

Description

Patches that change packaging can't be conveniently tested by trial tests inside the package. A better way to test such things is to have a BuildStep which, after a package has been built (such as a source tarball or a py2exe or py2app package), it installs that package and then runs the unit tests from the version thus installed.

This would help test patches like #335 (OSError when trying to access http://localhost:8123/provisioning/), it would catch errors in the build process which cause packages to be built incorrectly (such as the one that distracted several of us from more useful labor Monday morning), and if implemented in re-usable BuildBot code, it would help test similar issues in other projects such as Nevow #2527, Nevow #857, pyflakes #2535, and twisted #2308.

Change History (8)

comment:1 Changed at 2008-03-13T17:53:23Z by zooko

  • Type changed from defect to enhancement

comment:2 Changed at 2008-03-13T18:18:47Z by zooko

I added a ticket on buildbot #199 for this.

comment:3 Changed at 2008-03-17T21:03:05Z by zooko

I updated buildbot #199 to suggest installing into a local, newly created subdirectory and testing that install by setting the PYTHONPATH to point to that subdirectory.

comment:4 Changed at 2008-06-01T20:43:52Z by warner

  • Milestone changed from eventually to undecided

comment:5 Changed at 2008-08-12T21:21:37Z by zooko

Nevow #2630 (installation of Nevow doesn't have automated tests) has been fixed -- the Nevow buildbot now tests installation of Nevow. We could do similarly for Tahoe.

comment:6 Changed at 2008-08-28T20:43:55Z by zooko

See also #434 (automate testing of installation) which is perhaps going to be fixed by the same patch that fixes this ticket -- if that patch makes it so that the buildbot both installs the package and runs the unit tests from the installed package.

comment:7 Changed at 2009-01-14T20:36:16Z by zooko

  • Owner changed from somebody to cgalvan

Chris has done this!

comment:8 Changed at 2009-01-23T22:51:31Z by zooko

  • Resolution set to fixed
  • Status changed from new to closed
Note: See TracTickets for help on using tickets.