Functional tests take a long time

Long Running Functional Tests

These are the few notes I took from the "long running functional tests" discussions.

Problems

• Complete features take 1 day
• Functional test takes 15 hours

Alternatives, Risks, and Trade-offs

• Parallel testing vs. pipelined testing
  • Compile
  • Fast unit tests
  • Slow unit tests
  • Functional tests

• Incremental feedback during test runs
  • Show failures sooner, but
  • Does not typically lead to stopping the tests because we want to know all the results from that set of code