Functional tests come in all shapes and sizes. Is there a class of lightweight, simple to use, tools that will discover, run and report on all tests found in a directory? I'm looking for something like nose, py.test but for arbitrary test programs.
Requirements
- finds and runs any executable file in a directory
- pass/fail based on non-zero exit status of script/program
- results displayed in console
- no database, http server or network access required
- runs on Linux
- optional configuration using a plain text file
Optional/Nice Extras
- fail if anything is written to stderr
- output junit xml reports
- organize using suites/tags
- works on Windows/MacOS
- supports debuggers on failure
Most test tools seem to focus on management of a test bank and the results. They must have some kind of runner built in. I'm looking for a quick way to start running tests without the overhead of learning and configuring a full suite.