I work on a team which is basically all backend. Functional and unit testing is achieved by python or perl scripts or sometimes bash scripts. But if we need to load or performance test our applications, we currently have a few scripts that generate linear load and we write some scripts that would print out some stuff to console e.g., a script will generate 1000 emails queued for a certain daemon and a couple of scripts will output process snapshot (ps), memory usage, etc. to the console and we monitor those. We can obviously write a multi-threaded script specific to each load test and something that will monitor results but that would be a very specific approach and would require us to do that for each test. Basically the reasons to use a generic tool that can be tailored for specific use.
What I am looking for and unable to find so far, is a backend tool that will help us generate load with multiple threads and can be used to collect console output and aggregate it over time to generate a tabular or a graphical result to be analyzed. There are a lot of tools available for web testing, but I am looking for something similar for backend.
We work with Perl and Python, so that is a critical part. And we are mostly working on linux or a mac. Also preferred is a open source solution.