Automated tests orchestrator

Question

Summary: I'm using TFS as a build server and I familiar with MTM. What I am looking for is an alternative to MTM for steps 3 -5 . I'm looking for an automated testing tool (free or opensource) that can do the following:

1. Manage test machines
2. Run the tests on the machines (according to configuration)
3. can either run shell commands on the agents or integrate with Seleniun and or C#

A plus if: - can integrate with TFS - Have easy reporting servers integration.

any ideas?

Answer 1

I think you are looking for a Build server. A typical build flow looks like this:

1. Get code from TFS
2. Build Code
3. Run unit-tests
4. Spawn nodes for integration tests
5. Run integration and or Selenium tests

Microsoft has testing tools to integration such a process tightly within TFS:

• Set up Team Foundation Build Service: https://msdn.microsoft.com/en-us/library/ee259687.aspx
• Test on a lab environment with test manager: https://msdn.microsoft.com/en-us/library/jj635157.aspx

There are also free build servers like:

• Jenkins (Open Source)
• TeamCity (First 20 builds and 3 agents are free)

It should be possible to script anything from starting machines, running tests and deployments with these build tools.