My office doesn't currently have any kind of automated testing or anything that runs on our web site updates prior to release. We really need something. I'm not entirely sure what options are available out there, but we really could use something that allows us to script a series of tests and conditions under which those tests pass or fail. Ideally something open source or more affordable would be fantastic. What options do you use in your office and what works well? If given the opportunity to change how testing is done in your environment, would you change it?
Currently we do everything manually. Of course this has dozens of problems with the biggest being time consuming and inconsistent. We update weekly or bi-weekly and really need to be able to press a few buttons or so to make sure everything's functioning as intended. The only thing I can imagine is something where I can define what the "working" status is on specific screens. Cross-browser would also be ideal, but if we can't do that it's still a step up to have some automated testing.
In regards to what kind of tests I'm not entirely sure how to define that. There are numerous sections of our web application that have pretty specific outcomes/functionality so I'm having trouble being broad with an answer there. I suppose the test would be successful if one of the following were true:
- A specific dom element existed on the page
- what's on the page visually matches a screenshot we took previously, thus it's a match
A lot of the answers below don't discuss solutions, but indeed question the need to test in itself. There is a lot of value in these answers as you need to be sure that automated testing is the right solution to whatever the problem is you're trying to solve for. For my needs, I've decided to go with: http://www.telerik.com/automated-testing-tools.aspx