Take the 2-minute tour ×
Software Quality Assurance & Testing Stack Exchange is a question and answer site for software quality control experts, automation engineers, and software testers. It's 100% free, no registration required.

The people I work with are .NET programmers that aren't exactly on the BDD/TDD bandwagon yet. I'm the main web designer, but for the past few months I've also been assigned the tester role as well (yeah, we're a tiny company).

I want to start incorporating some automated tests and after some research I'm more drawn to Watir/Cucumber and other Ruby-based tools.

Now I only test the GUI along with certain permissions (e.g. if I log in as a user, make sure I can't see what admins see, etc.) so I don't foresee any conflicts in terms of what language I use. Also, Ruby just feels a little easier to learn than C#/.NET.

However I'm wondering if there's anything I'm missing and whether it would just be easier to learn the .NET-based testing tools?

share|improve this question
    
Thanks so much for everyone's help! I now have a better understanding of what to do and I'll definitely be talking to the development team about this and work out the best solution for all of us. Much appreciated :) –  kleniq Aug 10 '11 at 5:02
    
You know, I only ever hear "what can go wrong" in movies, right before something really bad happens... –  corsiKa Aug 30 '11 at 16:25
add comment

8 Answers

up vote 3 down vote accepted

I agree that the language in general wont matter but with this caveat: since the product is coded in .Net you might look at the latest test tools that Microsoft includes with the tester edition of VS. The primary advantage being that tests and test documents could be managed in TFS, over time taking advantage of that could be helpful. Tests and test documents that live only on one persons machine are very fragile things.

share|improve this answer
add comment

If you are the sole tester, and might continue to be for a while, it probably doesn't matter much if you choose whatever tool you personally prefer.

But if there is an expectation that other programmers will contribute to test automation, you should take their needs and preferences into consideration as well.

Then again, when your company grows enough, you may hire some dedicated testers who will then make their own test automation choices anyway.

share|improve this answer
add comment

I am a big proponent of removing as many abstraction layers between my automated tests and the product code as possible.

Ruby or other scripting languages may seem fine for now, but if your test automation expands beyond simulating manipulating GUI elements you may find that C# may have been a better choice to begin with for several reasons:

  • Performance, C# is more performant than many scripted languages. May not seem important now, but as test library grows the time it takes to run a suite may matter.
  • Collaboration, dev can review and run autoamted tests. Being able to "plug in" to dev unit tets, or other test harness allows you to push tests upstream
  • Capability, writing your test automation in C# can use reflection to access parts of product code to improve your overall test effectiveness and reduce false positives.

You may also want to look at http://www.testingmentor.com/imtesty/2011/05/19/test-automation-beyond-rudimentary-script-lets/

One final thought...talk with your development team and get their input. Perhaps Ruby (or other language) is sufficient for the needs of the company. Also, think about potential future growth of the company and how needs might change in the foreseeable future.

share|improve this answer
add comment

My answer is the old favorite: it depends. If you're looking for blackbox regression, the language doesn't matter, although it does help to have other programmers who understand what you're doing with automated tests that they can either help write it or help debug it. If you're looking to build unit tests, you're better off working with the same language as the code.

Also, a lot depends on the purpose of your testing. If your GUI evolves rapidly, you might prefer to work on behind-the-scenes validation of data processing. If GUI is critical, is it faster to do a quick visual, or do you need extensive validation of which components display?

I'd recommend you don't get hung up on the language you use - start by working out what aspect of your application most needs automated testing, then what offers you the most effective tools to perform that testing. Language can be learned, whether it's a scripting language, a pseudo-English test definition language, or one of the classical programming languages (or anything else for that matter).

I hope that helps you find a good starting point.

share|improve this answer
add comment

I don’t think that learning C# for testing purposes is way harder than learning Ruby. C# has a lot of syntax sugar that enables you to write less code.

With C# you could use WatiN (supports IE and FireFox only: http://sourceforge.net/projects/watin/) or Selenium.

It does not depend what language/platform you choose, but if you will have a problems with C#, you can ask a developer who sits near you. But when you have problems with Ruby then whom will you ask?

Try to write several tests on both languages. And choose the language you are more comfortable with.

share|improve this answer
    
+1 Highlighting this so it won't get lost in other replies, "...if you will have a problems with C#, you can ask a developer who sits near you. But when you have problems with Ruby then whom will you ask? " –  user179700 Sep 2 '11 at 3:30
add comment

If it is a very small company and you aren't mandated to use a specific tool set, I would choose whatever you prefer and what is easier for you to learn and be interested in. They are asking you to test the software with the best tools available and that's up to you.

That being said, if you don't want to be expected to maintain the testing suite forever you might want to consider using tools that the development team is experienced in using. One would hope they would be skilled enough to switch between the two but as companies grow things get more specific as far as platforms. This is based on my experiences though.

Also, if you're primarily a Mac or Unix user (with your background as a web designer), I think you'll have an easier time with a tool that runs natively in a Unix-like OS than having to be rolled into the .Net experience.

Additionally, as things grow up you may want to consider how testing is viewed (e.g. do you need pretty charts and graphs to spoon-feed product status to upper management? If so, you may want to look at tool sets that support that kind of feature.

share|improve this answer
add comment

Using C# would lower the barrier to entry for the developers to start TDD/BDD.

share|improve this answer
add comment

Keep using the same two languages (KISS):

  • C#
  • English*

Use http://specflow.org/ to have gerkin style text only tests. It's not fancy and there's very little to go wrong with it. Plays nicely with TeamCity etc as the tests are normal MSTest / NUnit test assembiles.

I like them as they stop me getting side tracked with the implementation of the test, and they lead you down the path of building up your own bespoke testing language. (what would my pefect testing language look like for this problem domain?)

share|improve this answer
    
* SpecFlow comes in many other languages... –  Squirrel Aug 22 '11 at 22:29
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.