Tag Info

Hot answers tagged

13

There are a few things I try to remember about finding bugs in production: Quality isn't binary. If you measure your performance by whether there are bugs, you will always fail. Instead, I consider whether the quality is improving. Failure is a learning opportunity. When a bug makes it into production, I ask myself what I could have done differently. ...


12

1) Are there a difference between those ones? The Australian IT industry still views testing as a job that anyone can perform with minimal technical skills. A quick search on a leading recruitment site has a number of advertisements for Testers with requirements similar to the following: At least 3 years experience in a Tester or Test Analyst role ...


9

I agree with Bruce in general; however, 1) Are there differences between a STAE/STE and SDET role? Maybe...it depends on the company. Some companies to not differentiate roles based on title. For example, at Microsoft we used to have both STE and SDET roles and titles. When I started in '94 only people whose primary job was to build and maintain test ...


9

As user246 says, tricks to force developers to test can always be gamed: you're much better off finding out why they don't like testing and what the actual problem is then building a culture of testing and quality from that. You're working in PHP - there are unit test frameworks available for PHP that your devs can use. If they have no idea how much trouble ...


8

I second (third?) the congratulations! While I'm nowhere near as experienced as Joe or Bruce, I can offer a few tips from experience: Communication is critical - you absolutely must have at least an instant messaging application to talk real-time with your team. That application should also be something your development team is using since you want your ...


7

First off, everything I say here should be checked against your job description - that's going to tell you what your employer expects of you. As a lead, you probably don't have hire/fire responsibility (that usually goes with the manager title), so your employer's expectations will probably fall into these areas: resource management - making sure that ...


6

How do I get past the fact that im never going to be able to find everything? There's nothing to get past here. You need to convince yourself that "finding everything" isn't actually your role. Your goal is to help your company get to "good enough". And understanding what is "good enough" in the context of your company and your customers is the key. ...


6

OK...now that a few folks have voiced their perspectives on "boxes" let me try to answer your question. I am going to assume that we agree that by 'white box' testing you are referring to the act of designing static or dynamic tests based on the implementation of a programming language that performs some functional task or behavior in a software program; or ...


5

The key challenge is getting control of either: the thing that triggers action requests. the clock by which the system determines what time it is. The other answers (and your question) have already mentioned the first possibility, so I'll focus on the second. When I design systems like this, I try to arrange for the clock to be substitutable. For the ...


5

Mercfh, I know you've accepted user246's excellent answer, but here are a few more things for you to consider: It's impossible to fully test anything non-trivial. It's often impossible to test every path through a system. Many bugs are in the eye of the beholder. What I mean by this is that something which bothers a customer enough to report a bug is often ...


5

Good luck with that. Your developers are probably bright enough to subvert any gimmick or incentive you put in place. Instead, you need to face the problem head-on: testing needs to be a part of your organization's culture. That's not to say that every developer needs to love testing, or needs to prefer testing over development. Rather, developers need ...


5

Since you seem to imply that you already know what data you are going to report on, why not have data populated real time and accessible via the intranet? At MS all test results are available to everyone on the project team via the intranet. Test data is usually consumed across the organization differently, especially in large organizations. So, people can ...


5

There is no one "right" answer. The number and type of categories of defects that would be appropriate to your context depend upon several factors, including: Type of application Your team size The level and frequency of "in the hallways" conversations between people on the team The number of bugs you have "hanging around" waiting to be taken care of etc. ...


5

There's a few extra factors here that can impact the way you handle this problem: Do you get results for each test as it completes or do you have to wait until all tests complete? Do you have multiple machines on which to run the tests (and is it possible to do this) or are you tied to a single system running your tests in sequence? Can you break your ...


5

It depends, and there are no industry standards. Seriously. Any metric can be gamed (and will be, if you use it for assessment). I'm not aware of any standard approaches, not least because the teams are - or should be - evaluating themselves regularly and looking for ways to improve their own processes (if they aren't then they're probably using ...


5

I'm going to start with my standard response: it depends. I'm assuming you're talking about computer games and not board or other kinds of games, but the computer game industry has something of a reputation for using a lot of unskilled testers. That reputation comes from the fact that the large game development companies can call on gamers who think it ...


4

There are a number of systems that can handle this. I'm familiar with Test Link and TFS, both of which have APIs (although the TFS API is a little challenging - speaking as someone who's worked out how to post test results to TFS through the API) and both of which have ways to handle test cases that need to change. A lot depends on your budget - Test Link ...


4

I'm going to go out on a limb here and say that what you have is an ad-hoc development process rather than an agile one. Here's where I'd start, assuming that you have the ability to work with the programmers and project/application management on this (you can get a lot of it even if you don't have that ability). Who - Who is the intended and actual user ...


3

Congratulations! Here's a list I used last time I took a new position: http://www.allthingsquality.com/2010/04/qa-leaders-checklist.html It's pretty hard to know what you should expect, since every situation is different. Instead of anticipating, try to determine how you will go about learning what you have actually gotten into.


3

Depend on industry, domain and whether companies give out titles or not Some companies will have a rigid structure where you need X years before you get a title change I've known 'test managers' who have 2 years or less experience and you can find people who've worked for many years who are happy just to be called testers


3

Issue Reports (Bug Reports) are one of the main communication methods that QAers use. You are creating a statement to your stakeholders - "I have found what I think is a problem, and here's my clear explanation of what it is and how you can see it too. Please look into this". Understand the Audience for the Report It's important to know who is going to ...


3

The short answer to your question is that if the same person does both the development and the testing, he's going to bring a lot of assumptions into the tests. On the other hand, he probably already knows the weak points and how the code works, so he's got a lot to offer in the testing process too. It doesn't sound like you have dedicated testers, so ...


3

It is hard to find very knowledgeable security experts in QA, mostly because it is extremely complex, and requires constant learning and keeping up on trends. There are a number of things that you would absolutely need to know in order to be considered a "security expert". The biggest challenge is that it's not OK to know some of these things, or to have ...


3

There are several factors to consider when selecting test data. For example, if your 200TB of production data is essentially equivalent, then you could potentially calculate a statistical sample from the total equivalent population. If not you could group your 200TB of production data into smaller equivalent subsets and calculate sample sizes for each ...


3

Your first step is to host the app on as close to a production environment as possible to eliminate "noise" from your load/performance testing. In the case of a test server, you'd want to keep everything else off it, have any database hosted on a separate system if that's your likely production configuration, and then start exploring the application behavior ...


3

As you say - 'it depends' but a few comments from my experiences: If you supply exact steps and data then what is the point of UAT? You might as well get your testers to run the scripts. I'd rather give the users some training on the system and give them scenarios to follow - which will have been developed with their input. Should anyone be able to run the ...


2

My favorite answer here: it depends. As Phil said, each company handles things differently. As a thumbnail guide, most of the job ads I've seen treat 1-2 years experience as a junior role, where there's likely to be a fair amouont of guidance needed. 3-5 is usually seen as an intermediate level, where the tester is largely self-guided and is starting to ...


2

Take a look at the Test Matrix Report. If this does not have the needed column, register on TestLink Mantis and create a feature request (with the maximum level of detail). Regards Francisco Mancardi TestLink Team Leader


2

There is a very relevant whitepaper here that you should read. It raises some excellent points. Whilst I don't want to be negative, or scare you, your situation will be VERY challenging as you have to contend with the following: Learning your new role and your lack of testing experience. Communication with and governance of the offshore team. Working in ...


2

Most systems in test mode can be configured extensively. Try to find a way to configure this system-under-test to trigger the action requests on demand (and thus under your control). Failing that, configure the system to trigger action requests on a short duration of your choosing (1 hour? 1 day?). Is this system under your control for testing purposes?



Only top voted, non community-wiki answers of a minimum length are eligible