3

It depends Some things you may want to consider: Badly formed input - how does the API handle badly formed input? Can you send it something from the Big List of Naughty Strings and get back data you didn't expect? Security - If the API uses an auth header, can you access anything useful without one? If something else is used, can you bypass it with your ...


1

This what the Postman variables do, Assuming that your response data is: { name: "something" user:{ id:"12" } } in the test script section, add below command let jsonData = JSON.parse(responseBody); pm.environment.set("id", jsonData.user.id) //this stores the id to env variable 'id' now you can access the id value from the next ...


1

No, how would they know the reponse is cached. Call API with parameters Verify results Stop data storage (e.g. database) Call API again with same parameters Verify same results How would you do it manually? Does that translate to an automated test? Is the second time faster? (if you can measure that) Can we make it testable by introducing data in the ...


1

Since I defined 1 as number of threads in our thread group , will it fire the above 4 requests sequentially or parallel ? As said in the manual, samplers tell JMeter to send requests to a server and wait for a response. They are processed in the order they appear in the tree. Regarding If I had defined 2 as number of threads in our thread group ...


1

If your DEV environment has lesser hardware specifications than ACC and/or STG you can only do the following test types there: Regression Testing - to check that recent bugfixes or new features didn't cause performance degradations Soak Testing - to ensure that there are no memory leaks as the chance to detect them on scaled down environment will be higher ...


1

What is the main purpose behind your test? Try to define your SLO/SLIs first (KPIs). Usually SLO/SLIs are defined mainly by Product People. Of course Engineers could contribute , too. You could read more how Google defines it's SLI/SLO/SLAs. When they are defined, you could think against which environement you want to run the perormance test. Usually, ...


1

Is it a fair test? Not really. Performance tests usually involve warm-up phase as anonygoose suggested in his/her answer. For instance, in case of HTTP clients this is to let them start thread and HTTP connection pools. Performance tests should sent many requests over time. If you're sending only one request you might be simply out of lack as the server ...


1

According to this question Rest Assured is pretty slow on the first request you make. Looks like it has to warm up a little for some reason. I've tested version 4.0 of Rest Assured myself, and this appears to be the case. The first request is 2000ms+, then every subsequent request in the same suite is 200-300ms. A counter question might be: why compare ...


1

It depends on the service. If I'm testing something that doesn't change, or doesn't change often, I would assert the response against a benchmark response. For those services where the data may change, I would look to write some sort of validation script to compare the response results with the db.


1

Do testers perform usability tests in general? I think the answer is NO. You are not the user. Do testers facilitate usability tests in general? It depends, but I would answer YES. Help users test it, sounds good. So I think API usability testing with its users (e.g. developers) makes perfect sense, I would start with: Hallway testing by pulling in some ...


1

As @Mache says, you search for each value. var jsonData = pm.response.json(); pm.test("Verify Json values", function () { pm.expect(jsonData.data.id).is.to.equal(2); pm.expect(jsonData.data.first_name).is.to.equal("Janet"); pm.expect(jsonData.data.last_name).is.to.equal("Weaver"); // and so on and so on }); The better option: Create ...


Only top voted, non community-wiki answers of a minimum length are eligible