Tag Info

Hot answers tagged

4

If I understand correctly, the only thing that makes this scenario a challenge is the use of the "live feed". Thus, stub out the live feed. Replace it with your own "non-live feed" and you end up with predictable states where your expected calculation results are truly predictable. Your "non-live feed" can be generated by hand, or if you are automating ...


3

As always, "it depends". Some of the times you'd want to use a clean test database: You're performing regression: you want to start regression from a known starting point. You're testing setup and configuration issues You're comparing results against some baseline. Here you're going to want to start from the exact same condition your baseline started ...


2

I can't promise that our techniques are state-of-the-art, but they gave us the level of confidence we needed and might give you some ideas for an approach. We made a backup of the production database before we made the fix, with all of its known duplications. We then ran the de-duping code against that database and analyzed the duplications it found to ...


2

I would add to an answer from Joe that you may randomize data that you send to an app from the live feed stub. With this technique you may be able to find bugs that would not be found if you only used the same data all over again.


2

In my experience, something like a csv compare can be done programmatically without too much of a speed hit - so long as there aren't many errors. The way I'd handle it is to have your baseline CSV files being the data you expect each table to contain, one for each table (excluding any timestamps or other time-sensitive data - you'd need to check that ...


2

using your favorite script language would probably be the best solution, Peter suggested Perl and I'll add Python to the list, both have excellent modules to parse and analyze CSVs and XMLs and a lot of capabilities to help you in your tasks.


1

Try using SchemaCrawler. SchemaCrawler is a free and open-source command-line tool that produces text (text, JSON, CSV, HTML) output that is designed to be diff-ed, using standard diff tools. It can compare both structure and data. Sualeh Fatehi, SchemaCrawler


1

Instead of testing with csv / xml level. You can load the data into a database and run queries and obtain accurate results Create a Results DB with Run_Id (ex-ResultMMDDYYY_1) Load the source and destination data into the DB Run Queries for each source / destination tables and create a results table Fetch the data from results table and publish results You ...


1

Purely in relation to ISO/IEC/IEEE 29119 (The New International Software Testing Standard): There's mixed opinion on ISO/IEC/IEEE 29119, but it does provide a versatile framework that can help/suggest structure to a QA/test team. Standards aren't everything - efficient and effective testing should be your first priority. If ISO-29119 is of interest, ...


1

I found an open source command line tool that can compare databases, csv, xml etc. http://www.diffkit.org/


1

I would hope since this is a financial application there is some sort of auditing you could utilize. If not I would ask to see if it could be injected into the app if you can't control the feed in some manner. You should be able to determine what the selected or triggered price was. You can use the total transaction value against the quantity to see if ...


1

Based on the information on wikipedia and searching online (there seem to be a lot of diagrams) it seems like the standard tries to set up a model using five (to 8) characteristics that are sub-divided into sub-characteristics. If I were you I'd mindmap the characteristics and sub-characteristics (although you could also just list them in a document) and ...


1

I would guess that the app uses log files ( if not ask for them) or records the exchange rate somewhere for auditing


1

[Disclaimer: This product is created by my company] We have a product call QuerySurge that allows you to fully compare data in the source tables with the data loaded into the data warehouse. Compared to other approaches, this seems to be the best automated method for validation.


1

There are times I want to do that and have in the past, my clean/start data was set to copy over when I needed it and I had my Gold Standard to compare against. I could run this each time and be able to check where the system went wrong by checking against my Gold. However, things have changed. With Customer environments in flux, quick develop and release ...



Only top voted, non community-wiki answers of a minimum length are eligible