Hot answers tagged data-quality
As always, "it depends". Some of the times you'd want to use a clean test database: You're performing regression: you want to start regression from a known starting point. You're testing setup and configuration issues You're comparing results against some baseline. Here you're going to want to start from the exact same condition your baseline started ...
I can't promise that our techniques are state-of-the-art, but they gave us the level of confidence we needed and might give you some ideas for an approach. We made a backup of the production database before we made the fix, with all of its known duplications. We then ran the de-duping code against that database and analyzed the duplications it found to ...
[Disclaimer: This product is created by my company] We have a product call QuerySurge that allows you to fully compare data in the source tables with the data loaded into the data warehouse. Compared to other approaches, this seems to be the best automated method for validation.
There are times I want to do that and have in the past, my clean/start data was set to copy over when I needed it and I had my Gold Standard to compare against. I could run this each time and be able to check where the system went wrong by checking against my Gold. However, things have changed. With Customer environments in flux, quick develop and release ...
Only top voted, non community-wiki answers of a minimum length are eligible