Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [data-warehouse-testing]

It ensures that the ETL process functions well with other upstream and downstream processes. A Data warehouse implementation is a collection of many components, and hence integration testing is a must. Typically, system testing only includes testing within the ETL application.

Filter by
Sorted by
Tagged with
0 votes
1 answer
51 views

Big data application testing

I am working on a project which has big data components in it. What would be testing artifacts (types of testing) of it which consists of data batch jobs, data ingestion framework, HDFS, tableau ...
brij's user avatar
  • 185
3 votes
2 answers
428 views

aws data pipeline testing tools

Our team is building an AWS product which uses several sets of tools like Lambda, SNS topics, EC2, data pipelines etc. I would like to know what type of testing tools/strategies that can be used to ...
Lalindra Kawshika's user avatar
2 votes
3 answers
19k views

I have an ETL scenario where my source is Database and Target is flat file. How best can I test it to make bug free?

The flat file has millions of records and the source query is joining at least 10 tables. The Testing I have done is: Structure validation of the file. Like name & number of fields, delimiter, ...
A Ahmed's user avatar
  • 21
1 vote
2 answers
61 views

Any advice on testing sprocs that feed into an API?

I'm currently testing a Web API that delivers JSON content that I am validating the results for with defined JSON files. This works well. We know what the request is, can develop a query that should ...
MichaelF's user avatar
  • 2,363
2 votes
1 answer
387 views

Testing database transformation mappings

If regularly testing the creation of different datawarehouse tables using mappings from source tables. What do you suggest is the best approach or specific SQLs to do the trick?
toop's user avatar
  • 211
5 votes
2 answers
2k views

Data warehouse testing checklist

What are some best practice approaches such as: SCD type 1/2/3 nulls duplicates missing data extra data special characters FK/PK referential integrity.etc
toop's user avatar
  • 211
10 votes
5 answers
7k views

How far would you go in ETL and data warehouse testing?

Recently I've been testing on an ETL/Data warehouse project and the strategy I took was to work very closely with the business and leverage their knowledge to come up with all the weird and wonderful ...
Adrian Lai's user avatar
8 votes
5 answers
20k views

What are some real world strategies for testing ETL and data warehouse applications

Does anyone have any advice to share on how to successfully test BIG ETL or data warehouse applications? I have my own ideas of-course, but there only appears to be one main article on line that ...
Bruce McLeod's user avatar
  • 9,750