Skip to main content

All Questions

Filter by
Sorted by
Tagged with
1 vote
0 answers
24 views

How to properly validate an ETL process?

In an ETL process a table is dynamically constructed using a complex SQL query. This query is written by a developer. As a QA engineer, how can I validate that the table is correct according to ...
Aishwarya's user avatar
3 votes
2 answers
430 views

aws data pipeline testing tools

Our team is building an AWS product which uses several sets of tools like Lambda, SNS topics, EC2, data pipelines etc. I would like to know what type of testing tools/strategies that can be used to ...
Lalindra Kawshika's user avatar
2 votes
3 answers
19k views

I have an ETL scenario where my source is Database and Target is flat file. How best can I test it to make bug free?

The flat file has millions of records and the source query is joining at least 10 tables. The Testing I have done is: Structure validation of the file. Like name & number of fields, delimiter, ...
A Ahmed's user avatar
  • 21
8 votes
5 answers
20k views

What are some real world strategies for testing ETL and data warehouse applications

Does anyone have any advice to share on how to successfully test BIG ETL or data warehouse applications? I have my own ideas of-course, but there only appears to be one main article on line that ...
Bruce McLeod's user avatar
  • 9,750