Is there a best tool for use to load up data and do a comparison large sets of data apart from Excel in a customizable way?

  • 1
    What type of data? Relational? Tree-based like XML? Graph-based? What kind of comparison? Values? Types?
    – dzieciou
    Commented Mar 31, 2016 at 10:35

4 Answers 4


Talend Open Studio for Data Quality is a great tool for data comparison, data validation and lot of other data testing features. You can upload data from different type of sources into it and perform the checks.

But note that it is comparatively complex tool to begin with, so learning curve could be an important factor while choosing it.

  • I believe I cannot afford enterprise tools. At this point of time looking for something open source.
    – DJD
    Commented Mar 31, 2016 at 7:35
  • This is Open Studio. Not commercial. Commented Mar 31, 2016 at 7:46

Another tool that is very popular is RedGate, I have used it in the past with good results: http://www.red-gate.com/products/


How you are going to take data? Are you going to dumb the data from db or any external sources.

If you want to compare table data between tables in two different databases.use below tool



One option is to use shell scripting with a combination of sed, awk and md5 to parse and hash the data.

Not the answer you're looking for? Browse other questions tagged or ask your own question.