1

I am comparing different file formats for understanding which has the best performance for my case. I use these data formats for storing data-sets created from different analytical techniques. I wrote some Python scripts for analyzing the compression ratio now I am trying to implement something for measuring the access time I know that for many indicators I will have only relative value but I would like to know if there is a tool that allows me to test file formats and helping me in choosing the best one for my application.

  • 2
    Any feedback on how to improve the question is appreciated. – G M Sep 14 '19 at 16:52
  • 1
    The word "performance" is not applicable to file formats. Change the title to sth like "performance of reading files of different formats". – mentallurg Sep 14 '19 at 17:06
1

My expectation is that you're looking for a microbenchmark library for your programming language.

This "microbenchmark" approach allows testing single functions with multiple threads/iterations/input data and reports the trends. So just look for "microbenchmark" libraries/packages for your programming language and you should be able to use the approach for the comparison.

If you don't have access to the source code of the application you can go for "macrobenchmark", to wit testing the whole application with different file formats and comparing the output. Depending on the application nature you can use a suitable load testing tool which provides the same performance metrics which you could compare. Check out Open Source Load Testing Tools: Which One Should You Use? article for example load testing tool assessment/selection criteria.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.