I am comparing different file formats for understanding which has the best performance for my case. I use these data formats for storing data-sets created from different analytical techniques. I wrote some Python scripts for analyzing the compression ratio now I am trying to implement something for measuring the access time I know that for many indicators I will have only relative value but I would like to know if there is a tool that allows me to test file formats and helping me in choosing the best one for my application.
2
-
2Any feedback on how to improve the question is appreciated.– G MCommented Sep 14, 2019 at 16:52
-
1The word "performance" is not applicable to file formats. Change the title to sth like "performance of reading files of different formats".– mentallurgCommented Sep 14, 2019 at 17:06
Add a comment
|
1 Answer
My expectation is that you're looking for a microbenchmark library for your programming language.
This "microbenchmark" approach allows testing single functions with multiple threads/iterations/input data and reports the trends. So just look for "microbenchmark" libraries/packages for your programming language and you should be able to use the approach for the comparison.
If you don't have access to the source code of the application you can go for "macrobenchmark", to wit testing the whole application with different file formats and comparing the output. Depending on the application nature you can use a suitable load testing tool which provides the same performance metrics which you could compare. Check out Open Source Load Testing Tools: Which One Should You Use? article for example load testing tool assessment/selection criteria.
