4
votes
2answers
159 views

Testing programs that handle huge datasets

I'm writing a script that parses many thousands of lines from a server log and collates the data. I'm wondering how to go about creating unit-tests for such a program, to make sure it gathers the data ...