123 reputation
4
bio website aace.org
location Philadelphia, PA
age 37
visits member for 1 year, 11 months
seen Oct 18 '13 at 17:33
I'm mostly a code monkey but interested in how information is used generally, even wrote my master's thesis on it, sort of. Currently working on developing an online community for academics as well as a digital library for educational professionals.

Oct
18
comment Testing programs that handle huge datasets
These are web server log files, so just as an example I need to take a given IP address and determine whether it corresponds to a provided IP range for an organization. That's way outside of my abilities in Excel.
Oct
18
comment Testing programs that handle huge datasets
Part of the problem is that it relies on processing against database records. The file contains the record IDs and I need to pull in fields from the corresponding record.
Jun
25
comment Testing programs that handle huge datasets
I'm not sure if the business logic I need to perform can be done in Excel, honestly. If it can, I certainly don't have the Excel expertise to do it.
Jun
21
awarded  Scholar
Jun
21
awarded  Supporter
Jun
21
accepted Testing programs that handle huge datasets
Jun
21
comment Testing programs that handle huge datasets
I guess for functional issues my question is more like: am I correctly tabulating/summarizing the information? So even if it correctly processes one row of data, is it adding up the records correctly, and correctly sorting/filtering the data?
Jun
21
comment Testing programs that handle huge datasets
So use an extremely small dataset first followed by a test that just ensures that it can handle a large file without breaking?
Jun
19
awarded  Student
Jun
19
asked Testing programs that handle huge datasets
Oct
24
awarded  Autobiographer