I'm working with several companies that are deploying SAP HANA (in memory appliance that compresses data from the DB and moves the entire structure into memory resulting in query times that are ~3600 times faster). Our problem is we need to functionally test the system to ensure the right data arrived, no corruption occurred, the apps were modified to talk to this appliance rather than the DB correctly, etc.
We came up with a basic way to do this but we need more. We're going to run some reports with the system before migrating to HANA and then run the reports afterwards. They should be the same since the application shouldn't have changed functionally and the data should be identical even though it's in columnar format and in a different location.
How else can you functionally test reports or reporting UIs like BI or BW? What about Flash or CRM apps?
Also, I'd like to find a way to automate this. If anyone has experience automating BOBJ, let me know. I'd love to buy you a steak dinner.