I work for a company that provides BI solutions. I am an SME/Super User and one of my typical duties is to evaluate system configuration for new installs and upgrades prior to the client receiving it.
We are in the process of re-evaluating our roles and responsibilities and my group is under the belief that many of our duties in this regard should be handled by our (very small) testing group.
Examples of things we currently examine that we think should be tested prior to reaching us:
- Are new documents able to be created?
- How long does it take for a new document to be created?
- Are all KPIs present in the document?
- Are the values of the KPIs reasonable?
- Does basic functionality work (e.g., sorting, filtering)?
There are about 15 of these types of tasks for about 30 individual documents.
In addition, we also examine the installs to ensure that any customizations that were requested are present/functioning based on our industry experience. E.g., For our CRM tool: Does the system reflect the client's sales team's commission structure?
We would like to limit our review to the latter type of tasks but wanted to ask experts to better understand what is typical.
Appreciate your comments.