The following information about UAT is useful especially for first communication about UAT or when the customer has low experience with UAT and needs our support.
UAT testing on the project
UAT overview for customer
In our UAT testing phase, our primary goals are straightforward and geared towards ensuring a seamless experience for your business. We aim to comprehensively test the end-to-end process within the real environment, integrating the Pricefx software with your CRM, ERP, and other pricing-related tools. Our focus is on confirming that Pricefx performs as expected, effectively supporting and enhancing your business operations. The ultimate objective is to transition the project into live usage, leveraging the capabilities of Pricefx to positively impact your business.
It's important to note what UAT testing is not: it's not about repeating tests from the Feature Sprints, submitting change requests, or simply getting acquainted with the application. Instead, during this phase, your crucial responsibilities include creating UAT test cases and diligently testing them on the QA partition. If any bugs are identified, we encourage you to report them promptly to JIRA. Your acceptance of the solution is pivotal, marking the formal conclusion of the development phase and signaling the readiness to move forward with the live implementation of the project. We appreciate your collaboration in achieving these milestones and look forward to a successful UAT testing phase.
UAT overview
During the UAT phase, we've allocated a generous two-week window for testing all your UAT test scenarios. While this timeframe is sufficient, it's essential for testers to be well-prepared and commit daily efforts, dedicating at least 2 to 3 hours each day. We want to emphasize that attempting to tackle the entire testing process in a single day is not the most practical solution, so it's crucial to be ready for a sustained effort over the allocated period. The limited timeframe stresses the need for an organized approach, ensuring that every testing aspect is thoroughly addressed.
In terms of documentation, we've provided test cases for UAT. These serve a dual purpose by not only guiding testers on what needs to be tested during UAT but also offering the flexibility to organize their testing time efficiently and seek clarification on any uncertainties before UAT kicks off. Reporting test results is a key component of this phase. It allows project managers to have a clear overview of the testing progress and what remains to be tested, facilitating effective project management. At the same time, testers gain insights into their completed testing, which is helping them in organizing their ongoing efforts. Additionally, efficient bug reporting in JIRA plays a crucial role in expediting the fixing process.
Typical issues during UAT
When UAT testing lacks a structured plan, it often leads to challenges that impact the effectiveness of the testing process. The absence of a defined plan often results in testers resorting to exploratory testing, making it difficult to keep UAT testing under control. Time constraints are a common issue, with insufficient time allocated for comprehensive testing, leaving the progress unmonitored. Problems arise in accepting the solution as UAT testers express a desire to test more, further complicating the process. The absence of prioritization for test cases contributes to critical issues being reported only towards the end of UAT.
Moreover, the absence of training for UAT testers can lead to reported bugs being more akin to questions, change requests, or misunderstandings rather than genuine issues. This lack of clarity can result in UAT testers spending more time learning to navigate the Pricefx application rather than focused testing. The situation is compounded when UAT testers find themselves multitasking, neglecting dedicated time for testing due to other work commitments. To ensure a smoother UAT testing experience, a structured plan, clear priorities, and dedicated time for testing are essential elements that contribute to the overall success of the testing phase. Let's work together to address these challenges and enhance the efficiency of our UAT testing process.
Tips - Before UAT
To ensure a streamlined and effective UAT testing process, we recommend a thought throughl and organized approach. Begin by selecting a dedicated group of UAT testers, preferably Subject Matter Experts (SMEs), and ensure their commitment and availability for testing. Verify that they have access to all necessary systems required for UAT. The next step involves creating UAT test cases, aligning them with business cases, and ensuring comprehensive coverage of end-to-end scenarios. These test cases should include checklists outlining specific verification points.
Appointing a UAT leader from the project team, someone familiar with the solution, is crucial. UAT testers will report their results to this person, streamlining communication and oversight. Choose a test management tool; we recommend using X-Ray in Pricefx Jira for this purpose, noting that Excel is not considered a suitable test management tool.
Prioritize the training of UAT testers on both the application and the UAT process. Conduct a demo session with all UAT testers, demonstrating how to use the developed software and clarifying expectations for UAT testing. This session, ideally based on UAT test cases, should allow testers to explore the functionality themselves, providing assistance with any initial issues or questions. Recording the session enhances its utility, serving as a valuable reference.
Tips - During UAT
UAT testers, equipped with test execution tools such as X-Ray, should prioritize test cases, ensuring that critical functionalities are verified early on in the UAT process. Given the limited time for the UAT phase, it's crucial to keep in mind that there won't be plenty of time for retesting everything covered in Feature Sprints.
Daily reporting of test results is a key practice, with testers logging their progress regularly. The test results should not only include a detailed description of what was tested but also attach screens or other relevant files to provide comprehensive insights. In the event of identifying bugs, testers are encouraged to report them in Jira, categorizing them under Bug and providing a detailed description of the issue, the expected result, and any accompanying screens or files. Post-fix, it's essential to retest all fixes, close the bug, and finalize the testing of the UAT test case.
We recommend checking the testing status every day to ensure a steady pace and efficient progress. The UAT Leader should actively monitor the progress of UAT testers, providing necessary support and guidance.
Acceptance
The finalization of UAT testing signifies our readiness to transition into the Go-Live phase and utilize the solution in production. It's important to note that medium and low-priority bugs should not impede acceptance, as they can be addressed post Go-Live during the Stabilization phase. The decision to accept or not should align with the specified timeframe for the UAT phase, with a clear decision at the end.
Bug prioritization
Test management – X-Ray overview
X-Ray, is a Pricefx tool for test management plug-in integrated into JIRA. It comes with no additional cost to the project. This tool enhances transparency by making test documentation and results visible to both our project team and customers. Test cases are organized in separate issue types, linked to user stories for clarity on their purpose. It seamlessly supports testing in both Feature Sprints and UAT, ensuring an easy-to-use experience for anyone familiar with JIRA. With functionalities like exports, imports, and workflows, X-Ray has been successfully utilized on Pricefx projects since April 2021 and extended for customer UAT since October 2021.
Test management - details
In case the customer is more experienced and he is more interested in how UAT phase will be performed on the project, you can use the second version of the slide deck: