Client

• • • • • Healthcare.
        • Banking and finance, insurance.
        • Energy, telecommunication.
        • Government and public sector.

Challenges

• • • • • The system was a new development that caused many changes to the features. In addition, the testing team and development are distributed.
        • No time to write the software documentation from the development team.
        • Little budget for testing activities
        • Pressure from stakeholders to go live in a very short time
        • Almost 99.9% functions are NOT tested
        • Test on multiple devices for both Android and iOS
        • User-friendly is an important requirement but vague

Solutions

• • • • • A team of expert testers on both manual testing and using tools to test decided to apply Context Driven Testing which focused on testing while playing, exploring; less documentation, and leverage all resources (tools, log file, devices) to test.
        • Testing team together MeU Solutions R&D to quickly develop a tool called Click2Play to record and playback all test activities on the mobile application. And using Exploratory Tracker tool (developed by MeU Solutions) to capture tester’s actions for Desktop Web application. Click2Play was developed in parallel with testing execution.
        • The team conducted a session (2 hours) to analyze product coverage outline-PCO (It is important to communicate with the client on product knowledge and support test strategy), product risks, market analysis on using the device and OS version (to identify and propose suitable devices and OS version) and define the testing strategy based on Heuristics Testing Strategy Model.
        • PCO is cover all aspects of the product like functions, data, interface (for user-friendly), time
        • With the know-how of the product, the testing team generated many test charters to cover at max PCO. Test charters were rated from Low to High as its priority with the client’s agreement.
        • For primary platforms, all charters needed to cover elements of PCO. But other ones, only charters for sanity and compatibility tests
        • The Testing team with pairwise testing to perform test charters with using One2Explore
        • Debriefing for each test session to identify improvements and missing/ untouching areas during active sessions executed.
        • Leverage innovative/ famous tools to perform and manage test efficiently: Test Management, Defect Tracking System with Jira; Product Coverage Outline with Xmind, One2Explore (MeU’s IP)-an innovative exploratory testing tool that produces detailed step-by-step recording, automatically records all test execution environment data and user interactions on desktop, web or mobile apps; status report with Testing Dashboard.

Results

• • • • • The test team has completed test this product within 6 sessions of testing.
        • Several critical/ major defects were found and appreciated by Dev in the 2nd session. These defects were suggested to develop to change the way they coded.
        • Product risk assessment was provided by the test team to product team which supported the management team to have the whole view of product quality healthy; and finally, the product is go-live as the expectation with high quality.