VenueNext is transforming the way guests experience every kind of venue, from arenas and concert halls to hotels and hospitals. It gives guests access to the venue’s offerings at the touch of the button with a context-aware smartphone apps.
They engaged Bq Professional Services to ensure the overall quality of the application using BQ platform for Mobile Application automation Testing and Test Asset Management.
Business Context
- More than 15 Venue/Team specific Mobile applications for both iOS and Android
- Team/Venue specific features built on top of core functionality
- Integrates several third party libraries for functionality like ticket booking, seat allocation, live game scores, videos etc.
Business Challenges
- Testing over 15 apps for every release on both iOS and Android.
- There was no Mobile Application Automation Tests
- Business users testing all the apps, taking time away from their day-to-day responsibilities.
- Very little to no documentation of Test Assets. Testing was very person and device dependent.
- Domain and technical knowledge spread across different teams. With little to no documentation, there was no single source of truth (desired behavior).
- Multiple integration points (Web, API, Splunk etc.) made it difficult for the users to test complete workflows given the paucity of time.
- Dev team tested on dev environment while Business users tested on Production environment, leading to different results and difficult to catch/reproduce defects.
- VN customers wanted an audit of testing performed before UAT.
Technical Challenges
- All applications use a single core with customer specific configuration and implementation changes. Change in a single place often lead to un-desirable behavior in other apps.
- Person and device dependent testing, lead to defect leakage.
- Several third party libraries are integrated in a single shell. Upgrading these libraries was very time consuming since all the apps had to be tested thoroughly
- Multiple integration points including API calls and web browser apps, made it difficult to comprehensively test complete workflows. For example, one of the workflows involved placing an order from the customer app, generating order number from the backend admin web app, checking and updating various attributes of the order in the third mobile app running in the kitchen
Bqurious Solution – Mobile Application Automation Testing
- Enabled Business Users to create Mobile Application Automation tests without writing a single line of code.
- Tests were modularized so the common pieces were created only once and then reused across different customer specific apps. This made test maintenance very efficient.
- Business users created automated workflows touching across multiple technologies very easily.
- Automated smoke and regression suites were created that ran on multiple devices automatically from Jenkins build pipeline.
- Business Users created automated test shells and passed them to the developers. Developers then populated the test shells during development, leading to more complete test coverage.
- Integration with JIRA gave the users a single view into the entire process including comprehensive analytics.Detailed Test Results with screenshots acted as an audit trail for the VN customers and also as a knowledge repository/User Manuals for new VN team members
Results
- Over 60% reduction in testing effort leading to faster time to market.
- Comprehensive End-to-End Testing with customer verifiable results.
- Repeatable, single-click regression testing in a fraction of time across multiple devices simultaneously.
- Greatly reduced test maintenance effort.
- Respond to changing requirements easily and quickly.
- Increased test coverage leading to better quality.
- Faster time to identify and fix issues.
