CASE STUDY

TELECOMMUNICATIONS

Leveraging Mobile Automation to Optimize Test/QA Efforts

Overview

This client is one of the largest wireless carriers in the United States and Europe and leading the way with cutting edge innovations in the mobile web and the IoT.

Mobile Communication

This wireless carrier has a history of network excellence, product and service innovation, and offers some of the industry’s highest service levels. In addition to operating its leading cellular network,

the company has also made forays into mobile banking, web TV, and the Internet of Things – all with an eye on enhancing the breadth of its service offerings and level of customer engagement.

80M+

Wireless Customers

5G

Leading the way

IoT

Innovator

Expertise in Digital Services & Industry Leading Tools

leveraging mobile automation
leveraging mobile automation

Business Goals

Cost Efficiency

Target annual cost savings of over $500K

Execution

Capitalize fully on the benefits of test automation

Faster Cycle Time

Get new products and services to market faster

The Challenge

As customer demand for new digital services has multiplied in recent years, and new devices and networks enable next-generation capabilities, delivery teams have struggled to keep pace.

This carrier defined a clear strategy to embrace a ‘shift left’ approach to its Test/QA efforts with the help of test automation. Its objectives were to:

Automate a large part of its software and device test footprint to speed cycle time and reduce manual testing errors.

Reduce the time and resource requirements involved with testing new service offerings.

Ensure the highest service levels possible for users.

The Solution

Infostretch got involved with the carrier after a well-known global IT services vendor was unable to meet the carrier’s test automation requirements and failed to live up to its own service-level agreements.

Infostretch is currently engaged with the carrier, providing Quality Engineering services in two primary areas:

Customer-branded mobile apps

Customer-branded mobile apps

catering to users on the carrier’s cellular network as well as for Enterprise customers.

Android Security Market Releases

Android Security Market Releases

for devices certified to operate on the carrier’s network.

Infostretch leveraged its expertise in enterprise mobile automation along with its technology partnership with Perfecto to quickly put the carrier’s Test/QA efforts back on the right track.

Some of the key aspects of the solution and deployment include:

  • 1400 test cases automated on four different platforms – iOS on mobile and iPad; Android on mobile and tablet – for two different apps.
  • 120+ test cases automated on 35+ different devices for testing of Security Market Releases for Android patches with plans to automate more of the carrier’s Test/QA footprint.
  • 20% improvement in test execution efficiency as a result of fine-tuning the automation framework.
  • Build of a self-service framework to enable non-testers in the customer organization to independently execute test cases on as-needed basis.
  • Daily test execution and analysis to ensure quality releases to the end customer.
  • Parameterized set up and functionality to maximize functional test coverage.
  • Error bucketing (automatic failure categorization).
  • Generation of network, system and device-related metrics from test execution of automation script.
  • Test result integration with TestRail.
  • Subject matter experts on Kibana for reporting to trigger and manage execution by non-technical personnel.
  • Use of JIRA to manage entire flow to provide visibility across the entire delivery cycle; e.g., Requirements, Development, Delivery, Review, Acceptance.

Infostretch also leveraged its long-time partner Perfecto to provide the optimal technical solution.

This involved re-orienting the statistics used to analyze the software test failures more effectively and efficiently. Infostretch also developed automation scripts to test device behavior in varied network signal strength environments while switching from one network to another; e.g., WiFi, 2G, UMTS, 3G, 4G/LTE, etc.

In addition, Infostretch also brought in 24×7 Support for test execution including daily build release and validation; while using a static code analysis tool.

A Delivery Timeline

A Delivery Timeline

Integration and Deployment of Industry Leading Tools

Industry Leading Tools
Industry Leading Tools
Industry Leading Tools
Industry Leading Tools
Industry Leading Tools

Technical Achievements & Outcomes

Technical Achievements & Outcomes

Parallel execution in 250+
devices of large volume of
test cases in tight time frame

Technical Achievements & Outcomes

50% improvement in
execution time by using
native framework

leveraging mobile automation

77 million records
of test execution data
generated so far

About Infostretch

Infostretch leverages a proven combination of technology, processes, and expertise to help enterprises accelerate the execution of their digital strategy. We deliver faster and more effectively by unifying expert professional services and best practices with pre-built software frameworks and products. Our 1,000+ development, testing and integration specialists have deep capabilities in DevOps, QE, app development, Cloud, AI, IoT and mobility.