Problem Statement

Ensuring Seamless Transactions: A client in the payment domain sought an experienced QA partner to support end-to-end (E2E) smart speaker software testing. The goal was to validate successful transactions and transaction amounts across multiple Indian languages. Additionally, the client required testing for device upgrades with and without network connectivity.

How We Resolved the Issue

Expert Alignment:

• Aligned domain experts within one week to kickstart the project.

Comprehensive Testing Phases:

• Tested the smart speaker in six different phases:
  • Device power-on
  • Device to call time sync API
  • Network connection (2G/3G/4G)
  • Heartbeat call
  • MQTT connection
  • Device readiness to receive transactions

Implemented Solutions:

1. Log Validation:
   • Validated through device and server logs to ensure accuracy and functionality.
2. Audio Conversion:
   • Captured the voice from the speaker into a sound receiver, then converted the audio files into text files for validation.
3. Automation:
   • Automated E2E flows as part of regression for each release cycle, significantly speeding up the go-to-market (GTM) time.
4. OTA Testing:
   • Tested over-the-air (OTA) updates both with and without network connectivity. Devices were flashed using tools like Qflash.
5. API Automation:
   • Automated API testing to ensure backend stability and reliability.
6. Audio Message Validation:
   • Checked minimum and maximum values, switching devices on and off, welcome messages, successful transactions, battery status, and SIM insertion.

Tools Used:

• Utilized open-source tools such as Putty, Coolwatcher, and Qcom to capture logs.

Achievements

• Versions Tested and Released: Successfully tested and released over 30 versions of the smart speaker software.
• Faster Production Releases: Achieved a 2x faster production release cycle.
• Quality Improvement: Domain experts identified functional defects, significantly improving overall software quality.
• Increased Revenue: Due to the stability of the smart speaker, the client acquired a substantial number of merchants, resulting in increased revenue.