Case Study: Automation QA for performance monitoring platform

Aa
Aa
Aa

Empowering employees is a crucial part of their professional development. Sometimes it’s hard to track their progress properly, as different people must be rated according to their professional stack. This is where our partner Workstride steps in.

However, when the solution becomes widespread and the product grows big, its requirements become big too. Especially, when it comes to Quality Assurance.

In this case study, we will cover how Automated QA testing can save an enterprise-level project from poor quality and errors.

Brief summary

1. 85% of the current functionality of the product covered

2. 94% of test cases are fully automated

3. 350+ automated tests created

4. 51 defects found and reported

5. Overall client’s savings are comparable to the total of 4 Manual QA yearly work hours cost. 

About the project

WorkStride is a leading provider of channel partner performance and incentive programs for the global enterprise – including full-scale solutions for SPIFFs, Rebates, Training, MDF/COOP, and more.

The company provides a full suite of reward technology, service, and support. WorkStride focuses on expert service and performance results helps their clients to gain more than a platform. They gain a team.

.

What was the challenge

The main requirement was to increase the automated testing coverage across definite platforms because their current manual testing process took a long time and had not constantly updated test results. The project is huge and multifunctional, so the number of test cases is growing regularly.

Workstride needed a way to speed up the manual testing process. Also, the company wanted to improve the documentation of specific configurations, processes, etc., and set up the method of reporting failure and error detection accuracy

Problems we faced

• A lot of existing test cases were not automated. The manual coverage was relatively huge, while automation was used only for a few critical tests. As a result, this created a heavy load on manual testers.

• Existing automation tests were outdated and uninformative.

• The development team was not using the advantages of automation reporting.

• Poor documentation

Solution we provided

• The project team consisted of 3 Automation QA Testers and 1 Manual QA Tester

• The QA Automation team analyzed the current technology stack and scalability. We decided to change the test framework and language. Currently, tests are being written using TypeScript. 

• Test automation coverage maximization.

• Manual run of test cases reduced. Automated tests execution increased.

• BDD approach.

• Clear reporting was introduced.

• The documentation was updated constantly with details on how to clone, set up, configure, and write new tests. The details about the structure, best practices, and used frameworks were added.

• The tests are now running in parallel with an introduced nightly run on a Jenkins server.

• Significant reduction in test time achieved, not only due to the test execution time but also due to the redistribution of testing levels.

• Stable test environments due to more accurate test data built.

• Manual QA switches focus on hard-to-automate testing: UI, Usability, Localization, Compatibility, and partly regression.

.

Advantages of the tools we used

The technology stack used in this project includes, but is not limited to:

JavaScript and TypeScript

Main programming languages we used for test automation.

Cypress 10

It’s a good solution for UI end-to-end tests because of a huge variety of commands that imitate real users’ behavior. Also, it provides API requests that significantly reduce the run time, and more useful features such as time traveling, automatic waiting, screenshots, videos, etc. Just what we needed.

Cypress Dashboard (Cloud)

Increases test velocity while giving total visibility into tests running in CI pipelines, compatible with Jenkins. It’s a good alternative to test reporting tools, because of its high usability and user-friendly interface. As a side bonus, the development team was always able to access and debug failed tests. 

Cucumber

World’s leading tool for Behavior Driven Development. Cucumber uses Gherkin syntax that makes feature files easy and human-readable. Using Cucumber, we automated 220 scenarios and almost 34 feature files on four separate project modules.

Jenkins

For CI pipelines we use Jenkins. It provides hundreds of plugins to support building, deploying and automating. Also, Jenkins has great compatibility with Cypress Dashboard, so it’s simple to monitor the run results not only using logs. Since the company requested testing of a few projects we had to configure a schedule and parallel run for each one.

Jira

As a tracking system, we chose Jira. It allowed us to easily record and track bugs and assign them at the right time with the bug tracking template. ​​For the customer, Jira allowed monitoring of work progress and always being up to date with team tasks through a sprint cycle. It helped all team members to keep everyone aligned on each issue’s status and ensure that the highest priority work is being tackled first.

Achievements

We have already covered 85% of the current functionality of the product. Now we are on the way to gaining maximum coverage of the platform.

Approximately, 94% of test cases are fully automated. Our team reported more than 50  bug reports. Over 800 Jira tickets have been covered by manual testing and 350+ automated tests were created. It takes 4-5 hours per day to execute everything. 

Overall client’s savings are comparable to the total of 4 Manual QA yearly work hours cost. 

We provided actual test results of the product state and reported 51 defects. We are still working with Workstride to ensure proper work of the platform and assist with the new updates and feature releases.

Like in the case with Workstrike, our Automation QA team continues to bring the quality of products to the higher level for dozens of enterprise companies and startups in 8+ industries. 

If you need fast, continuous, and visible quality verification of your software, you can schedule a call and get a free POC, just drop us a note to hello@pecodesoftware.com