Deviniti has been supporting companies in business development for over 15 years. We help customers choose the best tools as a support of their digital transformation, and we create solutions that make it easier for teams to perform their daily duties. Jira isn’t a dedicated testing solution, but it is an integrated platform that allows managing projects, users, and workflows in a single place. Software teams that are used to Jira as their work environment will benefit from adding the function of test management. With QA teams in mind, we’ve created dedicated apps Requirements and Test Management for Jira and TestFLO for Jira. They make their work much easier and improve the efficiency of the software development lifecycle. They offer the best integration with Jira when it comes to testing apps, enabling users to make the most of native Jira mechanisms. Moreover, TestFLO for Jira is an incredibly flexible app that can be customized to serve different testing processes. We have recently helped a US-based corporation to implement TestFLO for Jira and streamline the testing process by introducing a centralized repository of testing documents. Read on to find out how our test management solution improved their underlying processes.
Biggest test management challenges
Tests and test management are an essential part of software development but unfortunately are often undervalued or even ignored altogether. The test management process brings a lot of challenges, as it’s divided into multiple steps covered by a multitude of tools. One of the most common problems of software teams is lack of an integrated tool to track the whole development and testing process, which makes us scatter it all over the place. As a result, we write a Master Test Plan in Word, execute tests in one of many testing tools, handle Continuous Integration (CI) loop in either Bamboo, Jenkins, Bitbucket Pipelines or another CI tool, duplicate and take care of defects in Jira, and write reports in Excel.
In this particular case, the organization is the leader of American market in the area of building self-service kiosks, point-of-sale terminals, checking processing systems, barcode scanners, and business consumables. The company provides quality point of sale (POS) products and solutions, as well as IT maintenance support services, to help organizations better serve their customers and grow their businesses. The company’s solutions cover several core industries that include retail, financial service, hospitality, and travel. The vision of the company is becoming the leading software and services-led enterprise in terms of hardware, software, and services provider in the industries they serve. That’s why the company needed a reliable test management tool that would help its development teams to deliver world-class quality software.
Before using TestFLO for Jira, they tracked all information related to tests using Excel spreadsheets that were posted to a shared network folder to grant access to all the team members. One of the primary challenges that came with this method was version control for test cases. With multiple team members editing such documents, the company was unable to track changes or the reasons behind them. Sometimes, the teams weren’t sure which version was the latest, since multiple users kept on updating the same documents simultaneously. The company needed a centralized repository of test documentation that would allow teams to track and review the changes.
Choosing the tool & solutions
To pick the best solution for their teams, the company used the Decision Analysis and Resolution (DAR), a CMMI-DEV evaluation process that analyzes possible decisions among the available tools. The solution evaluated different tools, including TestFLO for Jira, Xray for Jira, Hiptest, and Zephyr for Jira. They chose TestFLO for Jira because of its value, flexibility, and extensive customization options. As it was mentioned earlier, Jira alone isn’t a dedicated testing solution, but the team which already has been using Jira will truly benefit from transforming it into a test management tool with the help of additional, well-integrated apps. Thanks to this function, there was no need for creating a new infrastructure, implementing a new tool, or even staff training. That’s why Jira was the best choice in this case, which occurred to be such a great environment for test management.
The company successfully uses TestFLO for Jira to maintain a test case repository and create test plans, which QA teams then export and share with specific customers. They use the tool together with their software testing process to track against defects, stories, requirements, and other things with the help of the TestFLO for Jira reporting features. They also use TestFLO‘s ability to export reports to PDF so that the client doesn’t require to have access to their Jira, and is still informed about how the tests were carried out.
Moreover, TestFLO for Jira has a workflow condition that prevents a Test Case from being executed before the Test Plan has been started. A workflowmodification is enough to introduce this restriction, there are other workflow modifications that TestFLO for Jira allows for. Check them out in our documentation.
We know that working on Test Cases is dynamic. During the process, we have to deal with all kinds of situations when the details change or the bigger modifications are necessary. Sometimes after one meeting, the whole prioritization of the testing elements has to be re-arranged. Nevertheless, we all know that keeping everything in order is crucial, especially when the consecutiveness of Test Cases is significant, and completing one of them allows passing to the next. Whilst creating our test management tools we wanted to make the organizational issues the simplest and the most intuitive for the team members possible. This is why we’ve added functionality allowing to order Test Cases in a Test Plan via drag and drop list. It saves a lot of time which can be effectively used on actual testing instead of planning.
The order of test cases is first determined at the test planning phase. You can do this at the tree level on the left, where you can order files that contain test case templates, nest files, and set the order of test cases within the file in the view on the right. It’s simple, just drag and drop:
Then, by clicking on a file with right mouse button, you can choose to create an executable test plan from that file and all of its sub-files. That is how, from this part of the tree, you will create an executable test plan:
This results in a test plan that has executable test cases. Below you can see “Integration tests” that correspond to the “Integration tests” file from the tree mentioned before:
At this level, you can still change the order of the test cases if we want it to be a little different than we specified earlier in the tree. A specific instance was created from the template in the tree, and we can still customize this instance. The change here does not affect the whole tree, only this specific test plan. You can move the cases up and down by drag and drop or arrows on the right side. They can also be moved between groups, e.g. from “Integration tests” to “Critical functionalities”. Below you can see a down-scrolled view of the test plan:
You can also change the order of the whole groups.
Moreover, in version 8.6, which will be released in the nearest future, we will allow the test leader to force testers to complete cases in the order defined in the test plan. Currently, the order is a suggestion, and you can start executing test cases from the center of the plan, and perform them randomly. In some particular cases, it’s important to enforce the order according to your plan.
Results and benefits
Test management in Jira grants the requirement collection stage the importance it deserves. You need to think about gathering requirements in the same place as performing other testing activities, being able to keep testing and execute the whole software development together in a consistent interface. All team members involved in the process, so analysts, product managers, testers, developers, customers, and the rest of the stakeholders have easy access to data and can monitor implemented changes. What’s more, a well-planned and organized process is more likely to achieve the final goals than a chaotic one, especially when it comes to more complex projects. Test management lets you structure everything from end to end. Executing each testing step in one place makes it easier to track the relations between the objects.
Making sure that everything is ordered helps prevent mistakes, minimize bugs and as a result, saves time and budget. This idea goes perfectly with the rules of static testing which consists in testing the app based on its code and specification before even launching the actual program. It may sound strange, but did you know that a bug can cost even up to 880 times less when it’s found during the starting phase of testing than if it’s discovered later in the process?
In this case, following the implementation of TestFLO for Jira, the company gained the possibility of tracking the changes that could be referenced if any issues were to come up during testing. Using comments, the teams can reference the changes and their origin, as well as attach supporting documentation. That has introduced a significant improvement to the company’s reviewing process. Since all the information is centralized, the process is streamlined and efficient. With the ability to assign test cases to individual members, the team transparency has improved as well. The team members now know who is working on what and which documents are available without worrying about duplicating efforts.
Thanks to implementing TestFLO for Jira, QA teams can improve the transparency of tests, increase test coverage visibility, and boost traceability of tests and requirements. This solution also provides testers from different projects with easily accessible place for storing all the information relevant to testing, which includes displaying the history of changes, linking test artifacts to development activities, and copying the Test Repository from one project to another.
Modern technologies are an inseparable element of digital transformation that can affect every aspect of work, in every department, in every enterprise. A properly selected digital tool that perfectly matches the real business needs of a specific team can automate processes and facilitate completing of daily tasks. TestFLO for Jira is a tool which covers the entire test management process in Jira, and it adapts to the specific needs of QA teams. In this case, TestFLO for Jira helped the company to centralize test documentation and streamline the review process. That resulted in significant increases in staff productivity, and overall satisfaction with the process which is smooth and transparent.
The issues in Jira are without any doubt one of the strongest points of the Atlassian’s software. This is why we couldn’t imagine not to benefit from it in our extension. We made all our testing objects standard Jira issues, so they can be effectively used also in Kanban and Scrum boards. It makes it easy for the team to work together on a project, and by this we mean the whole software development, not only the testing process. Read more about tools for effective test management: