Zephyr Enterprise

Fantastic Test Management Add-In for JIRA

Comments: This is one of the best tools that I have worked on to date for the tasks of test management. The tool directly helps me provide most the reports and artifacts that I need for my day-to-day work.

Pros:

I love the ability to generate Reports and manage tests with ease. The rest APIs also allow to update of results of automation scripts to the JIRA and auto-generate dashboards, and status in JIRA. The ability to add custom fields for test objects is a big customizability power.

Cons:

The rest APIs can be made more simple to use.

Zephyr really helped us work in a scaled agile way as well as integrating our automation framework.

Comments: Where did we expect Zephyr to do well
- JIRA Integration Scaled Enterprise Agile
- Automation execution
- Global metrics
- Tablet and mobile test execution and real time metrics
What did leadership get
- On the go metrics at group level and product level
- Integration with Confluence for JIRA and Zephyr metrics
- Reduced cost as man hours are reduced, because all QA activities can be done via one tool
- 100% integration into all products

Pros:

It allowed the entire project team to work together on all aspects of their testing within the context of their specific software releases, while keeping a global view. Using structured and freeform test execution cycles, and the ability to run manual or kick-off automated tests in the automation tool of our choice allowed greater scalability. All the results get updated in real time to dashboards for senior management to review. All testing assets, across all products, projects, releases and sprints all in one place. Standardize on tests, data, metrics, processes, executions, documents, reports etc. Able to re-purpose and reuse which saved time and increased productivity. We required a test management application that would seamlessly integrate with our other business critical tools e.g. JIRA, Confluence, Eggplant, Ready API, Test Complete, Selenium, Jenkins etc

Cons:

There were some bugs found after major releases, but these were always turned around and resolved very quickly after reporting them. If we found areas that required new feature requests or enhancements, these are generally delivered in a 4 or 8 week cycle

Painful benefits

Comments: If you must use a tool built into Jira that offers test cycles aligned with Jira versions and you can find a less painful way to create steps than to manually type them in, then it may work well for you.

Pros:

With Zephyr I can create tests right inside Jenkins that leverage labels and components and release cycles.

Cons:

I find creating steps to be an awful editing experience. I tend to write tests in the ticket description instead just so I can avoid the cumbersome work of filling out steps.

Test Management System of Choice for our DevOps Journey!

Comments: The benefits are truly amazing! We can now "see," in real-time, the progress of all our testing and release pipelines. The integrations to other software development applications is excellent, via the API's or plug-ins. We can now quantitatively make release decisions, and assure upper management that the product we are pushing to production has been thoroughly tested.

Pros:

Robust two-way synchronization with Jira. Automatically sync's with sprint stories and bugs. Ease of use with solid API integrations and plug-ins with other major release pipeline applications. Customer support and interactions have been outstanding. Zephyr has a Customer Advisory Board, which meets twice a year, to listen to, and respond to the industry. The product and team have advanced rapidly, allowing our organization to accelerate our DevOps initiative. Zephyr continues to be on the foreground of innovation, as seen by their latest release named "Maestro," their DevOps plugin that takes Zephyr to the next level, as a qualitative test management solution. Very satisfied with all aspects of the product and its future road-map.

Cons:

The only con to Zephyr, is its ability to manage role-based securities. However, through an engagement with our top executives, and the senior executive team from Zephyr, they now have this concern vetted and will be working to incorporate this capability into a future release. Zephyr actively listens to its customers, so any (and I mean any) concerns you have, they truly listen and actively work to satisfy the need.

A test management tool worth-considering!

Comments: - As a software tester, a good test management tool is a must! And I believe that most, if not all, software testers out there will agree. To fit into this liking, Zephyr is really a worth-considering tool.- Zephyr consists all the basic and major functionalities that a test management tool should have. I love that this is integrated to Jira so its integration to Jira as a project management and bug tracking tool is a huge plus!- There may be some challenges when it comes to user experience but this is just a minor one

Pros:

- Zephyr can be integrated to Jira so you can maximize the functionalities of Jira to Zephyr's core features- In Zephyr, you can create test cases, test plans, and test cycles very easily- Jira's different issue types like bugs and stories can easily be linked together with Zephyr- User friendly and components are easy to navigate- Can be integrated to other third-party apps for dashboard and reporting

Cons:

- Even though the tool is user friendly and easy to navigate, the user experience is quite difficult and the flow of the process can become tedious especially if needs to be done multiple times- Creating of test cases is difficult when it comes to copying and pasting of multiple test steps

Used to work with Jira.... now you constantly can't login!

Comments: I have been a longtime Jira Capture user and at some point Zephyr replaced it. For a longtime it worked seamlessly... then all of a sudden we would get a constant "Invalid Login" when trying to login with Atlassian credentials. After contacting support several times I was told we had to create an API key. After going thru the pain... it would work for a week... then right when you urgently needed to take a screenshot it forgot the credentials and you are forced to create a new API key ... which takes over 15 minutes each time. Worked. Forgot credentials. Create key. Over and over. You have to pay for each user and after awhile it just got so frustrating it was no longer worth it. I wish Jira capture still was around. That worked flawlessly for years!

Pros:

Integrated with Jira, allowed QA to easily capture screenshots

Cons:

Cant login, login errors, can't use standard Atlassian credentials and forces you to create API keys, constantly forgets credentials but doesnt tell you until after you have filled out a full bug report so you end up losing all your work

consider Zephyr enterprise for easy test management

Comments: it served as well when we were a small company (50-100) , it started to grow small on us when we got bigger and amount of executions got on a large scale with different configurations. overall it served its purpose and helped us managing our tests.

Pros:

the easy integration with Jira, its mostly simple to configure.

Cons:

missing better planning and the ability to dictate different configuration in which each test execution should be reported differently. its not fully customizable (the reporting mechanism as well)

Nice product but the worst support

Pros:

easy to create a test plan and traceability between Stories and Task. Easy to execute test cases and monitor daily test executions . Also, you can assign test cases to testers and Tracks bugs vs Test iterations

Cons:

it is supposed to be a Testing tool, but... every release ( 1 month approx) is a pain, Always you will find a problem and not able to use Zephyr for 3 / 4 days, Looks like a testing tool, does not have a tester to test it? They do not have a Sanity Check to make sure to run a Smoke test and see how is Production. So disappoint it with the Roll out releases and support. The functionality looks right but... they need to fight for the great quality.

Nice case management tool

Pros:

The ease of use and the look of the overall system.

Cons:

It is not super user friendly, but in its defense we only had it for a short time.

It is not much easy to use

Comments: Can maintain the test case with integrating with Jira

Pros:

Can create test cases directly and execute them separately. Able to link the defects which are in another tools.

Cons:

Not able to create multiple test runs from the same test plan and execute parallel because it Overriding the final result automatically.

Good functionality, but the it's not so reliable.

Pros:

I worked mostly with Jira Plugin and it's pretty easy, obvious software, although Zephyr Teams & Enterprise more powerful. Easy to monitor testing process, schedule testing and making adjustments.

Cons:

Even it's a testing tool and team should know everything about quality - they push releases not fully checked, so we tired to have problems one-days a release.

Slow, buggy when integrated with Jira

Comments: Our organization needs to run test on weekly basis and we lost lot of time redacting them on the interface that can reject the input for any hidden reason.
Navigating through collections of test was buggy and frustrating.

Pros:

- few steps to create and execute tests - few boilerplate jira objects (execution are on zephyr side, not on jira side) - the "blocked" status

Cons:

- Really slow to use, the integration with JIRA leads to data loss - Hard to link snapshot, zip and other precondition or result artifacts and access it on execution

Need More

Pros:

the features provided are great but not always usable

Cons:

need more on the UX overall, it is NOT an easy app to use

Zephyr for JIRA

Pros:

We use Zephyr inside JIRA to keep track of our manual testing. It works very well.

Cons:

Sometimes there are small display issues.

I am a Zephyr user

Pros:

1. Flexibility in updating information. 2. Cheapest add-in 3. Integration with JIRA defect management tool.

Cons:

1. Integration with other application. 2. Cycle execution. 3. Not much flexible in agile process.

Test Management & Execution Software

Comments: Creation and execution of test cases/test steps.

Pros:

It is integrated with JIRA which allows us to associate the test cases and execution with our sprints and user stories which are located in JIRA. It is very easy to associate a test cases to various sprints. The tool provides visualization of where the test case is in our process. The reporting of the test cases is great as well. It provides visualization of the # of passes and failures within a given sprint. It also provides the ability to import test cases/steps from an excel spreadsheet.

Cons:

It seems like a lot of the information we have to enter for each step within a test case is very repetitive. I have not found a way yet where you can clone the information from a previous step so we do not have to enter the same information over and over again.