Zephyr Vortex

Owned by Kevin Pham (Deactivated)
Mar 21, 2019
9 min read

Overview

What is Vortex?

  • The value of Vortex is to Organize the Automated Test cases in Zephyr platform and see results
  • When the Vortex job is run, it posts the test cases into Zephyr, schedules and executes the test cases according to the automation report

Benefits to user

  • Integration with test automation tools/frameworks- Selenium, UFT and Tricentis
  • Users can get the complete picture of automated and non-automated test cases in Zephyr application
  • Increase ROI by reducing time to setup and maintain integration
  • Provides easy to use workflow and intuitive UI to setup integration with Automation Frameworks 

Vortex Configuration

  1. Install Zephyr
  2. Go to the zephyr Installation Directory eg: C:\Program Files\Zephyr\license
  3. Copy the  zautomation.lic license file in license folder
  4. Restart the Zephyr service

How to Validate Vortex is Installed Properly

  1. Launch Zephyr.
  2. Login as Manager →  Select any project 
  3. Click on Vortex →  It should be visible and should show in Green color
  4. Add Job and Execute Job

In Vortex we have Automation and Folder watcher. In both the widgets, Zephyr supports the following frameworks (JUnit xml format). 

  1. Cucumber
  2. JUnit
  3. Selenium
  4. TestNG
  5. Tricentis Tosca
  6. UFT
  7. eggPlant

Automation: 

 Automation is mainly to post a bunch of automation report into ZE UI. When Automation job is executed it posts the test cases into ZE, schedules and executes the test cases according to automation report. If there are any failed test cases, in the Test execution section, it will add logs and attachment.

Folder Watcher:

Folder Watcher also does the same job as Automation does, but the difference is that an Automation user has to execute the job, whereas in Folder watcher, user will configure the job's result folder with a sleep over time (eg: 2 minutes). So for every 2 minutes, this Folder watcher will watch the result folder and if any report file will generate, it will take that generated automated file and post the results to Zephyr.

How to Add and Execute Automation Job

Prior to using Vortex

General Vortex perquisites

  1. Install Zephyr.
  2. Install Zbot and configure with any user having all the permission of Test Repository, Test Planning and Test execution (manager, lead, or any custom user).
  3. Login as (manager, lead, or a custom user that has access to Vortex).
  1. Click on Vortex.
  2. Select Automation.
  3. Click on '+' button to add job.
  4. Fill in the mandatory fields that are highlighted red and then save the job.
  5. Click on the 'E' button to execution the automation job.
  6. Once the job is scheduled, it will give 3 notifications on the status of the job (New, In-progress, Complete).
  7. Once the job is completed based on the Automation report file, it will create test cases in Test Repository, create the cycle with the given name in Test Planning with the given start and end dates, and finally in Test execution it will post the results, and for failed test cases it will add any attachments and logs.

1. Click on Vortex.

2. Select Automation.

3. Click on the '+' button to add a job.

4. Fill in the mandatory fields that are highlighted red and then save the job.



5. Click on the 'E' button to execute the automation job.

6. Once the job is scheduled, it will give 3 notifications on the status of the job (New, In-progress, Complete).

  • Click on the 'Apply' button to apply the notifications.

  • The status of the job should now be set to 'Complete'.

7. Once the job is completed based on the Automation report file:

  • It will create test cases in Test Repository
  • It will create the cycle with the given name in Test Planning with the given start and end dates
  • In Test execution, it will post the results and for failed test cases it will add any attachments and logs.



Vortex Automation Job Notes

  • Since cucumber supports BDD framework, in ZE, it will create test cases with test steps. For the remaining frameworks, only test cases will be present and not the test cases with test steps.
  • In eggPlant, Zephyr will give the result path as a csv file instead of xml file. (eg : D:\egg plant\Files\EggPlant\test.suite\Results\SuiteStatistics.csv )
  • For every failed test case, it will attach screenshots or logs in the Test Execution.
  • For cucumber, if any of the steps fail, the next steps will not be executed and the test case status will be set as fail.
  • To run the Automation and Folder Watch, users should install Zbot and follow the instructions mentioned in page:
  • User can create their automated scripts through any framework, and they can execute their scripts by eclipse, bat file, sh file, Jenkins, Maven, etc. 
    • This depends from one user to another in user configuration.
    • After executing their script, they must have generated reports in any format like JSON, XML, PDF, etc.
    • Zephyr is only supporting JUnit XML now, and Zephyr are supporting only the above mentioned frameworks. The output report xml file consists of how many test cases are present, and how many passes and how many fail, and if it failed, it consists of the error.
  • Result path should as given:
    • 'C:\Users\jagadeesh\Desktop\cucumber1.xml'

Sample automated xml report files for all the frameworks is available at : \\192.168.100.203\SHARE\QA\Vortex\Files

Reuse Existing Cycles and Phases

Reuse ScenariosReuse Actions and Impact
Currently using an existing test cycle and phaseA new test cycle and phase aren't created and instead reuse the same testing cycle and phase that was already created from the previous job in the Test Planning and Test Execution pages.
Currently using an existing test cycle and phase but you need to update the cycle start and end datesA new test cycle and phase aren't created and instead will update/append the changes to the cycle's start and end dates for the test cycle and phase that already exists in the Test Planning and Test Execution pages.
Currently using an existing test cycle and phase but you need to update the person that they are assigned toA new test cycle and phase aren't created and instead will update/append the changes to the assignee for the specific testing cycle and phase that already exists in the Test Planning and Test Execution pages.
Creating a new test phase but using an existing test cycleWhen editing the phase name, the new test phase name will be created under the existing test cycle in the Test Planning, and Test Execution pages.
Using an existing test phase but creating a new test cycleWhen editing the cycle name, a new test cycle name will be created under the Test Planning and Test Execution pages but there won't be a new phase created in the Test Repository.
Creating a new test phase and new test cycleWhen editing both the cycle and phase name, a new test cycle name will be created in the Test Planning and Test Execution but there will not be a new test phase created in the Test Repository.

Using the previous example, we can reuse the existing cycle and phase that we created above.

1. Edit the existing job by selecting the job from the automation table in vortex.

2. Ensure that the 'Reuse cycle and folder" checkbox is checked and then click on 'Add'.

 3. Click on the 'E' to execute the automation job again.

4. Click on the 'Apply' button to apply the notifications.

5. The status should be set to complete after applying the notifications.

The new test folder will not be created in the test repository, it will remain the same as the previous job.

The new test cycle/phase will not be created in the Test Planning and Test Execution page, both will remain the same.

The execution history when reusing the same vortex job may display execution changes made by vortex.

How to Add and Execute Folder Watcher Job

Prior to using Vortex

General Vortex perquisites

  1. Install Zephyr.
  2. Install Zbot and configure with any user having all the permission of Test Repository, Test Planning and Test execution (manager, lead, or any custom user).
  3. Login as (manager, lead, or a custom user that has access to Vortex).
  1. Click on Vortex.
  2. Select Folder Watcher.
  3. Click on the '+' button to add a job.
  4. Fill in the mandatory fields that are highlighted red and then save the job.
  5. Trigger the script through Jenkins, Maven, sh file, bat file, eclipse, etc. Once the execution of script is completed, it will create the report file in the folder path and it will give notifications in folder watcher.
  6. After applying notifications, the job will be completed. Based on the Automation report file, it will create test cases in the Test Repository, create the cycle with the given name in Test Planning with the given start and end dates. In Test execution, it will post the results, and for failed test cases it will add any attachments and logs.

1. Click on Vortex

2. Select Folder Watcher.

3. Click on the '+' button to add a job.

4. Fill in the mandatory fields that are highlighted red and then save the job.


After saving and adding the job, the job will be created with the status set as 'new'.


After adding a job, it will keep on watching the folder path every 2 minutes.

  • It is based on sleep over time, since we have given 2 minutes, it will keep on watching the folder for every 2 mins.


5. Trigger the script through Jenkins, Maven, sh file, bat file, eclipse, etc. Once the execution of script is completed, it will create the report file in the folder path and it will give notifications in folder watcher.

So now, the user will go and trigger this script through Jenkins or through the bat file, sh file, maven file, etc.

  • This will create the output file in the folder path. So this folder watcher will take that file and post the results to Zephyr and the UI will remain the same as the Automation.


The status will be completed when Job Information changes to 'complete'.

7. After applying notifications, the job will be completed. Based on the Automation report file, it will create the following:

  • Test cases in the Test Repository
  • The cycle with the given name in Test Planning with the given start and end dates.
  • In Test execution, it will post the results, and for any failed test cases, it will add any attachments and logs.

We can then view them in the respective locations and pages.








Back to Top ^