UAT Procedure (clients report feedback via JIRA) – Draft

Stakeholder

Name

Status

Date of Sign Off

Client Representative

BE Lead

FE Lead

Project Manager

QA Lead (Author)

1. Purpose

The purpose of the document is to provide all needed information before the User Acceptance Testing (UAT) phase that includes readiness of build, test ware and instructions on how to work during the UAT phase.

2. Environment list

Environment

Link to WP admin

Link to the site

Comment

Development

  • Regression testing environment

  • UAT environment

Staging

  • Content and functionality configuration 

Production

3. Browsers/Devices

Browser/device

Component testing (full scope)

Smoke/Sanity testing

Regression testing

 

detailed testing per component using the whole testing scope based on created test cases
use only high priority tests while testing and use exploratory testing (experience based technique)
use regression test scenarios to confirm correct behavior for the previously delivered critical functionality when the new build is deployed

Win10 + Chrome (the latest)

* primary device for Desktop scope

(синяя звезда)

(синяя звезда)

(синяя звезда)

Win10 + Edge (the latest)

(синяя звезда)

(синяя звезда)

(синяя звезда)

Win10 + Firefox (the latest)

(синяя звезда)

(синяя звезда)

(синяя звезда)

MacOS + Safari (the latest)

* primary device for Desktop scope

(синяя звезда)

(синяя звезда)

(синяя звезда)

iPhone 14 Pro Max (the latest iOS + Safari)

* primary device for Mobile scope

(синяя звезда)

(синяя звезда)

(синяя звезда)

iPhone 13 Pro (the latest iOS + Safari)

(синяя звезда)

(синяя звезда)

(синяя звезда)

Samsung Galaxy S22 Ultra (the latest Android + Chrome)

* primary device for Mobile scope

(синяя звезда)

(синяя звезда)

(синяя звезда)

Samsung Galaxy S21 Plus (the latest Android + Chrome)

(синяя звезда)

(синяя звезда)

(синяя звезда)

4. Requirements references

Type

Link

Comment

Backlog

 

 

Requirements

 

 

Design

 

 

5. Testing documentation

Document

Link

Test cases

Test data

6. Known Defects

This section describes all defects which were found during the QA phase.
(синяя звезда) IMPORTANT: Please use this information to avoid duplicates while creating defects within the UAT phase.

<link to Existing Defects in Jira> – here you can find all open /in progress /resolved defects during the QA phase of the project.

<UAT Defects Board> – here you can find all issues found by the client team during UAT.

7. Types of tickets will be used

  • Bug – an issue that shows a difference between the site and designs. Sometimes it can be irregular behavior.

  • Task as a Change Request (appropriate "CR" label should be added to the ticket) – an issue that comes from Bug or recommendation. Need discussion with the client and approval as well (see <link to Change Request Log>). Type of issue to implement or update already implemented functionality or to develop the new one.

8. Process Flow

This section describes recommendations to organize the UAT phase that can help to avoid misunderstanding and improve efficiency in communication and problem solving.

8.1 UAT Timeframe

The UAT will last from dd/mm/yyyy till dd/mm/yyyy. During this time all the reported bugs and issues will be investigated by the Development team and qualified as Bugs or Change Requests. The bugs will be fixed in the order of their priorities. If the team will not have time to fix all bugs by the end of the UAT phase, the lower priority bugs will be transferred to the post-launch warranty phase.

8.2 UAT Entry Criteria

  1. UAT environment is up and running.

  2. Resources are sufficient and available to support UAT.

  3. Roles and responsibilities are identified.

  4. The UAT procedure is defined, the communication flow is agreed.

  5. UAT Procedure page is available (link to be provided via e-mail).

  6. Reporting-related specifics are agreed.

  7. UAT exit criteria are revised/defined.

  8. The component testing for the planned devices and browsers has been completed.

  9. The regression testing for the planned devices and browsers has been completed.

10. All bugs with priority blocker and critical have been fixed and closed.

8.3 UAT Exit Criteria

  1. All planned UAT test cases have been executed and passed.

  2. All bugs with priority blocker and critical have been resolved and re-tested.

  3. Any remaining priority bugs have been placed in the development schedule.

  4. Any CR’s/overlooked requirements have been negotiated and a plan is in place for addressing them.

  5. Successful executive go/no-go decision for launch.

  6. Planned reporting and analysis have been done.

UAT should start only when:

  • Project Development phase with all planned Development activities is finished for all Site Components.

  • UAT Entry Criteria are met.

otherwise timeline need to be revised.

(информация) Note: To get enough time for the bug-fix during the UAT phase it is strongly recommended to report found Defects for the site Components/Features right after it was found/discovered, to not get lots of JIRA defects reported during the last UAT days. If the development team will get all found defects reported in JIRA only during the last UAT days, there will be no possibility to fix them and retest till the Release Date.

8.4 Communications during UAT

UAT Sync-up meetings will be scheduled according to the UAT Timeframe.
All defects/issues should be reported to the JIRA.

Click Create Issue, do so through the <link to the project in JIRA> and follow the instruction below:

Filed

What to fill

Project

<Project Name>

Issue type

Bug

Summary

A brief one-line summary of the issue.
Summary field name should be filled according template:
[Area name] <Problem short and concrete description>

Component

<Component’s name> select from the dropdown. For each project, the list of components is specific.

Description

Description field should be filled as in following template:

Preconditions:

REPLACE the TEXT with needed configuration, if applicable.

Steps to reproduce:

  1. Step_1.

  2. Step_2.

  3. Step_3.

Actual result:

Clear description of what actually happened.

See attached screenshot for more details.

<Screenshot>

Expected result:

Clear description of what should have been happened.

See attached design for more details.

<Screenshot> / <link to the design>

Additional information:

REPLACE the TEXT with Additional information, if applicable.

Priority

The degree of importance for the business to resolve the defect. It is driven
by business value and indicates how soon the defect should be fixed.

Labels

UAT (required)

Environment

one of the (DEV, STG, PROD)

Attachment

If you can supplement your bug report with a picture that shows the
problem, or a score that helps others reproduce, fix and verify the problem
quickly, attach these files to the bug report. The attached files can be as
follows: pictures, video-recording, other files types, if needed.

Linked Issues

<link to the related issue>

Assignee

The person whom the bug is assigned to (QA Lead)

Epic Link

Contains a link to Epic in accordance with overall structure of epics on the
project. Choose from the drop down.

Sprint

Active sprint. Choose from the drop down.

QA Scope

<testing scope>

(информация) NOTE THAT

  • Point Preconditions is optional and filled when the additional configuration is required to reproduce the bug. (Ex. Product with a specific variation (or allocation) is configured. Specific promotion is configured);

  • Point Additional information is optional and filled only in case of some additional info is required to reproduce the bug OR in case of any additional places where the issue can be reproduced.

(синяя звезда) IMPORTANT: Defects that do not follow the template can be re-assigned back to their reporter in case of an unclear description. We encourage the UAT team to support any Bug report with a screenshot/attachment for better understanding.

9. Ticket Flow

Development team will work with UAT issues according to the priority of the issue (from highest to lowest), so please pay attention to the Defects priority section below when selecting issues priority.

After some investigation and testing ticket can be:
1. assigned to the Developer for fixing (it means that the ticket is clear enough, so the dev team can work on it).
     2. assigned back to the reporter:
          a) Resolve ticket with specific status using comments (it can be: Done, Cannot reproduce, Won’t Do, Duplicate, etc). In this case the reporter can:

Close (move the ticket to Done status) if it is clear per comment;

Reopen (move the ticket to Open status) if the ticket is still valid.

3. after fixing the defect, Developer will assign the defect to QA for verification. There are two possible ways:
          a) QA will approve that fix is acceptable and assign the defect to the reporter for final verification (see actions described in #2);
          b) QA will reject the fix and will change the issue status to Reopened and assign it back to Developer.
     4. all fixes will be verified on the UAT environment by QA and assigned to the Reporter from the Client side with Ready for Testing status.

10. Defects priority

Priority shows the degree of importance for the business to resolve the issue. In other words, the priority is driven by business value and indicates how soon the Issue should be fixed.

Priority
Level

Description

Highest
(Blocker)

Indicates that Defect needs to be fixed immediately. It evidences that core functionality fails or test execution is completely blocked and/or (some part of) project is blocked.

Examples:

  • Inability to add product to cart

  • Inability to proceed to Checkout

  • Inability to complete payment

  • Mini cart disappears, cart page can’t be opened

  • Inability to log in with valid credentials

High
(Critical)

Indicates that this issue has a significant impact and Defect needs to be fixed soon, but as early as possible. It shows that important functionality fails but we don’t need to test it right now and we have a workaround.

Examples:

  • Accordions can’t be expanded

  • Wrong validation behavior for input fields

  • Inability to add new address within MA

  • There is no validation for e-mail field on Login page

  • Error is occurred when try to add product to Cart from Wishlist

Medium
(Major)

Indicates that this Issue is causing a problem and requires urgent attention.

Examples:

  • Wrong displaying for alternative images carousel

  • Navigation arrows don’t work on Mobile

  • There is no fields validation when it’s required

Low
(Minor)

Indicates that this issue has a relatively minor impact that not breaking the business logic, user interface problem.

Examples:

  • Incorrect font size/type is used for content

Lowest
(Trivial)

Indicates that fixing of this Defect can be deferred until all other priority Issues are fixed.

Examples:

  • Minor look and feel issues

  • Minor glitches

  • Not so obvious spell mistakes

  • Any other minor issue causing an inconvenience

Comments

Leave a Reply