Request for Quote: Usability testing with disabled people

(1)

Page 1

Request for Quote:

Usability testing with disabled people

Created by: User Vision July 2015

Contact:

Chris Rourke, CEO [email protected]

Edward Chandler, Principal UX Consultant [email protected]

(2)

1. Research brief

1.1. Background

Our client has requested User Vision to engage the services of an organisation representing people with a disability, preferably based in the United States of America to conduct usability testing of their website with disabled people and specifically blind and visually impaired people.

The focus of the research will be to test an internet booking engine and associated account and booking management on our clients website.

We are currently working with our client to make their website accessible to people with disabilities. We are measuring the site against WCAG 2.0 Level AA. Having conducted audits on the site, we are now integrated within their business and development teams to deliver a more accessible site.

1.2. Purpose

The objective is to testtheusabilityofour client’s accessible site and to sign off compliance against web accessibility guidelines.

The research is to be able to comply with appropriate American legislation and the selected organisation must be knowledgeable on US Disability related legislation. 1.3. Roles and responsibilities

User Vision's role is to facilitate the successful delivery of the usability testing. This will include liaison between you and our client, overall management of the project, setting of deliverables and signing off all project work.

User Vision is seeking the services of an organisation representing people with a disability, preferably based in the United States of America who has the capacity, experience and knowledge to successfully conduct this research. This will include the following responsibilities:

 Recruitment of appropriate end users and payment of an incentive

 Provision of a test room with adjoining observation room

 Preparation of the test plan in discussion with User Vision and our client

 Provision of appropriate computer equipment along with all relevant assistive technologies for the end users to use

 Conducting the usability testing

 Recording of the sessions with picture in picture of the participant

 Analysis of the test sessions and report write up with recommendations

(3)

report.

1.3.1 Recruitment

The chosen organisation will be responsible for all aspects of the recruitment of participants for the usability testing in accordance with the recruitment criteria Once recruitment has started, User Vision will expect an update twice a week with participant numbers recruited and participant profiles.

User Vision and our client is happy to be guided in terms of participant numbers, however we expect additional participants to be recruited in case of no shows. All participants should be familiar computer users, who use assistive technologies and the web.

Our client requires a robust methodology with a variety of different type of users.

 Participants for each of the following screenreaders:

o JAWS (on windows)

o NVDA (on windows)

o Any other screenreader felt important to test with

 Participants for each of the following magnification solutions:

o Zoomtext (on windows)

o Any other magnification software felt important to test with

 60% Males / 40% Females

 30% Intermediate / 70% Expert AT users

 30% regular / 70% Prolific web users

 Even splits across age ranges: 18-75

 All must have travelled by air (preferably internationally)

Each participant will receive an incentive of $100 for their time. The chosen organisation will be expected to handle all payments to the participant.

Neither User Vision nor our client will be liable for any tax implications connected with the participants as a result of the incentive.

1.3.2 Provision of test room with observation room

We require that the selected organisation provide an appropriate test room for conducting one on one usability testing that is accessible for disabled people. The test room must have an adjoining observation room preferably connected by a one-way mirror or connected via video link to a screen.

The observation room will need to accommodate between 3-5 people and include refreshments throughout the test days.

(4)

We will consider alternative cities however preference will be given to testing in one of the above US cities.

In addition to the onsite observation facility, provision for remote observation is highly desirable.

Please note that neither User Vision nor our client will be liable for any complaints by the participants related to the accessibility of the test venue.

1.3.3 Preparation of the test plan

The selected organisation will be responsible for creating the test plan, which is to be used during the usability testing with input from User Vision and our client. Appropriate quantitative and qualitative metrics will be provided by the selected organisation to meet the needs of the research.

The main objectives of the research will be defined in consultation with successful organisation.

User Vision and our client will need to sign off the test plan so it will need to be provided well in advance of the test days.

1.3.4 Provision of appropriate computer equipment

User Vision and our client expect the successful organisation to provide relevant computer equipment along with all assistive technologies for the participants to use. All software must be fully licenced versions and not trial versions.

1.3.5 Conducting the usability testing

We will expect the successful organisation to facilitate the test sessions with the participants.

The facilitator must have a proven track record of conducting usability testing with disabled people and a background in relevant fields such as User Experience, Human Factors and User Research.

(5)

informed consent.

We are happy to be guided on the number of test sessions per day. We anticipate that each test session will last for 60 minutes.

1.3.6 Recording of the sessions with picture in picture of the participant

We expect the test sessions to be recorded for evidence as well as providing clips in the report to highlight and support insight.

The recordings should be of the screen, any assistive technology running and include a picture in picture of the participant.

All the recordings will need to be handed over to User Vision and our client following completion of the testing.

1.3.7 Analysis of the test sessions and report write up with recommendations

Following the completion of the testing with disabled people, the successful organisation is expected to deliver a comprehensive report.

The report will detail the findings of the testing in addition to nature and methodology of the testing.

The report needs to be delivered in Word or PowerPoint and PDF format. The report must be delivered no later than two weeks following the end of the testing.

An optional presentation of the findings back to User Vision and our client should be included.

1.3.8 Accessibility statement summarising the accessibility of the site

Along with the delivery of the report, our client wishes to be provided with a signed statement from the organisation confirming the accessibility of the website and that usability testing with disabled people has been performed. This should be provided on headed letterhead.

1.4. Quote submission

Submissions are to be made to Edward Chandler ([email protected]) in either Word or PowerPoint format as well as a version in pdf format.

The quote needs to be received by close of business (6pm BST) 31st of July 2015. Quotes should detail your approach to this research addressing all aspects

mentioned in this RFQ.

Profiles of the facilitator and any project team members should be included. Venue information should also be included in the submission

(6)

Budgets have yet to be agreed by our client, however as a UX Consultancy that is experienced in delivering this type of research, we will review costs for value for money and ability to meet the requirements of the RFQ.

Costs should be broken down into different project segments with any expenses (e.g. incentives, room hire etc) individually accounted for.

Submissions should be in US Dollars.

1.6. Testing timescales

The user testing must be conducted in October or early November 2015 with a hard deadline for the report being delivered by close of business (6pm GMT) 20th

November 2015.

1.7. Confidentiality and ownership

The successful organisation will be required to sign a non-disclosure agreement with ourselves and our client.

All material generated by the successful organisation for or as a result of the

usability testing including but not limited to; the test plan, any recordings, the report and any presented material will be proprietary property of our client and cannot be used for any other purpose other than conducting and reporting on the usability testing.