powered by
ANDROID
HERBIDEX MOBILE
USER TESTING 3
RESULTS
Quantitative Results
User Testing 3 was conducted mainly to test the usability of Herbidex Mobile and also to detect any minor errors before our hard launch on the 20th of November. The tasks were designed to be vaguer than our previous test cases for the last 2 User Tests to ensure the most accurate results on the intuitiveness of the application.
Demographics
To obtain as much feedback as we could before our hard launch, the team was able to recruit 33 participants; 16 male participants and 17 female participants ranging from the age of 21 to 25 which is in line with our target group for Herbidex Mobile.
Section 1: Product View & Checkout
The high percentage of correctly completed tasks in Section 1 indicate that in general, participants are able to complete a transaction using Herbidex Mobile without the assistance of one of the team members. As a result, we can infer that the interface is sufficiently intuitive and can be easily used by future consumers.
Analysis of Results:
Sub-Categories
However there is a slight dip in the Sub-Categories task because not all products from the production server have been assigned sub-categories. The absence of products in the sub-categories filter lead participants to believe that the filter was not working properly; reflected in results where 21% of participants were unable to correctly
complete this task. The team has noted this and have communicated with our sponsors who have assured us that this issue will be resolved in due time.
100% 100%
79%
100% 100%
91% 97% 100% 100% 100% 100%
Edit Quantity
Although most participants were able to complete this task correctly, a few participants detected a critical bug where the application would crash when the quantity was changed. This has been noted by our lead developer and we will be solving this bug before our hard launch.
Delete Product
Upon deleting products from the cart, one participant was detected a minor bug where the counter for cart management was not detecting the correct quantity of products in the cart. This has also been noted by our lead developer and will be resolved before our hard launch.
Cart Check-Out Satisfaction
Figure 1: Rated on a scale from 1 – 7 (1 being ‘very difficult to use’, 7 being ‘very easy to use’)
When asked to rate the difficulty of the entire check-out process, participants responded positively with a total of 24 participants finding it easy to complete a
transaction. These results show the team has accomplished one of our main objectives which are to provide participants with a platform to easily purchase natural health products.
0 0 0
4 2
24
3
1 2 3 4 5 6 7
Check-Out Satisfaction
Number of Users
Section 2: Search
All of our participants were able to successfully complete all the tasks without any assistance from the team members. The high accuracy in task completion indicates that the search functionalities of Herbidex Mobile are intuitive and user friendly.
Search Ratings
Figure 2: Rated on a scale from 1 – 7 (1 being ‘not useful at all’ and 7 being ‘very useful’)
When asked to rate the usefulness of the make a recommendation feature of the application, participants also responded positively with a total of 24 participants finding it useful.
100% 100% 100% 100% 100% 100% 100%
0%
20%
40%
60%
80%
100%
0 0 0
4 2
24
3
1 2 3 4 5 6 7
Make a Recommendation - Usefulness
Number of Users
Figure 3: Rated on a scale from 1 – 7 (1 being ‘very unwilling’ and 7 being ‘very willing’)
When asked to rate how willing they were to use the make a recommendation feature of the application, participants were generally willing, but the results were spread out.
The average participant rating was 5.1 which indicate that they are willing to make a recommendation for products.
Figure 4: Rated on a scale from 1 – 7 (1 being ‘not useful at all’ and 7 being ‘very useful’)
When asked to rate the usefulness of the ‘Get a Trial Product’ function, participants responded well with an average participant rating of 5.4, indicating that the function is useful.
1
0
3
8
7
8
6
1 2 3 4 5 6 7
Make a Recommendation - Willingness
Number of Users
0
2
0
4
9
12
6
1 2 3 4 5 6 7
Get a Trial Product - Usefulness
Number of Users
Figure 5: Figure 6: Rated on a scale from 1 – 7 (1 being ‘very unwilling’ and 7 being ‘very willing’)
When asked to rate how willing they were to use the ‘Get a Trial Product’ feature of the application, participants were generally willing with an average of 5.8. This implies that incentivizing consumers will add to their overall willingness to participate in crowd- sourcing activities.
Section 3: Account / Dynamic Pricing
The task results from section 3 indicate that participants have no difficulty in performing creating an account, logging out or viewing products with dynamic pricing.
1 0 1 2 3
17
9
1 2 3 4 5 6 7
Get a Trial Product - Willingness
Number of Users
100% 100% 100%
0%
20%
40%
60%
80%
100%
Create Account Logout Dynamic Pricing
Figure 7: Figure 8: Rated on a scale from 1 – 7 (1 being ‘very difficult’ and 7 being ‘very easy’)
Participants responded positively and found it easy to create an account with Herbidex Mobile with an average rating of 6.2.
Figure 9: Rated on a scale from 1 – 7 (1 being ‘very unwilling’ and 7 being ‘very willing’)
Participants also responded positively and are willing to purchase a product that has trial pricing with a willingness rating of 6.2.
0 0 0 1
4
17
11
1 2 3 4 5 6 7
Create Account
Number of Users
0 0 0 0
5
15
13
1 2 3 4 5 6 7
Willingness
Number of Users
Section 4: Aesthetics
Figure 10: Figure 11: Rated on a scale from 1 – 7 (1 being ‘very bad’ and 7 being ‘very good’)
Our participants found Herbidex Mobile aesthetically pleasing with an average score of 6.2.
0 0 0 0
3
20
10
1 2 3 4 5 6 7
Aesthetics
Number of Users
Qualitative Results
Rating Description1 Cosmetic problem only: need not be fixed unless extra time is available on project
2 Minor Usability Problem: fixing this should be given low priority
3 Major Usability Problem: imperative to fix this product for next release
Section 1: Product View & Checkout Use of Icons for Buttons
Positive Feedback
To me it was the icons used are the universal standard of other websites I been to.
The buttons are mostly intuitive and represent the action tagged to it.
Functionalities are well represented by the buttons.
Overall, the participants found that our buttons and icons used were intuitive enough to allow them to seamlessly navigate through the application and perform the necessary tasks.
Suggested Improvements Rating
The pencil for the editing of the number of item was not really intuitive, I
think it would be better if it was like a ‘+’ button or some sort 1 Don’t understand the sub-categories - button is not clear 1 Felt that the subcategories icon was not very intuitive and I was a little
confused initially. 1
However, there was feedback for two main points of improvement:
1. The edit icon could be changed to a more intuitive icon
2. Sub-categories are unclear; with some participants even questioning the need for it
The team has noted these improvements and will discuss with our sponsors on the changes that need to be made.
Transaction Process Positive Feedback
I can see all the information that I need.
There is an option to allow users to filter based on prices and allowing users to add their favorite items allow greater convenience.
Intuitive shopping cart.
Navigation around the entire UI is quite intuitive.
Participants were overall pleased with the transaction process and found it intuitive and easy to use.
Suggested Improvements Rating
Add to favourites button was a bit confusing, I thought it was the big red
heart at the bottom (navigation bar). 1
If the application may be used by old people, maybe you want to make
the words a little bigger. 1
Issue with quantity. When delete an item from cart. The item number
returns to 1 (even though the quantity is 4). 3
There were only aesthetic improvements suggested to the team regarding certain functionalities such as the use of the favorite’s button and certain buttons being too small. These issues will be reviewed for iteration 13. However, there was one critical bug found during testing being:
1. Edit Quantity: After removing a unique item from a cart with more than one unique item, the counter in cart management was incorrect. Our lead developer has taken note of this and will be working to resolve this issue.
Section 2: Search Positive Feedback
Allowing me to scan the barcode/QR code of existing items that I might see in the supermarket and make it easier to recommend products for this app.
Get a trial product, particularly useful for customer who wants to try new product.
Option to scan product using QR code. Very easy and convenient to use. Especially useful for users who are loyal customers who feels comfortable to shop from Herbidex.
The feedback for section 2 indicates that participants found the search functions of our application user friendly and intuitive, in particular the barcode and QR Scanning. This affirms the team’s objective to make it convenient for customers to scan products wherever they go.
Suggested Improvements Rating
Search is not cleared when navigating to other pages. 1 Not very clear if Herbidex can provide a trial product for any item I scan
and how they would deliver it to me. 1
There were two main aesthetic issues with section 2:
1. The text search was not cleared out when navigating to other pages. The team has decided that we will not be changing the current interface for this as the majority of participants did not have any issues with it.
2. Trial Product Description: Certain participants found that the trial product
description was vague and wanted more information on how they could receive it. The team will discuss with our sponsors to determine if this change is necessary for iteration 13.
Section 3: Account Positive Feedback
Seamless creation of account
Account creation is quite easy and fast
The user is automatically logged in upon creation of the account
Participants were able to sign up for an account and logout with ease; in particular they liked that there were few fields to fill in to register for an account.
Suggested Improvements Rating
Log-out button to be located in the profile page 1
I think the password need more validations for security purposes 1 There were 2 main issues for section 3:
1. Some participants had difficulty finding where the logout button was and suggested to add it to the profile page. This has been noted by the team and will be discussed for rectification in iteration 13.
2. Password Validation: Although the team has already added an unmasker for the password, some participants feel that for security reasons, there should min number of characters for validation. The team will decide if this should be rectified in iteration 13.
Conclusion:
Overall the team believes that we have reached the objective for User Testing 3, which is to have an intuitive and user friendly product for the hard launch. The Team has noted the crucial improvements needed to be made to the application and will be working to resolve them in subsequent iterations. Our sponsors are confident that the after resolving the bugs, Herbidex Mobile is ready for the hard launch on 20th November.
