Namespaces

Variants
Actions

Please note that as of October 24, 2014, the Nokia Developer Wiki will no longer be accepting user contributions, including new entries, edits and comments, as we begin transitioning to our new home, in the Windows Phone Development Wiki. We plan to move over the majority of the existing entries over the next few weeks. Thanks for all your past and future contributions.

(Difference between revisions)

Usability Testing

From Wiki
Jump to: navigation, search
mayankkedia (Talk | contribs)
hamishwillee (Talk | contribs)
m (Hamishwillee - Bot fixing redirect link.)
 
(9 intermediate revisions by 4 users not shown)
Line 1: Line 1:
 
[[Category:Development Process]][[Category:Usability]][[Category:Testing]]
 
[[Category:Development Process]][[Category:Usability]][[Category:Testing]]
 +
{{ArticleMetaData
 +
|sourcecode= <!-- Link to example source code e.g. [[Media:The Code Example ZIP.zip]] -->
 +
|installfile= <!-- Link to installation file (e.g. [[Media:The Installation File.sis]]) -->
 +
|devices= <!-- Devices tested against - e.g. ''devices=Nokia 6131 NFC, Nokia C7-00'') -->
 +
|sdk= <!-- SDK(s) built and tested against (e.g. [http://linktosdkdownload/ Nokia Qt SDK 1.1]) -->
 +
|platform= <!-- Compatible platforms - e.g. Symbian^1 and later, Qt 4.6 and later -->
 +
|devicecompatability= <!-- Compatible devices e.g.: All* (must have internal GPS) -->
 +
|dependencies= <!-- Any other/external dependencies e.g.: Google Maps Api v1.0 -->
 +
|signing=<!-- Signing requirements - empty or one of: Self-Signed, DevCert, Manufacturer -->
 +
|capabilities=<!-- Capabilities required by the article/code example (e.g. Location, NetworkServices. -->
 +
|keywords= <!-- APIs, classes and methods (e.g. QSystemScreenSaver, QList, CBase -->
 +
|id= <!-- Article Id (Knowledge base articles only) -->
 +
|language=<!-- Language category code for non-English topics - e.g. Lang-Chinese -->
 +
|review-by=[[User:SannaH]]
 +
|review-timestamp=20111121
 +
|update-by=<!-- After significant update: [[User:username]]-->
 +
|update-timestamp=<!-- After significant update: YYYYMMDD -->
 +
|creationdate=20071122
 +
|author=[[User:SannaH]]
 +
}}
  
 
==Usability testing myths and facts==
 
==Usability testing myths and facts==
Including usability and usability testing in the development process is often considered expensive by the account managers. As they believe that instead of spending time and money on usability designing, the team should concentrate on the features and other aspects of the product. However over the years research and emperical data has proved beyound doubt that usability testing and designing for usability is indeed benificial to the company from a long term cost perspective.
+
 
 +
Including usability and usability testing in the development process is often considered expensive by the account managers. As they believe that instead of spending time and money on usability designing, the team should concentrate on the features and other aspects of the product. However over the years research and empirical data has proved beyond doubt that usability testing and designing for usability is indeed beneficial to the company from a long term cost perspective.
 +
 
 +
Usability testing is typically conducted in a usability lab environment.Target market users of your application are given a predefined set of tasks and are asked to perform them while being observed. The tests themselves are one-on-one sessions - not a multiple participant focus group.
 +
 
 +
== Preparation ==
 +
 
 +
Identify the tasks, which should derive from the use-cases prepared during the design process. The definition of task completion should be clear. Next plan a test schedule and choose a location. Select the representative users. Materials required for the testing process should be kept handy.
 +
 
 +
==When should you conduct a Usability Test?==
 +
 
 +
* Usability testing can be conducted at any time in the development cycle
 +
* Testing early in the cycle is most effective because it reduces development cost
 +
* Even when conducted late in the cycle, issues around terminology and content location can be easily fixed
  
 
==How many users to test with==
 
==How many users to test with==
  
Usability testing doesn’t have to be expensive, though. With only 3 to 5 users, you can find the majority of problems in your application, as has been advocated by usability guru Jacob Nielsen in his much respected and yet equally criticised article [http://www.useit.com/alertbox/20000319.html Why You Only Need to Test With 5 Users]. Jacob asserts that 3 rounds of usability testing with 5 users is going to diagnose more then 85% of the usability problems. However there are other critics who point that 5 might be too small a size to look at for usability testing with the aim of covering more number of problems. They believe that depending upon the complexity of the solution the size of the usability testing group should vary. Laurie Faulkner for instance claims that 15 is a good number for the group size to look at, discussed in great details [http://www.geocities.com/faulknerusability/Faulkner_BRMIC_Vol35.pdf here in the article]
+
Usability testing doesn’t have to be expensive, though. With only 3 to 5 users, you can find the majority of problems in your application, as has been advocated by usability guru Jacob Nielsen in his much respected and yet equally criticized article [http://www.useit.com/alertbox/20000319.html Why You Only Need to Test With 5 Users]. Jacob asserts that 3 rounds of usability testing with 5 users is going to diagnose more then 85% of the usability problems. However there are other critics who point that 5 might be too small a size to look at for usability testing with the aim of covering more number of problems. They believe that depending upon the complexity of the solution the size of the usability testing group should vary. Laurie Faulkner for instance claims that 15 is a good number for the group size to look at, discussed in great details [http://www.simplifyinginterfaces.com/wp-content/uploads/2008/07/faulkner_brmic_vol35.pdf here in the article]
  
 
==Cost impact of usability==
 
==Cost impact of usability==
  
Another important to consider while deciding the size of the usability testing group is the cost aspect of it. Research has shown that adding more users to the group adds to the cost of the usability testing exponentially. So it is imperative you make sure that the group is not too big or too small for carrying the tests. The complexity and criticality of the product can also help decide the size of the usability testing group. For instance if the product in question is less tolerant to even minor usability testing you would need a bigger group as compared to one which is more feature focussed than usability oriented.
+
Another important to consider while deciding the size of the usability testing group is the cost aspect of it. Research has shown that adding more users to the group adds to the cost of the usability testing exponentially. So it is imperative you make sure that the group is not too big or too small for carrying the tests. The complexity and criticality of the product can also help decide the size of the usability testing group. For instance if the product in question is less tolerant to even minor usability testing you would need a bigger group as compared to one which is more feature focused than usability oriented.
  
 
==Implementation==
 
==Implementation==
Line 20: Line 53:
 
What do you gain from usability tests, then? You can see if there are features that the users can’t find. You will find out if they can understand the terminology used, or if it takes too much time to find the right keys or features? Most importantly you will find out if the users can actually complete the tasks they are asked to do and if they are satisfied with the experience of using the application. Usability testing improves your application’s quality!
 
What do you gain from usability tests, then? You can see if there are features that the users can’t find. You will find out if they can understand the terminology used, or if it takes too much time to find the right keys or features? Most importantly you will find out if the users can actually complete the tasks they are asked to do and if they are satisfied with the experience of using the application. Usability testing improves your application’s quality!
  
==Additonal resources==
+
==Additional resources==
  
There is an article about [http://www.forum.nokia.com/main/html_readers/group_testing_the_best_of_both_worlds.html group testing] available at the [http://forum.nokia.com/usability Forum Nokia Usability pages]!
+
There is an article about [http://www.developer.nokia.com/Design/Design_process/Getting_started/Testing_usability_and_evaluation.xhtml usability testing] available at the [http://www.developer.nokia.com/Design/User_experience/ Nokia Developer Usability pages]!
  
 
[http://www.davidleeking.com/2004/12/27/usability-testing-with-5-users-challenged/ 5 user theory challenged]
 
[http://www.davidleeking.com/2004/12/27/usability-testing-with-5-users-challenged/ 5 user theory challenged]

Latest revision as of 06:38, 22 November 2011

Article Metadata
Article
Created: SannaH (22 Nov 2007)
Reviewed: SannaH (21 Nov 2011)
Last edited: hamishwillee (22 Nov 2011)

Contents

[edit] Usability testing myths and facts

Including usability and usability testing in the development process is often considered expensive by the account managers. As they believe that instead of spending time and money on usability designing, the team should concentrate on the features and other aspects of the product. However over the years research and empirical data has proved beyond doubt that usability testing and designing for usability is indeed beneficial to the company from a long term cost perspective.

Usability testing is typically conducted in a usability lab environment.Target market users of your application are given a predefined set of tasks and are asked to perform them while being observed. The tests themselves are one-on-one sessions - not a multiple participant focus group.

[edit] Preparation

Identify the tasks, which should derive from the use-cases prepared during the design process. The definition of task completion should be clear. Next plan a test schedule and choose a location. Select the representative users. Materials required for the testing process should be kept handy.

[edit] When should you conduct a Usability Test?

  • Usability testing can be conducted at any time in the development cycle
  • Testing early in the cycle is most effective because it reduces development cost
  • Even when conducted late in the cycle, issues around terminology and content location can be easily fixed

[edit] How many users to test with

Usability testing doesn’t have to be expensive, though. With only 3 to 5 users, you can find the majority of problems in your application, as has been advocated by usability guru Jacob Nielsen in his much respected and yet equally criticized article Why You Only Need to Test With 5 Users. Jacob asserts that 3 rounds of usability testing with 5 users is going to diagnose more then 85% of the usability problems. However there are other critics who point that 5 might be too small a size to look at for usability testing with the aim of covering more number of problems. They believe that depending upon the complexity of the solution the size of the usability testing group should vary. Laurie Faulkner for instance claims that 15 is a good number for the group size to look at, discussed in great details here in the article

[edit] Cost impact of usability

Another important to consider while deciding the size of the usability testing group is the cost aspect of it. Research has shown that adding more users to the group adds to the cost of the usability testing exponentially. So it is imperative you make sure that the group is not too big or too small for carrying the tests. The complexity and criticality of the product can also help decide the size of the usability testing group. For instance if the product in question is less tolerant to even minor usability testing you would need a bigger group as compared to one which is more feature focused than usability oriented.

[edit] Implementation

It is very important to do a thorough pilot test to make sure your task descriptions are understandable to others who are going to help you in the usability testing. You should lay down the specific areas if any that you are interested in being tested and a set of guidelines which could be used as a ready reckoners by the end users. Make sure that you include test users from every user group to your actual tests. That way you will get a wider perspective for your results as a similar group would give you a narrow if not one-sided feedback on the product. The test criteria and time taken to complete the tests may/should vary between different user groups. For example, novice users may be given a longer time to complete some tasks than expert users.

[edit] Outcomes

What do you gain from usability tests, then? You can see if there are features that the users can’t find. You will find out if they can understand the terminology used, or if it takes too much time to find the right keys or features? Most importantly you will find out if the users can actually complete the tasks they are asked to do and if they are satisfied with the experience of using the application. Usability testing improves your application’s quality!

[edit] Additional resources

There is an article about usability testing available at the Nokia Developer Usability pages!

5 user theory challenged

Demystifying usability

--- Edited by Mayank on 22/06/2009 ---

This page was last modified on 22 November 2011, at 06:38.
123 page views in the last 30 days.

Was this page helpful?

Your feedback about this content is important. Let us know what you think.

 

Thank you!

We appreciate your feedback.

×