Create a Rich Internet Application

Les 6 Reporting

Informatica Communicatie Academie Hogeschool Arnhem Nijmegen

Contents of this lesson

Analysing data Reporting Assignment

Framework usability testing

Analysing data

Analysing quantitative data. Where are the problems Analysing qualitative data Where are the problems What causes these problems? Observations, questionnaires, . What is the dimension (size) and severity of the problems

Give suggestions for improvement

Analysing data
Example: Find Colleagues....

Analysing data
Example: Find Colleagues....

Analysing data
Scenario: Invite collegue Linked-In
User-01 Wrong clicking Questions asked Time needed to complete task
2 2 30

User-02
1 2 20

User-03
0 0 15

User-04
2 1 20

User-05
3 4 40

45
40

35 30 25 20
15 Wrong clicking

Questions asked
Time needed to complete task

10
5

0 User-01 User-02 User-03 User-04 User-05

Conclusion and recommendations

45 40 35 30 25 20 15 10 5 0 Userr-01 User-02 User-03 User-04 User-05 Wrong clicking Questions asked Time needed to complete task

Conclusion: 1. Four testers needed support 2. Four testers needed asking questions to complete the tasks (invite a colleague) 3. Testers were making mistakes (wrong clicking) when completing the tasks Recommendations: 1. Put this function on start page 2. Give online support in using this function

Analysing data
Task 1 1.1 1.2 1.3 1.4 Name Totally agree Agree Renting a Bike Bike are easy to select 3 Pimping the bike makes fun 2 Suggested Bike type conforms to my profile 0 Accesoires are easy to select 1 Do not know 2 5 1 4 3 3 6 5 Do not agree Totally disagree 2 0 1 0 0 0 2 0

Suggested Bike type conforms to my profile

Antwoord

Totally agree

Agree

Do not know

Do not agree

Totally disagree

Conclusion and recommendations

Relate conclusion to observations

Conclusion: 1. The suggested bike in relation to the profile does not fit. Recommendation: Improve usability profiling a user to match bikes better.
Task 1 1.1 1.2 1.3 1.4 Name Totally agree Agree Do not know Renting a Bike Bike are easy to select 3 2 Pimping the bike makes fun 2 5 Suggested Bike type conforms to my profile 0 1 Accesoires are easy to select 1 4 Do not agree 3 3 6 5 2 0 1 0 Totally disagree 0 0 2 0

Suggested Bike type conforms to my profile

Antwoord

Totall y agree

Agree

Do not know

Do not agree

Totall y disagree

Summary

Analyseren kwantitatieve gegevens What are the Metrics we want to use?

1. 2. 3. In relationship to the test goals; Depend on the selected scenarios; Focus on usability and functionality;

Note: What is right or wrong (the standards you apply to)

Follow these steps (mandatory): 1. 2. 3. 4. Process the data in Excel; Make graphs in Excel; Draw conclusions from the data and graphs in Excel; Write suggestions for improvements.

How to work?
Analyseren kwantitatieve gegevens
Rent a Bike

Scenarios

Which scenarios do we want to use?

Scenario Rent a Bike

Testgoals

1. Right bike with the right person 2. Easy to select(a) en fun to pimp(b) 3. Accesoires are easy to select and usefull for my tour

Decision about the metrics

1. Qualitative ordinale scale ranging from: Totally agree, Agree, Dont know, Disaggree and totally disagree. Posttask questions about Profile and Recommended bike. 2. (a) Measurement of time, clicks and needed guidance. (b) Qualitative ordinale scale ranging from: Totally agree, Agree, Dont know, Disaggree and totally disagree Posttask questions about pimping the bike. 3. Etc.

Data collection
Scenario:
Identifier 4.1 Description Bikes are easy to select

4. Renting a Bike
Observations 1. 2. 3. 4. 5. 6. Suggestion Difficulty with finding the right button for Give button a colour. selection; Carousel of presenting bikes ends abruptly and are confusing Not possible to change selected bike in the same screen 3D picture of bike makes fun! Money presentation is not clear to the user Next and Previous buttons are not visible

4.2

Pimping the bike makes fun

ETC.

Analysing data
Dimension and severity of the problems
Example how to classify problems:
Global Local

Moderate

(4.1 3) Change selected bike

new navigation needed additional functionality rework on design and program

(4.1 1) Finding right button (4.1. 2) Carousel end abrupt

easy to repair in one form

Severe

(4.1. 6) Next and previous buttons

(4.1 5) Help function is not working

technical problem change help library

due to MySql implementation new version of MySql in relationship to style sheets used

Give advise how to solve problems

Determine priority
Problem

Example of priority classification

Recommendation

1e priority

4.1 1 Finding right button

Easy to repair and is needed for earning money Reconsider colours for accepting an offer Reconsider shapes of buttons
Easy to repair and is needed for earning money Important to give user a sense of understanding related to his profile. Switch to latest versions of MySql, PHP and Unix Dont allow Ascii character set (use UTF) Reconsider classes in style sheet system is rather self explaining reconsider help text reconsider interactive help Reconsider functionality Renting a bike Add, delete, modify in one screen (also for bookings etc.)

4.1. 2 Carousel end abrupt

4.1. 6 Next and previous buttons

2e priority

(4.1 5) Help function is not working

4.1. 3 Change selected bike

Usability Report
Will be one report! Contains test design, conducting the test, analysing results, drawing conclusions and writing recommendations for improvements.

Conforms to the guidelines of reporting Contents Introduction Approach and covered chapters SEE THE EXAMPLE STRUCTURE REPORT !!!

Usability Report
A good Usability Report:
1. A chapter does not start with a table, graph or summary. 2. The measurements are presented in the appendices. 3. Measurements are presented and analysed in Excel. 4. Supported graphs are presented in the report. 5. A graph contains an explanation and a conclusion.

Approach

Opdracht: Usability test & rapport

Perform a usability test with approximately 5 people. Process and analyse the results. Write a usability report outlining the problems encountered. Write recommendations for (usability/functional) improvements .

Approach
Hand over evidence of the usability tests:
CD-ROM containing the usability tests performed usability test report