UX Review

From Foss2Serve
Revision as of 15:25, 28 May 2015 by Nyeates (Talk | contribs)
Jump to: navigation, search
Title User Experience Review: Fedora Desktop Environment Comparison
Audience Non-CS Majors, Business, Information Systems students; The activity and choice of software could easily be modified to handle more technically knowledged audiences
Overview Students will learn about user experience fundamentals and then interact with an existing open source software project to perform a Usability Review. A usability review involves observing a user (another student) while they attempt to use the software, and recording observations. The students will create a Usability Report that details their observations in a structured manner, and pulls together a larger understanding of the results.
Prerequisite Knowledge Prior to attempting this activity, students need to know
  • Have used any desktop-based Operating System
Learning Objectives After completing this activity, students should
  • Be able to describe what is meant by the term "user experience", why it is important, and specific challenges faced by open source software
  • Understand the complexity of user testing and the variety of testing that can be done with usability testing
  • Appreciate the fact that the desktop environment is completely separate from the operating system in Linux


Background reading material includes:

Are there other activities the student should have done first?

  • Might be helpful for students to conduct a FOSS Field Trip type activity, such as OS_Project_Comparison_Activity, to learn more about this or other open source projects before working with it

What is the rational for this activity? Usability is an important topic for ensuring the quality of software. With start-ups and open source organizations, unfortunately, they can overlook this inadvertantly. We are asking students to participate in user testing. Nielsen's article describes a three step process of what this involves: identifying representative users, asking them to perform representative tasks, and finally observing their interactions without interference.

Helpful hints for faculty:

  • There will be some prep work required to ensure that the software being tested is installed or otherwise available to the students. For example, one option would be to have Fedora with GNOME 3 on a USB stick for the students to use.
  • This activity can be enhanced by having the instructor develop a relationship with members of a specific open source community. This would allow opportunities such as
    • Having a conference call with open source community manager to answer student questions about the project
    • Having a conference call with users of the open source project that describes how they use it and what issues they have with the software
    • Having the opportunity of suggestions getting accepted back into the community
  • If your students feel that they have found a gaping hole in the usability of the software, this could be a great opportunity to provide feedback to open source community. This could be in the form of a bug. Please see TBD on how to create a bug.


What should the student do?

Selection of project: Compare usability of GNOME 2 vs. GNOME 3 vs. KDE

In groups of 3, the students will perform a Virtual Usability Review by doing the following steps

  • Roles: 2 Recorders (screen capture, video recording of the user, and audio feedback) and 1 Participant
    • Observer: Note what the participant does AND what the outcomes were. For example, how many places did they click before getting to the correct place (wrong turns)? How long did it take to complete the task? Did they complete the task? How happy was the participant when doing the work? For example: "On task 5, user first tried to look at Desktop. Then, user tried to look at Taskbar and didn't find it there."
  • Students will complete a set of tasks without any instructions
  1. Open a terminal
  2. Create a text file
  3. Make a directory or folder
  4. Search for and launch the application "GIMP", an open-source image manipulation tool similar to PhotoShop
  5. Launch a Web Browser
  6. Using the Web Browser, find a picture of the Linux Penguin and save it to the computer
  7. Insert the picture into a word processing package


What will the student hand in?

Each group would do complete a usability report for each desktop environment that is reviewed. The table below provides a sample.

Name of User
Name of the Desktop Environment
Prior experience with this Desktop Environment:

(None, Seen it before, Frequent user, Expert user)

Task to perform Time to completion

(max= 5 minutes)

Number of

wrong turns

Level of User Satisfaction

(1: frustrated, 5: Very Happy)

What steps did the user take? Please list all steps, even wrong turns
1. Open a terminal
2. Create a text file and add your name
3. Make a directory or folder
4. Search for and launch the application "GIMP",

an open source image manipulation tool similar to PhotoShop

5. Launch a Web Browser
6. Using the Web Browser, find a picture of the Linux penguin and save it to the computer
7. Insert the picture into a word processing package


How will the activity be graded?

How will learning will be measured?

Include sample assessment questions/rubrics.


What should the instructor know before using this activity?

What are some likely difficulties that an instructor may encounter using this activity?

Additional Information:

Knowledge Area/Knowledge Unit What ACM Computing Curricula 2013 https://www.acm.org/education/CS2013-final-report.pdf knowledge area and units does this activity cover?
Topic What specific topics are addressed? The Computing Curriucula 2013 provides a list of topics - https://www.acm.org/education/CS2013-final-report.pdf
Level of Difficulty Medium
Estimated Time to Completion During 75 minute class period: 15 minutes for teacher to setup the experience, Group work during class: 75 minutes; Reflection after class: 30 minutes
Materials/Environment Fedora with GNOME 2, Fedora with GNOME 3, Fedora with KDE
Author Nannette Napier, Nick Yeates, Gina Likins
Source Is there another activity on which this activity is based? If so, please provide a link to the original resource.
License Under which license is this material made available? (http://creativecommons.org/licenses/)

Suggestions for the Open Source Project:

Suggestions for an open source community member who is working in conjunction with the instructor.

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License

CC license.png

Personal tools
Learning Resources
HFOSS Projects