Usability Test Questions for Johnine Ornelas

Completed by: Maria Mejia

Date: 6/21/15
1. Are you able to download the zipped file and extract the files easily? Yes, I
downloaded the file without issue. It automatically opened in my
preferred browser, Google Chrome. It also ran in Safari and Firefox. I
conducted my test on a Mac Book Pro running OS 10.10.3
(Yosemite).
2. Are you able to launch the RLO by clicking on story_html5? Yes.

Menu
1. Does each of the menu buttons take you to the correct slide or scene? Yes
2. Is it clear how to return to the Menu or Exit the lesson? Not initially. Took
two tries to get back. It wasn't until responding to this question that
I remembered to read your callout on the Menu page. Your character
provides clear instructions. I didn't read the instructions at first
because I expected narration as indicated by the volume button in
the lower left-hand corner of screen. I would prefer if the menu was
a pop-out or set in "accordion" style where it can be called at any
time. Exit is clear. Once I got the hang of the Menu being on the
right (instead of left where I am used to it), no problems.
My recommendation would be to flip the position of the Glossary and
Resources to the upper right side, and move Menu to the left. Most
people's eyes are drawn to the upper-right portion of the screen first
(because that's where one's window controls are, especially if you're on a
Mac). There was a slight redundancy effect with the Menu link on the
upper right and then again in larger text above the Introduction button.
You colored text in the character's caption are in color. I thought they
were links - I realize you emphasized them with color (which looks good!)
but I am letting you know others might make that assumption. A
Lastly, move your Prev and Next buttons. There should be a Next button
on the Menu page.
Introduction
1. Is it clear what the purpose of the tutorial is and what the objectives are?
Yes.
2. There two jump buttons at the bottom. Does each take you to the
appropriate branch of the RLO? Yes. I really like how you created a
branch here - I wasn't expecting that from the every beginning. I

wasn't sure which was to turn. As a beginner, I would want to know

which is the best fit for me. I chose the review and didn't get
everything right, which led me back to the intro. Maybe a hint here
would help?
Critical Thinking Review
1. Are the instructions clear for the two drag and drop exercises? Yes.
2. Is the feedback for each attempt helpful? Yes. although I didn't get
everything right initially, I knew that I could look at the glossary for
help.
3. Can you find and access the Glossary while attempting to answer the
questions? Yes.
4. If you get an answer wrong, are you able to Try Again? Yes.
5. When you click on Continue after correctly answering the second question,
does it take you to the Overview of the Critical Thinking Criteria? Yes.
Overview of the Critical Thinking Criteria
1. Are the instructions clear? Yes.
2. Click on the Next button. Is it locked? No. I was able to hit next after
clicking on four of the criteria menu items.
3. Click on each criterion. Does a new window open explaining the criterion? Is
it clear how to close the window and return to the Overview slide? Yes and
yes.
4. After clicking on all of the criteria, click on Next. Does it take you to Applying
the Criteria? Yes.
5. How do you return to the Critical Thinking Review if you chose to skip it at the
beginning? Go to Menu > then Intro or hit Prev to return back to the
branching point.
Applying the Criteria
1. Can you easily page through this part of the RLO using the Next & Previous
buttons? This took some getting used to it first, but it made sense
once I started the branching scenario. I still say moving previous to
the lower left-hand corner and next to the right would make the
navigation more intuitive.
2. Aishas video presentation:
Are the instructions clear? Yes, Aisha's instructions are clear.
However, it seems as though I should be watching the video first
before assessing Aisha's performance. You may want to consider
switching the location of the KC and video buttons.
Did the video open in your web browser when you clicked on the Play
Video button? Yes.
Did the closed captioning automatically start? Yes.
Can you turn off the closed captioning for the video? Yes.

Did the pace and timing of the slides for the video segments seem
appropriate? Yes.

3. Knowledge checks
Does clicking on each Knowledge Check button take you to the correct
question? Yes.
Do the feedback pop-up windows provide meaningful feedback after each
knowledge check? Yes.
Is there sufficient information in the Overview of the Criteria to answer the
quiz questions? Yes.
If you get the Knowledge Check incorrect, does clicking try again
automatically return you to the previous slide with the Play Video button?
I was not able to test this at first. I got the questions right. When
I hit the previous lives to change my answers, I was not able to
make these modifications. This is behavior that you probably
want to keep.
I tested this again by submitting incorrect responses to knowledge check
one. I opened up a new incognito session in chrome. I restarted your elearning lesson. Yes, I was directed back to the previous slide.
4. Results Slide
Is the information on the slide helpful to the student? Yes. the results
slide provided a sense of accomplishment because I was able to
see how much more scored beyond the required passing score.
Do the questions encourage students to reflect on how they did and where
do go for information for review? Yes, I also liked that you provided
additional resources that the learner could access once the lesson
ends.
Summary
1. Does it clearly explain how Aishas presentation met the critical thinking
criteria? Yes.
2. Does it relate back to the objectives related in the Introduction? Yes.
Although the presentation was executed well, I think you can prep
the learner on the "Applying the Criteria" slide that they will be
assessing a presentation on Ebola. To go from theoretical subject
matter to actual news events was a little jarring. This would not only
prep for the change in subject matter, it would also provide a
smoother transition from spectator to evaluator.
Resources and Credits
1. Do the links open when you click on them? No, the first two - Aisha's
presentation and the Critical Thinking rubric appear as downloads

but do not open in my browser. The last two links do - Nurse's Guide
and Skeptics Guide. Not a problem, but just wanted you to know that
the behavior was slightly different than the way the question was
phrased.
General
1. Do the optional audio buttons for slides with text work? (Still need to record
these.) Yes. although there is no recording yet, the buttons do allow
me to adjust the levels for audio.
2. Where can you find information on what happens if you exit the program in
the middle? If I exit the program, I cannot access the material other
than the YouTube video (if that was already opened).
3. Visuals:
Are there enough images relative to text? Yes.
Do the images need further explanation? No.
Are the fonts and font colors readable? Yes.
Are the color choices appropriate or are they distracting? Appropriate.
4. Is the information presented in a logical, understandable way? Yes. My only
recommendation would be the transition I described above in the
"Resources and Credits" section.
If not, how could the organization be improved? See above.
5. Were you able to access the RLO in IE, Chrome and Firefox? From your laptop
or desktop computer? See beginning of this document.
6. What other suggestions or comments do you have? I noticed an
interesting behavior. As I was testing question #2 in this section, I
closed the RLO. I accessed it again by viewing my "Recently closed
tabs." It appears that my behavior has not been saved so I wasn't
able to scroll through your module the way I was before I closed the
tab. I imagine in an actual LMS, this behavior would not be an issue
because SCORM would have recorded my user behavior.
Overall, I was pleased with the look and feel of the module. I viewed it on
a 24" display and the colors were soothing to the eye - bright but not
overpowering. I liked that you customized the look of your player so it
doesn't look like every other Articulate asset out there. I didn't like the
volume button being present if there was no audio to listen to other than
the YouTube video. You did a good job of balancing text with images which
I image was difficult to do with such an abstract topic such as critical
thinking. I can tell you used hover states so I knew which options I'd
already clicked on. If you were publishing this for real, I would recommend
using a muted color than another bright one so it's more obvious that it's
been clicked - or use a highlight hover state.

I love that used characters of color! All too often I see e-learning that
doesn't include people that look like myself, so when I do see it I am
appreciative of the designer for considering multiple populations.
On the "Applying the Criteria" slide, you border on too much text here. You
can turn the first paragraph into a speech bubble for Aisha on the right
and do instructions on left. Break it up with bullets. Drop the last line,
"Click Next to continue." This can be a part of the speech bubble.
I think one of the things I love most about your module is how you manage
to change the setting in such an abbreviated lesson. First we started with
a very didactic approach to an abstract topic. Then, you moved from the
"teacher's voice" and to Aisha's as a student. And finally we moved from
the Voice of a classroom presentation to a clinical lesson. You managed to
move the learner into three environments within a short span of time. I
also like how you broke up the flow of the module for periodic checks. The
questions were written in a way that was applying to Aisha's (and not at
all about "trying to ace a quiz to finish". This is a well composed of
module, especially considering it's your first time using our Articulate. You
should be proud (and I hope that you are).