FY23 User Testing Planning
Creating a UX Research Plan
STEP ONE: Make a list of stakeholders.
The list should include anyone who should be consulted prior to and during the research process. Having this list makes it easy to deliver insights back at the end of the research project.
Working with stakeholders is especially important for anyone carrying out user research as you need to know both what they already know about a particular problem and what they need to find out. Understandably, strong communication throughout the research process is key
Here is a basic outline of the critical stakeholders in this process and the questions we’re intending to ask of them as it pertains to our study:
Senior Staff
Does the development work align with institutional goals and priorities? Does the design fit our goal audiences?
Michelle DiMeo
David Cole
The Board
What would you like to know about user habits in the Digital Collections?
What do you hope a user is able to accomplish in the Digital Collections as it pertains to your position at the Institute?
How do the Digital Collections ideally align with the strategic plan of the Institute?
Collections Managers
How are their collections presented? Is the integrity of their collections maintained digitally? How well can users access their materials?
Molly Sampson
Jim Voelkel
Patrick Shea
Ashley Augustyniak
Dave Caruso
What would you like to know about user habits in the Digital Collections?
What do you hope a user is able to do in the Digital Collections as it pertains to your collecting area/position at the Institute?
What changes to the interface could you see being more or less helpful?
Technical Team
As the primary staff developers, would the information gathered from users improve your understanding of the app’s use?
Sarah Newhouse
Jonathan Rochkind
Eddie Rubiez
Are there any specific questions or ideas that should be explored in this first pass of user testing?
Will these proposed studies and prompts provide you with insight into user needs?
Will the proposed studies provide direction to your work at the Institute?
You’re looking for pain points that affect the people you talk to than things that affect the entire domain in which those people live or work.
“Do you think you’d use this if [we designed it differently?]” is a poor question because it will likely elicit a yes/no (closed) response. It also asks users to ponder a potential behavior, which often isn’t strictly up to them.
STEP TWO: Identify known data.
What do we already know?
Any quantitative metrics of the Digital Collections use can be found on Google Analytics: https://analytics.google.com/analytics/web/?authuser=1#/report-home/a326869w144740760p168958592
General Trends:
Oral Histories are very popular.
Rare books are some of our most accessed materials.
Most of our users find our pages through Google searches.
Mostly accessed from the United States, but used internationally.
Users spend less than 2 minutes per page.
STEP THREE: Write research questions/objectives.
The why of the research. Actionable and specific. E.g.,
“How do people currently use the wishlist feature on our website?”
“How do our current customers go about tracking their orders?”
“How do people make a decision on which power company to use?”
“What actions do our customers take when they’re thinking about buying a new TV?”
These are NOT the questions asked during the sessions - broad enough to allow you to formulate a list of tasks or questions to help understand.
Can people find the information they need?
Can they accomplish their goals?
Can people understand the content?
Are people getting lost or confused?
STEP FOUR: Develop a research approach.
See Usability Testing and Survey
Research objectives are the ‘why’ of your research project. These should be informed by the existing data you’ve uncovered as well as discussions with your stakeholders.
When formulating your research questions, keep in mind that these are not the same questions you should be asking your users. Basically, they should be broad enough that you can use them to then generate tasks or questions for your users, the outputs of which should hopefully shed a little more light on the problem you’re working on.
Research Method Options:
Survey with Questions
First Click Testing with Chalkmark to test first impressions of mockups.
Test information architecture with Treejack or Optimal Sort
Usability testing using Reframer (moderated vs. unmoderated)
To-Do:
Decide who will be involved and what their roles are during the sessions.
Discuss what the script used during your sessions will contain.
Decide where sessions will take place and what equipment you’ll need.
Discuss the kinds of participants you require.
General Use and Searching
EVAL TYPE: Usability Testing
ROLES:
Interviewers: Jahna and Annabel
Survey Designers: Jahna & Annabel
LOCATION: Zoom
TARGETTED PERSONAS:
The scientifically-curious public
Educators
Researchers
Specific Features
EVAL TYPE: Usability Testing
ROLES:
Interviewers: Jahna and Annabel
Survey Designers: Jahna & Annabel
LOCATION: Zoom
TARGETTED PERSONAS:
Researchers
Educators
User Demographics & Satisfaction
EVAL TYPE: Survey
ROLES:
Survey Developers: Jahna and Annabel
Survey Deployers: Tech Team
LOCATION: In Application (Pop-up Window)
TARGETTED PERSONAS:
All users that navigate organically to the website.
OTHER RESOURCES