Huntsville-Madison County Public Library
Usability Testing | Huntsville, AL
Timeline: Aug 2023- Dec 2023
project Overview
The Huntsville-Madison County Public Library, Alabama's oldest public library branch, serves as a vital resource for Madison County residents. Offering a wide array of services, including online resources, computer training, a vast digital collection, public-use computers, free Wi-Fi, and meeting spaces, the library caters to diverse community needs. Its website serves as an essential hub, providing easy access to information on collections, services, and events.
Project Scope
Timeframe: Fall 2023
Role: UX Researcher
Team Members:
Kay Champagne
Shiva Vakili
Drew Yarbrough
Lizzy Young
Methods: Heuristic Analysis
Usability Testing
Tools: Google Docs
Microsoft
Word
Zoom
Excel,
Adobe InDesign
Objective
This study aims to assess the usability and accessibility of the Huntsville-Madison County Public Library website by identifying key challenges. Usability measures how easily users can navigate and interact with the site, while accessibility focuses on how well individuals with disabilities can access and use its features.
Methods
The study employed Heuristic Analysis and Usability Testing to evaluate the Huntsville-Madison County Public Library website. The heuristic analysis assessed accessibility issues, including unordered lists, redundant links, and missing alt text. Usability testing provided insights into user challenges, behaviors, and preferences when searching for library events and information. It also examined website accessibility and user satisfaction in navigating the site.
Heuristic Analysis
The research team applied industry-standard accessibility guidelines to evaluate the Huntsville-Madison County Public Library website.
-
Accessibility Standards: Utilized WebAIM accessibility principles to guide the heuristic analysis process.
-
Evaluation Tool: Employed the WAVE accessibility checker to identify and explore accessibility errors.
-
Key Issues Identified:
-
Unordered lists disrupting content structure for screen readers
-
Redundant links creating unnecessary navigation challenges
-
Alt text errors reducing accessibility for visually impaired users
-
Additional issues flagged by the WAVE tool for further review
-
Usability Testing
The research team conducted usability tests with 11 participants through in-person and Zoom sessions, each lasting about 25 minutes. The process included:
-
Pre-Test Questions: Participants provided demographic information and shared their familiarity with the library website.
-
First-Look Assessment: Users gave initial impressions, evaluated website aesthetics, and shared expectations about navigation.
-
Usability Tasks: Participants completed nine tasks designed to uncover usability and accessibility pain points.
-
Post-Test Feedback: Exit questions captured overall experiences, highlighting positive aspects, challenges, and user recommendations.
-
Transcription & Analysis: Sessions were transcribed using Trint software, and thematic analysis was conducted to identify key trends and insights.
Results
Accessibility Results
The heuristic analysis for accessibility revealed significant challenges to accessibility on the Huntsville-Madison County Library website. Specifically, the data revealed 3 main themes relating to accessibility:
-
Alternative Text:
-
Alt text was missing across the entire site, with the biggest issue being missing alt text on informational graphics.
-
-
Unordered Lists:
-
Numerous unordered lists across the site presented challenges to accessibility when presenting web content in a useful order.
-
-
Redundant Links:
-
Numerous adjacent links went to the same URL resulting in additional navigation and repetition for users.
-
Alternative Text
Most photos and graphics providing critical visual information on the site lacked alt text, which posed serious problems for screen readers. The researchers discovered a total of 51 alt text mistakes on the website using WAVE.
-
Alt Text Issues: Alt text was missing across the entire site, with the biggest issue being missing alt text on informational graphics.
-
Impact on Accessibility: Essential visual content, including photos and graphics, lacked alt text, posing major accessibility challenges for screen reader users.
Unordered Lists
The heuristic analysis revealed unordered list errors across five key pages of the library website. While not extensive, these errors significantly impacted accessibility. The Events page had the highest occurrence, with 17 unordered list errors.
Unordered lists disrupt screen readers' ability to present content in a structured, logical order, making navigation difficult for visually impaired users. Ensuring proper list formatting will improve content flow and accessibility. Addressing these issues is crucial for creating an inclusive digital experience.
-
Widespread Errors: Unordered list issues were found across five key pages of the library website.
-
High Impact on Accessibility: The Events page had the highest occurrence, with 17 unordered list errors.
-
Screen Reader Challenges: Unordered lists disrupt content structure, making it difficult for screen readers to present information logically.
-
Need for Improvement: Proper list formatting will enhance navigation and accessibility, ensuring a more inclusive user experience.
Redundant Link
Redundant links have been identified across multiple pages of the website, with 11 such errors on the Home page, 6 on the Events page, and another 6 on the Research page. The issues involve instances when adjacent links direct users to the same URL, resulting in additional navigation and repetition for users, but especially for those who depend on assistive technologies, such as screen readers or keyboard navigation.
On the Home page, the redundant links issue occurs numerous times when multiple images are arranged in a three-by-two layout designed for quick navigation to important sections or content of the website.
-
Frequent Errors: Identified on multiple pages—11 on the Home page, 6 on the Events page, and 6 on the Research page.
-
Navigation Challenges: Adjacent links directing to the same URL create unnecessary repetition, making navigation cumbersome.
-
Impact on Accessibility: Particularly problematic for users relying on screen readers or keyboard navigation.
-
Home Page Layout Issues: Redundant links commonly appear in the three-by-two image grid, designed for quick navigation.
-
Need for Optimization: Eliminating redundant links will streamline navigation and improve accessibility for all users.
Usability Results
Participant Demographics
The usability study included 11 participants, with an average age of 36.5 years. The gender distribution was balanced, with 5 identifying as male, 5 as female, and 1 as other. Participants rated their comfort level using websites on a scale of 1 to 10 (10 being very comfortable), resulting in an average rating of 8.75.
Pre-Test Findings
The research gathered demographic data and assessed participants’ comfort with website navigation and familiarity with library resources. While most participants reported infrequent use, a few regularly visited library websites for digital books or to borrow resources, highlighting diverse user needs.
Key findings included the importance of intuitive navigation, quick access to research materials, and the ability to easily check out or reserve books online. Additionally, two participants with graphic design experience contributed valuable insights into improving the website’s visual and functional design.
The study also revealed participants’ reliance on digital tools for event planning, emphasizing the need for clear event calendars and easy-to-find details.
Library Website Usage
-
Most participants did not frequently use library websites.
-
A few participants actively engaged with library websites, with one reporting bi-weekly use for accessing digital books.
-
One participant primarily relied on the Huntsville-Madison Library website but had previously used the Birmingham Library website before transitioning to school resources.
Event Attendance
-
A participant regularly attended story time sessions for their child, using the library website to check event details.
Graphic Design Background
-
Two participants had graphic design experience, offering valuable perspectives on design elements and aesthetics.
Library Website Expectations
Participants shared their expectations of a library website:
-
Accessing research journals and books
-
Easy book search and checkout
-
Quick search refinement options for research materials
None of the participants reported using assistive technology.
Post Test Findings
Overall Experience
Participants had mixed experiences:
✅ Finding books was straightforward, but locating materials on specific subjects was difficult.
✅ Navigation was generally smooth, but some found it more challenging than expected.
❌ Some essential features (like Makerspace info) were hard to locate.
❌ Search functionality was a major pain point.
“Locating books was straightforward, but finding specific materials proved challenging.”
Alex Smith
Participant Quote
"It was more difficult than expected. If I couldn't find information, I had to use Google instead.”
Drew Carlyle
Participant Quote
“The navigation buttons at the top made it easy to find what I needed.”
Charlie McMann
Participant Quote
Positive Aspects
✔ Visually appealing and well-structured homepage
✔ Intuitive book search functionality
✔ Clear navigation buttons for major services
✔ Special collections were a valuable discovery
Negative Aspects
❌ The search bar defaults to catalog searches, making it difficult to find website information.
❌ Event listings lacked crucial details, such as future meeting dates for clubs.
❌ Some buttons and elements blended into the background, reducing visibility.
Participants provided feedback on their overall experience, identifying positive and negative aspects of the website and recommending improvements.
-
Conducted usability testing on the HMCPL website.
-
Designed test scenarios and tasks to evaluate user interactions with the interface.
-
Recruited diverse user participants to ensure a representative sample.
-
Observed and documented user behaviors and feedback during testing sessions.
-
Analyzed usability issues, providing actionable recommendations for improvement.
-
Collaborated with the design and development teams to implement suggested changes.
-
Utilized usability testing tools and software to capture quantitative and qualitative data.
-
Contributed to the creation of a more user-friendly interface based on testing insights.
-
Presented findings and recommendations to stakeholders for informed decision-making.
-
Ensured the project aligned with accessibility standards, addressing any identified barriers
Recommendations- Accessibility
Three primary themes concerning accessibility emerged from the heuristic analysis of the Huntsville-Madison County Library website.
Three primary themes concerning accessibility emerged from the heuristic analysis of the Huntsville-Madison County Library website.
Redundant Link
Redundant links have been identified across multiple pages of the website, with 11 such errors on the Home page, 6 on the Events page, and another 6 on the Research page. The issues involve instances when adjacent links direct users to the same URL, resulting in additional navigation and repetition for users, but especially for those who depend on assistive technologies, such as screen readers or keyboard navigation.
On the Home page, the redundant links issue occurs numerous times when multiple images are arranged in a three-by-two layout designed for quick navigation to important sections or content of the website.
-
Frequent Errors: Identified on multiple pages—11 on the Home page, 6 on the Events page, and 6 on the Research page.
-
Navigation Challenges: Adjacent links directing to the same URL create unnecessary repetition, making navigation cumbersome.
-
Impact on Accessibility: Particularly problematic for users relying on screen readers or keyboard navigation.
-
Home Page Layout Issues: Redundant links commonly appear in the three-by-two image grid, designed for quick navigation.
-
Need for Optimization: Eliminating redundant links will streamline navigation and improve accessibility for all users.