OPAC Usability Hinders Information Literacy: Vocational Students Struggle with Library Jargon and Navigation
Category: User-Centred Design · Effect: Strong effect · Year: 2026
A significant gap exists between how vocational students search for information and the current design of library Online Public Access Catalogs (OPACs), leading to poor usability and reduced information literacy.
Design Takeaway
Redesign OPAC interfaces to use plain language, avoid technical jargon, and offer navigation structures that align with users' existing knowledge and common search behaviors.
Why It Matters
Designers must recognize that users' mental models, especially those of digital natives, may not align with traditional information architecture. Failing to bridge this gap results in systems that are not only difficult to use but actively impede users from achieving their goals.
Key Finding
The library's online catalog is difficult for vocational students to use, with many errors and a low success rate in finding information, largely due to confusing terminology and navigation.
Key Findings
- Heuristic evaluation identified 18 significant usability violations, particularly related to library technical jargon and error prevention.
- User testing revealed a low average Task Success Rate (49.3%) and a poor System Usability Scale (SUS) score (55.0), indicating unacceptable usability.
- Specific dissonance points were found between students' mental models and the system's bibliographic metadata and navigation.
Research Evidence
Aim: To evaluate the usability of a school library OPAC and identify specific points of 'mental model dissonance' that hinder information retrieval for vocational students.
Method: Mixed-methods evaluation (Heuristic Evaluation and User Testing)
Procedure: Three usability experts conducted a heuristic evaluation of the OPAC, identifying violations of usability principles. Subsequently, vocational students performed specific tasks using the OPAC, employing the Think-Aloud protocol to voice their thoughts and completing the System Usability Scale (SUS) questionnaire.
Sample Size: 3 experts, unspecified number of students
Context: Vocational high school library
Design Principle
Design interfaces to minimize cognitive load by matching system metaphors and terminology with user expectations and mental models.
How to Apply
Before launching or updating any information system, conduct heuristic evaluations with usability experts and perform user testing with representative users, employing think-aloud protocols and standardized usability questionnaires.
Limitations
The study focused on a single vocational high school, and the specific context of the 'Kurikulum Merdeka' may influence student search behaviors.
Student Guide (IB Design Technology)
Simple Explanation: The library's computer system for finding books is hard for students to use because it uses confusing words and isn't organized the way they expect, making it difficult to find what they need.
Why This Matters: This research shows that even systems designed for information access can fail if they don't consider the user's perspective, highlighting the importance of user-centered design in all projects.
Critical Thinking: To what extent do the findings regarding 'mental model dissonance' generalize to other digital information systems beyond library OPACs, and what are the implications for designing interfaces for diverse user groups?
IA-Ready Paragraph: This study highlights the critical need for user-centered design in information systems, demonstrating how a mismatch between user mental models and system architecture, as evidenced by low task success rates and poor usability scores in a school library OPAC, can significantly impede user goals. The research underscores the value of integrating heuristic evaluations with empirical user testing to identify specific design flaws and inform necessary interface restructuring for improved user experience and information literacy.
Project Tips
- When evaluating a system, consider both expert opinions and actual user experiences.
- Use qualitative data (like think-aloud) to understand *why* users struggle, not just *if* they struggle.
How to Use in IA
- Use the findings to justify user testing and heuristic evaluations in your own design project.
- Cite this study when discussing the importance of aligning system design with user mental models.
Examiner Tips
- Ensure your evaluation methods are clearly justified and appropriate for the design problem.
- Demonstrate how your findings directly inform design decisions and improvements.
Independent Variable: OPAC design (e.g., jargon, navigation, error prevention)
Dependent Variable: Usability (Task Success Rate, SUS score), User perception, Information retrieval efficiency
Controlled Variables: User demographic (vocational students), Specific tasks performed, Library context
Strengths
- Employs a mixed-methods approach combining expert review and empirical user testing.
- Identifies specific usability issues and quantifies user performance and perception.
Critical Questions
- How might the 'Kurikulum Merdeka' specifically influence the mental models of vocational students in this context?
- What are the long-term implications of poor OPAC usability on students' overall information literacy development?
Extended Essay Application
- Investigate the usability of a digital tool relevant to a specific curriculum or vocational field, using similar evaluation methods.
- Explore how to adapt existing information architectures to better suit the cognitive styles and digital literacy levels of a target user group.
Source
Usability Evaluation of a School Library OPAC Using Heuristic Evaluation and User Testing · Journal of Information Systems and Informatics · 2026 · 10.63158/journalisi.v8i1.1528