Help-Seeking Situations Related to Visual Interactions on Mobile Platforms and Recommended Designs for Blind and Visually Impaired Users
Open accessAbstract
While it is common for blind and visually impaired (BVI) users to use mobile devices to search for information, little research has explored the accessibility issues they encounter in their interactions with information retrieval systems, in particular digital libraries (DLs). This study represents one of the most comprehensive research projects, investigating accessibility issues, especially help-seeking situations BVI users face in their DL search processes. One hundred and twenty BVI users were recruited to search for information in six DLs on four types of mobile devices (iPhone, iPad, Android phone, and Android tablet), and multiple data collection methods were employed: questionnaires, think-aloud protocols, transaction logs, and interviews. This paper reports part of a large-scale study, including the categories of help-seeking situations BVI users face in their interactions with DLs, focusing on seven types of help-seeking situations related to visual interactions on mobile platforms: difficulty finding a toggle-based search feature, difficulty understanding a video feature, difficulty navigating items on paginated sections, difficulty distinguishing collection labels from thumbnails, difficulty recognizing the content of images, difficulty recognizing the content of graphs, and difficulty interacting with multilayered windows. Moreover, corresponding design recommendations are also proposed: placing meaningful labels for icon-based features in an easy-to-access location, offering intuitive and informative video descriptions for video players, providing structure information about a paginated section, separating collection/item titles from thumbnail descriptions, incorporating artificial intelligence image/graph recognition mechanisms, and limiting screen reader interactions to active windows. Additionally, the limitations of the study and future research are discussed.
Verified 2026-10-06 · 1 reference not checked yet
AI snapshot
Written from the paper’s full text.
TL;DR
This study examined help-seeking situations related to visual interactions among 120 blind and visually impaired (BVI) screen-reader users searching six digital libraries on four mobile device types. It identified seven typical visual-interaction help-seeking situations across features/elements, content, and structure, and proposed corresponding design recommendations.
Key findings
- Across 788 coded help-seeking instances, features/elements was the most frequent category (n = 329, 41.8%), followed by content (n = 274, 34.8%) and structure (n = 165, 20.94%); visual-interaction instances were 77/329 (23.4%) in features/elements, 144/274 (52.6%) in content, and 5/165 (3.03%) in structure.
- Seven typical visual-interaction situations were reported: difficulty finding a toggle-based search feature, understanding a video feature, navigating items on paginated sections, distinguishing collection labels from thumbnail descriptions, recognizing image content, recognizing graph content, and interacting with multilayered windows.
- Recommended designs included meaningful labels for icon-based features in easy-to-access locations, intuitive and informative video descriptions, structure information for paginated sections, separating collection/item titles from thumbnail descriptions, incorporating AI image/graph recognition mechanisms, and limiting screen reader interactions to active windows.
Methods
- Recruited 120 BVI participants across the United States, with 30 in each of four device groups (iPhone, iPad, Android phone, Android tablet); all relied on screen readers (VoiceOver or TalkBack).
- Each participant used two DLs—Library of Congress plus one of DPLA, HathiTrust, ArtStor, OER Commons, or the National Museum of African American History and Culture—and completed one orientation task and two search tasks; data came from pre-questionnaires, think-aloud protocols, transaction logs/screenshots/video, and interviews.
- Qualitative open coding was used, with inter-coder reliability of 0.81 based on Krippendorff’s Alpha, and descriptive analysis presented frequency distributions of help-seeking categories.
Limitations
- Stated: although the six DLs represented diverse domains, formats, and hosting organizations, findings may not be fully generalizable; online data collection via virtual conferencing might have hindered natural interactions.
- Evident from the text: this paper reports part of a larger study and focuses on seven visual-interaction situations; quantitative analysis of relationships between participant demographics, mobile platforms/devices, and help-seeking situations is left for future work.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 31 cited sources checked · 0 supported · 0 flagged
- Findingown data
Non-text interface elements, such as buttons with visual cues but without understandable labels, pose a challenge for BVI users.
“The non-text interface elements, such as buttons with visual cues but without understandable labels, pose a challenge for BVI users.”
Quote in the paperSubstantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
BVI users encountered help-seeking situations in their interactions with digital libraries on mobile devices.
“As a result of the open coding analysis, it was found that participants experienced a total of 788 instances of help-seeking situations.”
Quote in the paperSubstantial claim- Rests on an assumption: The 120 recruited BVI participants are representative of BVI users who use mobile digital libraries.
- Rests on an assumption: The six selected digital libraries are representative of mobile digital libraries.
- Rests on an assumption: The four mobile device types (iPhone, iPad, Android phone, Android tablet) represent mobile platforms for BVI users.
- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingnone given
Difficulty distinguishing collection labels from thumbnail descriptions is a typical help-seeking situation related to visual interactions on mobile platforms.
“Features/Elements: Difficulty Distinguishing Collection Labels from Thumbnail Descriptions”
Quote in the paperNot a substantial claim- Rests on an assumption: The 120 recruited BVI participants are representative of BVI users who use mobile digital libraries.
- Rests on an assumption: The six selected digital libraries are representative of mobile digital libraries.
- Rests on an assumption: The four mobile device types (iPhone, iPad, Android phone, Android tablet) represent mobile platforms for BVI users.
- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
Difficulty understanding a video feature occurs when BVI users face difficulty interpreting the functionality of or executing a video-related feature due to inappropriate labeling.
“This situation occurs when BVI users face difficulty interpreting the functionality of or executing a video-related feature due to inappropriate labeling.”
Quote in the paperSubstantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
A hidden search field caused by responsive design creates additional steps needed to locate the search field.
“Moreover, a hidden search field caused by responsive design creates additional steps needed to locate the search field, adding to complications that hamper easy access to the search field.”
Quote in the paperNot a substantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
Difficulty recognizing the content of images is a typical help-seeking situation related to visual interactions on mobile platforms.
“Content: Difficulty Recognizing the Content of Images”
Quote in the paperSubstantial claim- Rests on an assumption: The 120 recruited BVI participants are representative of BVI users who use mobile digital libraries.
- Rests on an assumption: The six selected digital libraries are representative of mobile digital libraries.
- Rests on an assumption: The four mobile device types (iPhone, iPad, Android phone, Android tablet) represent mobile platforms for BVI users.
- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
Within the features/elements category, 77 instances (23.4%) were related to difficulties in visual interaction.
“The features/elements category (n = 329) was the most frequently coded, constituting approximately 41.8% of the total coded situations instances, with 77 instances (23.4%) related to difficulties in visual interaction (Figure 2).”
Quote in the paperNot a substantial claim- Rests on an assumption: The 120 recruited BVI participants are representative of BVI users who use mobile digital libraries.
- Rests on an assumption: The six selected digital libraries are representative of mobile digital libraries.
- Rests on an assumption: The four mobile device types (iPhone, iPad, Android phone, Android tablet) represent mobile platforms for BVI users.
- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
On average, each participant encountered approximately seven help-seeking situations while completing their tasks.
“On average, each participant encountered approximately seven help-seeking situations while completing their tasks.”
Quote in the paperNot a substantial claim- Rests on an assumption: The 120 recruited BVI participants are representative of BVI users who use mobile digital libraries.
- Rests on an assumption: The six selected digital libraries are representative of mobile digital libraries.
- Rests on an assumption: The four mobile device types (iPhone, iPad, Android phone, Android tablet) represent mobile platforms for BVI users.
- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
Terms such as "search toggle" might not effectively convey the feature's function to participants.
“However, as indicated by IP5-LD, terms such as “search toggle” might not effectively convey the feature’s function to participants.”
Quote in the paperNot a substantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
Participants experienced a total of 788 instances of help-seeking situations.
“As a result of the open coding analysis, it was found that participants experienced a total of 788 instances of help-seeking situations.”
Quote in the paperNot a substantial claim- Rests on an assumption: The 120 recruited BVI participants are representative of BVI users who use mobile digital libraries.
- Rests on an assumption: The six selected digital libraries are representative of mobile digital libraries.
- Rests on an assumption: The four mobile device types (iPhone, iPad, Android phone, Android tablet) represent mobile platforms for BVI users.
- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
Difficulty finding a toggle-based search feature occurs when BVI users have difficulty finding a search box due to the search toggle button and the multiple steps needed to find the search box.
“This situation occurs when BVI users have difficulty finding a search box due to the search toggle button and the multiple steps needed to find the search box.”
Quote in the paperNot a substantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
Four categories of help-seeking situations were identified: features/elements, content, structure, and others.
“Four categories of help-seeking situations were identified: features/elements, content, structure, and others.”
Quote in the paperSubstantial claim- Rests on an assumption: The 120 recruited BVI participants are representative of BVI users who use mobile digital libraries.
- Rests on an assumption: The six selected digital libraries are representative of mobile digital libraries.
- Rests on an assumption: The four mobile device types (iPhone, iPad, Android phone, Android tablet) represent mobile platforms for BVI users.
- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
The features/elements category was the most frequently coded help-seeking situation category (n = 329, approximately 41.8% of total coded situations).
“The features/elements category (n = 329) was the most frequently coded, constituting approximately 41.8% of the total coded situations instances, with 77 instances (23.4%) related to difficulties in visual interaction (Figure 2).”
Quote in the paperNot a substantial claim- Rests on an assumption: The 120 recruited BVI participants are representative of BVI users who use mobile digital libraries.
- Rests on an assumption: The six selected digital libraries are representative of mobile digital libraries.
- Rests on an assumption: The four mobile device types (iPhone, iPad, Android phone, Android tablet) represent mobile platforms for BVI users.
- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
There is a lack of instructions for BVI users about using relevant features of screen readers or other assistive technologies to access the content of images on their mobile devices.
“Another issue is a lack of instructions for BVI users about using relevant features of screen readers or other assistive technologies to access the content of images on their mobile devices.”
Quote in the paperSubstantial claim - Findingown data
In an attempt to provide a description of the image associated with the collection, the ALT text of a collection thumbnail and the collection title are read out as one label to a screen reader.
“In an attempt to provide a description of the image associated with the collection, the ALT text of a collection thumbnail and the collection title are read out as one label to a screen reader.”
Quote in the paperSubstantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
BVI users were observed to have difficulty accessing the content of images when searching for information in digital libraries.
“However, BVI users were observed to have difficulty accessing the content of images when searching for information in DLs.”
Quote in the paperSubstantial claim - Findingown data
The help-seeking situation in paginated sections occurred due to missing labels of active elements (e.g., tabs) in the "Featured Content" section.
“As ID17-LO mentioned, this help-seeking situation occurred to him due to the missing labels of active elements (e.g., tabs) in the “Featured Content” section.”
Quote in the paperNot a substantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
The list of topics or categories that BVI users wish to browse is challenging to comprehend, as the thumbnail descriptions are addressed first without providing a clear notification when the title of the collection or topic is mentioned.
“The list of topics or categories that the BVI users wish to browse is challenging to comprehend, as the thumbnail descriptions are addressed first without providing a clear notification when the title of the collection or topic is mentioned.”
Quote in the paperNot a substantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
Difficulty distinguishing collection labels from thumbnail descriptions occurs when a thumbnail and a label associated with a collection title are read together, posing a challenge for BVI users to comprehend and interact with the collection effectively.
“This situation occurs when a thumbnail and a label associated with a collection title are read together, posing a challenge for BVI users to comprehend and interact with the collection effectively.”
Quote in the paperSubstantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
Descriptions as part of metadata did not provide detailed information on the visual characters (a soldier and a dog) presented in the poster.
“It was found that descriptions as part of metadata did not provide detailed information on the visual characters (i.e., a soldier and a dog) presented in the poster.”
Quote in the paperNot a substantial claim - Findingown data
AT18-OL expressed difficulty obtaining details of graphs due to a lack of descriptions.
“Specifically, one of the interviewees, AT18-OL, expressed difficulty obtaining details of the graphs due to a lack of descriptions.”
Quote in the paperNot a substantial claim - Findingown data
Visual cues, such as the play button or video player progress bar, do not provide the necessary information for BVI users to understand their functionality.
“Visual cues, such as the play button or video player progress bar, do not provide the necessary information for BVI users to understand their functionality.”
Quote in the paperSubstantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingown data
Difficulty navigating items on paginated sections occurs when BVI users have difficulty selecting an item on paginated sections due to inappropriate labels of active elements.
“This situation occurs when BVI users have difficulty selecting an item on paginated sections due to inappropriate labels of active elements.”
Quote in the paperSubstantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Findingnone given
Even when BVI users find features/elements, they have to take additional steps to use them.
“Moreover, even when they find these features/elements, they have to take additional steps to use these features/elements.”
Quote in the paperNot a substantial claim - Findingown data
This study shows that features/elements posed the highest number of help-seeking situations (41.8%) for BVI users.
“First, as to features/elements, while previous research has mainly focused on the challenges that BVI users encounter in visual content interactions [2,7,16,22,23,24,25,27], this study shows that features/elements posed the highest number of help-seeking situations (41.8%) for BVI users.”
Quote in the paperSubstantial claim - Findingreasoning
Two help-seeking situations related to visual content are caused by a lack of descriptions, inadequate descriptions, or clear indications of how to access these descriptions.
“In terms of design issues for visual content, two help-seeking situations are caused by a lack of descriptions, inadequate descriptions, or clear indications of how to access these descriptions.”
Quote in the paperSubstantial claim - Findingreasoning
Difficulty distinguishing collection labels from thumbnail descriptions is a distinct situation in DLs.
“Difficulty distinguishing collection labels from thumbnail descriptions is a distinct situation in DLs.”
Quote in the paperSubstantial claim - Findingown data
This paper reports seven typical help-seeking situations associated with visual interactions categorized into three groups: features/elements, content, and structure.
“This paper reports seven typical help-seeking situations associated with visual interactions categorized into three groups: features/elements (e.g., toggle-based search features), content (e.g., graphs), and structure (e.g., multilayered windows).”
Quote in the paperSubstantial claim - Findingreasoning
The lack of labels or inadequate labeling of video features makes it difficult for BVI users to make relevance judgments about the videos.
“On the one hand, the lack of labels or inadequate labeling of video features makes it difficult for BVI users to make relevance judgments about the videos.”
Quote in the paperSubstantial claim - Findingcitation
Icon-based features/elements, such as toggle-based search features, prevent BVI users from accessing and using these features/elements, thus disrupting their interaction process.
“Icon-based features/elements, such as toggle-based search features, prevent BVI users from accessing and using these features/elements, thus disrupting their interaction process.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [2] Xie, I., Wang, S., Lee, T.H., and Lee, H.S. (2023). Blind and visually impaired users’ interactions with digital libraries: Help-seeking situations in mobile and desktop environments. Int. J. Hum. Comput. Interact., 1–19. source
Not checked in the free run.
- cites [22] Nair, A., Mathew, R., Mei, Z., Milallos, R., Chelladurai, P.K., and Oh, T. (2023, January 26–29). Investigating the user experience and challenges of food delivery applications for the blind and visually impaired. Proceedings of the 25th International Conference on Mobile Human-Computer Interaction, Athens, Greece. source
Not checked in the free run.
- Findingown data
AP7-LA mistakenly perceived that the advanced search feature had omitted her words from the search query because the search was performed using the general search function instead of the intended advanced search.
“She mistakenly perceived that the advanced search feature had omitted her words from the search query because the search was, in fact, performed using the general search function instead of the intended advanced search.”
Quote in the paperNot a substantial claim - Findingown data
Inadequate labels for features/elements make finding them difficult for BVI users.
“Inadequate labels for the features/elements make finding them difficult for BVI users.”
Quote in the paperSubstantial claim - Findingnone given
Imaged-based icons represent the main problem for BVI users when accessing these features.
“Imaged-based icons represent the main problem for BVI users when accessing these features.”
Quote in the paperSubstantial claim - Findingreasoning
Difficulty recognizing the content of images is associated with BVI users being unable to find descriptions of images.
“Difficulty recognizing the content of images is associated with BVI users being unable to find descriptions of images.”
Quote in the paperSubstantial claim - Findingown data
BVI users often encounter challenges when attempting to obtain details on graphs.
“As shown in the examples, BVI users often encounter challenges when attempting to obtain details on graphs.”
Quote in the paperSubstantial claim - Findingown data
Several help situations are caused by a lack of or inappropriate labels.
“Regarding design issues for features/elements, several help situations are caused by a lack of or inappropriate labels.”
Quote in the paperSubstantial claim - Findingown data
Generalized descriptions without graphical components hampered users' understanding.
“Findings show that generalized descriptions without graphical components hampered users’ understanding.”
Quote in the paperSubstantial claim - Findingnone given
Video features present their progress using visual cues that BVI users cannot perceive and comprehend.
“On the other hand, video features present their progress using visual cues that BVI users cannot perceive and comprehend.”
Quote in the paperSubstantial claim - Findingnone given
Some DLs have not presented adequate ALT text and descriptions, particularly for graphs.
“However, some DLs have not presented adequate ALT text and descriptions, particularly for graphs.”
Quote in the paperNot a substantial claim - Findingreasoning
Active elements without specific labels cause confusion for BVI users.
“Active elements without specific labels cause confusion for BVI users.”
Quote in the paperSubstantial claim - Findingown data
BVI users cannot figure out paginated sections presented like a slide show and organized by unlabeled tabs.
“Another unique finding is that BVI users cannot figure out paginated sections presented like a slide show and organized by unlabeled tabs.”
Quote in the paperSubstantial claim - Premisecitation
Difficulty with navigation is another common type of help-seeking situation related to structures.
“Difficulty with navigation is another common type of help-seeking situation related to structures [7,16,19].”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [7] Carvalho, M.C.N., Dias, F.S., Reis, A.G.S., and Freire, A.P. (2018, January 9–13). Accessibility and usability problems encountered on websites and applications in mobile devices by blind and normal-vision users. Proceedings of the 33rd Annual ACM Symposium on Applied Computing, Pau, France. source
Not checked in the free run.
- cites [16] Alajarmeh, 2022, The extent of mobile accessibility coverage in WCAG 2.1: Sufficiency of success criteria and appropriateness of relevant conformance levels pertaining to accessibility problems encountered by users who are visually impaired, Univers. Access Inf. Soc. source
Not checked in the free run.
- cites [19] Rodrigues, 2020, Open challenges of blind people using smartphones, Int. J. Hum. Comput. Interact. source
Not checked in the free run.
- Premisereasoning
Sparse research has examined BVI users' help-seeking situations in the mobile DL environment.
“Even though previous research has identified BVI users’ help-seeking situations in the desktop DL environment, sparse research has examined BVI users’ help-seeking situations in the mobile DL environment.”
Quote in the paperSubstantial claim - Premisecitation
BVI users have difficulty interacting with inaccessible pop-up windows.
“BVI users also have difficulty interacting with inaccessible pop-up windows. Alamri et al. [31] found that students felt trapped in pop-up windows that screen readers could not read, could not understand the goal of pop-up windows, and could not understand how to interact with those windows.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [31] Alamri, 2020, Arab online courses and the disabled: An automated and user-testing approach, Sci. J. King Faisal. Univ. Humanit. Manag. Sci.
Not checked in the free run.
- Interpretationown data
The situation of distinguishing collection labels from thumbnail descriptions arises because the design fails to separate the collection label from the thumbnail description.
“As illustrated by the participant, this situation arises because the design fails to separate the collection label from the thumbnail description.”
Quote in the paperSubstantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Interpretationreasoning
BVI users cannot visually differentiate between titles and thumbnail descriptions.
“BVI users cannot visually differentiate between titles and thumbnail descriptions.”
Quote in the paperSubstantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Interpretationcitation
On a mobile platform, visual interactions are likely more challenging due to the often condensed or cramped interface designs of DLs resulting from the small screen sizes of mobile devices.
“Furthermore, on a mobile platform (e.g., iOS or Android) that enables mobile devices to run applications [3], visual interactions are likely more challenging due to the often condensed or cramped interface designs of DLs resulting from the small screen sizes of mobile devices.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [3] Basole, 2011, On the evolution of mobile platform ecosystem structure and strategy, Bus. Inf. Syst. Eng. source
Not checked in the free run.
- Premisecitation
Some help-seeking situations are related to system structures, particularly layers and layouts, which are associated with visual interactions.
“Some help-seeking situations are related to system structures, particularly layers and layouts, which are associated with visual interactions.”
Quote in the paperSubstantial claim - Interpretationreasoning
The sight-centered and complex design of current DLs often leads BVI users who rely on screen readers to encounter help-seeking situations.
“However, the sight-centered and complex design of current DLs—such as layered navigation involving categories and collections and detailed metadata for individual items—often leads blind and visually impaired (BVI) users who rely on screen readers to encounter help-seeking situations.”
Quote in the paperSubstantial claim - Interpretationreasoning
Without clear and comprehensive labels that assist BVI users in understanding the functionality of video-related features, a challenging environment is created, preventing users from fully utilizing the feature and accessing video content.
“Therefore, without clear and comprehensive labels that assist BVI users in understanding the functionality of video-related features, a challenging environment is created, preventing users from fully utilizing the feature and accessing video content.”
Quote in the paperSubstantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
- Interpretationown data
ID10-AL had difficulty recognizing the content of the found poster due to a lack of descriptions and ALT text for images.
“ID10-AL had difficulty recognizing the content of the found poster due to a lack of descriptions and ALT text for images and a lack of guidance for using assistive features (e.g., the image recognition feature of VoiceOver on iOS devices, the image description features of TalkBack on Android devices).”
Quote in the paperSubstantial claim - Interpretationown data
ID10-AL had difficulty recognizing the content of the found poster due to a lack of guidance for using assistive features.
“ID10-AL had difficulty recognizing the content of the found poster due to a lack of descriptions and ALT text for images and a lack of guidance for using assistive features (e.g., the image recognition feature of VoiceOver on iOS devices, the image description features of TalkBack on Android devices).”
Quote in the paperNot a substantial claim - Premisecitation
BVI users often encounter challenges related to locating and accessing features/elements due to labeling issues (e.g., missing, improper, or inadequate labels) in mobile websites and applications.
“Specifically, BVI users often encounter challenges related to locating and accessing features/elements due to labeling issues (e.g., missing, improper, or inadequate labels) in mobile websites and applications [7,16,17,18,19,20,21,22].”
Quote in the paperSubstantial claim0 of 8 sources checked- cites [7] Carvalho, M.C.N., Dias, F.S., Reis, A.G.S., and Freire, A.P. (2018, January 9–13). Accessibility and usability problems encountered on websites and applications in mobile devices by blind and normal-vision users. Proceedings of the 33rd Annual ACM Symposium on Applied Computing, Pau, France. source
Not checked in the free run.
- cites [16] Alajarmeh, 2022, The extent of mobile accessibility coverage in WCAG 2.1: Sufficiency of success criteria and appropriateness of relevant conformance levels pertaining to accessibility problems encountered by users who are visually impaired, Univers. Access Inf. Soc. source
Not checked in the free run.
- cites [17] Mateus, D.A., Silva, C.A., Eler, M.M., and Freire, A.P. (2020, January 26–30). Accessibility of mobile applications: Evaluation by users with visual impairment and by automated tools. Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems, Diamantina, Brazil. source
Not checked in the free run.
- cites [18] Milne, L.R., Bennett, C.L., and Ladner, R.E. (2014, January 17–22). The accessibility of mobile health sensors for blind users. Proceedings of the International Technology and Persons with Disabilities Conference Scientific/Research Proceedings (CSUN 2014), San Diego, CA, USA.
Not checked in the free run.
- cites [19] Rodrigues, 2020, Open challenges of blind people using smartphones, Int. J. Hum. Comput. Interact. source
Not checked in the free run.
- cites [20] Ross, A.S., Zhang, X., Fogarty, J., and Wobbrock, J.O. (2018, January 22–24). Examining image-based button labeling for accessibility in android apps through large-scale analysis. Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility, Galway, Ireland. source
Not checked in the free run.
- cites [21] Wentz, B., Pham, D., and Tressler, K. (2017). Exploring the accessibility of banking and finance systems for blind users. First Monday, 22. source
Not checked in the free run.
- cites [22] Nair, A., Mathew, R., Mei, Z., Milallos, R., Chelladurai, P.K., and Oh, T. (2023, January 26–29). Investigating the user experience and challenges of food delivery applications for the blind and visually impaired. Proceedings of the 25th International Conference on Mobile Human-Computer Interaction, Athens, Greece. source
Not checked in the free run.
- Premisecitation
BVI users are likely to encounter help-seeking situations related to accessing the content of visual documents (e.g., images and graphs) due to a lack of alternative (ALT) text or descriptions or inconsistent ALT text.
“Moreover, BVI users are likely to encounter help-seeking situations related to accessing the content of visual documents (e.g., images and graphs). These situations occur mainly due to a lack of alternative (ALT) text or descriptions or inconsistent ALT text for visual documents [7,16,22,23,24,25].”
Quote in the paperSubstantial claim0 of 6 sources checked- cites [7] Carvalho, M.C.N., Dias, F.S., Reis, A.G.S., and Freire, A.P. (2018, January 9–13). Accessibility and usability problems encountered on websites and applications in mobile devices by blind and normal-vision users. Proceedings of the 33rd Annual ACM Symposium on Applied Computing, Pau, France. source
Not checked in the free run.
- cites [16] Alajarmeh, 2022, The extent of mobile accessibility coverage in WCAG 2.1: Sufficiency of success criteria and appropriateness of relevant conformance levels pertaining to accessibility problems encountered by users who are visually impaired, Univers. Access Inf. Soc. source
Not checked in the free run.
- cites [22] Nair, A., Mathew, R., Mei, Z., Milallos, R., Chelladurai, P.K., and Oh, T. (2023, January 26–29). Investigating the user experience and challenges of food delivery applications for the blind and visually impaired. Proceedings of the 25th International Conference on Mobile Human-Computer Interaction, Athens, Greece. source
Not checked in the free run.
- cites [23] Huh, M., Peng, Y.H., and Pavel, A. (November, January 29). GenAssist: Making image generation accessible. Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, San Francisco, CA, USA.
Not checked in the free run.
- cites [24] Morris, M.R., Johnson, J., Bennett, C.L., and Cutrell, E. (2018, January 21–26). Rich representations of visual content for screen reader users. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada. source
Not checked in the free run.
- cites [25] Wang, R., Chen, Z., Zhang, M.R., Li, Z., Liu, Z., Dang, Z., Yu, C., and Chen, X.A. (2021, January 8–13). Revamp: Enhancing accessible information seeking experience of online shopping for blind or low vision users. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan. source
Not checked in the free run.
- Premisereasoning
There is a gap in research on design recommendations for IR systems, such as DLs, in the mobile environment.
“Moreover, while previous research has investigated diverse aspects of design recommendations to provide a more accessible environment, there is a gap in research on design recommendations for IR systems, such as DLs, in the mobile environment.”
Quote in the paperSubstantial claim - Interpretationown data
Another factor causing challenges is the lack of guidance for image description options in mobile environments.
“Another factor is the lack of guidance for image description options in mobile environments.”
Quote in the paperSubstantial claim - Premisecitation
Mobile devices with touch interfaces may be difficult for BVI users to interact with due to the reliance on gestures and small, hidden icons and the lack of physical buttons, which limits tactile feedback.
“Mobile devices with touch interfaces may be difficult for BVI users to interact with due to the reliance on gestures and small, hidden icons and the lack of physical buttons, which limits tactile feedback [16,19].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [16] Alajarmeh, 2022, The extent of mobile accessibility coverage in WCAG 2.1: Sufficiency of success criteria and appropriateness of relevant conformance levels pertaining to accessibility problems encountered by users who are visually impaired, Univers. Access Inf. Soc. source
Not checked in the free run.
- cites [19] Rodrigues, 2020, Open challenges of blind people using smartphones, Int. J. Hum. Comput. Interact. source
Not checked in the free run.
- Premisecitation
This situation was also discovered in the context of online course platforms.
“This situation was also discovered in the context of online course platforms [31].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [31] Alamri, 2020, Arab online courses and the disabled: An automated and user-testing approach, Sci. J. King Faisal. Univ. Humanit. Manag. Sci.
Not checked in the free run.
- Interpretationreasoning
One of the key reasons for these challenges is the small screen size.
“One of the key reasons for these challenges is the small screen size.”
Quote in the paperNot a substantial claim - Interpretationreasoning
This situation could further complicate the overall search process as users are uncertain why their search did not work.
“This could further complicate the overall search process as users are uncertain why their search did not work.”
Quote in the paperNot a substantial claim - Premisecitation
Information resources that are graphically oriented often result in restricted access for BVI users.
“In effect, information resources that are graphically oriented often result in restricted access for BVI users [47].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [47] Siu, A.F. (2021). Advancing Access to Non-Visual Graphics: Haptic and Audio Representations of 3D Information and Data, Stanford University.
Not checked in the free run.
- Interpretationown data
One system factor causing challenges in obtaining graph details is a lack of context-specific descriptions.
“One of the system factors causing these challenges is a lack of context-specific descriptions.”
Quote in the paperSubstantial claim - Interpretationreasoning
The findings may not be fully generalizable.
“First, although the six DLs we selected represent diverse types of DLs in terms of their content domains (e.g., history, art, and science), formats (e.g., image, video, and mathematical formulas), and nature of hosting organizations (e.g., the federal government and non-profit organization), our findings may not be fully generalizable.”
Quote in the paperNot a substantial claim - Interpretationown data
The absence of constraints within pop-up windows caused the participant to have limited situational awareness.
“The absence of constraints within pop-up windows caused the participant to have limited situational awareness.”
Quote in the paperSubstantial claim - Interpretationreasoning
This situation reveals problems associated with two entities combined in a visual format without separation, perceivable by sighted users but not BVI users.
“It reveals problems associated with two entities combined in a visual format without separation, perceivable by sighted users but not BVI users.”
Quote in the paperSubstantial claim - Interpretationreasoning
These system factors lead BVI users to be confused or frustrated when they access specific types of visual documents, like graphs in DLs.
“These system factors lead BVI users to be confused or frustrated when they access specific types of visual documents, like graphs in DLs.”
Quote in the paperSubstantial claim
- May combine two claims. 24
- Classified as probably not a substantial claim. 25
May combine two claims.
Findingown dataThe content category accounted for 274 instances (about 34.8% of coded help-seeking situations), with 144 (52.6%) associated with visual interactions.
“The content category (n = 274) accounted for about 34.8% of the coded help-seeking situations instances, with 144 (52.6%) associated with visual interactions.”
Quote in the paperSubstantial claim- Rests on an assumption: The 120 recruited BVI participants are representative of BVI users who use mobile digital libraries.
- Rests on an assumption: The six selected digital libraries are representative of mobile digital libraries.
- Rests on an assumption: The four mobile device types (iPhone, iPad, Android phone, Android tablet) represent mobile platforms for BVI users.
- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
May combine two claims.
Findingown dataThe structure category accounted for 165 instances (about 20.94% of help situations), with only five instances (3.03%) associated with visual interactions.
“About 20.94% of the help situations are associated with the structure category (n = 165), with only five instances (3.03%) associated with visual interactions.”
Quote in the paperNot a substantial claim- Rests on an assumption: The 120 recruited BVI participants are representative of BVI users who use mobile digital libraries.
- Rests on an assumption: The six selected digital libraries are representative of mobile digital libraries.
- Rests on an assumption: The four mobile device types (iPhone, iPad, Android phone, Android tablet) represent mobile platforms for BVI users.
- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataAvailable tags for video-related features are meaningless and nonsensical without proper context, as they only consist of numbers and text.
“As mentioned by AP14-OL, the available tags are meaningless and nonsensical without proper context, as they only consist of numbers and text.”
Quote in the paperNot a substantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
May combine two claims.
Findingown dataAP15-LO was unable to grasp any specific information about the graph and could only access an overview of the graph.
“AP15-LO was unable to grasp any specific information about the graph and could only access an overview of the graph (Figure 10).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataALT text was inadequate to concisely convey information about important components of the poster.
“Meanwhile, the ALT text was inadequate to concisely convey information about important components of the poster.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAP15-LO could access alternative descriptions (metadata) within the same task, but it was still difficult to recognize the unique components of graphs, including legends and colors.
“Even though another participant, AP15-LO, could access alternative descriptions (metadata) within the same task, it was still difficult to recognize the unique components of graphs, including legends and colors.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataAT18-OL could not understand the graphs in the task because they lacked descriptions.
“While searching for the task-related items, he could not understand the graphs because they lacked descriptions (Figure 9).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataWithout appropriate labels of tabs to indicate their order, ID17-LO was confused about the tabs and had no clear idea of the overall structure of the paginated section.
“Without appropriate labels of these tabs to indicate their order (e.g., 1 out of 4 pages), ID17-LO was confused about the tabs and had no clear idea of the overall structure of the paginated section.”
Quote in the paperNot a substantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
May combine two claims.
Findingown dataIn one case, ID10-AL found a requested World War II poster on war dogs in 1943 but only heard the word "armed" from VoiceOver when trying to access its content, making it challenging for her to obtain a comprehensive understanding of the poster.
“For example, ID10-AL found the requested poster successfully when she was asked to find a World War II poster on war dogs in 1943 (Figure 8). However, she only heard the word “armed” from VoiceOver when trying to access the content of the found poster, making it challenging for her to obtain a comprehensive understanding of the content of the poster.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataID17-LO could tell that there were tabs in the paginated section and that the first tab was selected, but he was unable to determine what those tabs were in the "Feature Content" sections, which led to confusion about the functions of the tabs.
“According to ID17-LO, he could tell that there were tabs in the paginated section and that the first tab was selected. However, he was unable to determine what those tabs were in the “Feature Content” sections during the orientation task, which led to his confusion about the functions of the tabs.”
Quote in the paperNot a substantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
May combine two claims.
Findingown dataThe absence of clear and comprehensive labeling results in confusion and presents a challenge for the participant to predict how to utilize the features presented to him.
“The absence of clear and comprehensive labeling results in confusion and presents a challenge for the participant to predict how to utilize the features presented to him.”
Quote in the paperSubstantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
Classified as probably not a substantial claim.
Findingown dataAT24-ML found it hard to recognize the collection titles as the descriptions were narrated alongside the title without clear differentiation, leaving him guessing the title.
“However, while going through the list of collections, he found it hard to recognize the collection titles as the descriptions were narrated alongside the title without clear differentiation, leaving him guessing the title (Figure 7).”
Quote in the paperSubstantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
May combine two claims.
Findingown dataBoth iOS and Android offer image description options, such as VoiceOver recognition and automatic TalkBack descriptions, but some BVI users need assistance activating them in different applications and devices.
“Both iOS and Android offer image description options, such as VoiceOver recognition and automatic Talkback descriptions; nevertheless, some BVI users need assistance activating them in different applications and devices.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenThe toggle-based search feature is presented as an icon without an adequate label.
“For example, the toggle-based search feature is presented as an icon without an adequate label.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAP15-LO could obtain a description of the graph, but the explanation did not help her understand the graph.
“On the other hand, AP15-LO could obtain a description of the graph, but the explanation did not help her understand the graph.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAP7-LA interacted with an advanced search feature designed as a pop-up window; after selecting refinements, her screen reader focus navigated to the general search button without feedback, and she interacted with the search button outside the pop-up window, leading to results of a previous keyword search.
“However, her screen reader focus navigated to the general search button without any feedback notifying her of her position. Although she believed she was interacting with the search button at the bottom of the pop-up window, she was interacting with the search button outside of the pop-up window. This led her to the results of a previous keyword search (Figure 11).”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Findingnone givenDifficulty interacting with multilayered windows is associated with the existence of multiple windows that BVI users cannot detect and/or act upon.
“In terms of structure, difficulty interacting with multilayered windows is associated with the existence of multiple windows that BVI users cannot detect and/or act upon.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataAT18-OL added that TalkBack did not give full descriptions, so he had to skip the graphs as he could not obtain more information.
“AT18-OL added that Talkback did not give full descriptions, so he had to skip the graphs as he could not obtain more information.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThese visual cues are not accessible to users with visual impairments, making it difficult for them to understand how to use these features.
“However, these cues are not accessible to users with visual impairments, making it difficult for them to understand how to use these features.”
Quote in the paperSubstantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
May combine two claims.
PremisereasoningGraphs rely on various visual cues (e.g., color, shape, and position) to convey information, which makes it difficult for BVI users to understand their content with the screen reader.
“Moreover, graphs rely on various visual cues (e.g., color, shape, and position) to convey information, which makes it difficult for BVI users to understand their content with the screen reader.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningVisual interactions can be more challenging for BVI users because they may require more detailed text-based descriptions, the use of advanced screen reader features, or other assistive technologies.
“These interactions can be more challenging for BVI users because they may require more detailed text-based descriptions, the use of advanced screen reader features (e.g., image description and screen recognition), or other assistive technologies (e.g., braille displays).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenMultiple sessions of group discussions were held to scrutinize the identified help-seeking situations and associated design recommendations.
“Multiple sessions of group discussions were held to scrutinize the identified help-seeking situations and associated design recommendations.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationOnly the authors' prior pilot study reported help-seeking situations faced by BVI users in their interactions with DLs, but that study only involved one DL and used one device type.
“Only our prior pilot study [2] reported help-seeking situations faced by BVI users in their interactions with DLs, but that study only involved one DL and used one device type.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [2] Xie, I., Wang, S., Lee, T.H., and Lee, H.S. (2023). Blind and visually impaired users’ interactions with digital libraries: Help-seeking situations in mobile and desktop environments. Int. J. Hum. Comput. Interact., 1–19. source
Not checked in the free run.
May combine two claims.
Study design and conductown dataInter-coder reliability was 0.81 based on Krippendorff's Alpha, indicating a good level of agreement among coders.
“Inter-coder reliability was 0.81 based on Krippendorff’s Alpha [45,46], indicating a good level of agreement among coders.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [45] Krippendorff, 2004, Reliability in content analysis: Some common misconceptions and recommendations, Hum. Commun. Res.
Not checked in the free run.
- cites [46] Marzi, 2024, K-Alpha Calculator—Krippendorff’s Alpha Calculator: A user-friendly tool for computing Krippendorff’s Alpha inter-rater reliability coefficient, MethodsX source
Not checked in the free run.
May combine two claims.
Interpretationown dataThe toggle-based search situation arises from inappropriate labeling and a lack of intuitive design in the feature.
“This situation arises from inappropriate labeling and a lack of intuitive design in the feature.”
Quote in the paperSubstantial claim- Rests on an assumption: Participants' think-aloud reports accurately reflect their help-seeking situations.
Probably not a substantial claim: may not pass S2 (checkable).
PremisereasoningThere is a need for further research to examine typical and unique help-seeking situations across diverse mobile platforms.
“Although these studies provided useful insights about improving accessibility and usability of IR systems, including DLs, for BVI users, there is a need for further research to examine typical and unique help-seeking situations across diverse mobile platforms.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisereasoningGraphs need more detailed descriptions than other types of visual items, such as images and videos, because they contain complex, multi-dimensional information such as points, trends, and axes.
“Graphs need more detailed descriptions than other types of visual items, such as images and videos, since they contain complex, multi-dimensional information such as points, trends, and axes.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningThe study was approved by the Institutional Review Board.
“Since the study involved BVI users as a group of vulnerable participants, approval was sought and granted by the Institutional Review Board.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Interpretationnone givenThis study specifies the help-seeking situations related to images and graphs in the context of DLs.
“This study specifies the help-seeking situations related to images and graphs in the context of DLs.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Premisenone givenIn addition to short ALT text, DLs typically also provide metadata for images and graphs, which can provide more detailed information than ALT text.
“In addition to short ALT text, DLs typically also provide metadata for images and graphs, which can provide more detailed information than ALT text.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
InterpretationreasoningThis problem is devastating for BVI users because they need assistance before they can move forward.
“This problem is devastating for BVI users because they need assistance before they can move forward.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThe discovery of these situations is the first step for researchers to understand the ways in which designs hinder BVI users' visual interactions with DLs and other systems.
“The discovery of these situations is the first step for researchers to understand the ways in which designs hinder BVI users’ visual interactions with DLs and other systems.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Premisenone givenMobile and tablet devices generally have smaller screens, which can lead to the limited input and interaction capabilities of mobile phones and tablets.
“Mobile and tablet devices generally have smaller screens, which can lead to the limited input and interaction capabilities of mobile phones and tablets.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningEven though the situations were identified from the DL context, they could also occur in other systems or applications.
“Even though the situations were identified from the DL context, they could also occur in other systems or applications.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenCompared with images, it is more difficult for BVI users to recognize the content of graphs because of their diverse formats and domains.
“Compared with images, it is more difficult for BVI users to recognize the content of graphs because of their diverse formats and domains.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationMobile screen readers, such as VoiceOver and TalkBack, have image description features, but BVI users may not be aware of them.
“Moreover, mobile screen readers, such as VoiceOver and TalkBack, have image description features [6,19], but BVI users may not be aware of them.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [6] Abraham, 2022, Smartphone usage among people living with severe visual impairment and blindness, Assist. Technol. source
Not checked in the free run.
- cites [19] Rodrigues, 2020, Open challenges of blind people using smartphones, Int. J. Hum. Comput. Interact. source
Not checked in the free run.
May combine two claims.
PremisecitationIn both DLs and online course platforms, BVI users could not interact with pop-up windows; instead, their foci were still on their original windows.
“In both contexts, BVI users could not interact with pop-up windows. Instead, their foci were still on their original windows.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [31] Alamri, 2020, Arab online courses and the disabled: An automated and user-testing approach, Sci. J. King Faisal. Univ. Humanit. Manag. Sci.
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
Interpretationnone givenCompared with other icon-based features/elements, video features are more complicated and dynamic.
“For example, compared with other icon-based features/elements, video features are more complicated and dynamic.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Study design and conductnone givenThe online data collection method using virtual conferencing tools might have hindered the natural interactions of BVI users with DLs.
“Second, the online data collection method using virtual conferencing tools, which allowed us to reach a wide range of BVI users across the nation, might have hindered the natural interactions of BVI users with DLs.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataWhile prior research focused more on BVI users' problems in understanding the overall structure, this study specifically highlights difficulty interacting with multilayered windows in DLs.
“While prior research focused more on BVI users’ problems in understanding the overall structure, this study specifically highlights difficulty interacting with multilayered windows in DLs.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenSome websites are not appropriately optimized to display properly on smaller screens, leading to poor user experience.
“Also, some websites are not appropriately optimized to display properly on smaller screens, leading to poor user experience.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe uniqueness of visual content situations lies in the metadata of DLs and mobile screen readers' image description features.
“Nevertheless, the uniqueness lies in the metadata of DLs and mobile screen readers’ image description features.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe lack of constraints designed for screen readers' interaction with pop-up windows allowed this situation to occur, leading the participant to misunderstand her current situation.
“The lack of constraints designed for screen readers’ interaction with pop-up windows allowed this situation to occur, leading the participant to misunderstand her current situation.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenHelp-seeking situations related to visual content are not unique in the mobile environment.
“Second, help-seeking situations related to visual content are not unique in the mobile environment.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningIt sets up the foundations for researchers and practitioners to further enhance DL design and other systems to support BVI users.
“It sets up the foundations for researchers and practitioners to further enhance DL design and other systems to support BVI users.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
The 120 recruited BVI participants are representative of BVI users who use mobile digital libraries.
“The study recruited 120 BVI participants across the United States, with 30 in each of 4 groups representing different types of mobile devices (iPhone, iPad, Android phone, and Android tablet).”
The paper relies on this without support.
The six selected digital libraries are representative of mobile digital libraries.
“Six DLs were selected for the study based on their diverse domains (e.g., history, art, science, and museum collections), diverse formats (e.g., text, image, video, and mathematical formulas), diverse types of hosting organizations, and different DL types (e.g., stand-alone, federated).”
The paper relies on this without support.
The four mobile device types (iPhone, iPad, Android phone, Android tablet) represent mobile platforms for BVI users.
“The study recruited 120 BVI participants across the United States, with 30 in each of 4 groups representing different types of mobile devices (iPhone, iPad, Android phone, and Android tablet).”
The paper relies on this without support.
Participants' think-aloud reports accurately reflect their help-seeking situations.
“Third, think-aloud protocols were used when participants worked on the tasks. Specifically, they were instructed to talk continuously about their thoughts and actions in relation to their interactions with each DL, specifying their intentions for their actions, the problems they encountered, and their solutions.”
The paper relies on this without support.
The proposed design recommendations will improve accessibility for BVI users.
“Moreover, corresponding design recommendations are also proposed: placing meaningful labels for icon-based features in an easy-to-access location, offering intuitive and informative video descriptions for video players, providing structure information about a paginated section, separating collection/item titles from thumbnail descriptions, incorporating artificial intelligence image/graph recogn”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
None of the universities examined had publicly documented the use of accessibility-focused AI systems or tools.
“Despite widespread recognition of AI's potential to assist with alt text generation [42], content remediation and real-time accessibility insights [5], and scientific visualizations accessibility [5,64], none of the universities examined had publicly documented the use of accessibility-focused AI systems or tools.”
From Toward universal access to information: an analysis of digital accessibility policy readiness in U.S. public universities (2026) · cites this paper as [5]
The citation to this paper is attached to the sentence’s earlier point about scientific-visualization accessibility, not to the quoted finding about universities. The paper’s Discussion (5.2, page unavailable) describes AI tools that can make diagrams accessible, but the passages examined do not report an audit of universities or their public documentation of accessibility-focused AI. Searched for universities examined and publicly documented AI use. (LLM, conf=0.78)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Participant ID example does not match the stated code list
MinorThe stated two-letter suffixes include DL but not LD. The example nevertheless uses LD for a participant assigned to the Library of Congress and DPLA.
“ends with two letters (AL, DL, HL, ML, OL) representing the abbreviations of two DLs assigned to the participant.”
“For example, IP5-LD indicates that the participant is in the iPhone group (IP), has the subject number 5 within the group, and has been assigned to the Library of Congress and DPLA (LD).”
Cites
Reliability in content analysis: some common misconceptions and recommendations.
Krippendorff, K. (2004) · Human Communication Research · doi:10.1093/hcr/30.3.411 · Cited by 1,027 · see citing works
Marzi, G., Balzano, M., & Marchiori, D. (2024) · MethodsX · doi:10.1016/j.mex.2023.102545 · Cited by 292 · see citing works
(2017) · doi:10.1145/2998181.2998364 · Cited by 258 · see citing works
On the evolution of mobile platform ecosystem structure and strategy
Basole, R. C., & Karla, J. (2011) · Business & Information Systems Engineering · doi:10.1007/s12599-011-0174-4 · Cited by 192 · see citing works
Rich Representations of Visual Content for Screen Reader Users
Morris, M. R., Johnson, J., Bennett, C. L., & Cutrell, E. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173633 · Cited by 159 · see citing works
Learning non-visual graphical information using a touch-based vibro-audio interface
Giudice, N. A., Palani, H. P., Brenner, E., & Kramer, K. M. (2012) · Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/2384916.2384935 · Cited by 133 · see citing works
Bennett, C. L., Gleason, C., Scheuerman, M. K., Bigham, J. P., Guo, A., & To, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445498 · Cited by 128 · see citing works
Twitter A11y: A Browser Extension to Make Twitter Images Accessible
Gleason, C., Pavel, A., McCamey, E., Low, C., Carrington, P., Kitani, K., & Bigham, J. P. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376728 · Cited by 123 · see citing works
Caption Crawler: Enabling Reusable Alternative Text Descriptions using Reverse Image Search
Guinness, D., Cutrell, E., & Morris, M. R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174092 · Cited by 108 · see citing works
Examining Image-Based Button Labeling for Accessibility in Android Apps through Large-Scale Analysis
Ross, A. S., Zhang, X., Fogarty, J., & Wobbrock, J. O. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236364 · Cited by 90 · see citing works
Kim, H. K., Han, S. H., Park, J., & Park, J. (2016) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2016.07.002 · Cited by 80 · see citing works
Coping tactics employed by visually disabled users on the web
Vigo, M., & Harper, S. (2013) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2013.08.002 · Cited by 75 · see citing works
Carvalho, M. C. N., Dias, F. S., Reis, A. G. S., & Freire, A. P. (2018) · Proceedings of the 33rd Annual ACM Symposium on Applied Computing · doi:10.1145/3167132.3167349 · Cited by 75 · see citing works
The grammar of emoji? Constraints on communicative pictorial sequencing
Cohn, N., Engelen, J. A. A., & Schilperoord, J. (2019) · Cognitive Research Principles and Implications · doi:10.1186/s41235-019-0177-0 · Cited by 70 · see citing works
GenAssist: Making Image Generation Accessible
Huh, M., Peng, Y.-H., & Pavel, A. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606735 · Cited by 67 · see citing works
Zaina, L. A. M., Fortes, R. P. D. M., Casadei, V., Nozaki, L. S., & Paiva, D. M. B. (2022) · Journal of Systems and Software · doi:10.1016/j.jss.2021.111213 · Cited by 56 · see citing works
Open Challenges of Blind People Using Smartphones
Rodrigues, A., Nicolau, H., Montague, K., Guerreiro, J., & Guerreiro, T. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1768672 · Cited by 53 · see citing works
Mateus, D. A., Silva, C. A., Eler, M. M., & Freire, A. P. (2020) · Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems · doi:10.1145/3424953.3426633 · Cited by 51 · see citing works
Smartphone usage among people living with severe visual impairment and blindness
Abraham, C. H., Boadi-Kusi, B., Morny, E. K. A., & Agyekum, P. (2022) · Assistive Technology · doi:10.1080/10400435.2021.1907485 · Cited by 49 · see citing works
Alajarmeh, N. (2022) · Universal Access in the Information Society · doi:10.1007/s10209-020-00785-w · Cited by 44 · see citing works
Engel, C., Müller, E. F., & Weber, G. (2019) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3316782.3316793 · Cited by 43 · see citing works
Wang, R., Chen, Z., Zhang, M. R., Li, Z., Liu, Z., Dang, Z., Yu, C., & Chen, X. '. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445547 · Cited by 42 · see citing works
Smartphone Usage by Expert Blind Users
Jain, M., Diwakar, N., & Swaminathan, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445074 · Cited by 41 · see citing works
Radcliffe, E. M., Lippincott, B., Anderson, R. K., & Jones, M. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18073669 · Cited by 33 · see citing works
Design Patterns and Trade‐Offs in Responsive Visualization for Communication
Kim, H., Moritz, D., & Hullman, J. R. (2021) · Computer Graphics Forum · doi:10.1111/cgf.14321 · Cited by 30 · see citing works
Exploring the accessibility of banking and finance systems for blind users
Wentz, B., Pham, D. (., & Tressler, K. (2017) · First Monday · doi:10.5210/fm.v22i3.7036 · Cited by 26 · see citing works
A Large-Scale Longitudinal Analysis of Missing Label Accessibility Failures in Android Apps
Fok, R., Zhong, M., Ross, A. S., Fogarty, J. A., & Wobbrock, J. O. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502143 · Cited by 26 · see citing works
Xie, I., Babu, R., Castillo, M. D., & Han, H. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23982 · Cited by 25 · see citing works
Self-citationThe Accessibility of Mobile Health Sensors for Blind Users
Milne, L. R., Bennett, C. L., & Ladner, R. E. (2014) · CSUN ScholarWorks (California State University, Northridge) · Cited by 19 · see citing works
Xie, I., Babu, R., Lee, H. S., Wang, S., & Lee, T.-H. (2021) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24469 · Cited by 16 · see citing works
Self-citationThe accessibility and usage of smartphones by Arab-speaking visually impaired people
Al-Mouh, N. A., & Al-Khalifa, H. S. (2015) · International Journal of Pervasive Computing and Communications · doi:10.1108/ijpcc-09-2015-0033 · Cited by 14 · see citing works
Tiwary, T., & Mahapatra, R. P. (2022) · 2022 3rd International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT) · doi:10.1109/icict55121.2022.10064545 · Cited by 12 · see citing works
Accessible images (AIMS): a model to build self-describing images for assisting screen reader users
Nengroo, A. S., & Kuppusamy, K. S. (2017) · Universal Access in the Information Society · doi:10.1007/s10209-017-0607-z · Cited by 12 · see citing works
Xie, I., Lee, T.-H., Lee, H. S., Wang, S., & Babu, R. (2023) · Information Research · doi:10.47989/ir283337 · Cited by 12 · see citing works
Self-citationXie, I., Wang, S., Lee, T. H., & Lee, H. S. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2023.2260673 · Cited by 11 · see citing works
Self-citationAutomatic Role Detection of Visual Elements of Web Pages for Automatic Accessibility Evaluation
Duarte, C., Salvado, A., Akpınar, E., Yeşilada, Y., & Carriço, L. M. (2018) · International Web for All Conference (W4A) · doi:10.1145/3192714.3196827 · Cited by 11 · see citing works
μGraph: Haptic Exploration and Editing of 3D Chemical Diagrams
Bernareggi, C., Ahmetovic, D., & Mascetti, S. (2019) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3308561.3353811 · Cited by 11 · see citing works
Xie, I., Babu, R., Lee, T.-H., Wang, S., & Lee, H. S. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102612 · Cited by 10 · see citing works
Self-citationTowards Enhancing Blind Users' Interaction Experience with Online Videos via Motion Gestures
Lee, H.-N., & Ashok, V. G. (2021) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/3465336.3475116 · Cited by 7 · see citing works
Self-citationSystem of Recommendation and Automatic Correction of Web Accessibility Using Artificial Intelligence
Morillo, P., Chicaiza-Herrera, D., & Vallejo-Huanga, D. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-19135-1_46 · Cited by 7 · see citing works
Nair, A., Mathew, R., Mei, Z., Milallos, R., Chelladurai, P. K., & Oh, T. (2023) · Proceedings of the 25th International Conference on Mobile Human-Computer Interaction · doi:10.1145/3565066.3608688 · Cited by 5 · see citing works
Arab Online Courses and the Disabled: An Automated and User-Testing Approach
Alamri, J. M., Barashi, W., Alsulami, R., AlHarigy, L., Shuaib, B., Hariri, S., Alsomahi, A., Alamoudi, D., & Barri, R. (2021) · Scientific Journal of King Faisal University Humanities and Management Sciences · doi:10.37575/h/edu/210067 · Cited by 2 · see citing works
Grapho: Bringing line chart accessibility to the visually impaired
Singh, A. K., & Joshi, A. N. (2022) · doi:10.1145/3570211.3570213 · Cited by 2 · see citing works
PDF/UA Structure Elements and the User Experience
McCall, K. (2017) · John Spoor Broome Library Institutional Repository (California State University) · Cited by 2 · see citing works
Hovious, A., & Wang, C. (2024) · Information Technology and Libraries · doi:10.5860/ital.v43i1.16661 · Cited by 2 · see citing works
LIP: Lightweight Intelligent Preprocessor for meaningful text-to-speech
Anand, H., Begam, N., Verma, R., Ghosh, S. K., Harichandana, B. S. S., & Kumar, S. (2022) · IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT) · doi:10.1109/conecct55679.2022.9865708 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- Xie, I., and Matusiak, K. (2016). Discover Digital Libraries: Theory and Practice, Elsevier.
- Ara, J., and Sik-Lanyi, C. (2022, January 5–6). Artificial intelligence in web accessibility: Potentials and possible challenges. Proceedings of the IAC, Vienna, Austria.
- Wentzell, 2022, How can AccessiBe’s ADHD-friendly profile, content and color adjustments improve reading and comprehension for Philadelphia college students with ADHD?, J. Comput. Sci. Coll., 38, 203
Cited by
Sorted by citations
Singh, P., Sverdlov, O., Beckman, R. A., & Burden, A. M. (2025) · Clinical and Translational Science · doi:10.1111/cts.70241 · Cited by 5 · see citing works
Audo-Sight: Enabling Ambient Interaction for Blind and Visually Impaired Individuals
Ainary, B. (2025) · doi:10.12794/metadc2443352 · Cited by 2 · see citing works
Nayak, A. K., Prakash, Y., Jayarathna, S., Lee, H.-N., & Ashok, V. G. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791509 · Cited by 2 · see citing works
Self-citationCudjoe, E. K., & Asilevi, P. A. (2026) · Universal Access in the Information Society · doi:10.1007/s10209-026-01379-8
Self-citationCudjoe, E. K., Asilevi, P. A., Dahunsi, O., & Adams, M. (2026) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2026.103293
Self-citationBlind and visually impaired users’ acceptance of digital libraries in the mobile environment
Xie, I., Choi, W., Hong, B. H., Cudjoe, E. K., Acheampong, E., & Wang, S. (2026) · Journal of Librarianship and Information Science · doi:10.1177/09610006261461293
Self-citationOkuonghae, O. (2026) · Digital Library Perspectives · doi:10.1108/dlp-01-2026-0015
Salous, M., Woźniak, M. P., von Reeken, T., Kramer, M., Heuten, W., Boll, S., & Abdenebaoui, L. (2026) · International Conference on Conversational User Interfaces · doi:10.1145/3816046.3816207 · Cited by 1 · see citing works
- Authors
- Xie, I., Choi, W., Wang, S., Lee, H. S., Hong, B. H., Wang, N.-C., & Cudjoe, E. K.
- Affiliations
- University of Wisconsin–Milwaukee (US)
- Corresponding author
- Xie, Iris
- ORCID
- Venue
- Journal of Imaging
- Publisher
- MDPI AG
- Published
- 2024-08-22
- Volume
- 10
- Issue
- 8
- Pages
- 205
- ISSN
- 2313-433X (ISSN-L)
- PMC
- PMC11355365
- OpenAlex
- W4401793025
- Semantic Scholar
- 713c6ddf3fc7bf3889a1d2e23f776e6ca2871642
- Cited by
- 8
- References
- 46
- Citations by year
- 2026: 6 · 2025: 2
- FWCI
- 16.73
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Journal of Imaging (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Institute of Museum and Library Services (LG-252289-OLS-22)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- blind and visually impaired users, mobile accessibility, digital libraries, information retrieval, visual interaction, screen readers, assistive technology, design guidelines, audio description, mobile devices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review