CoChat
Sign Up
PreprintCited by 151Data Visualization and AnalyticsInformation Retrieval and Search BehaviorUsability and User Interface Design

Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Models

Open access
Suh, Sangho, Min, Bryan, Palani, Srishti, Xia, Haijun·2023·arXiv
DOI 10.48550/arxiv.2305.11483arXiv 2305.11483
Open this paper in CoChat — free accountOpen PDF

Abstract

People are increasingly turning to large language models (LLMs) for complex information tasks like academic research or planning a move to another city. However, while they often require working in a nonlinear manner -- e.g., to arrange information spatially to organize and make sense of it, current interfaces for interacting with LLMs are generally linear to support conversational interaction. To address this limitation and explore how we can support LLM-powered exploration and sensemaking, we developed Sensecape, an interactive system designed to support complex information tasks with an LLM by enabling users to (1) manage the complexity of information through multilevel abstraction and (2) seamlessly switch between foraging and sensemaking. Our within-subject user study reveals that Sensecape empowers users to explore more topics and structure their knowledge hierarchically, thanks to the externalization of levels of abstraction. We contribute implications for LLM-based workflows and interfaces for information tasks.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2305.11483

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 61

  1. Michal Armoni. 2013. On teaching abstraction in CS to novices. Journal of Computers in Mathematics and Science Teaching 32, 3 (2013), 265-284.
  2. Ricardo A Baeza-Yates, Carlos A Hurtado, Marcelo Mendoza, et al. 2004. Query Recommendation Using Query Logs in Search Engines.. In EDBT workshops, Vol. 3268. Springer, 588-596. https://doi.org/10.1007/978-3-540-30192-9_58 · DOI
  3. Joseph M Ballay. 1994. Designing Workscape: an interdisciplinary experience. In Proceedings of the SIGCHI conference on Human factors in computing systems. 10-15. https://doi.org/10.1145/191666.191676 · DOI
  4. Benjamin B Bederson and James D Hollan. 1994. Pad++ a zooming graphical interface for exploring alternate interface physics. In Proceedings of the 7th annual ACM symposium on User interface software and technology. 17-26. https://doi. org/10.1145/192426.192435 · DOI
  5. David Benyon. 2001. The new HCI? Navigation of information space. Knowledge- based systems 14, 8 (2001), 425-430. https://doi.org/10.1016/S0950-7051(01)00135- 6 · DOI
  6. Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, et al. 2023. Sparks of Artifcial General Intelligence: Early experiments with GPT-4. arXiv preprint arXiv:2303.12712 (2023). https://doi.org/10.48550/arXiv.2303.12712 · DOI · Paper page
  7. John M Budd. 2004. Relevance: Language, semantics, philosophy. (2004). http: //hdl.handle.net/2142/1678
  8. Robert Capra, Gary Marchionini, Javier Velasco-Martin, and Katrina Muller. 2010. Tools-at-hand and learning in multi-session, collaborative search. In Proceedings of the SIGCHI conference on human factors in computing systems. 951-960. https: //doi.org/10.1145/1753326.1753468 · DOI
  9. Stuart K Card, George G Robertson, and Jock D Mackinlay. 1991. The information visualizer, an information workspace. In Proceedings of the SIGCHI Conference on Human factors in computing systems. 181-186. https://doi.org/10.1145/108844. 108874 · DOI
  10. Stuart K Card, George G Robertson, and William York. 1996. The WebBook and the Web Forager: an information workspace for the World-Wide Web. In Proceedings of the SIGCHI conference on Human factors in computing systems. 111-f. https://doi.org/10.1145/238386.238446 · DOI
  11. Joseph Chee Chang, Nathan Hahn, Adam Perer, and Aniket Kittur. 2019. Search- Lens: Composing and capturing complex user interests for exploratory search. In Proceedings of the 24th International Conference on Intelligent User Interfaces. 498-509. https://doi.org/10.1145/3301275.3302321 · DOI
  12. Andy Cockburn and Bruce McKenzie. 2000. An evaluation of cone trees. In People and Computers XIV-Usability or Else! Proceedings of HCI 2000. Springer, 425-436. https://doi.org/10.1007/978-1-4471-0515-2_28 · DOI
  13. Andy Cockburn and Bruce McKenzie. 2002. Evaluating the efectiveness of spatial memory in 2D and 3D physical and virtual environments. In Proceedings of the SIGCHI conference on Human factors in computing systems. 203-210. https: //doi.org/10.1145/503376.503413 · DOI
  14. Anita Crescenzi, Yuan Li, Yinglong Zhang, and Rob Capra. 2019. Towards Better Support for Exploratory Search through an Investigation of Notes-to-self and Notes-to-share. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1093-1096. https://doi.org/ 10.1145/3331184.3331309 · DOI
  15. Anita Crescenzi, Austin R Ward, Yuan Li, and Rob Capra. 2021. Supporting metacognition during exploratory search with the OrgBox. In Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval. 1197-1207. https://doi.org/10.1145/3404835.3462955 · DOI · Paper page
  16. Douglass R Cutting, David R Karger, Jan O Pedersen, and John W Tukey. 2017. Scatter/gather: A cluster-based approach to browsing large document collections. In ACM SIGIR Forum, Vol. 51. ACM New York, NY, USA, 148-159. https://doi. org/10.1145/133160.133214 · DOI
  17. Andrew S Denney and Richard Tewksbury. 2013. How to write a literature review. Journal of criminal justice education 24, 2 (2013), 218-234. https://doi.org/10. 1080/10511253.2012.730617 · DOI
  18. Susan Dumais, Edward Cutrell, Jonathan J Cadiz, Gavin Jancke, Raman Sarin, and Daniel C Robbins. 2003. Stuf I've seen: a system for personal information retrieval and re-use. In Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval. 72-79. https: //doi.org/10.1145/860435.860451 · DOI
  19. Kim M Fairchild, Steven E Poltrock, and George W Furnas. 2013. Semnet: Three- dimensional graphic representations of large knowledge bases. In Cognitive science and its applications for human-computer interaction. Psychology Press, 215-248.
  20. Nigel Ford. 1999. Information retrieval and creativity: towards support for the original thinker. Journal of Documentation 55, 5 (1999), 528-542. https: //doi.org/10.1108/EUM0000000007156 · DOI
  21. Allen Foster and Nigel Ford. 2003. Serendipity and information seeking: an empirical study. Journal of documentation 59, 3 (2003), 321-340. https://doi.org/ 10.1108/00220410310472518 · DOI
  22. Marti A Hearst. 1992. Automatic acquisition of hyponyms from large text corpora. In COLING 1992 Volume 2: The 14th International Conference on Computational Linguistics. https://doi.org/10.3115/992133.992154 · DOI
  23. Marti A Hearst. 2006. Clustering versus faceted categories for information exploration. Commun. ACM 49, 4 (2006), 59-61. https://doi.org/10.1145/1121949. 1121983 · DOI
  24. Sarah Henderson. 2009. Personal document management strategies. In Proceed- ings of the 10th International Conference NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction. 69-76. https://doi.org/10.1145/1577782. 1577795 · DOI
  25. D Austin Henderson Jr and Stuart Card. 1986. Rooms: the use of multiple virtual workspaces to reduce space contention in a window-based graphical user interface. ACM Transactions on Graphics (TOG) 5, 3 (1986), 211-243. https://doi.org/10.1145/24054.24056 · DOI
  26. Ken Hinckley, Shengdong Zhao, Raman Sarin, Patrick Baudisch, Edward Cutrell, Michael Shilman, and Desney Tan. 2007. InkSeine: In Situ search for active note taking. In Proceedings of the SIGCHI conference on human factors in computing systems. 251-260. https://doi.org/10.1145/1240624.1240666 · DOI
  27. Janellen Huttenlocher and Clark C Presson. 1973. Mental rotation and the perspective problem. Cognitive Psychology 4, 2 (1973), 277-299. https://doi.org/ 10.1016/0010-0285(73)90015-7 · DOI
  28. William P Jones and Susan T Dumais. 1986. The spatial metaphor for user inter- faces: experimental tests of reference by location versus name. ACM Transactions on Information Systems (TOIS) 4, 1 (1986), 42-63. https://doi.org/10.1145/5401.5405 · DOI
  29. David Kirsh. 2001. The context of work. Human-Computer Interaction 16, 2-4 (2001), 305-322. https://interactivity.ucsd.edu/articles/HCI/fnal.html
  30. Jefrey W Knopf. 2006. Doing a literature review. PS: Political Science & Politics 39, 1 (2006), 127-132. https://doi.org/10.1017/S1049096506060264 · DOI
  31. Andrew Kuznetsov, Joseph Chee Chang, Nathan Hahn, Napol Rachatasum- rit, Bradley Breneisen, Julina Coupland, and Aniket Kittur. 2022. Fuse: In- Situ Sensemaking Support in the Browser. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1-15. https: //doi.org/10.1145/3526113.3545693 · DOI
  32. Thomas W Malone. 1983. How do people organize their desks? Implications for the design of ofce information systems. ACM Transactions on Information Systems (TOIS) 1, 1 (1983), 99-112.
  33. Gary Marchionini. 2006. Exploratory search: from fnding to understanding. Commun. ACM 49, 4 (2006), 41-46. https://doi.org/10.1145/1121949.1121979 · DOI · Paper page
  34. André N Meyer, Thomas Fritz, Gail C Murphy, and Thomas Zimmermann. 2014. Software developers' perceptions of productivity. In Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering. 19-29. https://doi.org/10.1145/2635868.2635892 · DOI · Paper page
  35. Naomi Miyake and Donald A Norman. 1979. To ask a question, one must know enough to know what is not known. Journal of verbal learning and verbal behavior 18, 3 (1979), 357-364. https://doi.org/10.1016/S0022-5371(79)90200-7 · DOI
  36. Dan Morris, Meredith Ringel Morris, and Gina Venolia. 2008. SearchBar: a search-centric web history for task resumption and information re-fnding. In Proceedings of the SIGCHI conference on human factors in computing systems. 1207-1216. https://doi.org/10.1145/1357054.1357242 · DOI
  37. Meredith Ringel Morris. 2013. Collaborative search revisited. In Proceedings of the 2013 conference on Computer supported cooperative work. 1181-1192. https: //doi.org/10.1145/2441776.2441910 · DOI
  38. Kay Owens. 2014. Visuospatial reasoning: An ecocultural perspective for space, geometry and measurement education. Vol. 111. Springer. https://doi.org/10.1007/ 978-3-319-02463-9_10 · DOI
  39. Srishti Palani, Zijian Ding, Austin Nguyen, Andrew Chuang, Stephen MacNeil, and Steven P Dow. 2021. CoNotate: Suggesting Queries Based on Notes Promotes Knowledge Discovery. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1-14. https://doi.org/10.1145/3411764.3445618 · DOI
  40. Srishti Palani, Yingyi Zhou, Sheldon Zhu, and Steven P Dow. 2022. InterWeave: Presenting Search Suggestions in Context Scafolds Information Search and Synthesis. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1-16. https://doi.org/10.1145/3526113.3545696 · DOI
  41. Peter Pirolli and Stuart Card. 2005. The sensemaking process and leverage points for analyst technology as identifed through cognitive task analysis. In Proceedings of international conference on intelligence analysis, Vol. 5. McLean, VA, USA, 2-4.
  42. Dimitri Popolov, Michael Callaghan, and Paul Luker. 2000. Conversation space: Visualising multi-threaded conversation. In Proceedings of the working conference on Advanced visual interfaces. 246-249. https://doi.org/10.1145/345513.345330 · DOI
  43. Napol Rachatasumrit, Gonzalo Ramos, Jina Suh, Rachel Ng, and Christopher Meek. 2021. ForSense: Accelerating Online Research Through Sensemaking Integration and Machine Research Support. In 26th International Conference on Intelligent User Interfaces. 608-618. https://doi.org/10.1145/3532853 · DOI
  44. Ehud Rivlin, Rodrigo Botafogo, and Ben Shneiderman. 1994. Navigating in hyperspace: designing a structure-based toolbox. Commun. ACM 37, 2 (1994), 87-97. https://doi.org/10.1145/175235.175242 · DOI
  45. George Robertson, Mary Czerwinski, Kevin Larson, Daniel C Robbins, David Thiel, and Maarten Van Dantzich. 1998. Data mountain: using spatial memory for document management. In Proceedings of the 11th annual ACM symposium on User interface software and technology. 153-162. https://doi.org/10.1145/288392.288596 · DOI
  46. Corbin Rosset, Chenyan Xiong, Xia Song, Daniel Campos, Nick Craswell, Saurabh Tiwary, and Paul Bennett. 2020. Leading conversational search by suggesting useful questions. In Proceedings of the web conference 2020. 1160-1170. https: //doi.org/10.1145/3366423.3380193 · DOI
  47. Nirmal Roy, Manuel Valle Torre, Ujwal Gadiraju, David Maxwell, and Claudia Hauf. 2021. Note the highlight: incorporating active reading tools in a search as learning environment. In Proceedings of the 2021 conference on human information interaction and retrieval. 229-238. https://doi.org/10.1145/3406522.3446025 · DOI
  48. Daniel M Russell, Mark J Stefk, Peter Pirolli, and Stuart K Card. 1993. The cost structure of sensemaking. In Proceedings of the INTERACT'93 and CHI'93 conference on Human factors in computing systems. 269-276. https://doi.org/10. 1145/169059.169209 · DOI
  49. Marc M Sebrechts, John V Cugini, Sharon J Laskowski, Joanna Vasilakis, and Michael S Miller. 1999. Visualization of search results: a comparative evaluation of text, 2D, and 3D interfaces. In Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval. 3-10. https://doi.org/10.1145/312624.312634 · DOI
  50. Chirag Shah and Roberto González-Ibáñez. 2010. Exploring information seeking processes in collaborative search tasks. Proceedings of the American Society for Information Science and Technology 47, 1 (2010), 1-7. https://doi.org/10.1002/ meet.14504701211 · DOI
  51. Roger N Shepard and Jacqueline Metzler. 1971. Mental rotation of three- dimensional objects. Science 171, 3972 (1971), 701-703. https://doi.org/10.1126/ science.171.3972.701 · DOI · Paper page
  52. Sangho Suh, Martinet Lee, and Edith Law. 2020. How do we design for con- creteness fading? survey, general framework, and design dimensions. In Pro- ceedings of the Interaction Design and Children Conference. 581-588. https: //dl.acm.org/doi/10.1145/3392063.3394413 · DOI
  53. Sangho Suh, Jian Zhao, and Edith Law. 2022. CodeToon: Story Ideation, Auto Comic Generation, and Structure Mapping for Code-Driven Storytelling. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1-16. https://doi.org/10.1145/3526113.3545617 · DOI
  54. Melanie Tory, David Sprague, Fuqu Wu, Wing Yan So, and Tamara Munzner. 2007. Spatialization design: Comparing points and landscapes. IEEE Transactions on Visualization and Computer Graphics 13, 6 (2007), 1262-1269. https://doi.org/ 10.1109/TVCG.2007.70596 · DOI
  55. Barbara Tversky. 2005. Visuospatial reasoning. Cambridge University Press. https://doi.org/10.4135/9781452257044.n284 · DOI
  56. Kelsey Urgo and Jaime Arguello. 2022. Learning assessments in search-as- learning: A survey of prior work and opportunities for future research. In- formation Processing & Management 59, 2 (2022), 102821. https://doi.org/10.1016/ j.ipm.2021.102821 · DOI
  57. Colin Ware and Steven Osborne. 1990. Exploration and virtual camera control in virtual three dimensional environments. In Proceedings of the 1990 symposium on Interactive 3D graphics. 175-183. https://doi.org/10.1145/91394.91442 · DOI
  58. Ryen W White and Resa A Roth. 2009. Exploratory search: Beyond the query- response paradigm. Synthesis lectures on information concepts, retrieval, and services 1, 1 (2009), 1-98. https://doi.org/10.1007/978-3-031-02260-9 · DOI · Paper page
  59. Sharon Alayne Widmayer. 2004. Schema theory: An introduction. Retrieved December 26 (2004), 2004.
  60. Haijun Xia, Ken Hinckley, Michel Pahud, Xiao Tu, and Bill Buxton. 2017. Writ- Large: Ink Unleashed by Unifed Scope, Action, & Zoom. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 3227-3240. https://doi.org/10.1145/3025453.3025664 · DOI
  61. Yao Zhang and Chang Liu. 2020. Users' Knowledge Use and Change during Information Searching Process: A Perspective of Vocabulary Usage. In Proceedings of the ACM/IEEE joint conference on digital libraries in 2020. 47-56. https://doi. org/10.1145/3383583.3398532 · DOI

Cited by

Sorted by citations

Authors
Suh, S., Min, B., Palani, S., & Xia, H.
Affiliations
University of California San Diego (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
Pages
1-18
DOI
10.48550/arxiv.2305.11483
arXiv
2305.11483
OpenAlex
W4377371585
Cited by
151
References
0
Citations by year
2026: 45 · 2025: 79 · 2024: 27
FWCI
16.18
Type
conference paper
Language
en
Open access
Licence
Locations
  • ACM Symposium on User Interface Software and Technology (UIST) (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Data Visualization and Analytics
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
large language models, sensemaking, information exploration, knowledge organization, foraging, nonlinear interactions, information complexity, knowledge hierarchies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review