Cited by 5Data Visualization and AnalyticsSoftware Engineering ResearchUsability and User Interface Design

Considering Visualization Example Galleries

Open access
Yang, Junran, McNutt, Andrew M., Battle, Leilani·2024·2024 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)

Abstract

Example galleries are often used to teach, document, and advertise visually-focused domain-specific languages and libraries, such as those producing visualizations, diagrams, or webpages. Despite their ubiquity, there is no consensus on the role of “example galleries”, let alone what the best practices might be for their creation or curation. To understand gallery meaning and usage, we interviewed the creators $(\mathrm{N}=11)$ and users $(\mathrm{N}=9)$ of prominent visualization-adjacent tools. From these interviews we synthesized strategies and challenges for gallery curation and management (e.g. weighing the costs/benefits of adding new examples and trade-offs in richness vs ease of use), highlighted the differences between planned and actual gallery usage (e.g. opportunistic reuse vs search-engine optimization), and reflected on parts of the gallery design space not explored (e.g. highlighting the potential of tool assistance). We found that galleries are multi-faceted structures whose form and content are motivated to to accommodate different usages-ranging from marketing material to test suite to extended documentation. This work offers a foundation for future support tools by characterizing gallery design and management, as well as by highlighting challenges and opportunities in the space (such as how more diverse galleries make reuse tasks simpler, but complicate upkeep).

AI snapshot

Written from the paper’s full text.

TL;DR

This interview study characterizes visualization example galleries as multi-purpose artifacts serving marketing, reusable template corpora, and test infrastructure, with creator and user needs often in tension. It synthesizes strategies and challenges for gallery curation, maintenance, communication, and organization across prominent visualization-adjacent tools.

Key findings

  • Galleries are motivated by three central purposes: advertising the library, accelerating reuse via templates/opportunistic reuse, and supporting sustainability by acting as test infrastructure.
  • The authors identify three gallery forms—showcase, reference, and index—and note that galleries are multi-faceted structures ranging from marketing material to test suite to extended documentation.
  • Trade-offs are pervasive: diversifying galleries can make reuse easier but complicates upkeep; smaller galleries are easier to maintain; PLOT.LY has nearly 13× more examples than SEABORN, reflecting different resource and goal allocations.
  • Planned and actual gallery usage differ, e.g., creators may optimize for search engines while users engage in opportunistic reuse, and community-contributed examples can capture new use cases but require maintenance.

Methods

  • Semi-structured interviews with N=11 gallery creators and N=9 users of visualization-adjacent tools, conducted over Zoom; creators received $50 and users $15 gift cards, and interviews lasted about 60 minutes for creators and 30 minutes for users.
  • A gallery survey of 14 visualization-adjacent notations was used to establish a baseline definition of “gallery,” sampling via web search for terms like “visualization” and “gallery.”
  • Interviews were transcribed, open-coded, iteratively refined, and finalized via affinity diagramming; the study was marked exempt by the University of Washington IRB.

Limitations

  • The paper states that it interviewed a relatively limited set of creators and users, that a survey would have had further reach, that user interviews may not capture non-users of the selected tools, and that interviews centered on high-level practices may miss low-level usage details.
  • The authors state that the studied libraries have strong influence from Heer, who is also a collaborator, and that findings may be bound to those communities; they also note that galleries outside visualization may operate differently.
  • The text makes evident additional positionality concerns: several participants had prior relationships with the research team, and the authors note these relationships will inevitably bias results.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1109/vl/hcc60511.2024.00043

Cites

53 of 53 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

7 of 18 cited sources checked · 2 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    Multiple galleries together help users select a suitable library by comparison.

    “Multiple galleries together help users select a suitable library by comparison [28], [55].”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites [28] source
    • cites [55] source

      The Introduction and Results (sections 1 and 4.2; page numbers unavailable) discuss using one example gallery to find and select relevant examples. A search for multiple galleries and library selection found no passage saying that comparing galleries helps users choose a suitable library. (LLM, conf=0.75)

      Experimental — accuracy not yet measured
  • Findingown data

    Aesthetics are an important factor considered by creators when selecting gallery examples.

    “Similarly, C Matt , C Josh , and C Xiaoji noted that they consider aesthetics to be an important factor.”
    Quote in the paperNot a substantial claim
  • Findingnone given

    The user participants all started their journey with the charting libraries by playing with the gallery examples.

    “The user participants all started their journey with the charting libraries by playing with the gallery examples.”
    Quote in the paperNot a substantial claim
  • Findingown data

    Galleries are multi-faceted structures whose form and content are motivated to accommodate different usages ranging from marketing material to test suite to extended documentation.

    “We found that galleries are multi-faceted structures whose form and content are motivated to accommodate different usages-ranging from marketing material to test suite to extended documentation.”
    Quote in the paperSubstantial claim
  • Findingown data

    PLOT.LY has nearly 13× more examples than SEABORN.

    “This contrast can be seen in Fig. 3: PLOT.LY has nearly 13× more examples than SEABORN.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. 113
  • May combine two claims. 52
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Correll [9] calls for selecting datasets that are of social import or impact as means for advocating for positive change.

    “Correll [9], referring to example data more generally, calls for selecting datasets that are of social import or impact as means for advocating for positive change.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
  • Classified as probably not a substantial claim.

    Premisecitation

    Lee-Robbins [31] characterizes visualization as being a means of fulfilling learning objectives.

    “We connect this observation with Lee-Robbins' [31] characterization of visualization as being a means of fulfilling learning objectives.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [31] source

      The available passages contain bibliographic information for Lucero’s paper, but no discussion of visualization or learning objectives. Searches for the claimed characterization and for Lee-Robbins returned only that bibliographic information, so our copy cannot verify the attribution. (LLM, conf=0.75)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A playground or online editor is a common documentation component for external DSL-style libraries [14] (e.g. VEGA/VEGA-LITE, PENROSE, IDYLL, NOTA, etc.).

    “A playground or online editor is a common documentation component for external DSL-style libraries [14] (e.g.VEGA/VEGA-LITE, PENROSE, IDYLL, NOTA, etc.).”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [14] source

      Section 2.1.1 describes code examples, galleries, and API documentation that development environments can render interactively. It does not address whether playgrounds or online editors are common documentation components for external DSL-style libraries. Searches for those terms found no passage establishing the claim. (LLM, conf=0.75)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The VEGA and VEGA-LITE editor [59] includes specialized affordances for those libraries, such as debugging [20] and performance [64] tools.

    “For instance, the VEGA and VEGA-LITE editor [59] includes specialized affordances for those libraries, such as debugging [20] and performance [64] tools.”
    Quote in the paperNot a substantial claim1 of 3 sources checked
    • cites [59]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [20] source

      The Future Work section discusses a proposed IDE extension for Adamite and mentions debugging only in connection with developers’ notes. Searches for VEGA, VEGA-LITE, and debugging tools found no passage about specialized tools in the VEGA or VEGA-LITE editor; our copy therefore does not address the attributed claim. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
    • cites [64]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Premisecitation

    Maintenance is typically invisible labor [1] that rarely garners the attention that new feature work does, but may offer a marketing-style signal that the library is actively maintained.

    “Maintenance is typically invisible labor [1] that rarely garners the attention that new feature work does, but may offer a marketing-style signal that the library is actively maintained.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Prior work explored gallery-like exploration of visualization collections drawn from databases.

    “prior work explored gallery-like exploration of visualization collections drawn from databases [43], [53], [63].”
    Quote in the paperNot a substantial claim1 of 3 sources checked
    • cites [43] source

      The Conclusion (section 8) describes contextualized programming-language documentation, and Code Examples (section 3.5) describes examples tailored to a programmer’s code. Searches for gallery-like exploration and database-derived visualization collections found no passage addressing the attributed claim. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
    • cites [53]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [63]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingown data

    The user participants browse the overview page and select basic examples to replicate, then slightly tweak the examples by changing parameters, and then refer to the references for detail.

    “They browse the overview page and select basic examples to replicate.Then they slightly tweak the examples by changing the parameters, and that was when they refer to the references for detail.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    Barriers exist both in delivering information from the creators via documentation and receiving questions and feedback from the users.

    “Barriers exist both in delivering information from the creators via documentation and receiving questions and feedback from the users.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Galleries are often the main point of contact between users and creators.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Some libraries incorporate a smaller reference gallery that resembles the references type of documentation.

    “Some libraries incorporate a smaller reference gallery that resembles the references type of documentation: it details the lowest level breakdown of library usage.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    More complex and customized examples appear either as a 'showcase' or 'miscellaneous' category in the main gallery or as an independent gallery focused on that topic, depending on the number of examples.

    “More complex and customized examples appear either as a "showcase" or "miscellaneous" category in the main gallery or as an independent gallery focused on that topic (such as IPYVIZZU), depending on the number of examples.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingreasoning

    The gallery is intended to be a subset of examples that are visually appealing and representative of the kind of things users are expected to want to do.

    “So the gallery is intended to be a subset of those that are visually appealing and also representative of the kind of things that we expect our users to want to do”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    As beginners, the user participants were not trying to become an expert, but just wanted to use the library.

    “As beginners, they were not “trying to become an expert, but just wanted to use it” (U 5 ).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    PLOT.LY's SEO strategy involves ensuring every feature gets an example, not meant to be browsable as a unit but to be linked directly and optimized for CMD+F or search.

    “C Nicolas explained that the strategy involved ensuring that "every feature gets an example...It's not something that's meant to be browsable as a unit; it's meant to be linked directly to any sort of scroll up and down and optimize for using CMD+F within a page or Google or our search feature".”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    Interest in marketing affects the selection of gallery elements.

    “This interest in marketing affects the selection of gallery elements.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    IDYLL and PENROSE have no categorization to lean on.

    “In contrast, IDYLL and PENROSE have no such categorization to lean on.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Findingnone given

    There is no one definition of a gallery.

    “As with many things in engineering, there is no one definition of a gallery.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Findingreasoning

    Although creators and users agree on tutorials being a more conventional teaching material for beginners, gallery examples provide shortcuts for more focused further learning.

    “Although the creators and users agree on the tutorials being a more conventional teaching material for the beginners, gallery examples provide shortcuts for more focused further learning.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    U3 learned about visualization research and vocabulary by studying VEGA-LITE's gallery.

    “In addition, U 3 highlighted that he learned about visualization research and vocabulary by studying VEGA-LITE's gallery.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    Commercialized libraries such as PLOT.LY put in enormous effort to compete for market share and often leverage their gallery not only for marketing its features, but also as a means of Search Engine Optimization (SEO).

    “Commercialized libraries such as PLOT.LY put in enormous effort to compete for market share, and often leverage their gallery not only for marketing its features, but also as a means of Search Engine Optimization (SEO).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Three central reasons why galleries are formed are to advertise the library, to accelerate library usage via reuse, and to support gallery sustainability by acting as a test suite.

    “We identify three central reasons why galleries are formed: to advertise the library, to accelerate library usage via reuse, and to support gallery sustainability by acting as a test suite.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    Each library contains at least one main gallery that can typically be accessed from the navigation bar.

    “Each library contains at least one main gallery that can typically be accessed from the navigation bar.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Creators did not express a cohesive opinion on what constitutes a gallery.

    “Similarly, creators did not express a cohesive opinion on what constitutes a gallery.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Findingown data

    Visitors come to the site and first scroll through examples to see if the library meets their quality standards.

    “C Matt observed that "people come to the site, and the first thing [is that] they'll scroll through the examples to see 'if I were to try to make something like this?Is this up to my quality standards?"'”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Findingnone given

    Smaller galleries are easier to maintain and put less burden on the developers.

    “Yet, smaller galleries are easier to maintain and put less burden on the developers.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingnone given

    User participants struggled with integrating multiple tools (U 6) and spent considerable time adapting data to match visualization specifications (U 1-7).

    “User participants struggled with integrating multiple tools (U 6 ) and spent considerable time adapting data to match visualization specifications (U 1-7 ).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Users may start exploring a library after finding a StackOverflow answer implementing the design they need.

    “For example, U 2 started exploring PLOT.LY after finding a StackOverflow answer implementing the design they need (e.g.Kernel Density plot with zooming).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Some highly customized examples are aimed at showing the upper bound of what the library can achieve and are not expected to be frequently reused.

    “C Jeff and C Fil noted that some highly customized examples are aimed and are not expected to be frequently reused.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Some creators regard galleries as the interface to a database of self-contained examples (MATPLOTLIB), whereas others saw them as more bespoke curated collections (DECK.GL).

    “Some seemed to regard them as the interface to a database of self-contained examples (MATPLOTLIB), whereas others saw them as more bespoke curated collections (DECK.GL).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    Reference galleries are dominated by leading visual examples followed by explanations, unlike API references where textual information appears first followed by an optional code example.

    “However, unlike the API references where the textual information appears first followed by an optional code example, the reference galleries are dominated by leading visual examples followed by explanations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    The galleries all contain the elements caption, visual, explanation, and code, but with different levels of detail.

    “The galleries all contain these elements but with different levels of detail.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Findingnone given

    Unaware of this backstage work, users desire ever larger galleries, being overly optimistic of effectively locating examples in need.

    “Unaware of this backstage work, users desire ever larger galleries, being overly optimistic of effectively locating examples in need.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    D3, as a special case, arranges the more complicated categories such as animation and interaction at the beginning and the basic charts at the end.

    “D3, as a special case, arranges the more complicated categories such as animation and interaction at the beginning and the basic charts at the end.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    The creators occasionally get inspirations and implement new use cases.

    “The creators occasionally get inspirations and implement new use cases.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingnone given

    Galleries serve as marketing materials, reusable templates, and testing infrastructure.

    “We find that galleries serve as marketing materials, reusable templates, and testing infrastructure.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Findingnone given

    Gallery creation and maintenance is a huge burden.

    “Gallery creation and maintenance is a huge burden.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Findingnone given

    Creators anticipate diminished utility for each new example added to larger collections as they foresee heavier burden for maintenance, the need to redesign, and users' cognitive load.

    “Creators anticipate diminished utility for each new example added to larger collections as they foresee heavier burden for maintenance, the need to redesign, and users' cognitive load.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Findingnone given

    Galleries give users a first impression and serve as the entry point to learning the tool.

    “In contrast, galleries give users a first impression and serve as the entry point to learning the tool.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Findingnone given

    Expert users revisit galleries less frequently because they know the examples by memory or need customized cases from other sources.

    “Expert users revisit them less frequently because they know the examples by memory or need customized cases from other sources.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    U 5 disliked how software version updates can affect the community examples, potentially breaking examples and confusing readers (particularly of unofficial documentation, like on StackOverflow).

    “U 5 disliked how software version updates can affect the community examples, potentially breaking examples and confusing readers (particularly of unofficial documentation, like on StackOverflow).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    VEGA-LITE and ALTAIR users (U 3-6) browse the galleries when searching for relevant examples, while two of the PLOT.LY users (U 2,7) start from Google searches as expected by the gallery designers.

    “VEGA-LITE and ALTAIR users (U 3-6 ) browse the galleries when searching for relevant examples, while two of the PLOT.LY users (U 2,7 ) start from Google searches as expected by the gallery designers.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    A few galleries employ cross-links to references, tutorials and other relevant examples, and tags of keywords.

    “Besides common elements like text and image, a few galleries employ cross-links to references, tutorials and other relevant examples, and tags of keywords.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Findingnone given

    It is unclear how to most effectively distribute limited developer time.

    “Moreover, it is unclear how to most effectively distribute limited developer time.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Most users would not interact with the creators directly, but typically find answers to their questions through StackOverflow or GitHub issues (U 1,2,4,6), and reviews containing research done by others (U 2).

    “Most users would not interact with the creators directly, however, they typically find answers to their questions through StackOverflow or GitHub issues (U 1,2,4,6 ), and reviews containing research done by others (U 2 ).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Some creators interact with users on social media platforms to answer questions, collect feedback, and observe how users review the tool.

    “Some creators interact with users on social media platforms to answer questions, collect feedback, and observe how users review the tool.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    If there are changes to an example's data, the vega-datasets repository needs to be updated, which in turn involves ensuring that other examples do not break.

    “Further, if there are changes to an example's data, the vega-datasets repository needs to be updated, which in turn involves ensuring that other examples do not break.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    The VEGA and VEGA-LITE editor supports link sharing so that specifications, examples, and demos can be distributed.

    “Similarly, it supports link sharing so that specifications, examples, and demos can be distributed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    In general, creators avoid repetitive examples that overwhelm users by the quantity.

    “In general, creators avoid repetitive examples that overwhelm users by the quantity.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    Many documentation sites now include chatbots as a sibling feature to traditional documentation.

    “To wit, many documentation sites now including chatbots as a sibling feature to traditional documentation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Galleries are one of the many tools utilized in user's workflows.

    “Galleries are one of the many tools utilized in user's workflows.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    U 4 complained about the difficulty of identifying valid combinations of static design and animation operations.

    “For instance, U 4 complained about the difficulty of identifying valid combinations of static design and animation operations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    Users encountered well known bugs with these tools.

    “Users encountered well known bugs with these tools.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    These tools allow users to play with the examples and make modifications in-situ.

    “These tools allow users to play with the examples and make modifications in-situ.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    For creators, galleries start as materialization of design space and means to test implementations.

    “For the creators, galleries start as materialization of design space and means to test implementations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    Creators make assumptions about usage patterns and work backwards to inform their design decisions.

    “Creators make assumptions about usage patterns and work backwards to inform their design decisions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    Most galleries navigate this challenge by sorting and clustering by complexity or similarity.

    “Most galleries navigate this challenge by sorting and clustering by complexity or similarity.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    A persistent view observed across creators, users, and galleries themselves is that galleries are sometimes viewed as databases.

    “One persistent view that we observed across creators, users, and galleries themselves is that they are sometimes viewed as databases.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    VEGA groups the examples as bar chart, line charts and so on.

    “VEGA groups the examples as bar chart, line charts and so on”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Findingown data

    Galleries can be a variety of different things.

    “As we observed galleries can be a variety of different things.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Creators often monitor services like StackOverflow (C Nicolas, C Carlos, and C Fil), Discord (C Matt, C Josh, C Dominik, and C Fil), and GitHub (all).

    “Creators often monitor services like StackOverflow (C Nicolas , C Carlos , and C Fil ), Discord (C Matt , C Josh , C Dominik , and C Fil ), and GitHub (all).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    Creators empirically construct and evaluate the galleries without standard validation mechanisms, which may limit a gallery's potential.

    “Creators empirically construct and evaluate the galleries without standard validation mechanisms, which may limit a gallery's potential.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Larger galleries are often categorized by features or task.

    “Larger galleries are often categorized by features or task.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    PLOT.LY groups by data domain like finance or statistics.

    “PLOT.LY groups by data domain like finance or statistics.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Diversifying the types of tasks covered in a gallery can make it easier for users to find specific tasks relevant to them and provide more useful test cases for creators.

    “For instance, diversifying the types of tasks covered in a gallery can make it easier for users to find specific tasks that are relevant to them and provide a more useful test cases for creators.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Galleries designed with marketing motivation emphasize demonstrating expressiveness and unique facilities of the language, as a signal of development status and evidence of community, to elicit adoption or usage.

    “Galleries designed with motivation emphasize demonstrating expressiveness and unique facilities of the language-a signal of development status and evidence of community-as well as sketching what is possible with a notation-so as to elicit adoption or usage.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Community examples tend to be more like showcase examples, which can limit their re-usability.

    “We note that this tends to cause these examples to be more like showcase examples (which is how QUARTO uses them), which can limit their re-usability.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Eliciting external examples is a commonly used means to expand galleries.
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationreasoning

    Rich evocative galleries can serve as marketing materials by demonstrating the design space of possibilities, possibly attracting new users or helping prospective users differentiate from similar offerings.

    “Rich evocative galleries can serve as marketing materials by demonstrating the design space of possibilities for the library, possibly attracting new users or helping prospective users differentiate from similar offerings.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    Designing an appropriate mixture of communication forms is dependent on the community around those tools.

    “While a number of channels are available (ranging from the galleries themselves, to secondary channels like GitHub or Discord), designing an appropriate mixture of communication forms is dependent on the community around those tools.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Galleries are often the main point of contact between users and creators.
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    An example gallery is often the face of the library, acting as an ambassador for the library as a whole.

    “An example gallery is often the face of the library, acting as an ambassador for the library as a whole.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Imposing strong restrictions may support higher quality examples, but can also severely reduce the number of community submissions to the gallery.

    “Imposing strong restrictions may support higher quality examples, but can also severely reduce the number of community submissions to the gallery.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Eliciting external examples is a commonly used means to expand galleries.
  • Classified as probably not a substantial claim.

    Premisecitation

    Crichton [10] argued that documentation generation can be seen as a form of information visualization.

    “Crichton [10] (i.e.C Will ) argued that documentation generation can be seen as a form of information visualization.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [10]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationcitation

    Galleries are, in essence, a visualization of what is possible in a gallery in a means that is meant to support learning of those features-whether or not that learning is intentional.

    “We argue that galleries are then, in essence, a visualization of what is possible in a gallery in a means that is meant to support learning of those features-whether or not that learning is intentional.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    Despite the example creation labor being outsourced, the curation and management overhead for quality control still apply to monitoring user-contributed examples.

    “Despite the example creation labor being outsourced, the curation and management overhead for quality control still apply to monitoring user-contributed examples.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Eliciting external examples is a commonly used means to expand galleries.
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    There are few unambiguous guidelines for gallery design; compromises are needed to support conflicting usage patterns.

    “Like most socio-technical artifacts, there are few unambiguous guidelines; for a system with fixed resources, compromises will need to be made to support conflicting usage patterns (e.g.maintainers vs users).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Some libraries (e.g. P5.JS [44]) specifically facilitate new users' ability to contribute examples (and other forms of documentation), and try to make the process of adding to that documentation a welcoming and easy process.

    “To this end, some libraries (e.g.P5.JS [44]) specifically facilitate new users' ability to contribute examples (and other forms of documentation), and try to make the process of adding to that documentation a welcoming and easy process.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [44]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    Galleries of charting libraries are broadly used as learning tools because they are often categorized based on well-studied taxonomies, and provide basic and straightforward examples.

    “Galleries of charting libraries are broadly used as learning tools because they are often categorized based on well-studied taxonomies, and provide basic and straightforward examples.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Effectively communicating the design space depends on the interface component.

    “While the design space is interpolated from the collection components, effectively communicating it depends on the interface component.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The type of galleries employed seems to be informed by library nature and construct.

    “The type of galleries employed seems to be informed by library nature and construct.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    Whether a resource allocation is better depends on the intent of the library.

    “Is this a better allocation of resources?It depends on the intent of the library.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Augmenting gallery organization and content are a family of other tools that provide context, support inter-connections with the rest of the documentation, and bridge gaps left by the default presentation.

    “Finally, augmenting this gallery organization and content are a family of other tools, that provide context, support inter-connections with the rest of the documentation, and bridge gaps left by the default presentation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    Communicating correct usage patterns is essential, both to ensure that users understand what the notation can do (as in the comparative research use case of marketing), as well as show how to do those things.

    “Communicating correct usage patterns is essential, both to ensure that users understand what the notation can do (as in the comparative research use case of marketing), as well as show how to do those things.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    This design supports both conceptual reuse-as it makes it easy to make adjustments to existing examples-as well as marketing-as it can demonstrate the facilities of the library more clearly than static images of gifs.

    “This design supports both conceptual reuse-as it make it easy to make adjustments to existing examples-as well as marketing-as it can demonstrate the facilities of the library more clearly than static images of gifs.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    The order in which gallery examples are presented and the means by which they are organized strongly affects the readability.

    “The order in which gallery examples are presented and the means by which they are organized strongly affects the readability.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Galleries are agglomerative objects. They consist of many constituent objects, the organization and selection of which is guided by balancing different views and constraints.

    “Finally, galleries are agglomerative objects.They consist of many constituent objects, the organization and selection of which is guided by balancing different views and constraints.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Navigating these different usages forms inherently leads to trade-offs and compromises.

    “Navigating these different usages forms inherently leads to trade-offs and compromises.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    This expresses a marketing-tact: it allows them to show that they have the parity of what others can do and more.

    “This expresses a marketing-tact: it allows them to show that they have the parity of what others can do and more.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    Growing a gallery can be extremely demanding without immediately demonstrable benefits.

    “Growing a gallery can be extremely demanding without immediately demonstrable benefits.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    As users get more advanced, galleries become cheat sheets for quick inspiration and reuse.

    “As they get more advanced, galleries become cheat sheets for quick inspiration and reuse.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationreasoning

    Users care about the end-results rather than the steps that lead to them, however, the space of possible usage patterns can be large, which can make searching for specific solutions challenging.

    “Users care about the end-results rather than the steps that lead to them, however, the space of possible usage patterns can be large, which can make searching for specific solutions challenging.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    As a gallery grows, it requires a series of careful considerations to select and organize the examples.

    “Further, as a gallery grows, it requires a series of careful considerations to select and organize the examples.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Newer libraries are likely to go through major changes, requiring additional labor to fix the examples.

    “Newer libraries are likely to go through major changes, requiring additional labor to fix the examples.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Communicating usage patterns is extremely difficult for libraries supporting interactions and animations because they add extra dimensions to the design space, which also requires more domain knowledge.

    “Communicating usage patterns is extremely difficult for libraries supporting interactions and animations because they add extra dimensions to the design space, which also requires more domain knowledge.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationnone given

    Most galleries only provide succinct examples which required less reading and code decomposition, leaving a gap for integrating the library with other environments.

    “Most galleries only provide succinct examples which required less reading and code decomposition, leaving a gap for integrating the library with other environments.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    The long term benefit of these generative structures rather than browsable structure is unclear.

    “Moreover, the long term benefit of these generative structures rather than browsable structure is unclear, although we suggest in the future they might be hybridized in useful ways.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    The organization, structure, and size are shaped by the goals of the creators and the community surrounding the library.

    “For instance, the organization, structure, and size are shaped by the goals of the creators and the community that surrounding the library.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    PLOT.LY's emphasis on marketing affects how their gallery is organized: an extensive set of design variants with descriptive headings are stocked in the same webpage, so that the webpage can be better indexed by search engines (i.e. for SEO).

    “In contrast, PLOT.LY's emphasis on marketing affects how their gallery is organized: an extensive set of design variants with descriptive headings are stocked in the same webpage, so that the webpage can be better indexed by search engines (i.e. for SEO).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    As a library phases into the maintenance period from active development, the frequency of adding new examples also slows down.

    “As a library phases into the maintenance period from active development, the frequency of adding new examples also slows down.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    Additional interface design (such as search bars, categories, or other affordances) for the gallery becomes essential for efficient example discovery, but it can introduce more cognitive overhead.

    “Additional interface design (such as search bars, categories, or other affordances) for the gallery becomes essential for efficient example discovery, but it can introduce more cognitive overhead.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation

    Making a system seamless for someone inevitably makes it frictional for someone else [19].

    “However, making a system seamless for someone inevitably makes it frictional for someone else [19].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [19] source
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    Weighing changes to the maintenance workload against the library goals is one means to determine resource allocation.

    “Weighing changes to the maintenance workload against the library goals is one means to determine resource allocation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationcitation

    Moving documentation into notebooks (or Discords in some cases) can make that documentation less discoverable (e.g. for search engines) and potentially more intimidating to some users.

    “For instance, moving documentation into notebooks (or Discords in some cases) can make that documentation less discoverable (e.g. for search engines) and potentially more intimidating to some users.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Correctly positioning the role of contributed examples can serve a dual purpose of providing documentation and soliciting feedback.

    “Correctly positioning the role of contributed examples can then serve a dual purpose of providing documentation and soliciting feedback.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Using AIs to support documentation is becoming increasingly common.

    “Clearly, using AIs to support documentation is becoming increasingly common.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    Scaling searching and browsing of examples keeps being an essential interface design challenge.

    “Beyond this, scaling searching and browsing of examples keeps being an essential interface design challenge.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    Reconciling the difference in needs and resources does not have a clear solution, but seems most effectively aided by iterative communication between both groups.

    “Reconciling the difference in needs and resources does not have a clear solution, but seems most effectively aided by iterative communication between both groups.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    While these decisions might benefit the assumed user group, they could make it less flexible for less expected or expert users.

    “While these decisions might benefit the assumed user group, they could make it less flexible for less expected or expert users.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    Conceptually and visually similar examples are placed closer together to avoid losing track or confusion.

    “Conceptually and visually similar examples are placed closer together to avoid losing track or confusion.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    A detailed chart example can incorporate the background of the data source and an explanation of why the visual encodings were selected to be more educational.

    “For example, a detailed chart example can incorporate the background of the data source and an explanation of why the visual encodings were selected to be more educational.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationreasoning

    Mature libraries tend to keep everything as is, which ensures stability but can impede new features.

    “In contrast, mature libraries tend to keep everything as is, which ensures stability but can impede new features.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationnone given

    Creating a gallery is usually easier at the beginning as presenting straightforward use cases that justify the need for new features in a library.

    “Creating a gallery is usually easier at the beginning as presenting straightforward use cases that justify the need for new features in a library.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Selecting examples requires balancing their need to interesting, understandable, re-usable, and to not unduly burden the infrastructure.

    “Selecting examples requires balancing their need to interesting, understandable, re-usable, and to not unduly burden the infrastructure.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    Marketing and communication needs subsequently arise to attract and keep users, especially when the software transitions from active feature development into maintenance phases.

    “Marketing and communication needs subsequently arise to attract and keep users, especially when the software transitions from active feature development into maintenance phases.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    PLOT.LY explicitly focuses on Search Engine Optimization (SEO), likely in part because they have such strong marketing centered goals, and so the costs of maintenance are offset by the potential value of increased SEO.

    “For example, PLOT.LY explicitly focuses on Search Engine Optimization (SEO), likely in part because they have such strong marketing centered goals, and so the costs of maintenance are offset by the potential value of increased SEO.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    We interviewed a relatively limited set of creators and users.

    “We interviewed a relatively limited set of creators and users.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    This work also focused on users of those galleries, but there was no overlap between the research team and that group.

    “This work also focused on users of those galleries, but there was no overlap between the research team and that group.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Galleries outside of visualization may operate differently.

    “Galleries outside of visualization may operate differently (e.g.nonvisual libraries like for data processing)”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Our interviews were centered on high level practices, which may miss low-level usage details.

    “Our interviews were centered on high level practices, which may miss low-level usage details.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    The libraries studied in this work have a strong influence from Heer and some findings may be bound to the specific perspectives espoused in the communities surrounding his work.

    “The libraries studied in this work have a strong influence from Heer (who is also a collaborator of ours) and some of our findings may be bound to the specific (although prominent) perspectives espoused in the communities surrounding his work.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Carlos Scheidegger, Jeffrey Heer, and Dominik Moritz are or have been current collaborators of Leilani's.

    “Carlos Scheidegger, Jeffrey Heer, and Dominik Moritz are or have been current collaborators of Leilani's.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    This work focuses soliciting the experiences of a small subject population who might potentially share common preferences and habits for gallery designing from previous collaboration experience.

    “This work focuses soliciting the experiences of a small subject population who might potentially share common preferences and habits for gallery designing from previous collaboration experience”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductown data

    We interviewed 11 gallery creators or maintainers.

    “We interviewed 11 gallery creators or maintainers.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Study design and conductnone given

    The three creators, Jeffrey Heer, Dominik Moritz, and Matt Conlen are, or have been, affiliated with the same research lab (UW IDL) as all three of the authors of this work.

    “The three creators, Jeffrey Heer, Dominik Moritz, and Matt Conlen are, or have been, affiliated with the same research lab (UW IDL) as all three of the authors of this work.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Study design and conductnone given

    Junran has co-authored papers with Dominik Moritz and Jeffrey Heer.

    “Junran has co-authored papers with Dominik Moritz and Jeffrey Heer.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    Our user interviews are influenced by our selection process and may not capture the usage patterns of those who do not identify as users of the selected tools.

    “Our user interviews are influenced by our selection process and may not capture the usage patterns of those who do not identify as users of the selected tools.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Study design and conductnone given

    Andrew co-authored a paper with Nicolas Kruchten, worked with Xiaoji Chen and Ib Green, and was advised by Jeffrey Heer.

    “Andrew co-authored a paper with Nicolas Kruchten, worked with Xiaoji Chen and Ib Green, and was advised by Jeffrey Heer.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Kruchten et al. [28] explore metrics for a particular form of gallery, but their connection to utility is unknown.

    “Kruchten et al. [28] explore metrics for a particular form of gallery, but their connection to utility is unknown.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [28] source
125 of 125
  • The paper relies on this without support.

    Example galleries are often used to teach, document, and advertise visually-focused domain-specific languages and libraries.

    “Example galleries are often used to teach, document, and advertise visually-focused domain-specific languages and libraries, such as those producing visualizations, diagrams, or webpages.”
  • The paper relies on this without support.

    There is no consensus on the role of example galleries or best practices for their creation or curation.

    “Despite their ubiquity, there is no consensus on the role of "example galleries", let alone what the best practices might be for their creation or curation.”
  • The paper relies on this without support.

    Questions like how many examples should be included and which examples are necessary remain unanswered.

    “Questions like how many examples should be included?and which examples are necessary?remain unanswered.”
  • The paper relies on this without support.

    The interaction between official channels and folk documentation is unclear.

    “The interaction between "official" channels and "folk" documentation (e.g.StackOverflow) are unclear.”
  • The paper relies on this without support.

    Code examples and documentation are essential for learning programming and accomplishing programming tasks.

    “Code examples and documentations are essential for learning programming and accomplishing programming tasks.”
  • The paper relies on this without support.

    Galleries are often the main point of contact between users and creators.

    “Galleries are often the main point of contact between users and creators, meaning they are laden with communicative tasks, such as showing how to use a library.”
  • The paper relies on this without support.

    Eliciting external examples is a commonly used means to expand galleries.

    “Eliciting external examples is a commonly used means to expand galleries.”
  • The paper relies on this without support.

    DECK.GL is intended to be used by web developers who are familiar with React and its functional paradigm, and can be confusing to other groups.

    “It is intended to be used by web developers who are familiar with React and its functional paradigm, and can be confusing to other groups.”
8 of 8

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Plotly citation points to Diátaxis

    Minor

    The text identifies [45] as Plotly, but reference 45 is about technical-documentation authoring.

  • Vega citation points to an unrelated reference

    Minor

    The text identifies [52] as Vega, but reference 52 is a paper about software-library selection.

  • Deck.gl citation points to VizSnippets

    Minor

    The text identifies [42] as Deck.gl, whereas reference 42 is a VizSnippets paper.

  • Vega bar-chart tutorial citation points to VegaProf

    Minor

    The tutorial is cited as [60], but reference 60 is a paper on profiling Vega visualizations.

  • Vega documentation citation points to the bar-chart tutorial

    Minor

    The text cites [57] for Vega's documentation section, but reference 57 is the bar-chart tutorial.

  • Diátaxis citation points to Vega-Lite

    Minor

    The text attributes the documentation taxonomy to [48], but reference 48 is a Vega-Lite paper.

6 of 6

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. Crichton, A new medium for communicating research on programming languages
  2. Tanzil, how do people decide?

Cited by

Sorted by citations

Authors
Yang, J., McNutt, A. M., & Battle, L.
Affiliations
University of Washington (US)
Venue
2024 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)
Publisher
IEEE
Published
2024-09-02
Pages
329-343
ISSN
1943-6092 (ISSN-L)
OpenAlex
W4403446902
Cited by
5
References
52
Citations by year
2026: 2 · 2025: 3
FWCI
1.11
Type
conference paper
Language
en
Open access
Locations
  • Proceedings/Proceedings -- IEEE Symposium on Visual Languages and Human-Centric Computing (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
National Science Foundation (2141506)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Data Visualization and Analytics
  • Physical Sciences › Computer Science › Information Systems › Software Engineering Research
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
visualization tools, gallery management, domain-specific languages, documentation, tool reuse, gallery design

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-13.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-13.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review