Data-driven interaction techniques for improving navigation of educational videos
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
With an unprecedented scale of learners watching educational videos on online platforms such as MOOCs and YouTube, there is an opportunity to incorporate data generated from their interactions into the design of novel video interaction techniques. Interaction data has the potential to help not only instructors to improve their videos, but also to enrich the learning experience of educational video watchers. This paper explores the design space of data-driven interaction techniques for educational video navigation. We introduce a set of techniques that augment existing video interface widgets, including: a 2D video timeline with an embedded visualization of collective navigation traces; dynamic and non-linear timeline scrubbing; data-enhanced transcript search and keyword summary; automatic display of relevant still frames next to the video; and a visual summary representing points with high learner activity. To evaluate the feasibility of the techniques, we ran a laboratory user study with simulated learning tasks. Participants rated watching lecture videos with interaction data to be efficient and useful in completing the tasks. However, no significant differences were found in task performance, suggesting that interaction data may not always align with moment-by-moment information needs during the tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Saliency Detection: A Spectral Residual Approach
Hou, X., & Zhang, L. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383267 · Cited by 3,422
Bostock, M., Ogievetsky, V., & Heer, J. (2011) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2011.185 · Cited by 3,165
How video production affects student engagement: an empirical study of MOOC videos
Guo, P. J., Kim, J., & Rubin, R. (2014) · Proceedings of the first ACM conference on Learning @ scale conference · doi:10.1145/2556325.2566239 · Cited by 1,850 · cited 2×
“For example, video analytics studies on MOOCs have compared the effects of video production methods on learner engagement [13] and identified common causes of peaks in learner activity within videos [20].”
BackgroundSelf-citationTwitinfo: aggregating and visualizing microblogs for event exploration
Marcus, A., Bernstein, M. S., Badar, O., Karger, D. R., Madden, S., & Miller, R. C. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978975 · Cited by 548 · cited 1×
“We use the Twitinfo [23] peak detection algorithm to detect peaks in the server log data.”
MethodSelf-citationHill, W. C., Hollan, J. D., Wroblewski, D., & McCandless, T. (1992) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '92 · doi:10.1145/142750.142751 · Cited by 509 · cited 1×
“Read Wear [14] presented a visionary idea in this space to visualize users’ read and edit history data in the scrollbar.”
BackgroundA study on video browsing strategies
Ding, W., & Marchionini, G. (1997) · University Libraries (University of Maryland) · Cited by 427
Understanding in-video dropouts and interaction peaks inonline lecture videos
Kim, J., Guo, P. J., Seaton, D. T., Mitros, P., Gajos, K. Z., & Miller, R. C. (2014) · Proceedings of the first ACM conference on Learning @ scale conference · doi:10.1145/2556325.2566237 · Cited by 370 · cited 3×
“Prior work in video clickstream analysis on four edX MOOCs found many interaction peaks , i.e., concentrated bursts in play/pause button clicks during certain segments of a video [20].”
BackgroundInfluentialSelf-citationSemantic pointing: improving target acquisition with control-display ratio adaptation
Blanch, R., Guiard, Y., & Beaudouin-Lafon, M. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985758 · Cited by 305 · cited 1×
“It is an example of control-display ratio adaptation [5, 16, 37], dynamically changing the ratio between physical cursor movement and on-screen cursor movement.”
BackgroundSocial navigation: techniques for building more usable systems
Dieberger, A., Dourish, P., Höök, K., Resnick, P., & Wexelblat, A. (2000) · Interactions · doi:10.1145/352580.352587 · Cited by 238 · cited 1×
“Adapting to collective video watching patterns can lead to richer social navigation support [10].”
BackgroundChronicle: capture, exploration, and playback of document workflow histories
Grossman, T., Matejka, J., & Fitzmaurice, G. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866054 · Cited by 155 · cited 1×
“Chron-icle [12] captured and provided playback for rich, contextual user interaction history inside a graphical application.”
BackgroundFluid interaction techniques for the control and annotation of digital video
Ramos, G., & Balakrishnan, R. (2003) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/964696.964708 · Cited by 130 · cited 2×
“Elastic interfaces [24] use the rubber band analogy to control scrub-bing speed and support precise navigation, as seen in the PV Slider [35] and Apple’s iOS video interface.”
MethodCrowdsourcing step-by-step information extraction to enhance existing how-to videos
Kim, J., Nguyen, P. T., Weir, S., Guo, P. J., Miller, R. C., & Gajos, K. Z. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2556986 · Cited by 130 · cited 1×
“Existing systems reveal step-by-step structure by adding rich signals to the video timeline, such as tool usage and intermediate results in graphical applications [8, 21].”
BackgroundSelf-citationRevisiting read wear: analysis, design, and evaluation of a footprints scrollbar
Alexander, J., Cockburn, A., Fitchett, S., Gutwin, C. A., & Greenberg, S. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518957 · Cited by 102 · cited 1×
“Previous research has separated personal and collective history traces to support GUI command selection [26], and added history indicators to a document scrollbar [2], which improved task performance in information finding.”
BackgroundEffects of output display and control—display gain on human performance in interactive systems
MacKenzie, I. S., & Riddersma, S. (1994) · Behaviour and Information Technology · doi:10.1080/01449299408914613 · Cited by 100
The Collaborative Lecture Annotation System (CLAS): A New TOOL for Distributed Learning
Risko, E. F., Foulsham, T., Dawson, S., & Kingstone, A. F. (2012) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2012.15 · Cited by 77 · cited 1×
“Other researchers have used more explicit input from video watchers, including user ratings [33], annotations [38], and the “this part is important” button [36].”
BackgroundChi, P.-Y., Liu, J., Linder, J., Dontcheva, M., Li, W., & Hartmann, B. (2013) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2501988.2502052 · Cited by 75 · cited 1×
“Existing systems reveal step-by-step structure by adding rich signals to the video timeline, such as tool usage and intermediate results in graphical applications [8, 21].”
BackgroundSnap-and-go: helping users align objects without the modality of traditional snapping
Baudisch, P., Cutrell, E. B., Hinckley, K., & Eversole, A. (2005) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055014 · Cited by 72 · cited 1×
“The idea of enlarging the motor space around targets is inspired by Snap-and-Go [4].”
MethodPatina: dynamic heatmaps for visualizing application usage
Matejka, J., Grossman, T., & Fitzmaurice, G. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466442 · Cited by 67 · cited 2×
“Patina [26] separated individual and collective history and added overlays on top of the GUI, to help people find commonly used menu items and discover new ways of completing desktop-related tasks.”
BackgroundNoteVideo: facilitating navigation of blackboard-style lecture videos
Monserrat, T.-J. K. P., Zhao, S., McGee, K., & Pandey, A. V. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466147 · Cited by 62 · cited 1×
“For blackboard-style lecture videos, NoteV-ideo [29] reverse-engineers a rendered video to create a sum-mary image and support spatial and temporal navigation.”
MethodSwifter: improved online video scrubbing
Matejka, J., Grossman, T., & Fitzmaurice, G. W. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466149 · Cited by 57 · cited 1×
“To provide an overview of the entire clip at a glance and support rapid navigation, recent research has used a grid layout to display pre-cached thumbnails [27], short snippets [18] in a single clip, personal watching history for multiple clips [1], a conceptual hierarchy visualization [19], or a 3D space-time cube di…”
MethodCollective intelligence within web video
Chorianopoulos, K. (2013) · Human-centric Computing and Information Sciences · doi:10.1186/2192-1962-3-10 · Cited by 53 · cited 2×
“To model user interest in video watching, researchers have proposed features such as viewership [38], scrubbing [39], zooming and panning [7], and replaying and skipping [9] activities.”
MethodCausality: a conceptual model of interaction history
Nancel, M., & Cockburn, A. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2556990 · Cited by 50 · cited 1×
“Causality [30] introduced an application-independent conceptual model for working with interaction history.”
BackgroundElastic graphical interfaces to precise data manipulation
Masui, T., Kashiwagi, K., & Borden, G. R. (1995) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/223355.223471 · Cited by 46 · cited 2×
“Elastic interfaces [24] use the rubber band analogy to control scrub-bing speed and support precise navigation, as seen in the PV Slider [35] and Apple’s iOS video interface.”
MethodCrowdsourcing step-by-step information extraction to enhance existing how-to videos
Nguyen, P. T., Weir, S., Guo, P. J., Miller, R. C., Gajos, K. Z., & Kim, J. H. (2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 44
Self-citationPanopticon: a parallel video overview system
Jackson, D., Nicholson, J., Stoeckigt, G., Wrobel, R., Thieme, A., & Olivier, P. L. (2013) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2501988.2502038 · Cited by 37 · cited 2×
“For educational lecture videos, Panopticon [18] has been shown to shorten task completion time in seeking information inside videos [32].”
BackgroundNoteVideo: facilitating navigation of blackboard-style lecture videos
Monserrat, T.-J. K. P., Zhao, S., McGee, K., & Pandey, A. V. (2013) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2468356.2479567 · Cited by 34
Swift: reducing the effects of latency in online video scrubbing
Matejka, J., Grossman, T., & Fitzmaurice, G. W. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207766 · Cited by 33 · cited 2×
“To improve video scrubbing, YouTube displays thumbnail previews for quickly skimming local frames, and Swift [25] overlays low-resolution thumbnails to avoid network latency delays.”
ResultHurst, A., Mankoff, J., Dey, A. K., & Hudson, S. E. (2007) · Proceedings of the 20th annual ACM symposium on User interface software and technology · doi:10.1145/1294211.1294242 · Cited by 32 · cited 2×
“It is an example of control-display ratio adaptation [5, 16, 37], dynamically changing the ratio between physical cursor movement and on-screen cursor movement.”
BackgroundMethodYew, J., Shamma, D. A., & Churchill, E. F. (2011) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978984 · Cited by 31 · cited 1×
“To model user interest in video watching, researchers have proposed features such as viewership [38], scrubbing [39], zooming and panning [7], and replaying and skipping [9] activities.”
MethodToward emergent representations for video
Shaw, R. B., & Davis, M. (2005) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1101149.1101244 · Cited by 23 · cited 2×
“To model user interest in video watching, researchers have proposed features such as viewership [38], scrubbing [39], zooming and panning [7], and replaying and skipping [9] activities.”
BackgroundMethodVideo summarization based on user interaction
Olsen, D. R., & Moon, B. B. (2011) · European Conference on Interactive TV and Video (EuroITV) · doi:10.1145/2000119.2000142 · Cited by 21 · cited 1×
“Other researchers have used more explicit input from video watchers, including user ratings [33], annotations [38], and the “this part is important” button [36].”
BackgroundVideotrees: Improving video surrogate presentation using hierarchy
Jansen, M., Heeren, W. F. L., & van Dijk, B. (2008) · International Workshop on Content-Based Multimedia Indexing (CBMI) · doi:10.1109/cbmi.2008.4564997 · Cited by 19 · cited 1×
“…clip at a glance and support rapid navigation, recent research has used a grid layout to display pre-cached thumbnails [27], short snippets [18] in a single clip, personal watching history for multiple clips [1], a conceptual hierarchy visualization [19], or a 3D space-time cube display [31].”
BackgroundPanopticon as an eLearning support search tool
Nicholson, J., Huber, M. W., Jackson, D., & Olivier, P. L. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557082 · Cited by 6 · cited 2×
“For educational lecture videos, Panopticon [18] has been shown to shorten task completion time in seeking information inside videos [32].”
BackgroundMethod
Cited by
SceneSkim: Searching and Browsing Movies Using Synchronized Captions, Scripts and Plot Summaries
Pavel, A., Goldman, D. B., Hartmann, B., & Agrawala, M. (2015) · Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology · doi:10.1145/2807442.2807502 · Cited by 67
“, user interface events for software tutorials [26, 18, 11, 36], sports statistics for athletic events [34, 29], or computer vision and crowdsourcing approaches for informa tional lecture videos [19, 31, 19, 35, 21], how-to videos [22] and movies [39, 38, 30].”
BackgroundEvaluating the Quality of Learning Resources: A Learnersourcing Approach
Abdi, S., Khosravi, H., Sadiq, S., & Demartini, G. (2021) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2021.3058644 · Cited by 40
“Successful examples of learnersourced artifacts created by students include traces of videos watched by students [2], annotating videos for future students [1], creating open-ended artifact, such as solutions [3], or explanations [4], [5], and curriculum design [6].”
BackgroundCritical issues in designing and implementing temporal analytics.
Chen, B., Knight, S., & Wise, A. (2018) · Journal of Learning Analytics · doi:10.18608/jla.2018.51.1 · Cited by 26
Metadata
- Authors
- Kim, J., Guo, P. J., Cai, C. J., Li, S.-W. (., Gajos, K. Z., & Miller, R. C.
- Venue
- Proceedings of the 27th annual ACM symposium on User interface software and technology
- Publisher
- ACM
- Published
- 2014-10-05
- Pages
- 563-572
- OpenAlex
- W2051277183
- Cited by
- 166
- References
- 33
- FWCI
- 7.57
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.