Two-Level Approach for No-Reference Consumer Video Quality Assessment
The DOI matches its Crossref record; 43 of the 48 references it cites were found in a registry or an index.
Abstract
Smartphones and other consumer devices capable of capturing video content and sharing it on social media in nearly real time are widely available at a reasonable cost. Thus, there is a growing need for no-reference video quality assessment (NR-VQA) of consumer produced video content, typically characterized by capture impairments that are qualitatively different from those observed in professionally produced video content. To date, most of the NR-VQA models in prior art have been developed for assessing coding and transmission distortions, rather than capture impairments. In addition, the most accurate NR-VQA methods known in prior art are often computationally complex, and therefore impractical for many real life applications. In this paper, we propose a new approach for learning-based video quality assessment, based on the idea of computing features in two levels so that low complexity features are computed for the full sequence first, and then high complexity features are extracted from a subset of representative video frames, selected by using the low complexity features. We have compared the proposed method against several relevant benchmark methods using three recently published annotated public video quality databases, and our results show that the proposed method can predict subjective video quality more accurately than the benchmark methods. The best performing prior method achieves nearly similar accuracy, but at substantially higher computational cost.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Temporal pooling is one of the most important, unresolved problems for video quality prediction [42], [60], [76], [82], [83].”
From UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content (2021) · cites this paper as [42]
In the citing paper
“The model currently achieves SOTA performance on three UGC video quality databases, CVD2014 [12], KoNViD-1k [10], and LIVE-Qualcomm [13], at a reasonably low complexity, as reported by the authors.”
From UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content (2021) · cites this paper as [42]
In the citing paper
“We observed in Section II-B that LIVE-VQC videos generally contain more (camera) motions than KoNViD-1k and YouTube-UGC, and TLVQM computes multiple motion relevant features.”
From UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content (2021) · cites this paper as [42]
In the citing paper
“TLVQM does require that a large set of parameters (around 30) be specified, which may affect performance on datasets or application scenarios it has not been exposed to.”
From UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content (2021) · cites this paper as [42]
Citations
Cites
Making a “Completely Blind” Image Quality Analyzer
Mittal, A., Soundararajan, R., & Bovik, A. C. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2012.2227726 · Cited by 6,766 · cited 4×
“In the field of NR-IQA and NR-VQA, Support Vector Regression (SVR) is the most commonly used regression model [5], [9], [38], [39], [43], but also neural networks and Random Forest Regression (RFR) have been employed successfully [7], [8], [12], [46].”
BackgroundMethodInfluentialNo-Reference Image Quality Assessment in the Spatial Domain
Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2214050 · Cited by 6,064 · cited 3×
“In the field of NR-IQA and NR-VQA, Support Vector Regression (SVR) is the most commonly used regression model [5], [9], [38], [39], [43], but also neural networks and Random Forest Regression (RFR) have been employed successfully [7], [8], [12], [46].”
MethodNatural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460 · cited 1×
“between neighboring locations, as well as spatial and temporal frequencies, follow certain typical statistical distributions [37].”
BackgroundDesign of an image edge detection filter using the Sobel operator
Kanopoulos, N., Vasanthavada, N., & Baker, R. L. (1988) · IEEE Journal of Solid-State Circuits · doi:10.1109/4.996 · Cited by 1,212
No-reference perceptual quality assessment of JPEG compressed images
Wang, Z., Sheikh, H. R., & Bovik, A. C. (2003) · Proceedings. International Conference on Image Processing · doi:10.1109/icip.2002.1038064 · Cited by 834
Unsupervised feature learning framework for no-reference image quality assessment
Ye, P., Kumar, J., Kang, L., & Doermann, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247789 · Cited by 785
A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB)
Ferzli, R., & Karam, L. J. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2011760 · Cited by 758
The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics
Winkler, S., & Mohandas, P. (2008) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2008.2000733 · Cited by 598
Blind Prediction of Natural Video Quality
Saad, M. A., Bovik, A. C., & Charrier, C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2299154 · Cited by 471 · cited 4×
“In the field of NR-IQA and NR-VQA, Support Vector Regression (SVR) is the most commonly used regression model [5], [9], [38], [39], [43], but also neural networks and Random Forest Regression (RFR) have been employed successfully [7], [8], [12], [46].”
MethodInfluentialA Completely Blind Video Integrity Oracle
Mittal, A., Saad, M. A., & Bovik, A. C. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2502725 · Cited by 357 · cited 2×
“Pixel-based models use a raw video signal solely as an input [4]–[5], [7]–[10], [12], and hybrid models combine features from the bitstream with features extracted from the”
BackgroundMethod
Research works printed but not linked: 13
- 2011, Objective Multimedia Video Quality Measurement of HDTV for Digital Cable Television in the Presence of a Reduced Reference Signal
- 2016, Objective Perceptual Multimedia Video Quality Measurement of HDTV for Digital Cable Television in the Presence of a Full Reference
- 2012, Methodology for the Subjective Assessment of the Quality of Television Pictures
- 2010, Report on the validation of video quality models for high definition video content
- ghadiyaram, 2017, LIVE-Qualcomm Mobile in-Capture Video Quality Database
- hosu, 2017, KoNViD-1k Video Database
- korhonen, 2019, Two Level Video Quality Model (TlvQM)
- zheng, 2018, Source Code for Classical Biqa Methods
- 2018, Image & Video Quality Assessment Algorithms Laboratory for Image & Video Engineering the University of Texas in Austin
- 2018, Scikit-Learn Toolbox
- alpert, 1997, Subjective quality evaluation–the SSCQE and DSCQE methodologies, EBU Tech Rev, 271, 12
- 1999, Subjective video quality assessment methods for multimedia applications
- nuutinen, 2018, The CVD Video Database
Cited by
Items 301–351 of 351
Energy Efficiency of Video Quality Assessment Metrics
Moan, S. L., Nguyen, H. T., & Amirshahi, S. A. (2025) · Proceedings - International Conference on Image Processing · doi:10.1109/icip55913.2025.11084706
Quality Assessment and Perception Models for Image and Video
Gao, W. (2025) · Springer eBooks · doi:10.1007/978-981-96-7714-6_3
Quality Assessment for Talking Head Videos via Multi-Modal Feature Representation
Su, M., Wang, Y., Chen, T., Li, C., Zhao, S., Wen, J., Lin, C., Liu, S., Chu, N., & Zhou, Y. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00130 · Cited by 2
“Among them, VMAF [36] is an FR VQA method, while VIIDEO [33], RAPIQUE [7], TLVQM [37], VIDEVAL [38], SimpVQA [6], and VSFA [5] are NR VQA methods.”
Xu, L., Zhou, Y., Liu, S., Wen, F., Zhou, Y., Liu, X., Guo, J., Wang, Y., & Cao, J. (2025) · Displays · doi:10.1016/j.displa.2025.103221 · Cited by 1
Ai, D., He, T., Lu, M., Wang, D., & Liu, Y. (2025) · Displays · doi:10.1016/j.displa.2025.103259 · Cited by 3
Yu, R., & Hu, Z. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131834 · Cited by 1
Fan, L., Zhang, Q., & Li, Q. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755844
“Hand-crafted methods, such as SpEED-QA [3], TLVQM [33], HDR-VDP [38], show poor performance because traditional prior-based quality metrics fall short in modeling the complex distortion introduced by the ITM enhancement process.”
Perceiving Smoothness: Temporal Consistency Learning for Multi-Frame-Rate Video Quality Assessment
Han, J., Min, X., Sun, W., & Zhai, G. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209186
A Unified Inverse-Tone-Mapped HDR Video Quality Assessment Method across Two HDR Formats
Fan, L., Min, X., Li, Q., & Wang, A. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209147
“Many advanced VQA algorithms developed on these SDR VQA datasets have been proposed, including TLVQM [10], VSFA [11], SimpleVQA [12], TB-VQA [13], FastVQA [14], Dover [15], etc.”
ESVQA: Perceptual Quality Assessment of Egocentric Spatial Videos
Zhu, X., Duan, H., Yang, L., Zhu, Y., Min, X., Zhai, G., & Callet, P. L. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209505 · Cited by 12
“…ES-VQAnet, we compare it with 16 state-of-the-art no-reference (NR) VQA models designed for traditional 2D videos, which can be categorized into two groups: • Hand-crafted models: BRISQUE [22], BMPRI [20], NIQE [24], HOSA [23], BPRI-PSS [21], BPRI-LSSn [21], QAC [25], VIDEVAL [27], and TLVQM [26].”
Hu, B., Zhao, Y., Li, L., He, L., Lu, W. B., & Gao, X. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11210013
“We compared MACA-VQA against twelve representative SOTA UGC-VQA methods, including: 1) traditional methods like TLVQM [25] and VIDEVAL [3]; and 2) deep learning-based methods such as VSFA [1], Patch-VQ [5], BVQA [26], SimpleVQA [6], FastVQA [11], Dover [13], HVS-5M [27], PTM-VQA [28], KSVQE [29],…”
CDHQA: A Quality Assessment Database for Conversational Digital Human
Zhou, Y., Wan, J., Liu, S. W., Xia, Y., Lu, Z., Wen, F., Zhang, Z., Wang, Y., Zhou, Y., Liu, X., et al. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3729-7_2
Exploring Cross-Modal Mutual Prompt Learning for Video Quality Assessment
Chen, P., Li, L., Wu, J., Yan, J., Jakhetiya, V., & Chetouani, A. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3639890 · Cited by 1
Wang, Q., Peng, Z., Zou, W., et al. (2025) · ACM International Conference on Multimedia in Asia (MMAsia) · doi:10.1145/3743093.3770975
Subjective and Objective Quality Assessment of Display Content Videos
Huang, Y., Lu, F., Yu, H., Zhang, K., Sun, W., Min, X., & Zhai, G. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3642689
“Advanced models like TLVQM [30] extracted rich handcrafted features, including motion, blur, and color, while VIDEVAL [31] combined features from multiple NR VQA methods using support vector regression.”
Visual fixation guided spatio-temporal dual branch network for gaming video quality assessment
Bai, M., Cui, Z., Lu, Z., Gan, Z., Tang, G., & Liu, F. (2025) · Multimedia Systems · doi:10.1007/s00530-025-02123-7
“The representative VQA models for general videos include BRISQUE [3], TLVQM [4], VIDEVAL [5], RAPIQUE [8], VSFA [6], and FAST-VQA [19].”
EyeSim-VQA: A Free-Energy-Guided Eye Simulation Framework for Video Quality Assessment
Wang, Z., Lu, W. B., Li, J., He, L., Gong, M., & Gao, X. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3651537 · Cited by 1
“TLVQM [42] introduces a two-level feature extraction strategy, capturing inter-frame motion and action-related features along with spatial features from individual frames, leading to a more comprehensive assessment.”
MTPA: A multi-aspects perception assisted AIGV quality assessment model
Liu, Y., Fan, D., Liu, Z., Li, S., & Wang, H. (2026) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2026.104721 · Cited by 1
RAM-VQA: Restoration Assisted Multi-Modality Video Quality Assessment
Chen, P., Yan, J., Soundararajan, R., Valenzise, G., Li, C., & Li, L. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3655117 · Cited by 1
“Further developments integrated complementary feature types, with TLVQM [15] incorporating both spatial high-complexity and temporal low-complexity characteristics, and VIDEVAL [16] employing feature fusion and selection to construct an ensemble prediction model.”
SCCOME: Scene Change Capture and Optical Motion Estimation for Video Quality Assessment
Liu, T.-J., Liao, H.-S., & Liu, K.-H. (2025) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc58881.2025.11343375
“TLVQM [15] proposed a two-layer feature extraction framework to balance computational speed and accuracy by selecting relevant spatial and temporal features.”
InfluentialGuan, F., Yu, Z., Lu, Y., Luo, W. H., Gao, Y., Li, X., & Chen, Z. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00366
“Traditional Video Quality Assessment (VQA) methods [13, 15, 19, 20, 25, 26] rely on handcrafted features for evaluating video quality.”
Light-VQA+: A Video Quality Assessment Model for Exposure Correction with Vision-Language Guidance
Zhou, X., Liu, X., Dong, Y., Kou, T., Gao, Y., Zhang, Z., Li, C., Wu, H., & Zhai, G. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-025-02706-x · Cited by 12
A No-Reference Framework for Animated Video Quality Prediction in Consumer Multimedia Applications
Mogasati, R. S., Ganavdiya, S., Poreddy, A. K. R., Appina, B., & Pachori, R. B. (2026) · IEEE transactions on consumer electronics · doi:10.1109/tce.2026.3671988
“These challenges highlight the need for accurate quality assessment (QA) models for animated video (AV) content to optimize the perceptual losses due to compression and processing artefacts, thereby enhancing user satisfaction [4], [5].”
Bhardwaj, S., Lebreton, P., Shinde, T. S., et al. (2025) · Picture Coding Symposium · doi:10.1109/pcs65673.2025.11417508
Joint Model of Deep Hierarchical Network and Gabor Features via Spatio-Temporal Slice of VideosPreprint
Bediako, D. O., & Nornormey, E. A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6439524
Efficient No-Reference Video Quality Assessment Using Video Masked Autoencoder Feature Mixing
Suresh, N., & Channappayya, S. S. (2025) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf67917.2025.11443711
“Korhonen et al. [8] introduced a two-level supervised VQA approach that extracts features of varying complexity from videos.”
Liang, Z., Sheng, W., Ma, H., Zhou, F., & Qiu, G. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3679733
“Early no reference (NR) VQA models are mainly based on handcrafted features and also known as traditional models [2], [3], [4], [24], [25].”
Khan, Z. A. (2021) · theses.fr (ABES) · doi:10.70675/75d15fa7z97c5z418cza3b3z8f75630fddaa · Cited by 2
Ganavdiya, S., Mogasati, R. S., Appina, B., et al. (2026) · Displays · doi:10.1016/j.displa.2026.103468
Zhou, Y., Zhang, Z., Wen, F., Xu, L., Zhang, Y., Zhou, Y., Cao, J., Shi, Y., Liu, X., Min, X., et al. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104817
Ge, Q., Min, X., Wu, S., Li, Y., & Zhai, G. (2026) · Sensors · doi:10.3390/s26082530
“As a result, brief but salient degradations may disproportionately influence the final opinion, and quality prediction cannot be reduced to simple frame averaging [20,21].”
Biswas, S., & Palanisamy, R. (2026) · Multimedia Tools and Applications · doi:10.1007/s11042-026-21381-9
Venkataramanan, A. K., Stejerean, C., Katsavounidis, I. X., Tmar, H., & Bovik, A. C. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3684812 · Cited by 1
“Examples of classical NR models include BRISQUE [26], DIIVINE [27], TLVQM [28], HIGRADE [29], and ChipQA [30].”
BrightRate: Quality Assessment for User-Generated HDR Videos
Saini, S., Chen, B., Wang, Y., Birkbeck, N., Adsumilli, B., & Bovik, A. C. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00154 · Cited by 1
“Table 1 provides an overview of key video specifications and the encoding bitrate ladder used to simulate realistic streaming conditions.”
GameScope: A Multi-Attribute, Multi-Codec Benchmark Dataset for Gaming Video Quality Assessment
Sureddi, R., Saini, S., Saha, A., & Bovik, A. C. (2026) · Proceedings - International Conference on Image Processing · doi:10.1109/icip61757.2026.11630296
Yin, H., Mo, L., Wang, H., Huang, X., Yin, L., & Zhang, W. (2026) · Signal Processing Image Communication · doi:10.1016/j.image.2026.117596
Genre-Aware Representation Learning for No-Reference Game Video Quality Assessment
Yang, J., Xiong, P., & Wang, G. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-9507-5_18
Ge, Q., Li, Y., Wu, S., & Min, X. (2026) · Displays · doi:10.1016/j.displa.2026.103543
An efficient video quality assessment model incorporating VideoMamba and dual-dimensional attention
Zeng, H., Liu, F., Cui, Z., Gan, Z., & Tang, G. (2026) · Multimedia Systems · doi:10.1007/s00530-026-02416-5
“TLVQM [22] proposes a two-stage NR-VQA method: the first stage extracts temporally low-complexity handcrafted features from video frame sequences, while the second stage extracts high-complexity handcrafted features from a sparse set of representative frames.”
Vishwakarma, A. K., Ranjan, R., Priyadarshi, R., & Kollie, D. S. (2026) · Discover Computing · doi:10.1007/s10791-026-10248-0 · Cited by 1
“The two-level video quality metric, TLVQM, was presented in [98].”
Computational Attention-based Modeling of Individually Perceived Quality of Compressed Images
Tiotsop, L. F., Geissler, M., & Barkowsky, M. (2026) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3822181
“Historically, the Mean Opinion Score (MOS) obtained from subjective experiments has been regarded as the primary target for objective IQA models [31, 37, 42, 51].”
IBCL-VQA: Video Quality Assessment with In-Batch Contrastive Learning and Two-Phase Feature Fusion
Hu, B., Wang, W., Li, L., He, L., Lu, W. B., & Gao, X. (2026) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3822174
No-reference video quality assessment with guidance of keyframe extraction
Zhou, M., Han, D., Liu, W., Li, G., Li, M., & Ren, X. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582042
FGSVQA: Frequency-Guided Short-Form Video Quality Assessment
Wang, X., Katsenou, A., Shen, J., & Bull, D. (2026) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex69967.2026.11618324 · Cited by 1
“Existing VQA methods have progressed from hand-crafted feature-based [14], [15] approaches to deep learning-based models [16], [17].”
Exploring Fine-Grained UGC Compression Quality in a No-Reference Based Approach
Wang, Y., Pastor, A., Wu, Y., Jambunathan, S. P., Birkbeck, N., & Adsumilli, B. (2026) · Proceedings - International Conference on Image Processing · doi:10.1109/icip61757.2026.11630107
Bansal, R., & Kancharla, P. (2026) · Proceedings - International Conference on Image Processing · doi:10.1109/icip61757.2026.11629895
VDRS-VQA: Viewport-Domain Residual Sampling for No-Reference 360$^\circ$ Video Quality Assessment
Wu, X., Yan, X., Yang, C., Yu, X., An, P., & Lee, S. (2026) · IEEE Signal Processing Letters · doi:10.1109/lsp.2026.3725499
OLEC: Online-Learning-Based Error Concealment for Robust Point Cloud Streaming
Vargas-Alfonso, E., Dai, R., & Zhang, J. (2026) · IEEE National Aerospace and Electronics Conference (NAECON) · doi:10.1109/naecon70028.2026.11674962
“…video quality assessment and learned restoration showed that localized degradations induce measurable statistical irregularities in decoded frames, with perceptual degradation strongly correlated with simple local statistics such as variance, gradient energy, and spatial entropy [10], [11].”
Yue, G., Liu, T., Dong, L., He, L., Huang, Q., Wang, Z., & Wang, T. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114976
Wang, Q., Peng, Z., Chen, F., et al. (2026) · Digital Signal Processing · doi:10.1016/j.dsp.2026.106501
Dan, Y., & Li, Y. (2026) · Applied Sciences · doi:10.3390/app16199710
Metadata
- Authors
- Korhonen, J.
- Affiliations
- Shenzhen University (CN)
- Corresponding author
- Korhonen, Jari
- ORCID
- Korhonen, Jari
- Venue
- IEEE Transactions on Image Processing
- Published
- 2019-12
- Volume
- 28
- Issue
- 12
- Pages
- 5923-5938
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2950154603
- Semantic Scholar
- f441c421b710c164872298679de173621dc980dc
- Cited by
- 354
- References
- 48
- Citations by year
- 2026: 38 · 2025: 67 · 2024: 65 · 2023: 72 · 2022: 48 · 2021: 53 · 2020: 10 · 2019: 1
- FWCI
- 12.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Image Processing (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Natural Science Foundation of China (61772348)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Video Quality Assessment
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Keywords
- no-reference video quality assessment, consumer video, representative frame selection, computational efficiency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.