The DOI matches its DataCite record; 139 of the 139 references it cites were found in a registry or an index; 12 of the 40 sources its claims cite were checked for support.
DINOv2: Learning Robust Visual Features without Supervision
Open accessAbstract
The recent breakthroughs in natural language processing for model pretraining on large quantities of data have opened the way for similar foundation models in computer vision. These models could greatly simplify the use of images in any system by producing all-purpose visual features, i.e., features that work across image distributions and tasks without finetuning. This work shows that existing pretraining methods, especially self-supervised methods, can produce such features if trained on enough curated data from diverse sources. We revisit existing approaches and combine different techniques to scale our pretraining in terms of data and model size. Most of the technical contributions aim at accelerating and stabilizing the training at scale. In terms of data, we propose an automatic pipeline to build a dedicated, diverse, and curated image dataset instead of uncurated data, as typically done in the self-supervised literature. In terms of models, we train a ViT model (Dosovitskiy et al., 2020) with 1B parameters and distill it into a series of smaller models that surpass the best available all-purpose features, OpenCLIP (Ilharco et al., 2021) on most of the benchmarks at image and pixel levels.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
DINOv2 shows that self-supervised pretraining on a curated 142M-image dataset can produce general-purpose visual features competitive with weakly supervised models. Its ViT-g/14 backbone and distilled smaller variants perform strongly on image and pixel tasks without task-specific fine-tuning.
Key findings
- On ImageNet-1k linear probing, DINOv2 ViT-g/14 reaches 86.5% top-1, exceeding OpenCLIP ViT-G/14 (86.2%) and EVA-CLIP ViT-g/14 (86.4%), and improving over iBOT ViT-L/16 (82.3%) by 4.2 points; kNN is 83.5%, ReaL 89.6%, and V2 78.4%.
- Dense and retrieval tasks also improve: ViT-g/14 with multiscale linear segmentation gets 53.0 mIoU on ADE20k, 81.0 on Cityscapes, and 86.2 on Pascal VOC; depth DPT RMSE is 0.279 on NYUd versus OpenCLIP’s 0.414; retrieval reaches 52.3 mAP on Oxford-Hard and 82.6 mAP on Paris-Hard.
- Ablations show the KoLeo regularizer raises Oxford-M retrieval from 55.6 to 63.9 mAP, masked image modeling raises ADE-20k segmentation from 44.2 to 47.1 mIoU, and distillation from ViT-g improves ViT-L over scratch on all 12 benchmarks.
- Curated LVD-142M beats uncurated data on most benchmarks (e.g., INet-1k 85.8 vs 83.3, iNat2018 82.3 vs 68.0, iNat2021 86.4 vs 76.4) and beats ImageNet-22k on all but ImageNet-1k.
Methods
- Data: an automatic pipeline starts from 1.2B unique web images, applies deduplication, and retrieves images using self-supervised ViT-H/16 embeddings with cosine similarity, k-means, and Faiss, producing LVD-142M (142M images) in under two days on 20 nodes with 8 V100-32GB GPUs.
- Training: discriminative self-supervised learning combines DINO image-level and iBOT patch-level objectives with Sinkhorn-Knopp centering, a KoLeo regularizer, separate projection heads, and a short 518×518 high-resolution phase; ViT-g/14 has 1.1B parameters, with efficiency from FlashAttention, sequence packing, stochastic depth, and FSDP, and smaller models distilled from ViT-g.
- Evaluation: frozen features are assessed with linear probes and kNN on classification, segmentation, depth, retrieval, video, and fairness benchmarks, compared against self-supervised and weakly supervised baselines.
Limitations
- The paper states fairness gaps: on Dollar Street, Africa performance is 25.7% below Europe and high-income households are 31.7% above low-income; harmful label associations were rare, but a more thorough bias evaluation may reveal flaws.
- The paper states its carbon estimate covers only GPU electricity and excludes manufacturing and disposal; the whole project is estimated at 0.5k–1k tCO2eq, with one ViT-g pretraining at 3.7 tCO2eq.
- The text makes evident that evaluation centers on frozen linear probes and curated benchmarks, and the data pipeline retrieves from curated datasets, so coverage may be shaped by those sources; some tasks where text supervision helps (e.g., SUN, Cars) still lag OpenCLIP.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
63 Own result · 24 Own interpretation · 18 No basis given · 13 Sources not found · 10 Own method · 5 Not checked yet · 4 Supported · 4 Partly supported · 3 No full text of the sources · 1 Couldn’t confirm · accuracy not yet measured
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“This leads to approximately 50% reduction in communication costs compared to the float32 gradient all-reduce operation used in DistributedDataParallel (DDP), which is used in other self-supervised pretraining methods (Caron et al., 2021;Zhou et al., 2022a).”
§ DINOv2: Learning Robust Visual Features without Supervision > Fully-Sharded Data Parallel (FSDP).
What the sources say
- Could not verifycites Caron et al., 2021 sourceExperimental — accuracy not yet measured
The compute-requirements section (p. 9) reports DINO training time and GPU memory, not communication costs. Searches for FSDP, DistributedDataParallel, float32 gradient all-reduce, and the claimed 50% reduction found no passage in our copy establishing either the comparison or DDP's use in this method. (LLM, conf=0.75)
- Not matchedcites Zhou et al., 2022a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Some efforts on scaling these approaches beyond ImageNet-1k have been attempted (Caron et al., 2019;Goyal et al., 2021;2022a), but they focused on uncurated datasets, which typically lead to a significant drop in the quality of the features.”
§ DINOv2: Learning Robust Visual Features without Supervision > 1 Introduction
What the sources say
- Partly supportedcites Caron et al., 2019 sourceExperimental — accuracy not yet measured
The Introduction (p. 1) says previous work using non-curated raw data reported degraded feature quality. It does not establish that the drop is typically significant; the Introduction (p. 2) also reports that this paper’s approach surpassed features trained without labels on curated datasets. (LLM, conf=0.87)
- Partly supportedcites Goyal et al., 2021 sourceExperimental — accuracy not yet measured
Section 4.4 (p. 7) reports a significant drop for features from uncurated pretraining when they are frozen and evaluated on ImageNet, compared with features pretrained on curated, ImageNet-aligned data. That specific result does not establish that uncurated datasets typically reduce feature quality: the Introduction (p. 2) reports better performance than an ImageNet-supervised model on several downstream tasks. (LLM, conf=0.86)
- Not matchedcites Goyal et al., 2022a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This saves memory and compute in proportion approximately equal to the drop rate, thanks to specific fused kernels.”
§ DINOv2: Learning Robust Visual Features without Supervision > Efficient stochastic depth.
What the sources say
- Partly supportedcites Huang et al., 2016 sourceExperimental — accuracy not yet measured
Section 3 (p. 6) says bypassing ResBlocks avoids forward-backward computation and reports approximately 25% training-time savings under its linear-decay setting; Section 4 (p. 10) reports a corresponding measured speedup. The cited paper does not establish proportional memory savings or attribute the savings to fused kernels, so those parts of the citing sentence are unsupported. (LLM, conf=0.88)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“As a consequence, the training procedure scales more efficiently than DDP with float16 autocast when scaling the number of GPU nodes.”
§ DINOv2: Learning Robust Visual Features without Supervision > Fully-Sharded Data Parallel (FSDP).
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Overall, Pytorch-FSDP mixed-precision is superior to DDP with autocast in virtually all cases we encountered.”
§ DINOv2: Learning Robust Visual Features without Supervision > Fully-Sharded Data Parallel (FSDP).
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Our experiments did not show significant differences in final accuracy, and our ViT-g backbone counts 1.1B parameters.”
§ DINOv2: Learning Robust Visual Features without Supervision > Fast and memory-efficient attention.
What the sources say
- Not checked — no full text of the sourcecites Zhai et al., 2022 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“At scale, we observed that the opposite is true, and we therefore use two separate heads in all our experiments.”
§ DINOv2: Learning Robust Visual Features without Supervision > 4 Discriminative Self-supervised Pre-training
What the sources say
- Not matchedcites Zhou et al., 2022a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In this work, a naive clustering approach works reasonably well to resolve this issue.”
§ DINOv2: Learning Robust Visual Features without Supervision > 1 Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The KoLeo loss term improves nearest-neighbor search tasks (e.g.retrieval), and the MIM loss improves patch-level tasks (e.g.segmentation).”
§ DINOv2: Learning Robust Visual Features without Supervision > 6.2 Pretraining Data Source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As the size of models grow, training on LVD-142M becomes more beneficial than training on ImageNet-22k.”
§ DINOv2: Learning Robust Visual Features without Supervision > 6.3 Model Size and Data
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 26
- It may state two separate claims as one. 36
- The quote only partly states this claim. 4
Every source the paper cites for this claim was checked and supports it.
In the paper
“Our version is on par with or better than the original on all cases considered, while covering more use-cases and hardware.”
§ DINOv2: Learning Robust Visual Features without Supervision > Fast and memory-efficient attention.
What the sources say
- Supportedcites Dao et al., 2022 source
The source identifies and describes the original FlashAttention in the Introduction (§1). The citing authors’ comparison of their own version with that original—including performance, use-cases, and hardware—is their own claim, not a finding attributed to this source. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Of particular interest, Goyal et al. (2021) have also shown that these methods benefit from scaling in model size given enough pretrained data.”
§ DINOv2: Learning Robust Visual Features without Supervision > Scaling self-supervised pretraining.
What the sources say
- Supportedcites Goyal et al., 2021 source
In §4.1 (p. 4), the authors report that increasing model capacity has a greater effect for self-supervised pretrained models than for models trained from scratch, and confirm the gain with uncurated pretraining data. The Related Work (§2, p. 2) explains why large architectures matter for discriminative self-supervised learning on large datasets. (LLM, conf=0.90)
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“These approaches are conceptually closer to pretext tasks such as language modeling and can capture information at the image and pixel level (Caron et al., 2021).”
§ DINOv2: Learning Robust Visual Features without Supervision > 1 Introduction
What the sources say
- Supportedcites Caron et al., 2021 source
The Introduction (p. 1) compares self-supervised vision pretraining with language-modeling pretext tasks. It reports image-classification performance, while §4.2.2 (p. 7) shows that the learned features retain spatial information and support segmentation, consistent with capturing information at both the image and pixel level. (LLM, conf=0.90)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Additionally, the features output by self-supervised models have been shown to exhibit various useful properties, and have enabled enabled a wide variety of applications (Amir et al., 2022;Tumanyan et al., 2022;Ofri-Amar et al., 2023;Hamilton et al., 2022).”
§ DINOv2: Learning Robust Visual Features without Supervision > 1 Introduction
What the sources say
- Not matchedcites Amir et al., 2022
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Tumanyan et al., 2022 source
The Introduction (p. 1) describes useful properties of self-supervised DINO-ViT features and lists applications including image retrieval, object segmentation, and copy detection. The Conclusions (p. 8) add semantic appearance transfer as an application of those features. (LLM, conf=0.90)
- Supportedcites Ofri-Amar et al., 2023 source
The Introduction (p. 2) describes features from a self-supervised DINO-ViT as effective visual descriptors that capture localized semantic information and underpin the paper’s image-alignment method. The DINO-ViT Features section (p. 3) also describes their use across applications including segmentation, object discovery, and transfer learning. (LLM, conf=0.92)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Not matched
Every source the paper cites for this claim was checked and supports it.
In the paper
“Patterson et al. (2021) propose a methodology to report an estimation of the carbon emitted during the training of a model based on the specifics of the data center and its power grid.”
§ DINOv2: Learning Robust Visual Features without Supervision > 9 Estimating the Environmental Impact of Training our Models
What the sources say
- Supportedcites Patterson et al. (2021) source
Section 2.5 (p. 5) gives formulas for estimating training energy use and CO₂e emissions using datacenter PUE and emissions per kWh. It also explains how to obtain the datacenter’s emissions figure or estimate the regional energy mix, supporting the claim that the methodology accounts for the datacenter and its power grid. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This methodology was used in previous work in natural language processing (Strubell et al., 2019;Touvron et al., 2023) to establish an apple-to-apple comparison between pretraining schemes.”
§ DINOv2: Learning Robust Visual Features without Supervision > 9 Estimating the Environmental Impact of Training our Models
What the sources say
- Partly supportedcites Strubell et al., 2019 sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Partly supportedcites Touvron et al., 2023 sourceExperimental — accuracy not yet measured
Section 6, p. 10, applies the same carbon-emissions formula to LLaMA, OPT, and BLOOM for a fair comparison, using a common data-center assumption. It identifies the formula as following Wu et al. (2022), however, and does not establish that it used Patterson et al. (2021)'s methodology. (LLM, conf=0.86)
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Partly supported
In the paper
“This reduces redundancy and increases diversity among images.”
§ DINOv2: Learning Robust Visual Features without Supervision > Data sources.
What the sources say
- Not checked — no full text of the sourcecites Pizzi et al., 2022 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The whole processing is distributed on a compute cluster of 20 nodes equipped with 8 V100-32GB GPUs and takes less than two days to produce the LVD-142M dataset.”
§ DINOv2: Learning Robust Visual Features without Supervision > Self-supervised image retrieval.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“With the same hardware, compared to the iBOT implementation, the DINOv2 code runs around 2× faster using only 1/3 of the memory.”
§ DINOv2: Learning Robust Visual Features without Supervision > 5 Efficient implementation
What the sources say
- Not matchedcites Zhou et al., 2022a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
In the paper
“In terms of models, we train a ViT model (Dosovitskiy et al., 2021) with 1B parameters and distill it into a series of smaller models that surpass the best available general-purpose features, OpenCLIP (Ilharco et al., 2021) on most of the benchmarks at image and pixel levels.”
§ DINOv2: Learning Robust Visual Features without Supervision > Abstract
What the sources say
- Not matchedcites Ilharco et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our family of models drastically improves over the previous state of the art in self-supervised learning and reaches performance comparable with weaklysupervised features.”
§ DINOv2: Learning Robust Visual Features without Supervision > 1 Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We choose N = 4 as it provides a good tradeoff in that sense.”
§ DINOv2: Learning Robust Visual Features without Supervision > Self-supervised image retrieval.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“These improvements make our approach around 2× faster and require 3× less memory than similar discriminative self-supervised methods, allowing us to leverage longer training with larger batch sizes.”
§ DINOv2: Learning Robust Visual Features without Supervision > 1 Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“However, their features require supervised finetuning, while our features perform well out of the box.”
§ DINOv2: Learning Robust Visual Features without Supervision > Intra-image self-supervised training.
What the sources say
- Not matchedcites He et al., 2022
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Only LayerScale and Stochastic Depth incur a performance drop in linear probing but significantly improve the training stability in our experience.”
§ DINOv2: Learning Robust Visual Features without Supervision > 6.1 Improved Training Recipe
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We also see that training on our curated data increases the performances on domains that are not used for the curation process (INaturalist 2018, 2021 and Places205), proving that scale and diversity can benefit unseen domains.”
§ DINOv2: Learning Robust Visual Features without Supervision > 6.2 Pretraining Data Source
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Generally, we observe that each component improves the performance on either k-NN or linear probing and even both in most cases.”
§ DINOv2: Learning Robust Visual Features without Supervision > 6.1 Improved Training Recipe
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“This term is critical for dense prediction tasks, leading to almost 3% performance improvement.”
§ DINOv2: Learning Robust Visual Features without Supervision > 6.4 Loss Components
What the sources say
- Not matchedcites Zhou et al., 2022a
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This is true both when using models at resolution 224 and 448.”
§ DINOv2: Learning Robust Visual Features without Supervision > 7.1 ImageNet Classification
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For instance, a ViT-g trained on LVD-142M matches the performance on ImageNet-1k of a model trained on ImageNet-22k while significantly outperforming it on the other benchmarks.”
§ DINOv2: Learning Robust Visual Features without Supervision > 6.3 Model Size and Data
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On the other hand, training at high resolution for only 10k iterations at the end of the training is almost as good and only requiring a fraction of the compute.”
§ DINOv2: Learning Robust Visual Features without Supervision > 6.6 Impact of Resolution
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For comparison, retraining an OpenCLIP ViT-L or OpenCLIP ViT-G would require 22.4 MWh and 118.9 MWh, respectively, if run in the same data center.”
§ DINOv2: Learning Robust Visual Features without Supervision > 9 Estimating the Environmental Impact of Training our Models
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This carbon footprint represents in the order of 200k GPU-days.”
§ DINOv2: Learning Robust Visual Features without Supervision > 9 Estimating the Environmental Impact of Training our Models
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our models show very good performance on all datasets and for all setups.”
§ DINOv2: Learning Robust Visual Features without Supervision > Semantic segmentation.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Even though these benchmarks favor text-guided pretraining, our features are still competitive with OpenCLIP on most classification benchmarks, with the exception of a few datasets, especially SUN (-5.3%) and Cars (-4.7%).”
§ DINOv2: Learning Robust Visual Features without Supervision > 7.2 Additional Image and Video classification Benchmarks
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The 12 transfer classification benchmarks favor text-guided pretraining.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Additionally, we estimate the footprint of the whole project to be between 0.5k and 1k tCO 2 eq using the same grid as presented above 3 .”
§ DINOv2: Learning Robust Visual Features without Supervision > 9 Estimating the Environmental Impact of Training our Models
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While not perfect, the linear segmentation model using our DINOv2 backbone produces good results and behaves much better than the OpenCLIP one under this evaluation setup.”
§ DINOv2: Learning Robust Visual Features without Supervision > Semantic Segmentation and Depth Estimation.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We show that a ViT-L model distilled from a frozen ViT-g outperforms a the same model trained from scratch on all benchmarks, sometimes even outperforming the distillation target.”
§ DINOv2: Learning Robust Visual Features without Supervision > 10 Future work and Discussion
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We also observe that the model is robust to style (image versus drawing), and to large variation of poses (see the elephant).”
§ DINOv2: Learning Robust Visual Features without Supervision > Out-of-distribution generalization.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Our model is slightly fairer across regions and incomes than the SEERv2 model and significantly better than the supervised baseline reported by Goyal et al. (2022a).”
§ DINOv2: Learning Robust Visual Features without Supervision > 8.1 Geographical Fairness
What the sources say
- Not matchedcites Goyal et al. (2022a)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“first, our unsupervised foreground / background detector, based on detecting the highest variance direction, performs very well and is capable of delineating the boundary of the main object in the picture.”
§ DINOv2: Learning Robust Visual Features without Supervision > Out-of-distribution generalization.
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Second, the other components correspond to”
§ DINOv2: Learning Robust Visual Features without Supervision > Out-of-distribution generalization.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one. The quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For example, a single pre-training of a ViT-g model (22k GPU-hours) emits 3.7 tons of CO 2 eq, while a finetuning on ImageNet-1k (1k GPU-hours) emits 0.2 tons.”
§ DINOv2: Learning Robust Visual Features without Supervision > 9 Estimating the Environmental Impact of Training our Models
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Our pipeline does not require any metadata or text and directly works with images, as shown in Fig. 3.”
§ DINOv2: Learning Robust Visual Features without Supervision > 3 Data Processing
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Increasing image resolution is key to pixellevel downstream tasks such as segmentation or detection, where small objects disappear at low resolutions.”
§ DINOv2: Learning Robust Visual Features without Supervision > 4 Discriminative Self-supervised Pre-training
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We evaluate the quality of features by training a simple classifier over a frozen backbone, and do not perform finetuning of the backbone weights.”
§ DINOv2: Learning Robust Visual Features without Supervision > 7.1 ImageNet Classification
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“At the same time, we also see that the performance increase on the alternative test sets is larger for our method, indicating stronger generalization.”
§ DINOv2: Learning Robust Visual Features without Supervision > 7.1 ImageNet Classification
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This is explained by the lack of control over the data quality and diversity, which are essential to produce good features.”
§ DINOv2: Learning Robust Visual Features without Supervision > 1 Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Unlike these works, we use no pretrained encoders, metadata nor supervision to filter images and leverage visual similarity between images.”
§ DINOv2: Learning Robust Visual Features without Supervision > Automatic data curation.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Furthermore, these image encoders require aligned text-image corpora and hence, do not offer the flexibility of their text counterparts, that is, to learn from raw data alone.”
§ DINOv2: Learning Robust Visual Features without Supervision > 1 Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We also remove near-duplicates of images contained in the test or validation set of any benchmark used in this work.”
§ DINOv2: Learning Robust Visual Features without Supervision > Data sources.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“The KoLeo regularizer derives from the Kozachenko-Leonenko differential entropy estimator (see Beirlant et al. (1997); Delattre & Fournier (2017)) and encourages a uniform span of the features within a batch.”
§ DINOv2: Learning Robust Visual Features without Supervision > 4 Discriminative Self-supervised Pre-training
What the sources say
- Not matchedcites Beirlant et al. (1997)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites Delattre & Fournier (2017) source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“However, training at high resolution is time and memory demanding, and instead, we increase the resolution of images to 518 × 518 during a short period at the end of pretraining.”
§ DINOv2: Learning Robust Visual Features without Supervision > 4 Discriminative Self-supervised Pre-training
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“For all models, we run the linear evaluation using our code, after making sure that our numbers match those reported in technical reports and papers.”
§ DINOv2: Learning Robust Visual Features without Supervision > 7.1 ImageNet Classification
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This form of text-guided pretraining limits the information that can be retained about the image since captions only approximate the rich information in images, and complex pixel-level information may not surface with this supervision.”
§ DINOv2: Learning Robust Visual Features without Supervision > 1 Introduction
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
- Rests on an assumption: Captions only approximate the rich information in images, and complex pixel-level information may not surface with text supervision.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As DINOv2 leads to features that are strong in both the linear and finetuning settings, a strong property of our approach is that finetuning is optional.”
§ DINOv2: Learning Robust Visual Features without Supervision > 7.1 ImageNet Classification
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“These methods provide performant frozen features on standard benchmarks like ImageNet (Russakovsky et al., 2015), but they are hard to scale to larger model sizes (Chen et al., 2021).”
§ DINOv2: Learning Robust Visual Features without Supervision > Discriminative self-supervised learning.
What the sources say
- Not checked — no full text of the sourcecites Russakovsky et al., 2015 source
- Not matchedcites Chen et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“MLP heads gradients are reduced in float32 to avoid training instabilities”
§ DINOv2: Learning Robust Visual Features without Supervision > Fully-Sharded Data Parallel (FSDP).
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Following previous work, we use a linear model for simplicity, ensuring a reproducible evaluation, despite the fact that classes may not be linearly separable.”
§ DINOv2: Learning Robust Visual Features without Supervision > 7.1 ImageNet Classification
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“In order to report this additional validation performance, for all models, we run the evaluation with our code.”
§ DINOv2: Learning Robust Visual Features without Supervision > 7.1 ImageNet Classification
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Ruan et al. (2023) recommend to replace the teacher softmax-centering step of DINO and iBot by the Sinkhorn-Knopp (SK) batch normalization of SwAV (Caron et al., 2020).”
§ DINOv2: Learning Robust Visual Features without Supervision > 4 Discriminative Self-supervised Pre-training
What the sources say
- Not matchedcites Ruan et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked yetcites Caron et al., 2020 source
Checked before — its earlier verdict is held back until a new check runs.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
In the paper
“We can attribute the strong performance of the DINOv2 family of models to several factors: i) an improved training recipe with better hyperparameters and regularization (Table 1), ii) a larger model scale with improved results regardless of the data used for training (Fig. 4), iii) a larger dataset (Fig. 4) and iv) the distillation process that makes smaller models benefit from the performance of”
§ DINOv2: Learning Robust Visual Features without Supervision > 10 Future work and Discussion
What the sources say
- Not matchedcites Fig. 4
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This exhibits the ability of our model to transfer across domains and understand relations between similar parts of different objects.”
§ DINOv2: Learning Robust Visual Features without Supervision > 10 Future work and Discussion
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is interesting to see that our features perform well across task granularities, both at the category-level and instance-level.”
§ DINOv2: Learning Robust Visual Features without Supervision > 7.3 Instance Recognition
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“We can attribute the strong performance of the DINOv2 family of models to several factors: i) an improved training recipe with better hyperparameters and regularization (Table 1), ii) a larger model scale with improved results regardless of the data used for training (Fig. 4), iii) a larger dataset (Fig. 4) and iv) the distillation process that makes smaller models benefit from the performance of”
§ DINOv2: Learning Robust Visual Features without Supervision > 10 Future work and Discussion
What the sources say
- Not matchedcites Table 1
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
- Not matched
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“This estimate only considers the GPUs' electricity consumption and ignores other emissions, such as their manufacturing and disposal.”
§ DINOv2: Learning Robust Visual Features without Supervision > 9 Estimating the Environmental Impact of Training our Models
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“We can attribute the strong performance of the DINOv2 family of models to several factors: i) an improved training recipe with better hyperparameters and regularization (Table 1), ii) a larger model scale with improved results regardless of the data used for training (Fig. 4), iii) a larger dataset (Fig. 4) and iv) the distillation process that makes smaller models benefit from the performance of”
§ DINOv2: Learning Robust Visual Features without Supervision > 10 Future work and Discussion
What the sources say
- Not matchedcites Fig. 5
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
- Not matched
The paper relies on this without support.
Captions only approximate the rich information in images, and complex pixel-level information may not surface with text supervision.
“This form of text-guided pretraining limits the information that can be retained about the image since captions only approximate the rich information in images, and complex pixel-level information may not surface with this supervision.”
The paper relies on this without support.
Most SSL methods were developed using ImageNet-1k validation performance as a debugging signal.
“Because most SSL methods were developped using ImageNet-1k validation performance as a debugging signal, we also report the top-1 accuracy on ImageNet-ReaL and ImageNet-V2.”
The paper relies on this without support.
The 12 transfer classification benchmarks favor text-guided pretraining.
“Even though these benchmarks favor text-guided pretraining, our features are still competitive with OpenCLIP on most classification benchmarks, with the exception of a few datasets, especially SUN (-5.3%) and Cars (-4.7%).”
The paper relies on this without support.
The Non-Human and Crime meta-categories are harmful.
“Non-Human and Crime are considered harmful.”
The paper relies on this without support.
Self-reported gender, skin tone, and age labels are accurate.
“images of people of different gender, skin tone, and age (all self-reported).”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Foundation Models (FMs) [23, 35, 37] - generic models trained on web-scale datasets - have demonstrated remarkable zero-shot performance and can be quickly adapted to various downstream tasks with few additional tuning cost.”
From Towards More General Video-based Deepfake Detection through Facial Component Guided Adaptation for Foundation Model (2024) · cites this paper as [35]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous works, however, tend to focus on understanding evaluation using probe-based evaluation or visual question answering tasks after aligning with a large-language model.”
From V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning (2025) · cites this paper as Oquab et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“having high quality data outweighs the quantity of data”
From Genie: Generative Interactive Environments (2024) · cites this paper as Oquab et al. (2023)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A major advantage of this strategy is that the DINO model, pretrained on ImageNet, has been exposed to a very diverse set of natural images, which allows the model to develop a more sophisticated understanding of image structure than would be possible through studying astronomical images alone.”
From A Semi-Supervised Learning Method for the Identification of Bad Exposures in Large Imaging Surveys (2026) · cites this paper as Oquab et al. 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The semantic awareness of DINOv2 is also especially useful in creating a global coherence to evaluate whether scenes make sense wholistically.”
From MTReD: 3D Reconstruction Dataset for Fly-over Videos of Maritime Domain (2025) · cites this paper as [8]
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While DINOv2 was not explicitly trained for the medical domain, it has shown strong generalization, making it effective for general tasks, including those in medical imaging.”
From ConfIC-RCA: Statistically Grounded Efficient Estimation of Segmentation Quality (2025) · cites this paper as [54]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Because uncurated and unbalanced data can hinder model performance (Assran et al., 2022; Oquab et al., 2023), we filter YT1B by adapting an existing retrieval-based curation pipeline to handle videos.”
From V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning (2025) · cites this paper as Oquab et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“The latter is a much larger (300 million parameters) Vision Transformer21 trained at 0.5 mpp resolution on over 100,000 WSIs from 22 major tissue types using self-distillation and masked modeling22.”
From Generating dermatopathology reports from gigapixel whole slide images with HistoGPT (2025) · cites this paper as [22]
The cited source says what the claim attributes to it.
In the citing paper
“Similar to Oquab et al. (2023), we ensure that none of the videos from the target validation sets are contained in the initial, uncurated data pool.”
From V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning (2025) · cites this paper as Oquab et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“The OpenVLA model architecture consists of a fused vision backbone that combines the SigLIP [9] and DinoV2 [25] encoders.”
From OpenVLA: An Open-Source Vision-Language-Action Model (2024) · cites this paper as [25]
The cited source says what the claim attributes to it.
In the citing paper
“Models such as DINOv2 [7], Vision Transformers (ViT) [8], and Swin Transformers [9] have demonstrated outstanding transfer learning performance across a wide range of domains, often achieving state-of-the-art results with only minimal fine-tuning.”
From Trustworthy Celestial Eye: Calibrated and Robust Planetary Classification via Self-Supervised Vision Transformers (2026) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“Oquab et al. [7] proposed DINOv2, a self-supervised vision foundation model trained on 142 million curated natural images that demonstrates strong transfer learning capabilities across various downstream tasks.”
From Trustworthy Celestial Eye: Calibrated and Robust Planetary Classification via Self-Supervised Vision Transformers (2026) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“we propose that a DINOv2 [8] based perception score be used, and argue that as DINOv2 is trained using internet-scale levels of data, additional training data is not required.”
From MTReD: 3D Reconstruction Dataset for Fly-over Videos of Maritime Domain (2025) · cites this paper as [8]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“but the model's effectiveness on scientific imaging domains with distinct statistical properties remains underexplored.”
From Trustworthy Celestial Eye: Calibrated and Robust Planetary Classification via Self-Supervised Vision Transformers (2026) · cites this paper as [7]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“When compared to LPIPS, it demonstrates superior ability in evaluating scene completion while retaining equal sensitivity to scene accuracy”
From MTReD: 3D Reconstruction Dataset for Fly-over Videos of Maritime Domain (2025) · cites this paper as [8]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“significantly better on high-income households than low-income ones, with a difference of 31.7%.”
§ DINOv2: Learning Robust Visual Features without Supervision > Income buckets Regions
Reported 31.7 · recomputed 23.1
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“However, we still observe a significant difference between regions, particularly in Africa, where our model performance drops by 25.7% compared to Europe.”
§ DINOv2: Learning Robust Visual Features without Supervision > 8.1 Geographical Fairness
Reported 25.7 · recomputed 15.7
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ DINOv2: Learning Robust Visual Features without Supervision > Automatic data curation.
“Unlike these works, we use no pretrained encoders, metadata nor supervision to filter images and leverage visual similarity between images.”
§ DINOv2: Learning Robust Visual Features without Supervision > Self-supervised image retrieval.
“In order to do this, we first compute an image embedding using a self-supervised ViT-H/16 network pretrained on ImageNet-22k, and use cosine-similarity as a distance measure between images.”
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 2×
“However, despite their potential to learn general-purpose features, most of the advances in self-supervised learning were made in the context of pretraining on a small curated dataset, ImageNet-1k (Russakovsky et al., 2015).”
BackgroundMethodLearning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Research works printed but not linked: 2
- [62]62. Dan Hendrycks, Kevin Zhao, Steven Basart, Jacob Steinhardt, and Dawn Song. Natural adversarial exam- ples. In CVPR, 2021b.
- [113]113. Hugo Touvron, Andrea Vedaldi, Matthijs Douze, and Hervé Jégou. Fixing the train-test resolution discrep- ancy. In NeurIPS, 2019.
Cited by
Sorted by citations
Items 201–300 of 1,090
Hierarchical Spatio-temporal Decoupling for Text-to- Video Generation
Qing, Z., Zhang, S., Wang, J., Wang, X., Wei, Y., Zhang, Y., Gao, C., & Sang, N. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00634 · Cited by 43
“To accomplish this, we explore self-supervised models such as DINO [6, 35] and the multimodal model CLIP [39] as semantic models.”
ZeroShape: Regression-Based Zero-Shot Shape Reconstruction
Huang, Z., Stojanov, S., Thai, A., Jampani, V., & Rehg, J. M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00959 · Cited by 21
“…challenge of zero-shot generalization head-on, with impressive developments for 2D vision tasks like segmentation [23, 38], visual question answering [3, 24], image generation [1, 44, 45], and in training general vision representations that can be easily adapted for any vision task [34, 39].”
BackgroundAtila, A., Sukhomlinov, S. V., Honecker, M., et al. (2025) · Acta Materialia · doi:10.1016/j.actamat.2025.120753 · Cited by 19
Benchmarking pathology foundation models: Adaptation strategies and scenarios
Lee, J., Lim, J., Byeon, K., & Kwak, J. T. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110031 · Cited by 37
Transformer-based approach for printing quality recognition in fused filament fabrication
Wang, X. Q., Jin, Z., Zheng, B., et al. (2025) · npj Advanced Manufacturing · doi:10.1038/s44334-025-00025-0 · Cited by 19
“ViTisadaptedforself-supervisedlearningframeworkswhen pairedwiththemodelof “ Self-Distillation with No Labels v2 ” (DINOv2) 35 , which learns invariant representations without requiring labeled data.”
Wang, B., Lin, F., Li, M., et al. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103382 · Cited by 19
PolyMaX: General Dense Prediction with Mask Transformer
Yang, X., Yuan, L., Wilber, M. J., Sharma, A., Gu, X., Qiao, S., Debats, S. R., Wang, H., Adam, H., Sirotenko, M., et al. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00109 · Cited by 19
Few-Shot Panoptic Segmentation With Foundation Models
Käppeler, M., Petek, K., Vödisch, N., Burgard, W., & Valada, A. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611624 · Cited by 24
Retrieval-Augmented Few-Shot Medical Image Segmentation With Foundation Models
Zhao, L., Chen, X., Chen, E. Z., Liu, Y., Chen, T., & Sun, S. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3568479 · Cited by 19
Introduction to deep learning methods for multi‐species predictions
Hu, Y., Si‐Moussi, S., & Thuiller, W. (2024) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14466 · Cited by 29
A review of deep learning-based approaches to sign language processing
Tan, S., Khan, N., An, Z., Ando, Y., Kawakami, R., & Nakadai, K. (2024) · Advanced Robotics · doi:10.1080/01691864.2024.2442721 · Cited by 28
“Sign2GPT [18] tries to fully utilize a large vision (DINO-V2-ViT [108]) and language (XGLM [100]) models.”
Chaurasia, A. K., Harris, H., Toohey, P. W., & Hewitt, A. W. (2025) · Prostate Cancer and Prostatic Diseases · doi:10.1038/s41391-025-00957-w · Cited by 23
“Finally, this mode was chosen to train binary and multi-class classi fi ers for diagnosing prostate cancer from WSIs.”
Zhao, L. (2025) · Psychoradiology · doi:10.1093/psyrad/kkaf007 · Cited by 23
“Foundation models have emerged as a transformative approach in fields like NLP and computer vision (Radford et al. , 2018 ; Doso-vitskiy et al. , 2020 ; Oquab et al. , 2023 ; Dubey et al. , 2024 ).”
Foundation models and Transformers for anomaly detection: A survey
Ammar, M. B., Mendoza, A., Belkhir, N., Antoine Manzanera, B., & Franchi, G. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103517 · Cited by 25
EndoChat: Grounded multimodal large language model for endoscopic surgery
Wang, G., Bai, L., Wang, J., Yuan, K., Li, Z., Jiang, T., He, X., Wu, J., Chen, Z., Lei, Z., et al. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103789 · Cited by 54
MtArtGPT: A Multi-Task Art Generation System With Pre-Trained Transformer
Jin, C., Zhu, R., Zhu, Z., Yang, L., Min, Y., & Luo, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3349567 · Cited by 21
“In addition to generating text descriptions from input images and user instructions, we also employ various state-of-the-art visual models, such as Segment Anything [61] and Grounding DINO [62], [63], to assist with extracting semantic information and location labeling from images.”
MethodAn Investigation Into the Advancements of Edge-AI Capabilities for Structural Health Monitoring
Mishra, A., Gangisetti, G., & Khazanchi, D. (2024) · IEEE Access · doi:10.1109/access.2024.3365550 · Cited by 21
A Microscopic Vision-Based Robotic System For Floating Electrode Assembly
An, Y., Yang, J., He, B., Liu, Y., Guo, Y., & Yang, G. (2024) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2024.3359332 · Cited by 19
“In specific, we employ the effective pretrained feature extractor, DINOv2 [27], to extract the image features from the texture-less microscopic images of the electrode tip I E ( x, y ) , and use a multilayer perceptron (MLP) to regress the engaging hole subsequently, as shown in Fig.”
MethodExploring Self-Supervised Vision Transformers for Deepfake Detection: A Comparative Analysis
Nguyen, H. H., Yamagishi, J., & Echizen, I. (2024) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb62174.2024.10744497 · Cited by 29
“The introduction of registers [13] in DINOv2 [36] further validated these capabilities, demonstrating their effectiveness in transfer learning across various downstream tasks.”
BackgroundMethodInfluentialRevisit Anything: Visual Place Recognition via Image Segment Retrieval
Garg, K., Puligilla, S. S., Kolathaya, S., Krishna, K. M., & Garg, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73113-6_19 · Cited by 23
“In this work, we propose a generally-applicable approach which is built on top of models like SAM [37] and DINOv2 [51], and works with both VPR-agnostic [32] and VPR-specific [35] backbone models.”
MethodCaltech Aerial RGB-Thermal Dataset in the Wild
Lee, C., Anderson, M., Ranganathan, N., Zuo, X., Do, K., Gkioxari, G., & Chung, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73036-8_14 · Cited by 23
USE: Universal Segment Embeddings for Open-Vocabulary Image Segmentation
Wang, X., He, W., Xuan, X., Sebastian, C., Ono, J. P., Li, X., Behpour, S., Doan, T., Gou, L., Shen, H., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00401 · Cited by 23
“Inspired by recent advancements in multi-modal foundation models (e.g., LLaVA [21], CogVLM [32]), we introduce the USE model, which leverages the capabilities of pre-trained foundation models (i.e., CLIP [29] and DINOv2 [26]) with minimal trainable parameters.”
MethodMultiagent Multitraversal Multimodal Self-Driving: Open MARS Dataset
Li, Y., Li, Z., Chen, N., Gong, M., Lyu, Z., Wang, Z., Jiang, P., & Feng, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02081 · Cited by 21
“For EmerNeRF, we leverage the dino feature from the DINOv2 ViT-B/14 [69] foundation model.”
MethodAccurate and Efficient Object Pose Estimation via the Aggregation of Diffusion Features
Wang, T., Hu, G., & Wang, H. G. (2024) · International Journal of Computer Vision · doi:10.1109/cvpr52733.2024.00975 · Cited by 17
Yan, F., Wu, J., Li, J., Wang, W., Chen, Y., Wei, L., Lu, J., Chen, W., Gao, Z., Li, J., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02027-w · Cited by 34
“To achieve robustperformance across112clinical-gradedownstream tasks, we pre-trained our model on the curated dataset using the DINOv2 architecture 16 , which is designed to extract high-quality visual features through self-supervised learning on unlabeled data.”
InfluentialFoundation Models for Histopathology—Fanfare or Flair
Alfasly, S., Nejat, P., Hemati, S., Khan, J., Lahr, I., Alsaafin, A., Shafique, A., Comfere, N. I., Murphree, D. H., Meroueh, C., et al. (2024) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.02.003 · Cited by 21
Learning Cross-View Visual Geo-Localization Without Ground Truth
Li, H., Xu, C., Yang, W. T., Yu, H., & Xia, G.-S. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3425608 · Cited by 24
“In this field of CVGL, various works have been developed to address the challenges posed by tasks such as drone-to-satellite and ground-to-satellite localization.”
MethodRethinking Self-Supervised Semantic Segmentation: Achieving End-to-End Segmentation
Liu, Y., Zeng, J., Tao, X., & Fang, G. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3432326 · Cited by 17
Chen, J., Frey, J., Zhou, R., Miki, T., Martius, G., & Hutter, M. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3455788 · Cited by 25
“We first extract pixel-wise feature embed-dings using a pre-trained DINOv2 backbone [27], compared to DINOv1 [26] used in [18].”
BackgroundMethodOpenStreetView-5M: The Many Roads to Global Visual Geolocation
Astruc, G., Dufour, N., Siglidis, I., Aronssohn, C., Bouia, N., Fu, S., Loiseau, R., Nguyen, V. N., Raude, C., Vincent, E., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02074 · Cited by 30
“We consider different types of pretraining objectives, including classification on ImageNet, self-supervized pretraining DINOv2 [43], text supervision CLIP [48], as well as StreetCLIP [16], which is finetuned specifically for geolocation.”
Steerers: A Framework for Rotation Equivariant Keypoint Descriptors
Bökman, G., Edstedt, J., Felsberg, M., & Kahl, F. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00467 · Cited by 18
Curriculum Point Prompting for Weakly-Supervised Referring Image Segmentation
Dai, Q., & Yang, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01301 · Cited by 24
“Additionally, ImageNet predominantly features object-centric images, where the objects are often centrally positioned, making it easier to extract comprehensive class responses using CLIP or unsupervised DINO models [5, 43, 45].”
MethodInsect-Foundation: A Foundation Model and Large-Scale 1M Dataset for Visual Insect Understanding
Nguyen, H.-Q., Truong, T.-D., Nguyen, X.-B., Dowling, A. P. G., Li, X., & Luu, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02072 · Cited by 28
“Recent foundation models [6–8, 16–18, 33, 36, 55, 56] pre-trained on large-scale datasets have revolutionized vision models with solid performance on downstream applications.”
BackgroundMethodMammoVLM: A generative large vision–language model for mammography-related diagnostic assistance
Cao, Z., Deng, Z., Ma, J., Hu, J., & Ma, L. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.102998 · Cited by 21
DeAndres-Tame, I., Tolosana, R., Melzi, P., Vera-Rodríguez, R., Kim, M., Rathgeb, C., Liu, X., Gomez, L. F., Morales, A., Fiérrez, J., et al. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103099 · Cited by 17
“…of novel face generative methods and the creation of synthetic face databases, as well as investigate the application of synthetic data to better train FR systems, we have organized the 2 nd FRCSyn-onGoing Challenge, which is based on the 2 nd FRCSyn Challenge as part of CVPR 2024 1 [37].”
Unsupervised Recognition of Unknown Objects for Open-World Object Detection
Fang, R., Pang, G., Miao, W., Bai, X. P., Zheng, J. G., & Ning, X. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3559940 · Cited by 29
“5 [63] and Objects365 [64] datasets.”
Mining negative samples on contrastive learning via curricular weighting strategy
Zhuang, J., Jing, X., & Jia, X. (2024) · Information Sciences · doi:10.1016/j.ins.2024.120534 · Cited by 17
Bourriez, N., Bendidi, I., Cohen, E., Watkinson, G., Sanchez, M., Bollot, G., & Genovesio, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01098 · Cited by 16
“…has spurred important applications in many tasks[11, 14, 40, 49], as well as the creation of foundation models that have significantly improved performance across a variety of domains[18, 19], marking a new era of versatility and robustness in the application of these transformative technologies.”
BackgroundLiu, X., Shi, G., Wang, R., Lai, Y., Zhang, J., Han, W., Lei, M., Li, M., Zhou, X., Wu, Y., et al. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103550 · Cited by 18
YOLOv8 for defect inspection of hexagonal directed self-assembly patterns: a data-centric approach
Dehaerne, E., Dey, B., Esfandiar, H., Verstraete, L., Suh, H. S., Halder, S., & Gendt, S. D. (2023) · European Mask and Lithography Conference (EMLC) · doi:10.1117/12.2675573 · Cited by 17
MonoVAN: Visual Attention for Self-Supervised Monocular Depth Estimation
Indyk, I., & Makarov, I. (2023) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar59233.2023.00138 · Cited by 16
Vray, G., Tomar, D., Bozorgtabar, B., & Thiran, J. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3355645 · Cited by 19
Detecting floating litter in freshwater bodies with semi-supervised deep learning
Jia, T., de Vries, R., Kapelan, Z. S., van Emmerik, T. H. M., & Taormina, R. (2024) · Water Research · doi:10.1016/j.watres.2024.122405 · Cited by 19
Back to 3D: Few-Shot 3D Keypoint Detection with Back-Projected 2D Features
Wimmer, T., Wonka, P., & Ovsjanikov, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00398 · Cited by 21
“While we propose to use the DINO model [28], we investigate different 2D feature ex-tractors for shape analysis tasks in our experiments.”
InfluentialOne-Shot Open Affordance Learning with Foundation Models
Li, G., Sun, D., Sevilla-Lara, L., & Jampani, V. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00298 · Cited by 32
“The field of computer vision has recently witnessed a surge in the prevalence of large foundational models, such as CLIP [49], Segment Anything [25], DINO [8, 47] etc .”
Cross-modal change detection using historical land use maps and current remote sensing images
Deng, K., Hu, X., Zhang, Z., Su, B., Feng, C., Zhan, Y., Wang, X., & Duan, Y. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.10.010 · Cited by 19
Veasey, B. P., & Amini, A. A. (2025) · IEEE Open Journal of Engineering in Medicine and Biology · doi:10.1109/ojemb.2025.3530841 · Cited by 16
“Three classes of LVM architectures were examined in this study to gain a broad understanding of how they perform during domain adaptation for lung cancer classification, namely, DI-NOv2 ViT [13], SwinV2 transformer [11], and the ConvNext-V2 convolutional network [21].”
InfluentialA Review on Medical Image Segmentation: Datasets, Technical Models, Challenges and Solutions
Gan, H., Ramlee, M. H., Wang, Z., & Shimizu, A. (2025) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1574 · Cited by 19
“Although DINO and DINOv2 excels in extracting meaningful features in a self-supervised manner, the models still require fine-tuning on task-specific labeled data for optimal accuracy specialized segmentation tasks.”
InfluentialMAIRA-2: Grounded Radiology Report Generation
Bannur, S., Bouzid, K., Castro, D. C., Schwaighofer, A., Thieme, A., Bond-Taylor, S., Ilse, M., Pérez-García, F., Salvatelli, V., Sharma, H., et al. (2024) · arXiv · doi:10.48550/arxiv.2406.04449 · Cited by 19
“We retrained the image encoder, R ad -DINO (Pérez-García et al., 2024), for 106 000 iterations starting from the public ViT-B weights (Oquab et al., 2024), using a global batch size of 1280 across 32 A100 GPUs.”
MethodDepthCD: Depth prompting in 2D remote sensing imagery change detection
Zhou, N., Zhou, M., & Sui, H. (2025) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2025.05.020 · Cited by 18
Xu, F., Yin, W., Ye, Q., Chi, Y., Wen, H., Sun, Y., Zheng, J., Wang, Q., Wang, Q., Zhao, M., et al. (2025) · npj Precision Oncology · doi:10.1038/s41698-025-01094-2 · Cited by 20
“The feature extractor is pretrained using an image self-supervised learning framework (DINOv2), a state-of-the-art self-supervised learning framework for image analysis 21 .”
COMEDIAN: Self-Supervised Learning and Knowledge Distillation for Action Spotting Using Transformers
Denize, J., Liashuha, M., Rabarisoa, J., Orcesi, A., & Hérault, R. (2024) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw60836.2024.00060 · Cited by 23
PlaceFormer: Transformer-Based Visual Place Recognition Using Multi-Scale Patch Selection and Fusion
Kannan, S. S., & Min, B. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3408075 · Cited by 16
“Different Backbones: DINOv2 [31] stands out as a prominent Vision Foundational Model (VFM), proficient in tackling various vision challenges in its pre-initialized state.”
BackgroundSpawnNet: Learning Generalizable Visuomotor Skills from Pre-trained Network
Lin, X., So, J., Mahalingam, S., Liu, F., & Abbeel, P. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610356 · Cited by 18
Decoupling Image Deblurring Into Twofold: A Hierarchical Model for Defocus Deblurring
Liang, P., Jiang, J., Liu, X., & Ma, J. (2024) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2024.3443732 · Cited by 16
MaskDiffusion: Exploiting Pre-Trained Diffusion Models for Semantic Segmentation
Kawano, Y., & Aoki, Y. (2024) · IEEE Access · doi:10.1109/access.2024.3456442 · Cited by 21
“Unsupervised semantic segmentation [1], [2], [3] avoids costly annotation by leveraging representations obtained through a model [4], [5] which has been trained on a different task.”
MethodCustomize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training
He, R., Huang, S., Nie, X., Hui, T., Liu, L., Dai, J., Han, J., Li, G., & Liu, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00665 · Cited by 23
Rotation-Agnostic Image Representation Learning for Digital Pathology
Alfasly, S., Shafique, A., Nejat, P., Khan, J., Alsaafin, A., Alabtah, G., & Tizhoosh, H. R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01110 · Cited by 21
“Self-supervised learning has gained popularity in digital pathology due to its independence from annotated histopathological images, making it possible to leverage large datasets [29, 30].”
BackgroundCrowd-SAM: SAM as a Smart Annotator for Object Detection in Crowded Scenes
Cai, Z. Y., Gao, Y., Zheng, Y., Zhou, N., & Huang, D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72890-7_20 · Cited by 15
Restrepo, D. S., Wu, C., Cajas, S. A., Nakayama, L. F., Celi, L. A., & López, D. M. (2024) · medRxiv · doi:10.1101/2024.06.03.24308401 · Cited by 33
“Image embeddings were obtained using Meta’s foundation computer vision model DINO V2 [40], and text embeddings were extracted from Meta’s Large Language Model (LLM) LLAMA 2 [38].”
BackgroundMethodInfluentialFocus on Local: Finding Reliable Discriminative Regions for Visual Place Recognition
Wang, C., Chen, S., Song, Y., Xu, R., Zhang, Z., Zhang, J., Yang, H., Zhang, Y., Fu, K., Du, S., et al. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i7.32811 · Cited by 17
“Feature Extractor: Following prior works (Keetha et al. 2023; Lu et al. 2024d; Izquierdo and Civera 2024; Lu et al. 2024b), we adopt the pre-trained DINOv2 model (Oquab et al. 2023) as the feature extractor for our visual place recognition (VPR) pipeline.”
InfluentialResearch Advances in Deep Learning for Image Semantic Segmentation Techniques
Xiao, Z., Chai, T., Li, N., Shen, X., Guan, T., Tian, J., & Li, X. (2024) · IEEE Access · doi:10.1109/access.2024.3496723 · Cited by 18
Cao, S., Xu, B., Zhou, W., Zhou, L., Zhang, J., Zheng, Y., Hu, W., Han, Z., & Lü, H. (2025) · Plant Phenomics · doi:10.1016/j.plaphe.2025.100005 · Cited by 15
“To build on the strengths and avoid the weaknesses of synthetic images, the teacher model of V2 is based on the DINOv2-G encoder [49], trained on high-quality synthetic images, and then assigns pseudo-depth labels on unlabeled real images.”
Large vision-language models enabled novel objects 6D pose estimation for human-robot collaboration
Xia, W., Zheng, H., Xu, W., & Xu, X. W. (2025) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2025.103030 · Cited by 17
SurGen: 1020 H&E-stained whole-slide images with survival and genetic markers
Myles, C., Um, I. H., Marshall, C., Harris‐Birtill, D., & Harrison, D. J. (2025) · GigaScience · doi:10.1093/gigascience/giaf086 · Cited by 18
A New Retrieval Engine for Vitrivr
Gasser, R., Arnold, R., Faber, F., Schuldt, H., Waltenspül, R., & Rossetto, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-53302-0_28 · Cited by 14
FOSSIL: Free Open-Vocabulary Semantic Segmentation through Synthetic References Retrieval
Barsellotti, L., Amoroso, R., Baraldi, L., & Cucchiara, R. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00149 · Cited by 20
“To showcase this, and prove the effectiveness of different self-supervised backbones, in Table 2 we report an ablation study on performance obtained on the ADE benchmark with three different backbones: MAE ViT-L/14 [12], DINO ViT-B/8 [3] and DINOv2 ViT-L/14 [19].”
BackgroundMethodInfluentialMedical Image Retrieval Using Pretrained Embeddings
Jush, F. K., Truong, T., Vogler, S., & Lenga, M. (2024) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi56570.2024.10635170 · Cited by 17
“…of this study is as follows: • We evaluated the performance of using start-of-the-art self-supervised pretrained models i.e., DINOv1 [12], DINOv2 [13], DreamSim [14] trained on natural images versus a supervised pretrained model based on Swin Transformer [15] trained on RadImageNet dataset…”
MethodThe Manga Whisperer: Automatically Generating Transcriptions for Comics
Sachdeva, R., & Zisserman, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01232 · Cited by 22
“In addition, we use large pretrained vision encoders, CLIP [38] and DINO-V2 [34], to evaluate their feature representation for manga characters.”
MethodDINO-Mix enhancing visual place recognition with foundational vision model and feature mixing
Huang, G., Zhou, Y., Hu, X., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-73853-3 · Cited by 14
Visual place recognition for aerial imagery: A survey
Moskalenko, I., Kornilova, A., & Ferrer, G. (2024) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2024.104837 · Cited by 18
Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objects
Fan, Z., Ohkawa, T., Yang, L., et al. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72698-9_25 · Cited by 14
VLATest: Testing and Evaluating Vision-Language-Action Models for Robotic Manipulation
Wang, Z., Zhou, Z., Song, J., Huang, Y., Shu, Z., & Ma, L. (2025) · Proceedings of the ACM on Software Engineering · doi:10.1145/3729343 · Cited by 14
Distilling Foundation Models for Robust and Efficient Models in Digital Pathology
Filiot, A., Dop, N., Tchita, O., Riou, A., Dubois, R., Peeters, T., Valter, D., Scalbert, M., Saillard, C., Robin, G., et al. (2026) · Lecture Notes in Computer Science · doi:10.1007/978-3-032-04981-0_16 · Cited by 17
PointSea: Point Cloud Completion via Self-structure Augmentation
Zhu, Z., Chen, H., He, X., & Wei, M. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02400-y · Cited by 20
“Then, to explore the potential of vision foundation models in the completion task, we use the recently proposed DINO V2 model (Oquab et al., 2024) in PointSea.”
DINOv2 rocks geological image analysis: Classification, segmentation, and interpretability
Brondolo, F., & Beaussant, S. (2025) · Journal of Rock Mechanics and Geotechnical Engineering · doi:10.1016/j.jrmge.2025.01.057 · Cited by 17
Radio DINO: A foundation model for advanced radiomics and AI-driven medical imaging analysis
Zedda, L., Loddo, A., & Ruberto, C. D. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110583 · Cited by 23
Yang, N., Wang, Y., Wei, Z., & Wu, F. (2025) · Cartography and Geographic Information Science · doi:10.1080/15230406.2025.2531055 · Cited by 15
“For example, models like CLIP (Radford et al., 2021) can describe the content of an image, and DINO v2 (Oquab et al., 2023) can segment the image and recognize objects.”
Time Does Tell: Self-Supervised Time-Tuning of Dense Image Representations
Salehi, M., Gavves, E., Snoek, C. G. M., & Asano, Y. M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01516 · Cited by 15
Progressive Frame-Proposal Mining for Weakly Supervised Video Object Detection
Han, M., Wang, Y., Li, M., Chang, X., Yang, Y., & Qiao, Y. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3364536 · Cited by 14
“The emergence of large-scale pretrained models like DINOv2 [61] and SAM [62], renowned for their robust detection and segmentation abilities, represents a promising trend.”
BackgroundZedda, L., Perniciano, A., Loddo, A., & Ruberto, C. D. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111833 · Cited by 15
Rodrigues, C. N., Nunes, I. M., Pereira, M. B., Oliveira, H., & dos Santos, J. A. (2024) · Computers & Graphics · doi:10.1016/j.cag.2024.104014 · Cited by 15
Self-Supervised Learning for Few-Shot Bird Sound Classification
Moummad, I., Farrugia, N., & Serizel, R. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10627576 · Cited by 15
“A recent foundation model in computer vision, DINOv2, selects training images using a pretrained model on a large uncurated dataset to retrieve similar images in a curated dataset [12].”
Low-Resource Finetuning of Foundation Models Beats State-of-the-Art in Histopathology
Roth, B., Koch, V., Wagner, S. J., Schnabel, J. A., Marr, C., & Peng, T. (2024) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi56570.2024.10635695 · Cited by 22
“Similar as proposed in [11], we use input images of size 224 × 224 px with a local crop size of 98 × 98 px.”
BackgroundMethodInfluentialInstance-Aware Exploration-Verification-Exploitation for Instance ImageGoal Navigation
Lei, X., Wang, M., Zhou, W., Li, L., & Li, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01545 · Cited by 21
“Eventually, at t 3 , agent finds the “bed” described in the goal image. datasets [6, 41, 48, 53, 57], the implementation of advanced simulators [24, 46, 49, 53], the development of deep learning algorithms [5, 19, 38, 47], and so on.”
Automatic Controllable Colorization via Imagination
Cong, X., Wu, Y., Chen, Q., & Lei, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00252 · Cited by 16
“…feature space: (5) where ⊙ denotes operation to select some regions of an image, α ( j ) denotes the best reference candidate index for segment S j , M denotes distance measurement metrics ( L 1 , L 2 , L cosine , etc.), and D ( · ) denotes the robust and universe image feature DINOv2 [57].”
BackgroundREACTO: Reconstructing Articulated Objects from a Single Video
Song, C., Wei, J., Foo, C.-S., Lin, G., & Liu, F. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00515 · Cited by 14
Steitz, J.-M. O., & Roth, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02213 · Cited by 21
“However, since the introduction of transformers [59] into the realm of computer vision [4, 5, 13, 51, 52, 63], model sizes have grown exponentially from around a hundred million parameters for a vision transformer (ViT) [13] to more than a billion parameters [10, 46].”
Contini, M., Illien, V., Barde, J., Poulain, S., Bernard, S., Joly, A., & Bonhommeau, S. (2025) · Ecological Informatics · doi:10.1016/j.ecoinf.2025.103149 · Cited by 14
“The underwater deep learning model builds on the DinoV2 architecture, which is a vision transformer model that has been shown to outperform convolutional neural networks on image classification tasks (Oquab et al., 2023).”
Explicit Semantic-Base-Empowered Communications for 6G Mobile Networks
Wang, F., Zheng, Y., Xu, W., Liang, J., Zhang, P., & Han, Z. (2025) · Engineering · doi:10.1016/j.eng.2025.08.039 · Cited by 12
Open scene graphs for open-world object-goal navigation
Loo, J., Wu, Z., & Hsu, D. (2025) · The International Journal of Robotics Research · doi:10.1177/02783649251369549 · Cited by 26
Learning the What and How of Annotation in Video Object Segmentation
Delatolas, T., Kalogeiton, V. S., & Papadopoulos, D. P. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00680 · Cited by 15
Ypsilantis, N.-A., Chen, K., Cao, B., Lipovský, M., Doğan, P., Makosa, G., Bluntschli, B., Seyedhosseini, M., Chum, O., & Araújo, A. D. M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01037 · Cited by 16
Semantic-aware normalizing flow with feature fusion for image anomaly detection
Ma, W., Li, Y., Lan, S., Wang, W., Huang, W., & Zhu, W. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127728 · Cited by 18
Computer Vision and Videomics in Otolaryngology–Head and Neck Surgery
Paderno, A., Bedi, N., Rau, A., & Holsinger, F. C. (2024) · Otolaryngologic Clinics of North America · doi:10.1016/j.otc.2024.05.005 · Cited by 15
Decoding dynamic visual scenes across the brain hierarchy
Chen, Y., Beech, P., Yin, Z., Jia, S., Zhang, J., Yu, Z., & Liu, J. K. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012297 · Cited by 17
“Consequently, models developed by analyzing static images can effectively address dynamic video tasks in a frame-by-frame manner, without the need for temporal information [93].”
BackgroundIFFNeRF: Initialisation Free and Fast 6DoF pose estimation from a single image and a NeRF model
Bortolon, M., Tsesmelis, T., James, S., Poiesi, F., & Bue, A. D. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610425 · Cited by 15
Selective, Interpretable and Motion Consistent Privacy Attribute Obfuscation for Action Recognition
Ilic, F., Zhao, H., Pock, T., & Wildes, R. P. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01772 · Cited by 12
“Our use of DINO-ViT keys (rather than queries or values) is based on previous work finding them to perform best when applied to visual correspondence [1, 40].”
MethodSANeRF-HQ: Segment Anything for NeRF in High Quality
Liu, Y., Hu, B., Tang, C., & Tai, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00310 · Cited by 21
“DI-NOv2 [41] leverages self-supervised distillation and produces visual features across domains without any fine-tuning.”
VIT-LENS: Towards Omni-modal Representations
Lei, W., Ge, Y., Yi, K., Zhang, J., Gao, D., Sun, D., Ge, Y., Shan, Y., & Shou, M. Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02516 · Cited by 21
“Given the exceptional generalization and transfer learning capabilities of the pretrained-ViTs [7, 20, 21, 56, 65], there is promise in adapting their inherent knowledge to comprehend novel modalities.”
BackgroundMethod
Metadata
- Authors
- Oquab, M., Darcet, T., Moutakanni, T., Vo, H., Szafraniec, M., Khalidov, V., Fernandez, P., Haziza, D., Massa, F., El-Nouby, A., Assran, M., Ballas, N., Galuba, W., Howes, R., Huang, P.-Y., Li, S.-W., Misra, I., Rabbat, M., Sharma, V., Synnaeve, G., Xu, H., Jegou, H., Mairal, J., Labatut, P., Joulin, A., & Bojanowski, P.
- Affiliations
- Institut national de recherche en sciences et technologies du numérique (FR)
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2304.07193
- OpenAlex
- W4366208220
- Cited by
- 1,078
- References
- 131
- Citations by year
- 2026: 123 · 2025: 404 · 2024: 485 · 2023: 66
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- HAL (submittedVersion, cc-by)
- HAL (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- Agence Nationale de la Recherche (ANR-19-P3IA-0003, ANR‐19)
- HORIZON EUROPE European Research Council (101087696)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- DINOv2, self-supervised pre-training, vision transformer, foundation models, knowledge distillation, large-scale training, image classification benchmark
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
