Content-aware frame interpolation (CAFI): deep learning-based temporal super-resolution for fast bioimaging
Open accessPublished version of a preprint
The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
The development of high-resolution microscopes has made it possible to investigate cellular processes in 3D and over time. However, observing fast cellular dynamics remains challenging because of photobleaching and phototoxicity. Here we report the implementation of two content-aware frame interpolation (CAFI) deep learning networks, Zooming SlowMo and Depth-Aware Video Frame Interpolation, that are highly suited for accurately predicting images in between image pairs, therefore improving the temporal resolution of image series post-acquisition. We show that CAFI is capable of understanding the motion context of biological structures and can perform better than standard interpolation methods. We benchmark CAFI’s performance on 12 different datasets, obtained from four different microscopy modalities, and demonstrate its capabilities for single-particle tracking and nuclear segmentation. CAFI potentially allows for reduced light exposure and phototoxicity on the sample for improved long-term live-cell imaging. The models and the training and testing data are available via the ZeroCostDL4Mic platform.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
















Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“By leveraging deep learning algorithms, AI systems can interpret complex medical images—such as X-rays, CT scans, MRIs, pathology images, and ultrasounds—providing automated, yet highly precise assessments.84,85”
From A foundational architecture for AI agents in healthcare (2025) · cites this paper as [84]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Fiji: an open-source platform for biological-image analysis
Schindelin, J., Arganda-Carreras, I., Frise, E., Kaynig, V., Longair, M., Pietzsch, T., Preibisch, S., Rueden, C., Saalfeld, S., Schmid, B., et al. (2012) · Nature Methods · doi:10.1038/nmeth.2019 · Cited by 66,890
TrackMate: An open and extensible platform for single-particle tracking
Tinevez, J.-Y., Perry, N., Schindelin, J., Hoopes, G. M., Reynolds, G. D., Laplantine, E., Bednarek, S. Y., Shorte, S. L., & Eliceiri, K. W. (2017) · Methods · doi:10.1016/j.ymeth.2016.09.016 · Cited by 3,380
PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost VolumePreprint
Sun, D., Yang, X.-D., Liu, M.-Y., & Kautz, J. (2017) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.48550/arxiv.1709.02371 · Cited by 3,034
PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume
Sun, D., Yang, X., Liu, M.-Y., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00931 · Cited by 2,648
Lattice light-sheet microscopy: Imaging molecules to embryos at high spatiotemporal resolution
Chen, B.-C., Legant, W. R., Wang, K., Shao, L., Milkie, D. E., Davidson, M. W., Janetopoulos, C., Wu, X. S., Hammer, J. A., Liu, Z., et al. (2014) · Science · doi:10.1126/science.1257998 · Cited by 1,919
Long, A. H., Haso, W. M., Shern, J. F., Wanhainen, K. M., Murgai, M., Ingaramo, M., Smith, J. P., Walker, A. J., Kohler, M. E., Venkateshwara, V. R., et al. (2015) · Nature Medicine · doi:10.1038/nm.3838 · Cited by 1,815
Icy: an open bioimage informatics platform for extended reproducible research
de Chaumont, F., Dallongeville, S., Chenouard, N., Hervé, N., Pop, S., Provoost, T., Meas-Yedid, V., Pankajakshan, P., Lecomte, T., Le Montagner, Y., et al. (2012) · Nature Methods · doi:10.1038/nmeth.2075 · Cited by 1,538
Lysosomes as dynamic regulators of cell and organismal homeostasis
Ballabio, A., & Bonifacino, J. S. (2020) · Nature Reviews Molecular Cell Biology · doi:10.1038/s41580-019-0185-4 · Cited by 1,469
Video Enhancement with Task-Oriented Flow
Xue, T., Chen, B., Wu, J., Wei, D., & Freeman, W. T. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-01144-2 · Cited by 1,393
Cited by
Live-cell imaging in the deep learning era
Pylvänäinen, J. W., Gómez‐de‐Mariscal, E., Henriques, R., & Jacquemet, G. (2023) · Current Opinion in Cell Biology · doi:10.1016/j.ceb.2023.102271 · Cited by 86
DBlink: dynamic localization microscopy in super spatiotemporal resolution via deep learning
Saguy, A., Alalouf, O., Opatovski, N., Jang, S., Heilemann, M., & Shechtman, Y. (2023) · Nature Methods · doi:10.1038/s41592-023-01966-0 · Cited by 63
Neural space–time model for dynamic multi-shot imaging
Cao, R., Divekar, N. S., Nuñez, J. K., Upadhyayula, S., & Waller, L. (2024) · Nature Methods · doi:10.1038/s41592-024-02417-0 · Cited by 51
A foundational architecture for AI agents in healthcare
Liu, F., Niu, Y., Zhang, Q., Wang, K., Dong, Z., Wong, I. N., Cheng, L., Li, T., Duan, L., Li, K., et al. (2025) · Cell Reports Medicine · doi:10.1016/j.xcrm.2025.102374 · Cited by 41
“84,85 These systems are capable of identifying subtle patterns and anomalies that may elude human observation, enabling earlier detection of conditions such as tumors, fractures, and neurological disorders.”
DL4MicEverywhere: deep learning for microscopy made flexible, shareable and reproducible
Hidalgo-Cenalmor, I., Pylvänäinen, J. W., Ferreira, M., Russell, C., Saguy, A., Arganda‐Carreras, I., Shechtman, Y., Muñoz‐Barrutia, A., Serrano‐Solano, B., Fuster-Barceló, C., et al. (2024) · Nature Methods · doi:10.1038/s41592-024-02295-6 · Cited by 39
Metadata
- Authors
- Priessner, M., Gaboriau, D. C. A., Sheridan, A., Lenn, T., Garzon-Coral, C., Dunn, A. R., Chubb, J. R., Tousley, A. M., Majzner, R. G., Manor, U., Vilar, R., & Laine, R. F.
- Affiliations
- Imperial College London (GB)
- Salk Institute for Biological Studies (US)
- University College London (GB)
- Stanford Medicine (US)
- MRC Laboratory for Molecular Cell Biology (GB)
- Stanford University (US)
- Corresponding author
- Priessner, Martin
- Laine, Romain F.
- ORCID
- Venue
- Nature Methods
- Published
- 2024-01-18
- Volume
- 21
- Issue
- 2
- Pages
- 322-330
- ISSN
- 1548-7091 (ISSN-L)
- 1548-7105
- PMC
- PMC10864186
- OpenAlex
- W4390975819
- Cited by
- 35
- References
- 54
- Citations by year
- 2026: 9 · 2025: 18 · 2024: 8
- FWCI
- 4.86
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Nature Methods (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- Funders
- National Science Foundation (2014862)
- Wellcome Trust (104931/Z/14/Z, 104931, BB/L015129/1, 202867/Z/16/Z)
- Imperial College London (BB/L015129/1, 104931/Z/14/Z)
- National Institutes of Health
- Medical Research Council (MR/T027924/1)
- Engineering and Physical Sciences Research Council (EP/L016737/1, 1816855, EP/J021199/1)
- Biotechnology and Biological Sciences Research Council (BB/L015129/1, L015129)
- National Institute on Aging (P30AG068635)
- National Cancer Institute
- National Institute of General Medical Sciences (R35GM130332)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image Processing Techniques
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Biophysics › Cell Image Analysis Techniques
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Biophysics › Advanced Fluorescence Microscopy Techniques
- Keywords
- temporal super-resolution, frame interpolation, photobleaching, phototoxicity, single-particle tracking, nuclei segmentation, live-cell imaging
- MeSH terms
- Single Molecule Imaging, Deep Learning, Microscopy, Motion
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Content-aware frame interpolation (CAFI): deep learning-based temporal super-resolution for fast bioimaging. https://app.cochat.ai/papers/10.1038/s41592-023-02138-w
- The paper
- Priessner, M., Gaboriau, D. C. A., Sheridan, A., Lenn, T., Garzon-Coral, C., Dunn, A. R., Chubb, J. R., Tousley, A. M., Majzner, R. G., Manor, U., Vilar, R., & Laine, R. F. (2024). Content-aware frame interpolation (CAFI): deep learning-based temporal super-resolution for fast bioimaging. Nature Methods. https://doi.org/10.1038/s41592-023-02138-w
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.