STRONG LENS TIME DELAY CHALLENGE. II. RESULTS OF TDC1
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
We present the results of the first strong lens time delay challenge. The motivation, experimental design, and entry level challenge are described in a companion paper. This paper presents the main challenge, TDC1, which consisted of analyzing thousands of simulated light curves blindly. The observational properties of the light curves cover the range in quality obtained for current targeted efforts (e.g., COSMOGRAIL) and expected from future synoptic surveys (e.g., LSST), and include simulated systematic errors. Seven teams participated in TDC1, submitting results from 78 different method variants. After describing each method, we compute and analyze basic statistics measuring accuracy (or bias) A , goodness of fit χ 2 , precision P , and success rate f . For some methods we identify outliers as an important issue. Other methods show that outliers can be controlled via visual inspection or conservative quality control. Several methods are competitive, i.e., give | A | < 0.03, P < 0.03, and χ 2 < 1.5, with some of the methods already reaching sub-percent accuracy. The fraction of light curves yielding a time delay measurement is typically in the range f = 20%–40%. It depends strongly on the quality of the data: COSMOGRAIL-quality cadence and light curve lengths yield significantly higher f than does sparser sampling. Taking the results of TDC1 at face value, we estimate that LSST should provide around 400 robust time-delay measurements, each with P < 0.03 and | A | < 0.01, comparable to current lens modeling uncertainties. In terms of observing strategies, we find that A and f depend mostly on season length, while P depends mostly on cadence and campaign duration.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bostock, M., Ogievetsky, V., & Heer, J. (2011) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2011.185 · Cited by 3,165
MODELING THE TIME VARIABILITY OF SDSS STRIPE 82 QUASARS AS A DAMPED RANDOM WALK
MacLeod, C. L., Ivezić, Ž., Kochanek, C. S., Kozłowski, S., Kelly, B., Bullock, E., Kimball, A., Sesar, B., Westman, D., Brooks, K., et al. (2010) · The Astrophysical Journal · doi:10.1088/0004-637x/721/2/1014 · Cited by 700 · cited 2×
“The probability of the light curve parameters M̄ , σ, and τ given the data is proportional to the product of the likelihood function for a CAR process (Kelly et al. 2009a; MacLeod et al. 2010) and uniform priors.”
MethodInfluential
Cited by
Wong, K. C., Suyu, S. H., Chen, G. C.-F., Rusu, C. E., Millon, M., Sluse, D., Bonvin, V., Fassnacht, C. D., Taubenberger, S., Auger, M. W., et al. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stz3094 · Cited by 1,169
Self-citationBonvin, V., Courbin, F., Suyu, S. H., Marshall, P. J., Rusu, C. E., Sluse, D., Tewes, M., Wong, K. C., Collett, T., Fassnacht, C. D., et al. (2017) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stw3006 · Cited by 457
“They have been tested using realistic numerical simulations, and have been confronted with the data provided to the lensing community by the first Time-Delay Challenge (TDC1; see Dobler et al. 2015; Liao et al. 2015).”
BackgroundMethodSelf-citationBirrer (2020) · doi:10.1051/0004-6361/202038861 · Cited by 396
Birrer, S., Treu, T., Rusu, C. E., Bonvin, V, Fassnacht, C. D., Chan, J. H. H., Agnello, A., Shajib, A. J., Chen, G. C.-F., Auger, M., et al. (2019) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stz200 · Cited by 365
Self-citationH0LiCOW – I. H0 Lenses in COSMOGRAIL's Wellspring: program overview
Suyu, S. H., Bonvin, V., Courbin, F., Fassnacht, C. D., Rusu, C. E., Sluse, D., Treu, T., Wong, K. C., Auger, M. W., Ding, X., et al. (2017) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stx483 · Cited by 346
Self-citation
Metadata
- Authors
- Liao, K., Treu, T., Marshall, P., Fassnacht, C. D., Rumbaugh, N., Dobler, G., Aghamousa, A., Bonvin, V., Courbin, F., Hojjati, A., Jackson, N., Kashyap, V., Rathna Kumar, S., Linder, E., Mandel, K., Meng, X.-L., Meylan, G., Moustakas, L. A., Prabhu, T. P., Romero-Wolf, A., Shafieloo, A., Siemiginowska, A., Stalin, C. S., Tak, H., Tewes, M., & van Dyk, D.
- Venue
- The Astrophysical Journal
- Publisher
- American Astronomical Society
- Published
- 2015-02-03
- Volume
- 800
- Issue
- 1
- Pages
- 11
- ISSN
- 0004-637X (ISSN-L)
- 1538-4357
- OpenAlex
- W1979498879
- Cited by
- 147
- References
- 2
- FWCI
- 11.38
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: STRONG LENS TIME DELAY CHALLENGE. II. RESULTS OF TDC1. https://app.cochat.ai/papers/10.1088/0004-637x/800/1/11
- The paper
- Liao, K., Treu, T., Marshall, P., Fassnacht, C. D., Rumbaugh, N., Dobler, G., Aghamousa, A., Bonvin, V., Courbin, F., Hojjati, A., Jackson, N., Kashyap, V., Rathna Kumar, S., Linder, E., Mandel, K., Meng, X.-L., Meylan, G., Moustakas, L. A., Prabhu, T. P., . . . van Dyk, D. (2015). STRONG LENS TIME DELAY CHALLENGE. II. RESULTS OF TDC1. The Astrophysical Journal. https://doi.org/10.1088/0004-637x/800/1/11
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.