The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Crowdsourcing reproducible seizure forecasting in human and canine epilepsy
Open accessAbstract
See Mormann and Andrzejak (doi:10.1093/brain/aww091) for a scientific commentary on this article. Accurate forecasting of epileptic seizures has the potential to transform clinical epilepsy care. However, progress toward reliable seizure forecasting has been hampered by lack of open access to long duration recordings with an adequate number of seizures for investigators to rigorously compare algorithms and results. A seizure forecasting competition was conducted on kaggle.com using open access chronic ambulatory intracranial electroencephalography from five canines with naturally occurring epilepsy and two humans undergoing prolonged wide bandwidth intracranial electroencephalographic monitoring. Data were provided to participants as 10-min interictal and preictal clips, with approximately half of the 60 GB data bundle labelled (interictal/preictal) for algorithm training and half unlabelled for evaluation. The contestants developed custom algorithms and uploaded their classifications (interictal/preictal) for the unknown testing data, and a randomly selected 40% of data segments were scored and results broadcasted on a public leader board. The contest ran from August to November 2014, and 654 participants submitted 17 856 classifications of the unlabelled test data. The top performing entry scored 0.84 area under the classification curve. Following the contest, additional held-out unlabelled data clips were provided to the top 10 participants and they submitted classifications for the new unseen data. The resulting area under the classification curves were well above chance forecasting, but did show a mean 6.54 ± 2.45% (min, max: 0.30, 20.2) decline in performance. The kaggle.com model using open access data and algorithms generated reproducible research that advanced seizure forecasting. The overall performance from multiple contestants on unseen data was better than a random predictor, and demonstrates the feasibility of seizure forecasting in canine and human epilepsy. See Mormann and Andrzejak (doi:10.1093/brain/aww091) for a scientific commentary on this article. Seizures are thought to arise from an identifiable pre-ictal state. Brinkmann et al. report the results of an online, open-access seizure forecasting competition using intracranial EEG recordings from canines with naturally occurring epilepsy and human patients undergoing presurgical monitoring. The winning algorithms forecast seizures at rates significantly greater than chance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Analysis of a complex of statistical variables into principal components.
Hotelling, H. (1933) · Journal of Educational Psychology · doi:10.1037/h0071325 · Cited by 9,633
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 2×
“(Ioannidis, 2005; Landis et al., 2012; Button et al., 2013) The consequences of the lack of reproducibility are profound, and inefficient use of limited resources may slow the development of therapies for patients.”
BackgroundProbabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods
Platt, J. C. (1999) · Cited by 6,385
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
Cited by
Truong, N. D., Nguyen, A. D., Kuhlmann, L., Bonyadi, M. R., Yang, J., Ippolito, S., & Kavehei, O. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.04.018 · Cited by 635
Multi-day rhythms modulate seizure risk in epilepsy
Baud, M. O., Kleen, J. K., Mirro, E. A., Andrechak, J. C., King-Stephens, D., Chang, E. F., & Rao, V. R. (2018) · Nature Communications · doi:10.1038/s41467-017-02577-y · Cited by 532
Seizure prediction – ready for a new era
Kuhlmann, L., Lehnertz, K., Richardson, M. P., Schelter, B., & Zaveri, H. P. (2018) · Nature Reviews Neurology · doi:10.1038/s41582-018-0055-2 · Cited by 450
Focal Onset Seizure Prediction Using Convolutional Networks
Khan, H., Marcuse, L., Fields, M., Swann, K., & Yener, B. (2018) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2017.2785401 · Cited by 353
Epileptic Seizure Prediction Using Big Data and Deep Learning: Toward a Mobile System
Kiral-Kornek, I., Roy, S., Nurse, E., Mashford, B., Karoly, P., Carroll, T., Payne, D., Saha, S., Baldassano, S., O'Brien, T., et al. (2018) · EBioMedicine · doi:10.1016/j.ebiom.2017.11.032 · Cited by 303
Khosla, A., Khandnor, P., & Chand, T. (2020) · Biocybernetics and Biomedical Engineering · doi:10.1016/j.bbe.2020.02.002 · Cited by 267
Karoly, P. J., Rao, V. R., Gregg, N. M., Worrell, G. A., Bernard, C., Cook, M. J., & Baud, M. O. (2021) · Nature Reviews Neurology · doi:10.1038/s41582-021-00464-1 · Cited by 262
Self-citationA forward-looking review of seizure prediction
Freestone, D. R., Karoly, P. J., & Cook, M. J. (2017) · Current Opinion in Neurology · doi:10.1097/wco.0000000000000429 · Cited by 169
Machine learning and wearable devices of the future
Beniczky, S., Karoly, P., Nurse, E., Ryvlin, P., & Cook, M. (2021) · Epilepsia · doi:10.1111/epi.16555 · Cited by 155
B2-ViT net: broad vision transformer network with broad attention for seizure prediction
Shi, S., & Liu, W. (2024) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2023.3346955 · Cited by 124
Computer-assisted EEG diagnostic review for idiopathic generalized epilepsy
Clarke, S., Karoly, P. J., Nurse, E., Seneviratne, U., Taylor, J., Knight-Sadler, R., Kerr, R., Moore, B., Hennessy, P., Mendis, D., et al. (2021) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2019.106556 · Cited by 55
Bruno, E., Böttcher, S., Viana, P. F., Amengual‐Gual, M., Joseph, B., Epitashvili, N., Dümpelmann, M., Glasstetter, M., Biondi, A., Van Laerhoven, K., et al. (2021) · Epilepsia · doi:10.1111/epi.17044 · Cited by 37
Self-citationHubbard, I., Beniczky, S., & Ryvlin, P. (2021) · Frontiers in Neurology · doi:10.3389/fneur.2021.740743 · Cited by 34
Metadata
- Authors
- Brinkmann, B. H., Wagenaar, J., Abbot, D., Adkins, P., Bosshard, S. C., Chen, M., Tieng, Q. M., He, J., Muñoz-Almaraz, F. J., Botella-Rocamora, P., Pardo, J., Zamora-Martinez, F., Hills, M., Wu, W., Korshunova, I., Cukierski, W., Vite, C., Patterson, E. E., Litt, B., & Worrell, G. A.
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-03-31
- Volume
- 139
- Issue
- 6
- Pages
- 1713-1722
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2317674142
- Cited by
- 272
- References
- 52
- FWCI
- 15.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.