The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Crowdsourcing reproducible seizure forecasting in human and canine epilepsy
Open accessAbstract
See Mormann and Andrzejak (doi:10.1093/brain/aww091) for a scientific commentary on this article. Accurate forecasting of epileptic seizures has the potential to transform clinical epilepsy care. However, progress toward reliable seizure forecasting has been hampered by lack of open access to long duration recordings with an adequate number of seizures for investigators to rigorously compare algorithms and results. A seizure forecasting competition was conducted on kaggle.com using open access chronic ambulatory intracranial electroencephalography from five canines with naturally occurring epilepsy and two humans undergoing prolonged wide bandwidth intracranial electroencephalographic monitoring. Data were provided to participants as 10-min interictal and preictal clips, with approximately half of the 60 GB data bundle labelled (interictal/preictal) for algorithm training and half unlabelled for evaluation. The contestants developed custom algorithms and uploaded their classifications (interictal/preictal) for the unknown testing data, and a randomly selected 40% of data segments were scored and results broadcasted on a public leader board. The contest ran from August to November 2014, and 654 participants submitted 17 856 classifications of the unlabelled test data. The top performing entry scored 0.84 area under the classification curve. Following the contest, additional held-out unlabelled data clips were provided to the top 10 participants and they submitted classifications for the new unseen data. The resulting area under the classification curves were well above chance forecasting, but did show a mean 6.54 ± 2.45% (min, max: 0.30, 20.2) decline in performance. The kaggle.com model using open access data and algorithms generated reproducible research that advanced seizure forecasting. The overall performance from multiple contestants on unseen data was better than a random predictor, and demonstrates the feasibility of seizure forecasting in canine and human epilepsy. See Mormann and Andrzejak (doi:10.1093/brain/aww091) for a scientific commentary on this article. Seizures are thought to arise from an identifiable pre-ictal state. Brinkmann et al. report the results of an online, open-access seizure forecasting competition using intracranial EEG recordings from canines with naturally occurring epilepsy and human patients undergoing presurgical monitoring. The winning algorithms forecast seizures at rates significantly greater than chance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Analysis of a complex of statistical variables into principal components.
Hotelling, H. (1933) · Journal of Educational Psychology · doi:10.1037/h0071325 · Cited by 9,633
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 2×
“(Ioannidis, 2005; Landis et al., 2012; Button et al., 2013) The consequences of the lack of reproducibility are profound, and inefficient use of limited resources may slow the development of therapies for patients.”
BackgroundProbabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods
Platt, J. C. (1999) · Cited by 6,388
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
Kwan, P., Arzimanoglou, A., Berg, A. T., Brodie, M. J., Allen Hauser, W., Mathern, G., Moshé, S. L., Perucca, E., Wiebe, S., & French, J. (2010) · Epilepsia · doi:10.1111/j.1528-1167.2009.02397.x · Cited by 4,877
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“(Ioannidis, 2005; Landis et al., 2012; Button et al., 2013) The consequences of the lack of reproducibility are profound, and inefficient use of limited resources may slow the development of therapies for patients.”
BackgroundFeder, J. (1988) · Springer eBooks · doi:10.1007/978-1-4899-2124-6 · Cited by 3,595
Approach to an irregular time series on the basis of the fractal theory
Higuchi, T. (1988) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(88)90081-4 · Cited by 2,160
EEG analysis based on time domain properties
Hjorth, B. (1970) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(70)90143-4 · Cited by 1,504
A call for transparent reporting to optimize the predictive value of preclinical research
Landis, S. C., Amara, S. G., Asadullah, K., Austin, C. P., Blumenstein, R., Bradley, E. W., Crystal, R. G., Darnell, R. B., Ferrante, R. J., Fillit, H., et al. (2012) · Nature · doi:10.1038/nature11556 · Cited by 1,196
Seizure prediction: the long and winding road
Mormann, F., Andrzejak, R. G., Elger, C. E., & Lehnertz, K. (2007) · Brain · doi:10.1093/brain/awl241 · Cited by 1,109
Löscher, W. (2011) · Seizure · doi:10.1016/j.seizure.2011.01.003 · Cited by 932
Cook, M. J., O'Brien, T. J., Berkovic, S. F., Murphy, M., Morokoff, A., Fabinyi, G., D'Souza, W., Yerra, R., Archer, J., Litewka, L., et al. (2013) · The Lancet Neurology · doi:10.1016/s1474-4422(13)70075-9 · Cited by 879
(1995) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2544-7 · Cited by 569
WaveLab and Reproducible Research
Buckheit, J. B., & Donoho, D. L. (1995) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2544-7_5 · Cited by 537
Seizure prediction with spectral power of EEG using cost-sensitive support vector machines
Park, Y., Luo, L., Parhi, K. K., & Netoff, T. (2011) · Epilepsia · doi:10.1111/j.1528-1167.2011.03138.x · Cited by 398
Classification of patterns of EEG synchronization for seizure prediction
Mirowski, P., Madhavan, D., LeCun, Y., & Kuzniecky, R. (2009) · Clinical Neurophysiology · doi:10.1016/j.clinph.2009.09.002 · Cited by 380
Kolmogorov complexity of finite sequences and recognition of different preictal EEG patterns
Petrosian, A. (2002) · Proceedings Eighth IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.1995.465426 · Cited by 234
Definition of refractory epilepsy: defining the indefinable?
Kwan, P., & Brodie, M. J. (2010) · The Lancet Neurology · doi:10.1016/s1474-4422(09)70304-7 · Cited by 196
An invitation to reproducible computational research
Donoho, D. L. (2010) · Biostatistics · doi:10.1093/biostatistics/kxq028 · Cited by 162
The statistics of a practical seizure warning system
Snyder, D., Echauz, J., Grimes, D. B., & Litt, B. (2008) · Journal of Neural Engineering · doi:10.1088/1741-2560/5/4/004 · Cited by 139
Self-citationTeixeira, C., Direito, B., Bandarabadi, M., Quyen, M. L. V., Valderrama, M., Schelter, B. O., Schulze‐Bonhage, A., Navarro, V., Sales, F., & Dourado, A. (2014) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2014.02.007 · Cited by 133
Forecasting Seizures in Dogs with Naturally Occurring Epilepsy
Howbert, J. J., Patterson, E. E., Stead, S. M., Brinkmann, B. H., Vasoli, V. M., Crepeau, D., Vite, C. H., Sturges, B. K., Ruedebusch, V., Mavoori, J., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0081920 · Cited by 129
Self-citationLarge-scale electrophysiology: Acquisition, compression, encryption, and storage of big data
Brinkmann, B. H., Bower, M. R., Stengel, K. A., Worrell, G. A., & Stead, M. (2009) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2009.03.022 · Cited by 120
Self-citationThe peri-ictal state: cortical excitability changes within 24 h of a seizure
Badawy, R. A. B., Macdonell, R. A. L., Jackson, G. D., & Berkovic, S. F. (2009) · Brain · doi:10.1093/brain/awp017 · Cited by 120
Baumgartner, C., Serles, W., Leutmezer, F., Pataraia, E., Aull, S., Czech, T., Pietrzyk, U., Relic, A., & Podreka, I. (1998) · PubMed · Cited by 117
Electroencephalography in dogs with epilepsy: similarities between human and canine findings
Berendt, M., Høgenhaven, H., Flagstad, A., & Dam, M. (1999) · Acta Neurologica Scandinavica · doi:10.1111/j.1600-0404.1999.tb00676.x · Cited by 113
A novel implanted device to wirelessly record and analyze continuous intracranial canine EEG
Davis, K. A., Sturges, B. K., Vite, C. H., Ruedebusch, V., Worrell, G. A., Gardner, A. B., Leyde, K. W., Sheffield, W. D., & Litt, B. (2011) · Epilepsy Research · doi:10.1016/j.eplepsyres.2011.05.011 · Cited by 108
Self-citationAdelson, P. D., Nemoto, E. M., Scheuer, M. L., Painter, M. J., Morgan, J., & Yonas, H. (1999) · Epilepsia · doi:10.1111/j.1528-1157.1999.tb02030.x · Cited by 106
Epilepsy from the Patient's Perspective: Review of Results of a Community-Based Survey
Fisher, R. S. (2000) · Epilepsy & Behavior · doi:10.1006/ebeh.2000.0107 · Cited by 100
Bower, M. R., & Buckmaster, P. S. (2008) · Journal of Neurophysiology · doi:10.1152/jn.01369.2007 · Cited by 91
Seizure prediction: Any better than chance?
Andrzejak, R. G., Chicharro, D., Elger, C. E., & Mormann, F. (2009) · Clinical Neurophysiology · doi:10.1016/j.clinph.2009.05.019 · Cited by 91
Patterns of seizure activation after withdrawal of antiepileptic medication
Marciani, M. G., Gotman, J., Andermann, F., & Olivier, A. (1985) · Neurology · doi:10.1212/wnl.35.11.1537 · Cited by 86
Forecasting Seizures Using Intracranial EEG Measures and SVM in Naturally Occurring Canine Epilepsy
Brinkmann, B. H., Patterson, E. E., Vite, C. H., Vasoli, V. M., Crepeau, D., Stead, M., Howbert, J. J., Cherkassky, V., Wagenaar, J., Litt, B., et al. (2015) · PLoS ONE · doi:10.1371/journal.pone.0133900 · Cited by 83
Self-citationWhat is the present-day EEG evidence for a preictal state?
Stacey, W. C., Quyen, M. L. V., Mormann, F., & Schulze‐Bonhage, A. (2011) · Epilepsy Research · doi:10.1016/j.eplepsyres.2011.07.012 · Cited by 80
Fujita, S., Toyoda, I., Thamattoor, A. K., & Buckmaster, P. S. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0584-14.2014 · Cited by 79
Muñana, K. R., Thomas, W., Inzana, K. D., Nettifee, J. A., McLucas, K., Olby, N. J., Mariani, C. L., & Early, P. J. (2012) · Journal of Veterinary Internal Medicine · doi:10.1111/j.1939-1676.2011.00866.x · Cited by 76
Improving seizure control in dogs with refractory epilepsy using gabapentin as an adjunctive agent
Govendir, M., Perkins, M. C., & Malík, R. (2005) · Australian Veterinary Journal · doi:10.1111/j.1751-0813.2005.tb13269.x · Cited by 74
Clinical Risk Factors Associated with Anti-Epileptic Drug Responsiveness in Canine Epilepsy
Packer, R. M. A., Shihab, N. K., Torres, B. B. J., & Volk, H. A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0106026 · Cited by 65
Unpredictability of Seizures and the Burden of Epilepsy
Schulze‐Bonhage, A., & Kühn, A. (2008) · Wiley eBooks · doi:10.1002/9783527625192.ch1 · Cited by 53
Canine Epilepsy: An Underutilized Model
Patterson, E. E. (2014) · ILAR Journal · doi:10.1093/ilar/ilu021 · Cited by 51
Self-citationEffects of the Removal of Phenytoin, Carbamazepine, and Valproate on the Electroencephalogram
Duncan, J. S., Smith, S. J. M., Forster, A. M., Shorvon, S. D., & Trimble, M. (1989) · Epilepsia · doi:10.1111/j.1528-1157.1989.tb05477.x · Cited by 49
Feasibility study of a caregiver seizure alert system in canine epilepsy
Coles, L. D., Patterson, E. E., Sheffield, W. D., Mavoori, J., Higgins, J., Michael, B., Leyde, K. W., Cloyd, J. C., Litt, B., Vite, C. H., et al. (2013) · Epilepsy Research · doi:10.1016/j.eplepsyres.2013.06.007 · Cited by 40
Self-citationCanine status epilepticus: A translational platform for human therapeutic trials
Leppik, I. E., Patterson, E. N., Coles, L. D., Craft, E. M., & Cloyd, J. C. (2011) · Epilepsia · doi:10.1111/j.1528-1167.2011.03231.x · Cited by 31
Self-citationTopiramate as an add‐on antiepileptic drug in treating refractory canine idiopathic epilepsy
Kiviranta, A., Laitinen‐Vapaavuori, O., Hielm-Björkman, A. K., & Jokinen, T. S. (2013) · Journal of Small Animal Practice · doi:10.1111/jsap.12130 · Cited by 21
Re: Clinical presentations of naturally occurring canine seizures: similarities to human seizures
Berendt, M., & Dam, M. (2003) · Epilepsy & Behavior · doi:10.1016/s1525-5050(02)00686-8 · Cited by 6
Cited by
Truong, N. D., Nguyen, A. D., Kuhlmann, L., Bonyadi, M. R., Yang, J., Ippolito, S., & Kavehei, O. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.04.018 · Cited by 635
Multi-day rhythms modulate seizure risk in epilepsy
Baud, M. O., Kleen, J. K., Mirro, E. A., Andrechak, J. C., King-Stephens, D., Chang, E. F., & Rao, V. R. (2018) · Nature Communications · doi:10.1038/s41467-017-02577-y · Cited by 532
Seizure prediction – ready for a new era
Kuhlmann, L., Lehnertz, K., Richardson, M. P., Schelter, B., & Zaveri, H. P. (2018) · Nature Reviews Neurology · doi:10.1038/s41582-018-0055-2 · Cited by 450
Focal Onset Seizure Prediction Using Convolutional Networks
Khan, H., Marcuse, L., Fields, M., Swann, K., & Yener, B. (2018) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2017.2785401 · Cited by 353
Epileptic Seizure Prediction Using Big Data and Deep Learning: Toward a Mobile System
Kiral-Kornek, I., Roy, S., Nurse, E., Mashford, B., Karoly, P., Carroll, T., Payne, D., Saha, S., Baldassano, S., O'Brien, T., et al. (2018) · EBioMedicine · doi:10.1016/j.ebiom.2017.11.032 · Cited by 303
Metadata
- Authors
- Brinkmann, B. H., Wagenaar, J., Abbot, D., Adkins, P., Bosshard, S. C., Chen, M., Tieng, Q. M., He, J., Muñoz-Almaraz, F. J., Botella-Rocamora, P., Pardo, J., Zamora-Martinez, F., Hills, M., Wu, W., Korshunova, I., Cukierski, W., Vite, C., Patterson, E. E., Litt, B., & Worrell, G. A.
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-03-31
- Volume
- 139
- Issue
- 6
- Pages
- 1713-1722
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2317674142
- Cited by
- 272
- References
- 52
- FWCI
- 15.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.