Post Classification Label Refinement Using Implicit Ordering Constraint Among Data Instances
Abstract
Classification of instances into different categories in various real world applications suffer from inaccuracies due to lack of representative training data, limitations of classification models, noise and outliers in the input data etc. In this paper we propose a new post classification label refinement method for the scenarios where data instances have an inherent ordering among them that can be leveraged to correct inconsistencies in class labels. We show that by using the ordering constraint, more robust algorithms can be developed than traditional methods. Moreover in most applications where this ordering among instances exists, it is not directly observed. The proposed approach simultaneously estimates the latent ordering among instances and corrects the class labels. We demonstrate the utility of the approach for the application of monitoring the dynamics of lakes and reservoirs. The proposed approach has been evaluated on synthetic datasets with different noise structures and noise levels.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
This approach was successfully used to build global maps of surface water dynamics.
“This approach was successfully used in [29], [30] to build global maps of surface water dynamics.”
From Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data (2017) · cites this paper as [29]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Rank aggregation methods for the Web
Dwork, C., Kumar, R., Naor, M., & Sivakumar, D. (2001) · International World Wide Web Conference (WWW) · doi:10.1145/371920.372165 · Cited by 1,825 · see citing works
A global inventory of lakes based on high-resolution satellite imagery
Verpoorter, C., Kutser, T., Seekell, D. A., & Tranvik, L. J. (2014) · Geophysical Research Letters · doi:10.1002/2014gl060641 · Cited by 1,504 · see citing works
The Method of Paired Comparisons.
Curnow, R. N., & David, H. A. (1964) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2344014 · Cited by 1,285 · see citing works
Cohen, W. W., Schapire, R. E., & Singer, Y. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.587 · Cited by 809 · see citing works
Young, H. P. (1988) · American Political Science Review · doi:10.2307/1961757 · Cited by 746 · see citing works
Aslam, J. A., & Montague, M. (2001) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/383952.384007 · Cited by 696 · see citing works
Statistical ranking and combinatorial Hodge theory
Jiang, X., Lim, L., Yao, Y., & Yinyu Ye, Y. (2010) · Mathematical Programming · doi:10.1007/s10107-010-0419-x · Cited by 335 · see citing works
Comparison of methods for land-use classification incorporating remote sensing and GIS inputs
Rozenstein, O., & Karnieli, A. (2010) · Applied Geography · doi:10.1016/j.apgeog.2010.11.006 · Cited by 330 · see citing works
Die Berechnung der Turnier-Ergebnisse als ein Maximumproblem der Wahrscheinlichkeitsrechnung
Zermelo, E. (1929) · Mathematische Zeitschrift · doi:10.1007/bf01180541 · Cited by 286 · see citing works
Comparison and improvement of methods for identifying waterbodies in remotely sensed imagery
Sun, F., Sun, W., Chen, J., & Gong, P. (2012) · International Journal of Remote Sensing · doi:10.1080/01431161.2012.692829 · Cited by 237 · see citing works
Learning Mallows Models with Pairwise Preferences
Lu, T., & Boutilier, C. E. (2011) · Cited by 152 · see citing works
Liu, D., Kelly, M., & Gong, P. (2006) · Remote Sensing of Environment · doi:10.1016/j.rse.2005.12.012 · Cited by 149 · see citing works
Chen, X., Chen, J., Shi, Y., & Yamaguchi, Y. (2012) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2012.05.006 · Cited by 138 · see citing works
Aggregation of Partial Rankings, p-Ratings and Top-m Lists
Ailon, N. (2008) · Algorithmica · doi:10.1007/s00453-008-9211-1 · Cited by 136 · see citing works
A boosting algorithm for learning bipartite ranking functions with partially labeled data
Amini, M.-R., Truong, T. V., & Goutte, C. (2008) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1390334.1390354 · Cited by 63 · see citing works
An information fusion method for multispectral image classification postprocessing
Solaiman, B., Koffi, R. K., Mouchot, M. C., & Hillion, A. (1998) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/36.662725 · Cited by 43 · see citing works
Change Detection from Temporal Sequences of Class Labels: Application to Land Cover Change Mapping
Mithal, V., Khandelwal, A., Boriah, S., Steinhaeuser, K., & Kumar, V. (2013) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972832.72 · Cited by 12 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data
Karpatne, A., Atluri, G., Faghmous, J. H., Steinbach, M., Banerjee, A., Ganguly, A., Shekhar, S., Samatova, N., & Kumar, V. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2720168 · Cited by 1,752 · see citing works
Self-citationMachine Learning for the Geosciences: Challenges and Opportunities
Karpatne, A., Ebert‐Uphoff, I., Ravela, S., Babaie, H. A., & Kumar, V. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2861006 · Cited by 685 · see citing works
Self-citationAn approach for global monitoring of surface water extent variations in reservoirs using MODIS data
Khandelwal, A., Karpatne, A., Marlier, M. E., Kim, J., Lettenmaier, D. P., & Kumar, V. (2017) · Remote Sensing of Environment · doi:10.1016/j.rse.2017.05.039 · Cited by 197 · see citing works
Self-citationReaLSAT, a global dataset of reservoir and lake surface area variations
Khandelwal, A., Karpatne, A., Ravirathinam, P., Ghosh, R., Wei, Z., Dugan, H. A., Hanson, P. C., & Kumar, V. (2022) · Scientific Data · doi:10.1038/s41597-022-01449-5 · Cited by 77 · see citing works
Self-citationAdombi, A. V. D. P., Chesnaux, R., & Boucher, M. (2021) · Hydrogeology Journal · doi:10.1007/s10040-021-02403-2 · Cited by 38 · see citing works
Wang, L., Chen, J., & MARATHE, M. V. (2020) · ACM Transactions on Spatial Algorithms and Systems · doi:10.1145/3380971 · Cited by 37 · see citing works
“Grand Challenges” in Big Data and the Earth Sciences
Sellars, S. L. (2018) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-17-0304.1 · Cited by 30 · see citing works
Geographical Hidden Markov Tree for Flood Extent Mapping
Xie, M., Jiang, Z., & Sainju, A. M. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220053 · Cited by 30 · see citing works
Machine Learning for Understanding Inland Water Quantity, Quality, and Ecology
Appling, A., Oliver, S. K., Read, J. S., Sadler, J. M., & Zwart, J. A. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-819166-8.00121-3 · Cited by 29 · see citing works
Adombi, A. V. D. P., Chesnaux, R., Boucher, M., Braun, M., & Lavoie, J. (2024) · Journal of Hydrology · doi:10.1016/j.jhydrol.2024.131370 · Cited by 19 · see citing works
Geographical Hidden Markov Tree
Jiang, Z., Xie, M., & Sainju, A. M. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2930518 · Cited by 17 · see citing works
Integration of neural networks with numerical solution of PDEs for closure models development
Iskhakov, A. S., Dinh, N. T., & Chen, E. (2021) · Physics Letters A · doi:10.1016/j.physleta.2021.127456 · Cited by 15 · see citing works
Knowledge-based Residual Learning
Zheng, G., Liu, C., Wei, H., Jenkins, P., Chen, C., Wen, T., & Li, Z. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/228 · Cited by 12 · see citing works
Hou, M., Wei, J., Chu, H., Shi, Y., Ayantobo, O. O., Xu, J., Zhu, X., & Ren, Y. Q. (2022) · Journal of Hydrology Regional Studies · doi:10.1016/j.ejrh.2022.101271 · Cited by 9 · see citing works
Kim, S.-J., & Chung, S. (2023) · Water · doi:10.3390/w15173096 · Cited by 9 · see citing works
Sun, K., Tan, Q. H., Hu, L., & Xu, Q. (2025) · Environmental Research · doi:10.1016/j.envres.2025.121194 · Cited by 6 · see citing works
Development and Assessment of Physics-guided Machine Learning Framework for Prognosis System.
Gurgen, A. (2021) · NCSU Libraries Repository (North Carolina State University Libraries) · Cited by 5 · see citing works
Machine learning for understanding inland water quantity, quality, and ecologyPreprint
Appling, A., Oliver, S. K., Read, J. S., Sadler, J. M., & Zwart, J. A. (2022) · doi:10.31223/x5964s · Cited by 5 · see citing works
Jia, X., Chen, X., Karpatne, A., & Kumar, V. (2016) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2016.7840738 · Cited by 2 · see citing works
Self-citation
- Authors
- Khandelwal, A., Mithal, V., & Kumar, V.
- Affiliations
- University of Minnesota (US)
- Venue
- 2015 IEEE International Conference on Data Mining
- Publisher
- IEEE
- Published
- 2015-11
- Pages
- 799-804
- ISSN
- 1550-4786 (ISSN-L)
- OpenAlex
- W2245998324
- Cited by
- 21
- References
- 17
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 1 · 2022: 5 · 2021: 4 · 2020: 2 · 2019: 2 · 2018: 2 · 2017: 2 · 2016: 1
- FWCI
- 0.94
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings (publishedVersion)
- Funders
- National Science Foundation
- National Aeronautics and Space Administration
- University of Minnesota
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Engineering › Media Technology › Remote-Sensing Image Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Text and Document Classification Technologies
- Keywords
- label noise correction, label inconsistency, classification robustness, noisy training data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
