An Entity-Matching System Based on Multimodal Data for Two Major E-Commerce Stores in Mexico
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
E-commerce has grown considerably in Latin America in recent years due to the COVID-19 pandemic. E-commerce users in English-speaking and Chinese-speaking countries have web-based tools to compare the prices of products offered by various retailers. The task of product comparison is known as entity matching in the data-science domain. This paper proposes the first entity-matching system for product comparison in Spanish-speaking e-commerce. Given the lack of uniformity of e-commerce sites in Mexico, we opted for a bimodal entity-matching system that uses the image and textual description of products from two of the largest e-commerce stores in Mexico. State-of-the-art techniques in natural language processing and machine learning were used to develop this research. The resulting system achieves F1 values of approximately 80%, representing a significant step towards consolidating a product-matching system in Spanish-speaking e-commerce.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects
Lahat, D., Adali, T., & Jutten, C. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2460697 · Cited by 1,296
Multimodal fusion for multimedia analysis: a survey
Atrey, P. K., Hossain, M. A., El Saddik, A., & Kankanhalli, M. S. (2010) · Multimedia Systems · doi:10.1007/s00530-010-0182-0 · Cited by 1,279
Boulahia, S. Y., Amamra, A., Madi, M. R., & Daikh, S. (2021) · Machine Vision and Applications · doi:10.1007/s00138-021-01249-8 · Cited by 236
Research works printed but not linked: 76
- Guerra López, R.A. (2019). Diseño de un Sistema de Catalogación de Productos de E-Commerce Utilizando Procesamiento de Lenguaje Natural (NLP) y Machine learning. [Master’s Thesis, Universidad de Chile].
- Ngai, 2002, A literature review and classification of electronic commerce research, Inf. Manag., 39, 415, 10.1016/S0378-7206(01)00107-0 · DOI · Paper page
- Kou, W., Yesha, Y., and Tan, C.J. (2001). Electronic Commerce Technologies, Springer. [1st ed.]. Lecture Notes in Computer Science No.2040 2001-apr 10. · doi:10.1007/3-540-45415-2
- Bauknecht, K., Madria, S.K., and Pernul, G. (2000). Electronic Commerce and Web Technologies: First International Conference, EC-Web 2000 London, UK, September 4–6, 2000 Proceedings, Springer. [1st ed.]. Lecture Notes in Computer Science No. 1875. · doi:10.1007/3-540-44463-7
- Yokoo, M., Ito, T., Zhang, M., Matsuo, T., and Lee, J. (2008). Electronic Commerce: Theory and Practice, Springer. [1st ed.]. Studies in Computational Intelligence No. 110.
- Bawack, 2022, Artificial intelligence in E-Commerce: A bibliometric study and literature review, Electron. Mark., 32, 297, 10.1007/s12525-022-00537-z · DOI · Paper page
- Babbar, R., and Schölkopf, B. (2017, January 6–10). DiSMEC: Distributed Sparse Machines for Extreme Multi-Label Classification. Proceedings of the Tenth ACM International Conference on Web Search and Data Mining (WSDM ’17), Cambridge, UK. · DOI · Paper page
- Khandagale, 2020, Bonsai: Diverse and shallow trees for extreme multi-label classification, Mach. Learn., 109, 2099, 10.1007/s10994-020-05888-2 · DOI
- Dahiya, K., Agarwal, A., Saini, D., Gururaj, K., Jiao, J., Singh, A., Agarwal, S., Kar, P., and Varma, M. (2021, January 18–24). SiameseXML: Siamese Networks meet Extreme Classifiers with 100M Labels. Proceedings of the International Conference on Machine Learning, Vienna, Austria.
- Mittal, A., Dahiya, K., Malani, S., Ramaswamy, J., Kuruvilla, S., Ajmera, J., Chang, K., Agrawal, S., Kar, P., and Varma, M. (2022, January 19–24). Multimodal extreme classification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LO, USA. · DOI
- Wang, 2011, Entity matching: How similar is similar, Proc. VLDB Endow., 4, 622, 10.14778/2021017.2021020 · DOI
- Kejriwal, 2021, An evaluation and annotation methodology for product category matching in e-commerce, Comput. Ind., 131, 103497, 10.1016/j.compind.2021.103497 · DOI
- Singla, P., and Domingos, P. (2006, January 18–22). Entity resolution with markov logic. Proceedings of the Sixth International Conference on Data Mining (ICDM’06), Hong Kong, China. · DOI · Paper page
- Kusniyati, 2020, Analysis of Matric Product Matching between Cosine Similarity with Term Frequency-Inverse Document Frequency (TF-IDF) and Word2Vec in PT. Pricebook Digital Indonesia, Int. J. Sci. Res. Comput. Sci. Eng. Inf. Technol., 6, 105, 10.32628/CSEIT195672 · DOI
- Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv.
- Thor, 2010, Evaluation of entity resolution approaches on real-world match problems, Proc. VLDB Endow., 3, 484, 10.14778/1920841.1920904 · DOI · Paper page
- Xiao, 2011, Efficient similarity joins for near-duplicate detection, ACM Trans. Database Syst. (TODS), 36, 1, 10.1145/2000824.2000825 · DOI · Paper page
- Fellegi, 1969, A theory for record linkage, J. Am. Stat. Assoc., 64, 1183, 10.1080/01621459.1969.10501049 · DOI · Paper page
- Christen, P. (, January January). Febrl: A freely available record linkage system with a graphical user interface. Proceedings of the Second Australasian Workshop on Health Data and Knowledge Management, Wollongong, Australia.
- Bilenko, M., and Mooney, R.J. (2003, January 24–27). Adaptive duplicate detection using learnable string similarity measures. Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Washington, DC, USA. · DOI · Paper page
- Li, 2020, Deep cross-platform product matching in e-commerce, Inf. Retr. J., 23, 136, 10.1007/s10791-019-09360-1 · DOI
- Konda, 2016, Magellan: Toward building entity matching management systems, Proc. VLDB Endow., 9, 1197, 10.14778/2994509.2994535 · DOI · Paper page
- Christophides, V., Efthymiou, V., Palpanas, T., Papadakis, G., and Stefanidis, K. (2019). End-to-end entity resolution for big data: A survey. arXiv. · DOI · Paper page
- Ebraheem, 2018, Distributed representations of tuples for entity resolution, Proc. VLDB Endow., 11, 1454, 10.14778/3236187.3236198 · DOI · Paper page
- Yang, 2018, Representation and matching of team managers: An experimental research, IEEE Trans. Comput. Soc. Syst., 5, 311, 10.1109/TCSS.2018.2812825 · DOI
- Mudgal, S., Li, H., Rekatsinas, T., Doan, A., Park, Y., Krishnan, G., Deep, R., Arcaute, E., and Raghavendra, V. (2018, January 10–15). Deep learning for entity matching: A design space exploration. Proceedings of the 2018 International Conference on Management of Data, Houston, TX, USA. · DOI · Paper page
- Ristoski, 2018, A machine learning approach for product matching and categorization, Semant. Web, 9, 707, 10.3233/SW-180300 · DOI
- Kannan, A., Givoni, I.E., Agrawal, R., and Fuxman, A. (2011, January 21–24). Matching unstructured product offers to structured product specifications. Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Diego, CA, USA. · DOI
- Finkel, J.R., Grenager, T., and Manning, C.D. (2005, January 25–30). Incorporating non-local information into information extraction systems by gibbs sampling. Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL’05), Ann Arbor, MI, USA. · DOI · Paper page
- Mikolov, T., Sutskever, I., Chen, K., Corrado, G., and Dean, J. (2013). Distributed representations of words and phrases and their compositionality. arXiv.
- Wang, M., and Manning, C.D. (2013, January 14–19). Effect of non-linear deep architecture in sequence labeling. Proceedings of the Sixth International Joint Conference on Natural Language Processing, Nagoya, Japan.
- Peeters, R., Primpeli, A., Wichtlhuber, B., and Bizer, C. (2020, January 30). Using schema. org annotations for training and maintaining product matchers. Proceedings of the 10th International Conference on Web Intelligence, Mining and Semantics, Biarritz, France. · DOI
- Shah, K., Kopru, S., and Ruvini, J.D. (2018). Neural network based extreme classification and similarity models for product matching. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3 (Industry Papers), Association for Computational Linguistics. · DOI
- Li, Y., Li, J., Suhara, Y., Doan, A., and Tan, W.C. (2020). Deep entity matching with pre-trained language models. arXiv. · DOI · Paper page
- Peeters, 2020, Intermediate training of BERT for product matching, Small, 745, 2
- Borst, J., Koerner, E., Opasjumruskit, K., and Niekler, A. (2020, January 12–17). Language Model CNN-driven similarity matching and classification for HTML-embedded Product Data. Proceedings of the ISWC 2020, virtual.
- Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). Roberta: A robustly optimized bert pretraining approach. arXiv.
- Sanh, V., Debut, L., Chaumond, J., and Wolf, T. (2019). DistilBERT, a distilled version of BERT: Smaller, faster, cheaper and lighter. arXiv.
- Zhang, Y., and Wallace, B. (2015). A sensitivity analysis of (and practitioners’ guide to) convolutional neural networks for sentence classification. arXiv.
- Fu, C., Wang, T., Nie, H., and Han, X. (2020, January 12–17). 0001, L.S. ISCAS_ICIP at MWPD-2020 Task 1: Product Matching Based on Deep Entity Matching Frameworks. Proceedings of the ISWC 2020, virtual. MWPD@ISWC.
- Fu, C., Han, X., Sun, L., Chen, B., Zhang, W., Wu, S., and Kong, H. (2019, January 10–16). End-to-End Multi-Perspective Matching for Entity Resolution. Proceedings of the IJCAI, Macao, China. · DOI
- Nie, H., Han, X., He, B., Sun, L., Chen, B., Zhang, W., Wu, S., and Kong, H. (2019, January 3–7). Deep sequence-to-sequence entity matching for heterogeneous entity resolution. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China. · DOI · Paper page
- Fu, C., Han, X., He, J., and Sun, L. (2021, January 7–15). Hierarchical matching network for heterogeneous entity resolution. Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, Yokohama, Japan. · DOI
- Torrey, L., and Shavlik, J. (2010). Transfer learning. Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, IGI Global. · DOI · Paper page
- Pfeifer, R., Schreter, Z., Fogelman, F., and Steels, L. (1989). Generalization and Network Design Strategies. Connectionism in Perspective, Elsevier. An Extended Version Was Published as a Technical Report of the University of Toronto.
- LeCun, 1989, Backpropagation applied to handwritten zip code recognition, Neural Comput., 1, 541, 10.1162/neco.1989.1.4.541 · DOI · Paper page
- LeCun, 1995, Convolutional networks for images, speech, and time series, Handb. Brain Theory Neural Netw., 3361, 1995
- Khan, 2020, A survey of the recent architectures of deep convolutional neural networks, Artif. Intell. Rev., 53, 5455, 10.1007/s10462-020-09825-6 · DOI · Paper page
- Russakovsky, 2015, ImageNet Large Scale Visual Recognition Challenge, Int. J. Comput. Vis. (IJCV), 115, 211, 10.1007/s11263-015-0816-y · DOI · Paper page
- Salton, 1975, A Vector Space Model for Automatic Indexing, Commun. ACM, 18, 613, 10.1145/361219.361220 · DOI · Paper page
- Salton, 1988, Term-Weighting Approaches in Automatic Text Retrieval, Inf. Process. Manag., 24, 513, 10.1016/0306-4573(88)90021-0 · DOI · Paper page
- Consoli, 2020, TF-IDF vs word embeddings for morbidity identification in clinical notes: An initial study, Proceedings of the First Workshop on Smart Personal Health Interfaces Co-Located with 25th International Conference on Intelligent User Interfaces, SmartPhil@IUI 2020, Volume 2596, 1
- Kumar, 2020, Ensembling classical machine learning and deep learning approaches for morbidity identification from clinical notes, IEEE Access, 9, 7107, 10.1109/ACCESS.2020.3043221 · DOI
- Manning, C.D., Raghavan, P., and Schütze, H. (2008). Introduction to Information Retrieval, Cambridge University Press. · DOI · Paper page
- Piskorski, J., and Jacquet, G. (2020, January 11–16). TF-IDF Character N-grams versus Word Embedding-based Models for Fine-grained Event Classification: A Preliminary Study. Proceedings of the Workshop on Automated Extraction of Socio-Political Events from News 2020, Marseille, France.
- Zamojski, W., Mazurkiewicz, J., Sugier, J., Walkowiak, T., and Kacprzyk, J. (2021). Subject Classification of Texts in Polish—From TF-IDF to Transformers. Theory and Engineering of Dependable Computer Systems and Networks, Springer International Publishing. · doi:10.1007/978-3-030-76773-0
- Senel, 2018, Semantic Structure and Interpretability of Word Embeddings, IEEE/ACM Trans. Audio Speech Lang. Proc., 26, 1769, 10.1109/TASLP.2018.2837384 · DOI
- Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient Estimation of Word Representations in Vector Space. In Workshop Track Proceedings, Proceedings of the 1st International Conference on Learning Representations (ICLR 2013), Scottsdale, AZ, USA, 2–4 May 2013; Bengio, Y., LeCun, Y., Eds. arXiv.
- Pennington, J., Socher, R., and Manning, C.D. (2014, January 25–29). GloVe: Global Vectors for Word Representation. Proceedings of the Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar. · DOI · Paper page
- Bojanowski, 2017, Enriching Word Vectors with Subword Information, Trans. Assoc. Comput. Linguist., 5, 135, 10.1162/tacl_a_00051 · DOI · Paper page
- Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv.
- Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention is all you need. arXiv.
- Zhu, Y., Kiros, R., Zemel, R.S., Salakhutdinov, R., Urtasun, R., Torralba, A., and Fidler, S. (2015, January 7–13). Aligning Books and Movies: Towards Story-Like Visual Explanations by Watching Movies and Reading Books. Proceedings of the ICCV 2015, Santiago, Chile. · DOI · Paper page
- Chaperon, 2020, Spanish Pre-Trained BERT Model and Evaluation Data, PML4DC ICLR 2020, 2020, 1
- Mao, J., Xu, W., Yang, Y., Wang, J., Huang, Z., and Yuille, A. (2014). Deep captioning with multimodal recurrent neural networks (m-rnn). arXiv.
- Kiros, 2014, Multimodal neural language models. International conference on machine learning, PMLR, 32, 595
- Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhudinov, R., Zemel, R., and Bengio, Y. (2015, January 7–9). Show, attend and tell: Neural image caption generation with visual attention. Proceedings of the International Conference on Machine Learning (PMLR 2015), Lille, France.
- Khaleghi, 2013, Multisensor data fusion: A review of the state-of-the-art, Inf. Fusion, 14, 28, 10.1016/j.inffus.2011.08.001 · DOI · Paper page
- Yao, W., Moumtzidou, A., Dumitru, C.O., Andreadis, S., Gialampoukidis, I., Vrochidis, S., Datcu, M., and Kompatsiaris, Y. (2021, January 10–15). Early and Late Fusion of Multiple Modalities in Sentinel Imagery and Social Media Retrieval. Proceedings of the ICPR Workshops 2020, virtual. · DOI
- Gadzicki, K., Khamsehashari, R., and Zetzsche, C. (2020, January 6–9). Early vs Late Fusion in Multimodal Convolutional Neural Networks. Proceedings of the 2020 IEEE 23rd International Conference on Information Fusion (FUSION), Rustenburg, South Africa. · DOI · Paper page
- Breiman, 2005, Bagging Predictors, Mach. Learn., 24, 123, 10.1007/BF00058655 · DOI · Paper page
- Polikar, 2006, Ensemble based systems in decision making, IEEE Circuits Syst. Mag., 6, 21, 10.1109/MCAS.2006.1688199 · DOI · Paper page
- Rokach, 2009, Ensemble-based classifiers, Artif. Intell. Rev., 33, 1, 10.1007/s10462-009-9124-7 · DOI · Paper page
- Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
- Pedregosa, 2011, Scikit-learn: Machine Learning in Python, J. Mach. Learn. Res., 12, 2825
- Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2–4). TensorFlow: A System for Large-Scale Machine Learning. Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation (OSDI’16), Savannah, GA, USA.
Metadata
- Authors
- Estrada-Valenciano, R., Muñiz-Sánchez, V., & De-la-Torre-Gutiérrez, H.
- Venue
- Mathematics
- Publisher
- MDPI AG
- Published
- 2022-07-23
- Volume
- 10
- Issue
- 15
- Pages
- 2564
- ISSN
- 2227-7390
- Cited by
- 8
- References
- 6
- Language
- en
- Funders
- Centro de Investigación en Matemáticas, A. C
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An Entity-Matching System Based on Multimodal Data for Two Major E-Commerce Stores in Mexico. https://app.cochat.ai/papers/10.3390/math10152564
- The paper
- Estrada-Valenciano, R., Muñiz-Sánchez, V., & De-la-Torre-Gutiérrez, H. (2022). An Entity-Matching System Based on Multimodal Data for Two Major E-Commerce Stores in Mexico. Mathematics. https://doi.org/10.3390/math10152564
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.