The MatchNMingle Dataset: A Novel Multi-Sensor Resource for the Analysis of Social Interactions and Group Dynamics In-the-Wild During Free-Standing Conversations and Speed Dates
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
We present MatchNMingle, a novel multimodal/multisensor dataset for the analysis of free-standing conversational groups and speed-dates in-the-wild. MatchNMingle leverages the use of wearable devices and overhead cameras to record social interactions of 92 people during real-life speed-dates, followed by a cocktail party. To our knowledge, MatchNMingle has the largest number of participants, longest recording time and largest set of manual annotations for social actions available in this context in a real-life scenario. It consists of 2 hours of data from wearable acceleration, binary proximity, video, audio, personality surveys, frontal pictures and speed-date responses. Participants' positions and group formations were manually annotated; as were social actions (eg. speaking, hand gesture) for 30 minutes at 20 FPS making it the first dataset to incorporate the annotation of such cues in this context. We present an empirical analysis of the performance of crowdsourcing workers against trained annotators in simple and complex annotation tasks, founding that although efficient for simple tasks, using crowdsourcing workers for more complex tasks like social action annotation led to additional overhead and poor inter-annotator agreement compared to trained annotators (differences up to 0.4 in Fleiss' Kappa coefficients). We also provide example experiments of how MatchNMingle can be used.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.143 · Cited by 7,539
High self-control predicts good adjustment, less pathology, better grades, and interpersonal success
Tangney, J. P., Baumeister, R. F., & Boone, A. L. (2004) · Journal of Personality · doi:10.1111/j.0022-3506.2004.00263.x · Cited by 6,557
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147
Empirical, Theoretical, and Practical Advantages of the HEXACO Model of Personality Structure
Ashton, M. C., & Lee, K. (2007) · Personality and Social Psychology Review · doi:10.1177/1088868306294907 · Cited by 2,171
Grammer, K., & Thornhill, R. (1994) · Journal of Comparative Psychology · doi:10.1037/0735-7036.108.3.233 · Cited by 1,110 · cited 1×
“We collected also these as prior research has shown that facial attributes, such as facial height-width ratio [63] or closeness of a person’s face to the mean face [32] correlate with perceived attractiveness.”
ResultAshton, M. C., Lee, K., Perugini, M., Szarota, P., de Vries, R. E., Di Blas, L., Boies, K., & De Raad, B. (2004) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.86.2.356 · Cited by 1,044 · cited 1×
“replications [5], and to outperform the FFM in both selfratings (i.”
BackgroundSocial signal processing: Survey of an emerging domain
Vinciarelli, A., Pantic, M., & Bourlard, H. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.11.007 · Cited by 842
Transfer learning for activity recognition: a survey
Cook, D., Feuz, K. D., & Krishnan, N. C. (2013) · Knowledge and Information Systems · doi:10.1007/s10115-013-0665-3 · Cited by 447
Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing
Vinciarelli, A., Pantic, M., Heylen, D., Pelachaud, C., Poggi, I., D'Errico, F., & Schroeder, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.27 · Cited by 381
LC‐MS/MS‐based method for long‐term steroid profiling in human scalp hair
Noppe, G., de Rijke, Y. B., Dorst, K., van den Akker, E. L. T., & van Rossum, E. F. C. (2015) · Clinical Endocrinology · doi:10.1111/cen.12781 · Cited by 127
Cited by
Sun, Y., Greaves, D. A., Orgs, G., de C. Hamilton, A. F., Day, S., & Ward, J. A. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3580781 · Cited by 35
Varghese, E. B., & Thampi, S. M. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104305 · Cited by 12
Person Re-ID by Fusion of Video Silhouettes and Wearable Signals for Home Monitoring Applications
Masullo, A., Burghardt, T., Damen, D., Perrett, T., & Mirmehdi, M. (2020) · Sensors · doi:10.3390/s20092576 · Cited by 10
“To the best of the Authors’ knowledge, the SPHERE-Calorie dataset is the only large dataset including RGB-D and acceleration data from wearable devices that is suitable for the Video-Acceleration Matching problem using silhouettes (while the Authors are aware of the existence of the MatchNMingle dataset [51], the comb…”
MethodPeng, Y. (., Tanaka, A., & Ward, J. A. (2020) · Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers · doi:10.1145/3410530.3414378 · Cited by 3
Metadata
- Authors
- Cabrera-Quiros, L., Demetriou, A., Gedik, E., van der Meij, L., & Hung, H.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2021-01-01
- Volume
- 12
- Issue
- 1
- Pages
- 113-130
- ISSN
- 1949-3045 (ISSN-L)
- 2371-9850
- OpenAlex
- W2810412635
- Cited by
- 63
- References
- 11
- FWCI
- 11.11
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.