The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Example-guided physically based modal sound synthesis
Abstract
Linear modal synthesis methods have often been used to generate sounds for rigid bodies. One of the key challenges in widely adopting such techniques is the lack of automatic determination of satisfactory material parameters that recreate realistic audio quality of sounding materials. We introduce a novel method using prerecorded audio clips to estimate material parameters that capture the inherent quality of recorded sounding materials. Our method extracts perceptually salient features from audio examples. Based on psychoacoustic principles, we design a parameter estimation algorithm using an optimization framework and these salient features to guide the search of the best material parameters for modal synthesis. We also present a method that compensates for the differences between the real-world recording and sound synthesized using solely linear modal synthesis models to create the final synthesized audio. The resulting audio generated from this sound synthesis pipeline well preserves the same sense of material as a recorded audio example. Moreover, both the estimated material parameters and the residual compensation naturally transfer to virtual objects of different sizes and shapes, while the synthesized sounds vary accordingly. A perceptual study shows the results of this system compare well with real-world recordings in terms of material perception.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A method for registration of 3-D shapes
Besl, P. J., & McKay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 18,103
Discrete-Time Signal Processing
Oppenheim, A. V., & Schafer, R. W. (1989) · Cited by 12,572
Convergence Properties of the Nelder--Mead Simplex Method in Low Dimensions
Lagarias, J. C., Reeds, J. A., Wright, M. H., & Wright, P. E. (1998) · SIAM Journal on Optimization · doi:10.1137/s1052623496303470 · Cited by 7,447
International Organization for Standardization
(2015) · Encyclopedia of Astrobiology · doi:10.1007/978-3-662-44185-5_100574 · Cited by 6,716
Topology matching for fully automatic similarity estimation of 3D shapes
Hilaga, M., Shinagawa, Y., Kohmura, T., & Kunii, T. L. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383282 · Cited by 2,187
Signal estimation from modified short-time Fourier transform
Griffin, D., & Lim, J. (1984) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1984.1164317 · Cited by 2,095
Proceedings IEEE International Conference on Acoustics Speech and Signal Processing
Zheng, F., McLaughlin, S., & Mulgrew, B. (1991) · Cited by 1,905
A modified Hausdorff distance for object matching
Dubuisson, M.-P., & Jain, A. K. (2002) · Proceedings of 12th International Conference on Pattern Recognition · doi:10.1109/icpr.1994.576361 · Cited by 1,464
Zwicker, E., & Fastl, H. (1999) · Springer Series in Information Sciences · doi:10.1007/978-3-662-09562-1 · Cited by 609
Proceedings of 12th International Conference on Pattern Recognition
(1994) · Proceedings of 12th International Conference on Pattern Recognition ICPR-94 · doi:10.1109/icpr.1994.576213 · Cited by 470
Serra, X., & Smith, J. (1990) · Computer Music Journal · doi:10.2307/3680788 · Cited by 338
Real Sound Synthesis for Interactive Applications
Cook, P. R. (2002) · A K Peters/CRC Press eBooks · doi:10.1201/b19597 · Cited by 331
FoleyAutomatic: physically-based sound effects for interactive simulation and animation
van den Doel, K., Kry, P. G., & Pai, D. K. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383322 · Cited by 305
Musical Sound Modeling with Sinusoids plus Noise
Serra, X. (1997) · Repositori digital de la UPF (Universitat Pompeu Fabra) · Cited by 260
Scanning physical interaction behavior of 3D objects
Pai, D. K., van den Doel, K., James, D. L., Lang, J., Lloyd, J. E., Richmond, J. L., & Yau, S. H. (2005) · ACM SIGGRAPH 2005 Courses on - SIGGRAPH '05 · doi:10.1145/1198555.1198615 · Cited by 193
Synthesizing sounds from rigid-body simulations
O'Brien, J. F., Shen, C., & Gatchalian, C. M. (2002) · Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation · doi:10.1145/545261.545290 · Cited by 162
Physical Modeling of Plucked String Instruments with Application to Real-Time Sound Synthesis
Välimäki, V., Huopaniemi, J., Karjalainen, M., & Jánosy, Z. (1996) · Journal of the Audio Engineering Society · Cited by 155
Physically Informed Sonic Modeling (PhISM): Synthesis of Percussive Sounds
Cook, P. R. (1997) · Computer Music Journal · doi:10.2307/3681012 · Cited by 155
Representations of Musical Signals
Battier, M., Poli, G. D., Piccialli, A., & Roads, C. (1992) · Leonardo Music Journal · doi:10.2307/1513226 · Cited by 149
The representation of auditory source characteristics: Simple geometric form
Lakatos, S., McAdams, S. E., & Caussé, R. (1997) · Perception & Psychophysics · doi:10.3758/bf03214206 · Cited by 137
van den Doel, K., & Pai, D. K. (1998) · PRESENCE Virtual and Augmented Reality · doi:10.1162/105474698565794 · Cited by 132
Rocchesso, D., Moynihan, B., & Bresin, R. (2002) · AirIuav (Università Iuav di Venezia) · Cited by 104
Chadwick, J. N., An, S. S., & James, D. L. (2009) · ACM Transactions on Graphics · doi:10.1145/1618452.1618465 · Cited by 81
Rigid-body fracture sound with precomputed soundbanks
Zheng, C., & James, D. L. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778806 · Cited by 79
Fast modal sounds with scalable frequency-domain synthesis
Bonneel, N., George Drettakis, B., Tsingos, N., Viaud‐Delmon, I., & James, D. L. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360623 · Cited by 70
Modeling timbre distance with temporal statistics from polyphonic music
Mörchen, F., Ultsch, A., Thies, M., et al. (2005) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tsa.2005.860352 · Cited by 68
Toward high-quality modal contact sound
Zheng, C., & James, D. L. (2011) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1964921.1964933 · Cited by 66
Sounding liquids: Automatic sound synthesis from fluid simulation
Moss, W., Yeh, H., Hong, J., Lin, M. C., & Manocha, D. (2010) · ACM Transactions on Graphics · doi:10.1145/1805964.1805965 · Cited by 66
Self-citationToward high-quality modal contact sound
Zheng, C., & James, D. L. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964933 · Cited by 58
Zheng, C., & James, D. L. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531343 · Cited by 57
Affine invariant comparison of point-sets using convex hulls and hausdorff distances
Gope, C., & Kehtarnavaz, N. (2006) · Pattern Recognition · doi:10.1016/j.patcog.2006.04.026 · Cited by 55
Development and Calibration of a Guitar Synthesizer
Välimäki, V., & Tolonen, T. (1997) · Journal of the Audio Engineering Society · Cited by 53
TimbreFields: 3D Interactive Sound Models for Real-Time Audio
Corbett, R., van den Doel, K., Lloyd, J. E., & Heidrich, W. (2007) · PRESENCE Virtual and Augmented Reality · doi:10.1162/pres.16.6.643 · Cited by 24
Realistic real-time sound re-synthesis and processing for interactive virtual worlds
Trebien, F., & Oliveira, M. M. (2009) · The Visual Computer · doi:10.1007/s00371-009-0341-5 · Cited by 24
Cited by
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
Mildenhall, B., Srinivasan, P. P., Tancik, M., Barron, J. T., Ramamoorthi, R., & Ng, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_24 · Cited by 5,351
Lights, camera, action: high-throughput plant phenotyping is ready for a close-up
Fahlgren, N., Gehan, M. A., & Baxter, I. (2015) · Current Opinion in Plant Biology · doi:10.1016/j.pbi.2015.02.006 · Cited by 703
Procedural Content Generation via Machine Learning (PCGML)
Summerville, A., Snodgrass, S., Guzdial, M., Holmgard, C., Hoover, A. K., Isaksen, A., Nealen, A., & Togelius, J. (2018) · IEEE Transactions on Games · doi:10.1109/tg.2018.2846639 · Cited by 425
Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays
Kramida, G. (2016) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2473855 · Cited by 379
Visual perception of materials and their properties
Fleming, R. W. (2014) · Vision Research · doi:10.1016/j.visres.2013.11.004 · Cited by 331
Metadata
- Authors
- Ren, Z., Yeh, H., & Lin, M. C.
- Venue
- ACM Transactions on Graphics
- Published
- 2013-01
- Volume
- 32
- Issue
- 1
- Pages
- 1-16
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2099332139
- Cited by
- 453
- References
- 34
- FWCI
- 36.80
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.