Physics-Based Simulation of Soft-Body Deformation Using RGB-D Data.

Publisher: MDPI Country of Publication: Switzerland NLM ID: 101204366 Publication Model: Electronic Cited Medium: Internet ISSN: 1424-8220 (Electronic) Linking ISSN: 14248220 NLM ISO Abbreviation: Sensors (Basel) Subsets: MEDLINE

Original Publication: Basel, Switzerland : MDPI, c2000-

Physics*; Computer Simulation

Providing real-time interaction in an immersive environment has drawn considerable attention in the virtual training fields. Physics-based simulations are suitable for such environments; however, they require the definition and adjustment of coefficients that determine material properties, making the methods more complex and time-consuming. In this paper, we introduce a novel approach to simulating the soft-body deformation of an observed object. Using an off-the-shelf RGB-D sensor, the proposed approach tracks an object's movement and simulates its deformation in an iterative manner. Polygonal models with different resolutions are used to improve the simulation speed and visual quality. During the simulation process, a low-resolution model is used for surface deformation using neighboring feature points detected from the sensor, and a volumetric model is added for internal force estimation. To visualize the observed model in detail, the deformed and low-resolution model is mapped to a high-resolution model using mean value coordinate interpolation. To handle topological deformations, such as cutting or tearing, a part intersected by a cutting tool is recognized by the sensor and responds to external forces. As shown in the experimental results, our approach generates convincing deformations of observed objects in real time.

IEEE Trans Pattern Anal Mach Intell. 2017 May;39(5):833-850. (PMID: 27164575)
J Med Syst. 2018 Feb 5;42(3):53. (PMID: 29404692)
Expert Rev Med Devices. 2021 Jan;18(1):47-62. (PMID: 33283563)
IEEE Trans Pattern Anal Mach Intell. 2016 Jan;38(1):172-87. (PMID: 26656585)
IEEE Trans Pattern Anal Mach Intell. 2015 Oct;37(10):2099-118. (PMID: 26353187)
Sensors (Basel). 2021 Oct 13;21(20):. (PMID: 34696004)
IEEE Trans Pattern Anal Mach Intell. 2011 May;33(5):931-44. (PMID: 20733216)

2017-0-01849 Institute for Information and Communications Technology Promotion; 2021R1F1A1046513 National Research Foundation of Korea; 2021-0-00320 Institute for Information and Communications Technology Promotion

Keywords: RGB-D data; object tracking; physics-based simulation; soft-body deformation; topological editing

Date Created: 20221014 Date Completed: 20221017 Latest Revision: 20221019

20221213

PMC9571817

10.3390/s22197225

36236323