GradRig: Differentiable Weights for Skinned Gaussian Splat Deformation

RESUMO

Skinned deformation is a common framework to turn a 3D shape from its rest pose into a dynamic pose through the deformation of a coarser kinematic structure, called rig. When applied to a 3D mesh, this rig only needs to displace vertices to deform the polygons that connect them. However, when deforming 3D Gaussian Splats, which do not provide connectivity information, rigidly transforming points is not enough to prevent the creation of holes when stretching shapes. In this paper, we use the spatial gradient of skinning weights to provide a full mesh-free deformation pipeline for Gaussian Splats, that more accurately stretches splats while remaining fully compatible with real-time rendering capabilities, which we demonstrate in a WebGL viewer. We present how we evaluate these gradients when the user creates the rig structure and propose an optional adaptive resampling scheme to split up splats that still produce artifacts.