by America Ortiz | Jan 3, 2024 | Video Processing, Visual Computing
Stereo Conversion with Disparity-Aware Warping, Compositing and Inpainting In this paper, we present a novel method for high-resolution 2D-to-3D conversion. It is fully differentiable in all of its stages and performs disparity-informed warping, consistent...
by America Ortiz | Dec 11, 2023 | Animation, Visual Computing
Pose and Skeleton-aware Neural IK for Pose and Motion Editing In this work, we introduce SKEL-IK, a novel architecture and training scheme that is conditioned on a base pose and designed to flow information directly onto the skeletal graph structure, such that hard...
by America Ortiz | Dec 9, 2023 | Video Processing, Visual Computing
Empowering Convolutional Neural Networks with MetaSin Activation In this work, we propose replacing a baseline network’s existing activations with a novel ensemble function with trainable parameters. The proposed METASIN activation can be trained reliably without...
by America Ortiz | Nov 29, 2023 | Capture, Visual Computing
An Implicit Physical Face Model Driven by Expression and Style We propose a new face model based on a data-driven implicit neural physics model that can be driven by both expression and style separately. At the core, we present a framework for learning implicit...
by America Ortiz | Oct 28, 2023 | Video Processing, Visual Computing
Neural Video Compression with Spatio-Temporal Cross-Covariance Transformers This work aims to effectively and jointly leverage robust temporal and spatial information by proposing a new 3D-based transformer module: Spatio-Temporal Cross- Covariance Transformer...