-
PS-CAD: Local Geometry Guidance via Prompting and Selection for CAD Reconstruction ACM Trans. Graph. (IF 7.8) Pub Date : 2025-05-08
Bingchen Yang, Haiyong Jiang, Hao Pan, Guosheng Lin, Jun Xiao, Peter WonkaReverse engineering CAD models from raw geometry is a classic but challenging research problem. In particular, reconstructing the CAD modeling sequence from point clouds provides great interpretability and convenience for editing. Analyzing previous work, we observed that a CAD modeling sequence represented by tokens and processed by a generative model does not have an immediate geometric interpretation
-
StiffGIPC: Advancing GPU IPC for Stiff Affine-Deformable Simulation ACM Trans. Graph. (IF 7.8) Pub Date : 2025-05-07
Kemeng Huang, Xinyu Lu, Huancheng Lin, Taku Komura, Minchen LiIncremental Potential Contact (IPC) is a widely used, robust, and accurate method for simulating complex frictional contact behaviors. However, achieving high efficiency remains a major challenge, particularly as material stiffness increases, which leads to slower Preconditioned Conjugate Gradient (PCG) convergence, even with the state-of-the-art preconditioners. In this paper, we propose a fully GPU-optimized
-
Reliable Iterative Dynamics: A Versatile Method for Fast and Robust Simulation ACM Trans. Graph. (IF 7.8) Pub Date : 2025-05-05
Jia-Ming Lu, Shi-Min HuSimulating stiff materials has long posed formidable challenges for traditional physics-based solvers. Explicit time integration schemes demand prohibitively small time steps, while implicit methods necessitate an excessive number of iterations to converge, often yielding visually objectionable transient configurations in the early iterations, severely limiting their real-time applicability. Position-based
-
End-to-end Surface Optimization for Light Control ACM Trans. Graph. (IF 7.8) Pub Date : 2025-05-02
Yuou Sun, Bailin Deng, Juyong ZhangDesigning a freeform surface to reflect or refract light to achieve a target distribution is a challenging inverse problem. In this paper, we propose an end-to-end optimization strategy for an optical surface mesh. Our formulation leverages a novel differentiable rendering model, and is directly driven by the difference between the resulting light distribution and the target distribution. We also enforce
-
HoloChrome: Polychromatic Illumination for Speckle Reduction in Holographic Near-Eye Displays ACM Trans. Graph. (IF 7.8) Pub Date : 2025-04-28
Florian Andreas Schiffers, Grace Kuo, Nathan Matsuda, Douglas Lanman, Oliver CossairtHolographic displays hold the promise of providing authentic depth cues, resulting in enhanced immersive visual experiences for near-eye applications. However, current holographic displays are hindered by speckle noise, which limits accurate reproduction of color and texture in displayed images. We present HoloChrome, a polychromatic holographic display framework designed to mitigate these limitations
-
StructRe : Rewriting for Structured Shape Modeling ACM Trans. Graph. (IF 7.8) Pub Date : 2025-04-28
Jiepeng Wang, Hao Pan, Yang Liu, Xin Tong, Taku Komura, Wenping WangMan-made 3D shapes are naturally organized in parts and hierarchies; such structures provide important constraints for shape reconstruction and generation. Modeling shape structures is difficult, because there can be multiple hierarchies for a given shape, causing ambiguity, and across different categories the shape structures are correlated with semantics, limiting generalization. We present StructRe
-
Policy-Space Diffusion for Physics-Based Character Animation ACM Trans. Graph. (IF 7.8) Pub Date : 2025-04-25
Michele Rocca, Sune Darkner, Kenny Erleben, Sheldon AndrewsAdapting motion to new contexts in digital entertainment often demands fast agile prototyping. State-of-the-art techniques use reinforcement learning policies for simulating the underlined motion in a physics engine. Unfortunately, policies typically fail on unseen tasks and it is too time-consuming to fine-tune the policy for every new morphological, environmental, or motion change. We propose a novel
-
A Neural Particle Level Set Method for Dynamic Interface Tracking ACM Trans. Graph. (IF 7.8) Pub Date : 2025-04-21
Duowen Chen, Junwei Zhou, Bo ZhuWe propose a neural particle level set (Neural PLS) method to accommodate tracking and evolving dynamic neural representations. At the heart of our approach is a set of oriented particles serving dual roles of interface trackers and sampling seeders. These dynamic particles are used to evolve the interface and construct neural representations on a multi-resolution grid-hash structure to hybridize coarse
-
MoFlow: Motion-Guided Flows for Recurrent Rendered Frame Prediction ACM Trans. Graph. (IF 7.8) Pub Date : 2025-04-18
Zhizhen Wu, Zhilong Yuan, Chenyu Zuo, Yazhen Yuan, Yifan PENG, Guiyang Pu, Rui Wang, Yuchi HuoRendering realistic images in real-time on high-frame-rate display devices poses considerable challenges, even with advanced graphics cards. This stimulates a demand for frame prediction technologies to boost frame rates. The key to these algorithms is to exploit spatiotemporal coherence by warping rendered pixels with motion representations. However, existing motion estimation methods can suffer from
-
Patch-Grid : An Efficient and Feature-Preserving Neural Implicit Surface Representation ACM Trans. Graph. (IF 7.8) Pub Date : 2025-04-08
Guying Lin, Lei Yang, Congyi Zhang, Hao Pan, Yuhan Ping, Guodong Wei, Taku Komura, John Keyser, Wenping WangNeural implicit representations are increasingly used to depict 3D shapes owing to their inherent smoothness and compactness, contrasting with traditional discrete representations. Yet, the multilayer perceptron (MLP) based neural representation, because of its smooth nature, rounds sharp corners or edges, rendering it unsuitable for representing objects with sharp features like CAD models. Moreover
-
B4M : B reaking Low-Rank Adapter for M aking Content-Style Customization ACM Trans. Graph. (IF 7.8) Pub Date : 2025-04-05
Yu Xu, Fan Tang, Juan Cao, Yuxin Zhang, Oliver Deussen, Weiming Dong, Jintao Li, Tong-Yee LeePersonalized generation paradigms empower designers to customize visual intellectual properties with the help of textual descriptions by adapting pre-trained text-to-image models on a few images. Recent studies focus on simultaneously customizing content and detailed visual style in images but often struggle with entangling the two. In this study, we reconsider the customization of content and style
-
Neurally Integrated Finite Elements for Differentiable Elasticity on Evolving Domains ACM Trans. Graph. (IF 7.8) Pub Date : 2025-04-02
Gilles Daviet, Tianchang Shen, Nicholas Sharp, David I.W. LevinWe present an elastic simulator for domains defined as evolving implicit functions, which is efficient, robust, and differentiable with respect to both shape and material. This simulator is motivated by applications in 3D reconstruction: it is increasingly effective to recover geometry from observed images as implicit functions, but physical applications require accurately simulating and optimizing-for
-
Diffusing Winding Gradients (DWG): A Parallel and Scalable Method for 3D Reconstruction from Unoriented Point Clouds ACM Trans. Graph. (IF 7.8) Pub Date : 2025-04-01
Weizhou Liu, Jiaze Li, Xuhui Chen, Fei Hou, Shiqing Xin, Xingce Wang, Zhongke Wu, Chen Qian, Ying HeThis paper presents Diffusing Winding Gradients (DWG) for reconstructing watertight surfaces from unoriented point clouds. Our method exploits the alignment between the gradients of screened generalized winding number (GWN) field–a robust variant of the standard GWN field– and globally consistent normals to orient points. Starting with an unoriented point cloud, DWG initially assigns a random normal
-
Fast Determination and Computation of Self-intersections for NURBS Surfaces ACM Trans. Graph. (IF 7.8) Pub Date : 2025-03-31
Kai Li, Xiaohong Jia, Falai ChenSelf-intersections of NURBS surfaces are unavoidable during the CAD modeling process, especially in operations such as offset or sweeping. The existence of self-intersections might cause problems in the latter simulation and manufacturing process. Therefore, fast detection of self-intersections of NURBS is highly demanded in industrial applications. Self-intersections are essentially singular points
-
SpotLessSplats: Ignoring Distractors in 3D Gaussian Splatting ACM Trans. Graph. (IF 7.8) Pub Date : 2025-03-29
Sara Sabour, Lily Goli, George Kopanas, Mark Matthews, Dmitry Lagun, Leonidas Guibas, Alec Jacobson, David Fleet, Andrea Tagliasacchi3D Gaussian Splatting (3DGS) is a promising technique for 3D reconstruction, offering efficient training and rendering speeds, making it suitable for real-time applications. However, current methods require highly controlled environments—no moving people or wind-blown elements, and consistent lighting—to meet the inter-view consistency assumption of 3DGS. This makes reconstruction of real-world captures
-
NeST: Neural Stress Tensor Tomography by leveraging 3D Photoelasticity ACM Trans. Graph. (IF 7.8) Pub Date : 2025-03-22
Akshat Dave, Tianyi Zhang, Aaron Young, Ramesh Raskar, Wolfgang Heidrich, Ashok VeeraraghavanPhotoelasticity enables full-field stress analysis in transparent objects through stress-induced birefringence. Existing techniques are limited to 2D slices and require destructively slicing the object. Recovering the internal 3D stress distribution of the entire object is challenging as it involves solving a tensor tomography problem and handling phase wrapping ambiguities. We introduce NeST, an
-
Kinematic Motion Retargeting for Contact-Rich Anthropomorphic Manipulations ACM Trans. Graph. (IF 7.8) Pub Date : 2025-03-15
Arjun Sriram Lakshmipathy, Jessica Hodgins, Nancy PollardHand motion capture data is now relatively easy to obtain, even for complicated grasps; however, this data is of limited use without the ability to retarget it onto the hands of a specific character or robot. The target hand may differ dramatically in geometry, number of degrees of freedom (DOFs), or number of fingers. We present a simple, but effective framework capable of kinematically retargeting
-
Encoded Marker Clusters for Auto-Labeling in Optical Motion Capture ACM Trans. Graph. (IF 7.8) Pub Date : 2025-02-10
Hao Wang, Taogang Hou, Tianhui Liu, Jiaxin Li, Tianmiao WangMarker-based optical motion capture (MoCap) is a vital tool in applications such as virtual production, and movement sciences. However, reconstructing scattered MoCap data into real motion sequences is challenging, and data processing is time-consuming and labor-intensive. Here we propose a novel framework for MoCap auto-labeling and matching. In this framework, we designed novel clusters of reflective
-
Direct Rendering of Intrinsic Triangulations ACM Trans. Graph. (IF 7.8) Pub Date : 2025-02-03
Waldemar CelesExisting intrinsic triangulation frameworks represent powerful tools for geometry processing; however, they all require the extraction of the common subdivision between extrinsic and intrinsic triangulations for visualization and optimized data transfer. We describe an efficient and effective algorithm for directly rendering intrinsic triangulations that avoids extracting common subdivisions. Our strategy
-
Texture Size Reduction Through Symmetric Overlap and Texture Carving ACM Trans. Graph. (IF 7.8) Pub Date : 2025-01-25
Julian Knodt, Xifeng GaoMaintaining memory efficient 3D assets is critical for game development due to size constraints for applications, and runtime costs such as GPU data transfers. While most prior work on 3D modeling focuses on reducing triangle count, few works focus on reducing texture sizes. We propose an automatic approach to reduce the texture size for 3D models while maintaining the rendered appearance of the original
-
Don't Splat your Gaussians: Volumetric Ray-Traced Primitives for Modeling and Rendering Scattering and Emissive Media ACM Trans. Graph. (IF 7.8) Pub Date : 2025-01-21
Jorge Condor, Sebastien Speierer, Lukas Bode, Aljaz Bozic, Simon Green, Piotr Didyk, Adrian JaraboEfficient scene representations are essential for many computer graphics applications. A general unified representation that can handle both surfaces and volumes simultaneously, remains a research challenge. In this work we propose a compact and efficient alternative to existing volumetric representations for rendering such as voxel grids. Inspired by recent methods for scene reconstruction that leverage
-
Implicit Bonded Discrete Element Method with Manifold Optimization ACM Trans. Graph. (IF 7.8) Pub Date : 2025-01-09
Jia-Ming Lu, Geng-Chen Cao, Chenfeng Li, Shi-min HuThis paper proposes a novel simulation approach that combines implicit integration with the Bonded Discrete Element Method (BDEM) to achieve faster, more stable and more accurate fracture simulation. The new method leverages the efficiency of implicit schemes in dynamic simulation and the versatility of BDEM in fracture modelling. Specifically, an optimization-based integrator for BDEM is introduced
-
Appearance-Preserving Scene Aggregation for Level-of-Detail Rendering ACM Trans. Graph. (IF 7.8) Pub Date : 2024-12-19
Yang Zhou, Tao Huang, Ravi Ramamoorthi, Pradeep Sen, Ling-Qi YanCreating an appearance-preserving level-of-detail (LoD) representation for arbitrary 3D scenes is a challenging problem. The appearance of a scene is an intricate combination of both geometry and material models, and is further complicated by correlation due to the spatial configuration of scene elements. We present a novel volumetric representation for the aggregated appearance of complex scenes and
-
Unified Pressure, Surface Tension and Friction for SPH Fluids ACM Trans. Graph. (IF 7.8) Pub Date : 2024-12-10
Timo Probst, Matthias TeschnerFluid droplets behave significantly different from larger fluid bodies. At smaller scales, surface tension and friction between fluids and the boundary play an essential role and are even able to counteract gravitational forces. There are quite a few existing approaches that model surface tension forces within an SPH environment. However, as often as not, physical correctness and simulation stability
-
Perspective-Aligned AR Mirror with Under-Display Camera ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Jian Wang, Sizhuo Ma, Karl Bayer, Yi Zhang, Peihao Wang, Bing Zhou, Shree Nayar, Gurunandan KrishnanAugmented reality (AR) mirrors are novel displays that have great potential for commercial applications such as virtual apparel try-on. Typically the camera is placed beside the display, leading to distorted perspectives during user interaction. In this paper, we present a novel approach to address this problem by placing the camera behind a transparent display, thereby providing users with a perspective-aligned
-
StyleCrafter: Taming Artistic Video Diffusion with Reference-Augmented Adapter Learning ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Gongye Liu, Menghan Xia, Yong Zhang, Haoxin Chen, Jinbo Xing, Yibo Wang, Xintao Wang, Ying Shan, Yujiu YangText-to-video (T2V) models have shown remarkable capabilities in generating diverse videos. However, they struggle to produce user-desired artistic videos due to (i) text's inherent clumsiness in expressing specific styles and (ii) the generally degraded style fidelity. To address these challenges, we introduce StyleCrafter, a generic method that enhances pretrained T2V models with a style control
-
Volume Scattering Probability Guiding ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Kehan Xu, Sebastian Herholz, Marco Manzi, Marios Papas, Markus GrossSimulating the light transport of volumetric effects poses significant challenges and costs, especially in the presence of heterogeneous volumes. Generating stochastic paths for volume rendering involves multiple decisions, and previous works mainly focused on directional and distance sampling, where the volume scattering probability (VSP), i.e., the probability of scattering inside a volume, is indirectly
-
Medial Skeletal Diagram: A Generalized Medial Axis Approach for Compact 3D Shape Representation ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Minghao Guo, Bohan Wang, Wojciech MatusikWe propose the Medial Skeletal Diagram, a novel skeletal representation that tackles the prevailing issues around skeleton sparsity and reconstruction accuracy in existing skeletal representations. Our approach augments the continuous elements in the medial axis representation to effectively shift the complexity away from the discrete elements. To that end, we introduce generalized enveloping primitives
-
Skeleton-Driven Inbetweening of Bitmap Character Drawings ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Kirill Brodt, Mikhail BessmeltsevOne of the primary reasons for the high cost of traditional animation is the inbetweening process, where artists manually draw each intermediate frame necessary for smooth motion. Making this process more efficient has been at the core of computer graphics research for years, yet the industry has adopted very few solutions. Most existing solutions either require vector input or resort to tight inbetweening;
-
Neural Kernel Regression for Consistent Monte Carlo Denoising ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Pengju Qiao, Qi Wang, Yuchi Huo, Shiji Zhai, Zixuan Xie, Wei Hua, Hujun Bao, Tao LiuUnbiased Monte Carlo path tracing that is extensively used in realistic rendering produces undesirable noise, especially with low samples per pixel (spp). Recently, several methods have coped with this problem by importing unbiased noisy images and auxiliary features to neural networks to either predict a fixed-sized kernel for convolution or directly predict the denoised result. Since it is impossible
-
Chebyshev Parameterization for Woven Fabric Modeling ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Annika Öhri, Aviv Segall, Jing Ren, Olga Sorkine-HornungDistortion-minimizing surface parameterization is an essential step for computing 2D pieces necessary to fabricate a target 3D shape from flat material. Garment design and textile fabrication are a prominent application example. Common distortion measures quantify length, angle or area preservation in an isotropic manner, so that when applied to woven textile fabrication, they implicitly assume fabric
-
GFFE: G-buffer Free Frame Extrapolation for Low-latency Real-time Rendering ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Songyin Wu, Deepak Vembar, Anton Sochenov, Selvakumar Panneer, Sungye Kim, Anton Kaplanyan, Ling-Qi YanReal-time rendering has been embracing ever-demanding effects, such as ray tracing. However, rendering such effects in high resolution and high frame rate remains challenging. Frame extrapolation methods, which do not introduce additional latency as opposed to frame interpolation methods such as DLSS 3 and FSR 3, boost the frame rate by generating future frames based on previous frames. However, it
-
Real-time Large-scale Deformation of Gaussian Splatting ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Lin Gao, Jie Yang, Bo-Tao Zhang, Jia-Mu Sun, Yu-Jie Yuan, Hongbo Fu, Yu-Kun LaiNeural implicit representations, including Neural Distance Fields and Neural Radiance Fields, have demonstrated significant capabilities for reconstructing surfaces with complicated geometry and topology, and generating novel views of a scene. Nevertheless, it is challenging for users to directly deform or manipulate these implicit representations with large deformations in a real-time fashion. Gaussian
-
NFPLight: Deep SVBRDF Estimation via the Combination of Near and Far Field Point Lighting ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Li Wang, Lianghao Zhang, Fangzhou Gao, Yuzhen Kang, Jiawan ZhangRecovering spatial-varying bi-directional reflectance distribution function (SVBRDF) from a few hand-held captured images has been a challenging task in computer graphics. Benefiting from the learned priors from data, single-image methods can obtain plausible SVBRDF estimation results. However, the extremely limited appearance information in a single image does not suffice for high-quality SVBRDF reconstruction
-
Dense Server Design for Immersion Cooling ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Milin Kodnongbua, Zachary Englhardt, Ricardo Bianchini, Rodrigo Fonseca, Alvin Lebeck, Daniel S. Berger, Vikram Iyer, Fiodar Kazhamiaka, Adriana SchulzThe growing demands for computational power in cloud computing have led to a significant increase in the deployment of high-performance servers. The growing power consumption of servers and the heat they produce is on track to outpace the capacity of conventional air cooling systems, necessitating more efficient cooling solutions such as liquid immersion cooling. The superior heat exchange capabilities
-
GaussianObject: High-Quality 3D Object Reconstruction from Four Views with Gaussian Splatting ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Chen Yang, Sikuang Li, Jiemin Fang, Ruofan Liang, Lingxi Xie, Xiaopeng Zhang, Wei Shen, Qi TianReconstructing and rendering 3D objects from highly sparse views is of critical importance for promoting applications of 3D vision techniques and improving user experience. However, images from sparse views only contain very limited 3D information, leading to two significant challenges: 1) Difficulty in building multi-view consistency as images for matching are too few; 2) Partially omitted or highly
-
Learned Multi-aperture Color-coded Optics for Snapshot Hyperspectral Imaging ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Zheng Shi, Xiong Dun, Haoyu Wei, Siyu Dong, Zhanshan Wang, Xinbin Cheng, Felix Heide, Yifan PengLearned optics, which incorporate lightweight diffractive optics, coded-aperture modulation, and specialized image-processing neural networks, have recently garnered attention in the field of snapshot hyperspectral imaging (HSI). While conventional methods typically rely on a single lens element paired with an off-the-shelf color sensor, these setups, despite their widespread availability, present
-
All you need is rotation: Construction of developable strips ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Takashi Maekawa, Felix ScholzWe present a novel approach to generate developable strips along a space curve. The key idea of the new method is to use the rotation angle between the Frenet frame of the input space curve, and its Darboux frame of the curve on the resulting developable strip as a free design parameter, thereby revolving the strip around the tangential axis of the input space curve. This angle is not restricted to
-
Stochastic Normal Orientation for Point Clouds ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Guojin Huang, Qing Fang, Zheng Zhang, Ligang Liu, Xiao-Ming FuWe propose a simple yet effective method to orient normals for point clouds. Central to our approach is a novel optimization objective function defined from global and local perspectives. Globally, we introduce a signed uncertainty function that distinguishes the inside and outside of the underlying surface. Moreover, benefiting from the statistics of our global term, we present a local orientation
-
Trading Spaces: Adaptive Subspace Time Integration for Contacting Elastodynamics ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Ty Trusty, Yun (Raymond) Fei, David Levin, Danny KaufmanWe construct a subspace simulator that adaptively balances solution improvement against system size. The core components of our simulator are an adaptive subspace oracle, model, and parallel time-step solver algorithm. Our in-time-step adaptivity oracle continually assesses subspace solution quality and candidate update proposals while accounting for temporal variations in deformation and spatial variations
-
3D Gaussian Ray Tracing: Fast Tracing of Particle Scenes ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Nicolas Moenne-Loccoz, Ashkan Mirzaei, Or Perel, Riccardo de Lutio, Janick Martinez Esturo, Gavriel State, Sanja Fidler, Nicholas Sharp, Zan GojcicParticle-based representations of radiance fields such as 3D Gaussian Splatting have found great success for reconstructing and re-rendering of complex scenes. Most existing methods render particles via rasterization, projecting them to screen space tiles for processing in a sorted order. This work instead considers ray tracing the particles, building a bounding volume hierarchy and casting a ray for
-
Direct Manipulation of Procedural Implicit Surfaces ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Marzia Riso, Élie Michel, Axel Paris, Valentin Deschaintre, Mathieu Gaillard, Fabio PellaciniProcedural implicit surfaces are a popular representation for shape modeling. They provide a simple framework for complex geometric operations such as Booleans, blending and deformations. However, their editability remains a challenging task: as the definition of the shape is purely implicit, direct manipulation of the shape cannot be performed. Thus, parameters of the model are often exposed through
-
Online Neural Denoising with Cross-Regression for Interactive Rendering ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Hajin Choi, Seokpyo Hong, Inwoo Ha, Nahyup Kang, Bochang MoonGenerating a rendered image sequence through Monte Carlo ray tracing is an appealing option when one aims to accurately simulate various lighting effects. Unfortunately, interactive rendering scenarios limit the allowable sample size for such sampling-based light transport algorithms, resulting in an unbiased but noisy image sequence. Image denoising has been widely adopted as a post-sampling process
-
Generative Portrait Shadow Removal ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Jae Shin Yoon, Zhixin Shu, Mengwei Ren, Cecilia Zhang, Yannick Hold-Geoffroy, Krishna kumar Singh, He ZhangWe introduce a high-fidelity portrait shadow removal model that can effectively enhance the image of a portrait by predicting its appearance under disturbing shadows and highlights. Portrait shadow removal is a highly ill-posed problem where multiple plausible solutions can be found based on a single image. For example, disentangling complex environmental lighting from original skin color is a non-trivial
-
GPU Coroutines for Flexible Splitting and Scheduling of Rendering Tasks ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Shaokun Zheng, Xin Chen, Zhong Shi, Ling-Qi Yan, Kun XuWe introduce coroutines into GPU kernel programming, providing an automated solution for flexible splitting and scheduling of rendering tasks. This approach addresses a prevalent challenge in harnessing the power of modern GPUs for complex, imbalanced graphics workloads like path tracing. Usually, to accommodate the SIMT execution model and latency-hiding architecture, developers have to decompose
-
3D Reconstruction with Fast Dipole Sums ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Hanyu Chen, Bailey Miller, Ioannis GkioulekasWe introduce a method for high-quality 3D reconstruction from multi-view images. Our method uses a new point-based representation, the regularized dipole sum, which generalizes the winding number to allow for interpolation of per-point attributes in point clouds with noisy or outlier points. Using regularized dipole sums, we represent implicit geometry and radiance fields as per-point attributes of
-
Still-Moving: Customized Video Generation without Customized Video Data ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Hila Chefer, Shiran Zada, Roni Paiss, Ariel Ephrat, Omer Tov, Michael Rubinstein, Lior Wolf, Tali Dekel, Tomer Michaeli, Inbar MosseriCustomizing text-to-image (T2I) models has seen tremendous progress recently, particularly in areas such as personalization, stylization, and conditional generation. However, expanding this progress to video generation is still in its infancy, primarily due to the lack of customized video data. In this work, we introduce Still-Moving, a novel generic framework for customizing a text-to-video (T2V)
-
Designing triangle meshes with controlled roughness ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Victor Ceballos Inza, Panagiotis Fykouras, Florian Rist, Daniel Häseker, Majid Hojjat, Christian Müller, Helmut PottmannMotivated by the emergence of rough surfaces in various areas of design, we address the computational design of triangle meshes with controlled roughness. Our focus lies on small levels of roughness. There, roughness or smoothness mainly arises through the local positioning of the mesh edges and faces with respect to the curvature behavior of the reference surface. The analysis of this interaction
-
EgoHDM: A Real-time Egocentric-Inertial Human Motion Capture, Localization, and Dense Mapping System ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Handi Yin, Bonan Liu, Manuel Kaufmann, Jinhao He, Sammy Christen, Jie Song, Pan HuiWe present EgoHDM, an online egocentric-inertial human motion capture (mocap), localization, and dense mapping system. Our system uses 6 inertial measurement units (IMUs) and a commodity head-mounted RGB camera. EgoHDM is the first human mocap system that offers dense scene mapping in near real-time. Further, it is fast and robust to initialize and fully closes the loop between physically plausible
-
An Impulse Ghost Fluid Method for Simulating Two-Phase Flows ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Yuchen Sun, Linglai Chen, Weiyuan Zeng, Tao Du, Shiying Xiong, Bo ZhuThis paper introduces a two-phase interfacial fluid model based on the impulse variable to capture complex vorticity-interface interactions. Our key idea is to leverage bidirectional flow map theory to enhance the transport accuracy of both vorticity and interfaces simultaneously and address their coupling within a unified Eulerian framework. At the heart of our framework is an impulse ghost fluid
-
Evaluating Visual Perception of Object Motion in Dynamic Environments ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Budmonde Duinkharjav, Jenna Kang, Gavin Stuart Peter Miller, Chang Xiao, Qi SunPrecisely understanding how objects move in 3D is essential for broad scenarios such as video editing, gaming, driving, and athletics. With screen-displayed computer graphics content, users only perceive limited cues to judge the object motion from the on-screen optical flow. Conventionally, visual perception is studied with stationary settings and singular objects. However, in practical applications
-
A Mesh-based Simulation Framework using Automatic Code Generation ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Philipp Herholz, Tuur Stuyck, Ladislav KavanOptimized parallel implementations on GPU or CPU have dramatically enhanced the fidelity, resolution and accuracy of physical simulations and mesh-based algorithms. However, attaining optimal performance requires expert knowledge and might demand complex code and memory layout optimizations. This adds to the fact that physical simulation algorithms require the implementation of derivatives, which can
-
Geometry-Aware Retargeting for Two-Skinned Characters Interaction ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Inseo Jang, Soojin Choi, Seokhyeon Hong, Chaelin Kim, Junyong NohInteractive motion between multiple characters is widely utilized in games and movies. However, the method for generating interactive motions considering the character's diverse mesh shape has yet to be studied. We propose a Spatio Cooperative Transformer (SCT) to retarget the interacting motions of two characters having arbitrary mesh connectivity. SCT predicts the residual of root position and joint
-
A Time-Dependent Inclusion-Based Method for Continuous Collision Detection between Parametric Surfaces ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Xuwen Chen, Cheng Yu, Xingyu Ni, Mengyu Chu, Bin Wang, Baoquan ChenContinuous collision detection (CCD) between parametric surfaces is typically formulated as a five-dimensional constrained optimization problem. In the field of CAD and computer graphics, common approaches to solving this problem rely on linearization or sampling strategies. Alternatively, inclusion-based techniques detect collisions by employing 5D inclusion functions, which are typically designed
-
Quark: Real-time, High-resolution, and General Neural View Synthesis ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
John Flynn, Michael Broxton, Lukas Murmann, Lucy Chai, Matthew DuVall, Clément Godard, Kathryn Heal, Srinivas Kaza, Stephen Lombardi, Xuan Luo, Supreeth Achar, Kira Prabhu, Tiancheng Sun, Lynn Tsai, Ryan OverbeckWe present a novel neural algorithm for performing high-quality, highresolution, real-time novel view synthesis. From a sparse set of input RGB images or videos streams, our network both reconstructs the 3D scene and renders novel views at 1080p resolution at 30fps on an NVIDIA A100. Our feed-forward network generalizes across a wide variety of datasets and scenes and produces state-of-the-art quality
-
ELMO: Enhanced Real-time LiDAR Motion Capture through Upsampling ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Deok-Kyeong Jang, Dongseok Yang, Deok-Yun Jang, Byeoli Choi, Sung-Hee Lee, Donghoon ShinThis paper introduces ELMO, a real-time upsampling motion capture framework designed for a single LiDAR sensor. Modeled as a conditional autoregressive transformer-based upsampling motion generator, ELMO achieves 60 fps motion capture from a 20 fps LiDAR point cloud sequence. The key feature of ELMO is the coupling of the self-attention mechanism with thoughtfully designed embedding modules for motion
-
Differential Walk on Spheres ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Bailey Miller, Rohan Sawhney, Keenan Crane, Ioannis GkioulekasWe introduce a Monte Carlo method for computing derivatives of the solution to a partial differential equation (PDE) with respect to problem parameters (such as domain geometry or boundary conditions). Derivatives can be evaluated at arbitrary points, without performing a global solve or constructing a volumetric grid or mesh. The method is hence well suited to inverse problems with complex geometry
-
3DGSR: Implicit Surface Reconstruction with 3D Gaussian Splatting ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Xiaoyang Lyu, Yang-Tian Sun, Yi-Hua Huang, Xiuzhe Wu, Ziyi Yang, Yilun Chen, Jiangmiao Pang, Xiaojuan QiIn this paper, we present an implicit surface reconstruction method with 3D Gaussian Splatting (3DGS), namely 3DGSR, that allows for accurate 3D reconstruction with intricate details while inheriting the high efficiency and rendering quality of 3DGS. The key insight is to incorporate an implicit signed distance field (SDF) within 3D Gaussians for surface modeling, and to enable the alignment and joint
-
Differentiable Owen Scrambling ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Bastien Doignies, David Coeurjolly, Nicolas Bonneel, Julie Digne, Jean-Claude Iehl, Victor OstromoukhovQuasi-Monte Carlo integration is at the core of rendering. This technique estimates the value of an integral by evaluating the integrand at well-chosen sample locations. These sample points are designed to cover the domain as uniformly as possible to achieve better convergence rates than purely random points. Deterministic low-discrepancy sequences have been shown to outperform many competitors by
-
V^3: Viewing Volumetric Videos on Mobiles via Streamable 2D Dynamic Gaussians ACM Trans. Graph. (IF 7.8) Pub Date : 2024-11-19
Penghao Wang, Zhirui Zhang, Liao Wang, Kaixin Yao, Siyuan Xie, Jingyi Yu, Minye Wu, Lan XuExperiencing high-fidelity volumetric video as seamlessly as 2D videos is a long-held dream. However, current dynamic 3DGS methods, despite their high rendering quality, face challenges in streaming on mobile devices due to computational and bandwidth constraints. In this paper, we introduce V 3 (Viewing Volumetric Videos), a novel approach that enables high-quality mobile rendering through the streaming