Extracting-mapping scheme for the dynamic details in fluid re-simulations from videos

Reconstructing a 3D fluid simulation (re-simulation) from video has practical significance. In this study, we address the realistic problem of fluid re-simulation in an inverse project. State-of-the-art studies on the inverse problem of fluid simulation have mainly focused on dimensionality reduction for acquiring better time performance, but the realistic aspect has rarely been investigated. This paper presents an extracting-mapping scheme to tightly couple fluid re-simulation with enhanced physically driven data for realistic high-quality dynamic detail. We make a full use of the details extracted from recovered physically driven data to improve the coarse and unrealistic re-simulation from fluid auto-advection. Two schemes are discussed. The first scheme is the density block method (DBM). In this method, a density block database is constructed from the prepartitioned and sorted density blocks, and then, some selected density blocks with dynamic details are selected from the preconstructed database and coupled coherently into the physically driven data to enhance the detail in every auto-advection cycle. The second method is the density spectrum block method (DSBM) in the frequency domain. Using the DSBM and DBM, realistic effects are achieved by extensive quantitative and qualitative evaluation via re-simulation tests driven by the recovered physical data from ground truth fluid video. Both approaches outperform previous auto-advection re-simulation schemes in terms of the rich detail under several challenging scenarios and low-level hardware conditions.