Neural Rerendering in the Wild
Citations
476 citations
Cites background or methods from "Neural Rerendering in the Wild"
...Most similar in application to our work is Neural Rerendering in the Wild (NRW) [20] which synthesizes realistic novel views of tourist sites from point cloud renders by learning a neural re-rendering network conditioned on a learned latent appearance embedding module....
[...]
...Baselines: We evaluate our proposed method against Neural Rerendering in the Wild (NRW) [20], NeRF [21], and two ablations of NeRF-W: NeRF-A (appearance), wherein the ‘transient’ head is eliminated; and NeRF-U (uncertainty), wherein appearance embedding `(a)i is eliminated....
[...]
...Table 1: Quantitative results on the Phototourism dataset [13] for NRW [20], NeRF [21], and variations of the proposed model....
[...]
...Training NeRF on in-the-wild photo collections leads to particularly poor results that are unable to compete with NRW....
[...]
...NRW produces renders with typical checkerboard artifacts across all images common to 2D re-rendering meth- ods [14]....
[...]
405 citations
Cites background or methods from "Neural Rerendering in the Wild"
..., 2019), point clouds (Meshry et al., 2019; Aliev et al., 2019), and implicit functions (Sitzmann et al....
[...]
...Other methods (Thies et al., 2019; Kim et al., 2018; Liu et al., 2019a, 2020; Meshry et al., 2019; Martin Brualla et al., 2018; Aliev et al., 2019) first render a given geometry with explicit or neural textures into coarse RGB images or feature maps which are then translated into high-quality images....
[...]
...…textured meshes (Thies et al., 2019; Kim et al., 2018; Liu et al., 2019a, 2020), multi-plane images (Zhou et al., 2018; Flynn et al., 2019; Mildenhall et al., 2019), point clouds (Meshry et al., 2019; Aliev et al., 2019), and implicit functions (Sitzmann et al., 2019b; Mildenhall et al., 2020)....
[...]
...Other methods (Thies et al., 2019; Kim et al., 2018; Liu et al., 2019a, 2020; Meshry et al., 2019; Martin Brualla et al., 2018; Aliev et al., 2019) first render a given geometry with explicit or neural textures into coarse RGB images or feature maps which are then translated into high-quality…...
[...]
364 citations
298 citations
Cites methods from "Neural Rerendering in the Wild"
...[1, 9, 23, 36, 38, 41] use a DNN to improve view synthesis from a set of noisy, incomplete, or inconsistent depth maps....
[...]
161 citations
References
55,235 citations
11,958 citations
"Neural Rerendering in the Wild" refers background or methods in this paper
...Deep image synthesis The seminal work of pix2pix [16] trains a deep neural network to translate an image from one domain, such as a semantic labeling, into another domain, such as a realistic image, using paired training data....
[...]
...Figure 2: Output frames of a standard image translation network [16] trained for neural rerendering in a small dataset of 250 photos of San Marco....
[...]
11,682 citations
6,639 citations
4,178 citations
"Neural Rerendering in the Wild" refers methods in this paper
...Imageto-image (I2I) translation has since been applied to many tasks [5, 24, 32, 49, 47, 50]....
[...]