scispace - formally typeset
Search or ask a question
Topic

Upsampling

About: Upsampling is a research topic. Over the lifetime, 2426 publications have been published within this topic receiving 57613 citations.


Papers
More filters
Posted Content
TL;DR: StereoNet as mentioned in this paper uses a Siamese network to extract features from the left and right image, and hierarchically the model re-introduces high-frequency details through a learned upsampling function that uses compact pixel-to-pixel refinement networks.
Abstract: This paper presents StereoNet, the first end-to-end deep architecture for real-time stereo matching that runs at 60 fps on an NVidia Titan X, producing high-quality, edge-preserved, quantization-free disparity maps. A key insight of this paper is that the network achieves a sub-pixel matching precision than is a magnitude higher than those of traditional stereo matching approaches. This allows us to achieve real-time performance by using a very low resolution cost volume that encodes all the information needed to achieve high disparity precision. Spatial precision is achieved by employing a learned edge-aware upsampling function. Our model uses a Siamese network to extract features from the left and right image. A first estimate of the disparity is computed in a very low resolution cost volume, then hierarchically the model re-introduces high-frequency details through a learned upsampling function that uses compact pixel-to-pixel refinement networks. Leveraging color input as a guide, this function is capable of producing high-quality edge-aware output. We achieve compelling results on multiple benchmarks, showing how the proposed method offers extreme flexibility at an acceptable computational budget.

17 citations

Journal ArticleDOI
TL;DR: A novel algorithm is developed that reconstructs intermediate depth maps and estimates scene flow simultaneously and is more precise than a tracking-based method and the state-of-the-art techniques.
Abstract: In recent years, consumer-level depth cameras have been adopted for various applications. However, they often produce depth maps at only a moderately high frame rate (approximately 30 frames per second), preventing them from being used for applications such as digitizing human performance involving fast motion. On the other hand, low-cost, high-frame-rate video cameras are available. This motivates us to develop a hybrid camera that consists of a high-frame-rate video camera and a low-frame-rate depth camera and to allow temporal interpolation of depth maps with the help of auxiliary color images. To achieve this, we develop a novel algorithm that reconstructs intermediate depth maps and estimates scene flow simultaneously. We test our algorithm on various examples involving fast, non-rigid motions of single or multiple objects. Our experiments show that our scene flow estimation method is more precise than a tracking-based method and the state-of-the-art techniques.

17 citations

Journal ArticleDOI
TL;DR: Zhang et al. as mentioned in this paper proposed a gradual back-projection residual attention network for MRI super-resolution (GRAN), which outperforms most of the state-of-the-art methods.

17 citations

Patent
26 Feb 2014
TL;DR: In this paper, a video and image lossy compression method for image coding is proposed, which combines traditional JPEG, JPEG2000, H264 and HEVC-code standard algorithms with super-resolution image reconstruction.
Abstract: The invention discloses a video and image lossy compression method for image coding The method combines traditional JPEG, JPEG2000, H264 and HEVC-code standard algorithms with super-resolution image reconstruction and designs an image compression method combining the super-resolution reconstruction on the basis Downsampling is carried out on an input video and image, wherein a downsampling method adopts a Bicubic algorithm and a downsampling multiple is 2 The number of dot arrays of a downsampling image is only 1/4 of that of an original image The encoding rate of the downsampling image is far lower than that of an original input image so that the encoding rate is reduced At the same time, on the basis that robustness differences of a residual image and a general image are analyzed, a negative-feedback step is introduced in the design so that part of high-frequency detail information lost in a super-resolution image reconstruction step is remedied and reconstructed video or image quality is improved Compared with the JPEG and the H264 standard algorithms, the compression method reduces the encoding rate greatly under a situation that image quality is the same

17 citations

Patent
24 Mar 2009
TL;DR: In this article, a technique for eliminating from or reducing the complexity of an upsampler/interpolator of a transmit system is presented. But the upsampling from the first sampling rate towards the sampling rate of a DAC is not considered.
Abstract: A technique for eliminating from or reducing the complexity of an upsampler/interpolator of a transmit system. In general, the technique involves configuring an IFFT to perform both the conversion of a modulated signal from frequency to time domain, and at least a portion of the upsampling from the first sampling rate towards the sampling rate of a DAC. In one embodiment, the IFFT is configured to have a bandwidth substantially equal to the sampling rate of a DAC. In this embodiment, the upsampler/interpolator may be totally eliminated. In another embodiment, the IFFT is configured to have a bandwidth that is greater than the first sampling rate of the modulated signal, and lower than the sampling rate of the DAC. In this embodiment, a simpler upsampler/interpolator may be employed to perform the remaining upsampling from the IFFT bandwidth to the sampling rate of the DAC.

17 citations


Network Information
Related Topics (5)
Convolutional neural network
74.7K papers, 2M citations
90% related
Image segmentation
79.6K papers, 1.8M citations
90% related
Feature extraction
111.8K papers, 2.1M citations
89% related
Deep learning
79.8K papers, 2.1M citations
88% related
Feature (computer vision)
128.2K papers, 1.7M citations
87% related
Performance
Metrics
No. of papers in the topic in previous years
YearPapers
2023469
2022859
2021330
2020322
2019298
2018236