scispace - formally typeset
Search or ask a question

Showing papers on "Smart camera published in 2004"


Proceedings ArticleDOI
08 Aug 2004
TL;DR: This paper presents a self-reconfigurable camera array system that captures video sequences from an array of mobile cameras, renders novel views on the fly and reconfigures the camera positions to achieve better rendering quality.
Abstract: This paper presents a self-reconfigurable camera array system that captures video sequences from an array of mobile cameras, renders novel views on the fly and reconfigures the camera positions to achieve better rendering quality. The system is composed of 48 cameras mounted on mobile platforms. The contribution of this paper is twofold. First, we propose an efficient algorithm that is capable of rendering high-quality novel views from the captured images. The algorithm reconstructs a view-dependent multi-resolution 2D mesh model of the scene geometry on the fly and uses it for rendering. The algorithm combines region of interest (ROI) identification, JPEG image decompression, lens distortion correction, scene geometry reconstruction and novel view synthesis seamlessly on a single Intel Xeon 2.4 GHz processor, which is capable of generating novel views at 4–10 frames per second (fps). Second, we present a view-dependent adaptive capturing scheme that moves the cameras in order to show even better rendering results. Such camera reconfiguration naturally leads to a nonuniform arrangement of the cameras on the camera plane, which is both view-dependent and scene-dependent.

191 citations


Patent
11 Mar 2004
TL;DR: The digital 3D/360° camera system as discussed by the authors is an omnidirectional stereoscopic device for capturing image data that may be used to create a 3D model for presenting 3D images, movies, or 3D animation.
Abstract: The digital 3D/360° camera system is an omnidirectional stereoscopic device for capturing image data that may be used to create a 3-dimensional model for presenting a 3D image, a 3D movie, or 3D animation. The device uses multiple digital cameras, arranged with overlapping fields of view, to capture image data covering an entire 360° scene. The data collected by one, or several, digital 3D/360° camera systems can be used to create a 3D model of a 360° scene by using triangulation of the image data within the overlapping fields of view.

187 citations


Proceedings ArticleDOI
25 May 2004
TL;DR: This paper reports on a prototyping development of a smart camera for traffic surveillance and presents its scalable architecture comprised of a CMOS sensor, digital signal processors (DSP), and a network processor.
Abstract: A smart camera combines video sensing, high-level video processing and communication within a single embedded device. Such cameras are key components in novel surveillance systems. This paper reports on a prototyping development of a smart camera for traffic surveillance. We present its scalable architecture comprised of a CMOS sensor, digital signal processors (DSP), and a network processor. We further discuss the mapping of high-level video processing algorithms to embedded DSP-based platforms and identify typical pitfalls for the porting of software from desktops to embedded platforms. Our mapping strategies are demonstrated on an algorithm for automatic detection of stationary vehicles. This algorithm is migrated from a Matlab-based prototyping implementation to an embedded DSP implementation in our smart camera. Our implemented smart camera prototype streams the video data over an IP-network to a central monitoring station and is able to detect stationary vehicles and blocking cargo on highways within the required real-time constraints of six seconds.

154 citations


Patent
16 Nov 2004
TL;DR: In this article, a method of focusing a digital camera module with an image sensor is proposed, which includes capturing an image of a test target with the camera module, determining a focus quality of the image with the image sensor, and outputting a signal related to the focus quality from the image to a focusing station external to the camera.
Abstract: A method of focusing a digital camera module with an image sensor including capturing an image of a test target with the digital camera module, determining a focus quality of the image with the image sensor, outputting a signal related to the focus quality of the image from the digital camera module to a focusing station external to the digital camera module, and determining whether a position of a lens from the image sensor within the digital camera module should be altered to improve a focus quality of subsequently captured images.

143 citations


Proceedings ArticleDOI
24 Apr 2004
TL;DR: Usability issues encountered in using a camera phone as an image annotation device immediately after image capture and users' responses to use of such a system are presented.
Abstract: In this paper we describe a system that allows users to annotate digital photos at the time of capture. The system uses camera phones with a lightweight client application and a server to store the images and metadata and assists the user in annotation on the camera phone by providing guesses about the location and content of the photos. By conducting user interface testing, surveys, and focus groups we were able to evaluate the usability of this system and uncover usage patterns and motivations that will inform our development of future mobile media annotation applications. In this paper we present usability issues encountered in using a camera phone as an image annotation device immediately after image capture and users' responses to use of such a system.

101 citations


Patent
05 Nov 2004
TL;DR: In this paper, a digital camera is provided, comprising an image system having a unique combination of features that aid in generating creative, high-quality images, including a variety of overlays, each having prescribed attributes.
Abstract: A digital camera is provided, comprising an image system having a unique combination of features that aid in generating creative, high-quality images. The system presents a variety of overlays, each having prescribed attributes, e.g., ranging in size, opacity, and functionality, and from iconic overlays to full-scale overlays having varied opacity. The overlays can be used as an aid in composing a live image for digital capture, either as a constant or intermittent presence on the view-screen of the camera. In an exemplary embodiment, the camera can create a composite photograph in which a live image and the overlay are combined together. In an independent aspect, the camera can include an auto-compositing feature that aids in creating images free of improperly exposed regions. Thus, a photographer can create and combine images “on location” in a unique manner.

99 citations


01 Jan 2004
TL;DR: It is described how a computer vision approach to understanding the video can be used to represent “just enough” of the information contained in a video stream to allow video-based tasks to be accomplished, while hiding superfluous details that can contain privacyintrusive information.
Abstract: In this paper we describe a technology for protecting privacy in video systems. The paper presents a review of privacy in video surveillance and describes how a computer vision approach to understanding the video can be used to represent “just enough” of the information contained in a video stream to allow video-based tasks (including both surveillance and other “person aware” applications) to be accomplished, while hiding superfluous details, particularly identity, that can contain privacyintrusive information. The technology has been implemented in the form of a privacy console that manages operator access to different versions of the video-derived data according to access control lists. We have also built PrivacyCam—a smart camera that produces a video stream with the privacy-intrusive information already removed.

98 citations


Patent
03 Dec 2004
TL;DR: In this paper, a method of operating a portable composite communication terminal that functions as both a portable phone and a camera is presented, which includes: setting a camera mode by turning on the camera in said portable phone mode upon user request for camera operation, said user request being input through camera mode switch and processed by the controller, regulating voltage supporting components of the camera mode, and performing a camera function.
Abstract: A method of operating a portable composite communication terminal the functions as both a portable phone and a camera. The method includes: setting a portable phone mode by turning on the portable composite communication terminal, regulating voltage supporting components of the portable phone mode, and performing a general portable phone function; setting a camera mode by turning on the camera in said portable phone mode upon user request for camera operation, said user request being input through a camera mode switch and processed by the controller, regulating voltage supporting components of the camera mode, and performing a camera function; capturing the image of an object upon user request for a photograph in the camera mode; and displaying a captured image stored in a camera memory of the portable composite communication terminal on a display of the portable composite communication terminal upon user request for displaying the image.

90 citations


Patent
07 Jun 2004
TL;DR: A portable surveillance camera and a personal surveillance system are disclosed in this article, where a mini-camera such as a CMOS camera or a CCD camera is used to monitor or store multimedia data such as image, sound, event and control data.
Abstract: A portable surveillance camera and a personal surveillance system are disclosed. More specifically, provided are a portable surveillance camera comprising a mini-camera such as a CMOS camera or a CCD camera, and a system for surveilling a predetermined place using the portable surveillance camera. The personal surveillance system receives multimedia data such as image, sound, event and control data on real time from the portable surveillance camera installed in various areas such as a house, a shop or an office with a control device connectable to a network such as a LAN or an internet, and then monitors or stores the multimedia data. Also, the personal surveillance system can search, surveille, control, edit and store multimedia data such as image, sound, event and control data for a desired period of time from data stored in the portable surveillance camera or the control device.

86 citations


Patent
Kensuke Maruya1, Susumu Okada1
15 Jun 2004
TL;DR: In this paper, a video surveillance system which tracks a tracking target by a plurality of surveillance cameras is presented, which is capable of tracking completely the location of the tracking target even in case the camera picture is automatically changed in accordance with the moving of the target.
Abstract: The present invention provides a video surveillance system which tracks a tracking target by a plurality of surveillance cameras. This system is capable of tracking completely the location of the tracking target even in case the camera picture is automatically changed in accordance with the moving of the tracking target. The system includes a moving direction detector for detecting the moving direction of a tracking target. Moreover, the system has storage units for storing the passage configuration of a surveillance zone and the camera location information. The system also has a camera selector for identifying a camera which will shoot the tracking target next in accordance with the moving direction information, passage configuration information and camera location information, and a screen composition unit for synthesizing on a screen a picture from a camera shooting the tracking target and a picture from a camera selected by the camera selector.

85 citations


Patent
16 Jan 2004
TL;DR: In this article, a digital camera system at a collaborating work is described, in which camera information about each camera is displayed on a monitor of a master camera and memory status of each memory card in use is also displayed and further, when monitoring a video from a slave camera, a size of a display screen can be manually set.
Abstract: In a collaborating work, it is to provide a digital camera in which camera information about each camera is displayed on a monitor of a master camera and a memory status of each memory card in use is also displayed and further, when monitoring a video from a slave camera, a size of a display screen can be manually set and in a digital camera system at collaborating work, a first digital camera is provided with camera information about each digital camera, a total memory capacity, a total sum of shot-taken frame numbers, a total remaining memory capacity or a display device indicating a total sum of remaining frame numbers. Camera information is information that is required to be set when instructing a shooting work or a storage work or to specify a second digital camera.

Proceedings ArticleDOI
15 Oct 2004
TL;DR: The challenges involved in scheduling an active camera to observe multiple people to be discussed and some candidate scheduling policies are presented to address these challenges and evaluated.
Abstract: Remote identification of people is an important capability for security systems. Automatically controlling a pan-tilt-zoom camera is an effective way to collect high resolution video or images of people in an unconstrained environment. Often there will be more people in an area than cameras available. The cameras must then divide their time among the people in order to view everyone. In this paper, we discuss the challenges involved in scheduling an active camera to observe multiple people. We present some candidate scheduling policies to address these challenges and evaluate their performance. The evaluation was conducted with a simulation based on data collected with our cooperative active camera system.

Proceedings ArticleDOI
27 Jun 2004
TL;DR: This work presents a system that runs on an average PC with video input from an inexpensive USB camera, and developed the game "BlockEscape" to gather quantitative results to evaluate the interface system with test subjects and compared the system to a mouse substitution interface.
Abstract: There are people that are so severely paralyzed that they only have the ability to control the muscles in their eyes. Communication is limited to the interpretation of eye movements. Currently available human-computer interface systems are often intrusive, require special hardware, or use active infrared illumination. We present a system that runs on an average PC with video input from an inexpensive USB camera. The face is tracked using multi-scale template correlation. Symmetry between left and right eyes is exploited to detect if the computer user is looking at the camera, or off to the left or right side. The detected eye direction can then be used to control applications such as spelling programs or games. We developed the game "BlockEscape" to gather quantitative results to evaluate our interface system with test subjects. We also compared our system to a mouse substitution interface.

Patent
30 Apr 2004
TL;DR: In this paper, a system and method for assuring a high resolution image of an object, such as the face of a person, passing through a targeted space are provided, where both stationary and active or pan-tilt-zoom cameras are utilized.
Abstract: A system and method for assuring a high resolution image of an object, such as the face of a person, passing through a targeted space are provided. Both stationary and active or pan-tilt-zoom cameras are utilized. The at least one stationary camera acts as a trigger point such that when a person passes through a predefined targeted area of the at least one stationary camera, the system is triggered for object imaging and tracking. Upon the occurrence of a triggering event in the system, the system predicts the motion and position of the person. Based on this predicted position of the person, an active camera that is capable of obtaining an image of the predicted position is selected and may be controlled to focus its image capture area on the predicted position of the person. After the active camera control and image capture processes, the system evaluates the quality of the captured face images and reports the result to the security agents and interacts with the user.

Patent
26 Apr 2004
TL;DR: In this paper, a digital camera with an image sensor for capturing an image, an image processor for processing image data from the image sensor and transmitting processed data to a printhead, and, an effects interface for user input of one or more predetermined image manipulations; such that, the processed data transmitted to the printhead incorporated the selected image manipulation.
Abstract: A digital camera with an image sensor for capturing an image, an image processor for processing image data from the image sensor and transmitting processed data to a printhead, and, an effects interface for user input of one or more predetermined image manipulations; such that, the processed data transmitted to the printhead incorporate the selected image manipulations. This allows the user to print manipulated images directly from the camera without first downloading to a desktop system.

Proceedings ArticleDOI
28 Sep 2004
TL;DR: A dual-camera system comprised of a wide-angle, fixed field of view camera coupled with a computer-controlled pan/tilt/zoom-lens camera to make detailed measurements of people for activity recognition applications is described.
Abstract: This paper describes a dual-camera system intended to accomplish the task of vision-based activity recognition at multiple resolutions. The system is comprised of a wide-angle, fixed field of view camera coupled with a computer-controlled pan/tilt/zoom-lens camera to make detailed measurements of people for activity recognition applications. We demonstrate the use of the system in both indoor and outdoor environments.

Patent
22 Nov 2004
TL;DR: In this article, a passive infrared motion detector is used to detect the presence of a moving animal in an outdoor, battery powered digital camera, and the camera goes into a power-saving sleep mode between pictures.
Abstract: An outdoor, battery powered digital camera includes a passive infrared motion detector that allows the camera to be left unattended, as the detector automatically triggers the camera to take a picture upon sensing the presence of a moving animal. To prolong the life of the battery, the camera goes into a power-saving sleep mode between pictures. To enable the camera to instantly take a picture upon suddenly being awakened by the motion detector, the exposure setting of the camera is periodically checked, adjusted and stored so that the camera can use that fairly recent exposure setting, or one near it, to take an instant picture rather than wasting excessive time adjusting the exposure when the animal first appears. In some cases, the camera is used in conjunction with picture management software.

Patent
20 May 2004
TL;DR: In this paper, a method for customizing a digital camera for at least one particular user is disclosed, which includes providing customization software executed external to the digital camera which can access a plurality of firmware components having different camera features.
Abstract: A method for customizing a digital camera for at least one particular user is disclosed. The digital camera includes a reprogrammable memory for storing firmware which controls the operation of the digital camera and a camera graphical user interface responsive to the firmware stored in the reprogrammable memory. The method includes providing customization software executed external to the digital camera which can access a plurality of firmware components having different camera features. A user selects desired camera features to cause the customization software to access the corresponding firmware component(s). The selected corresponding firmware component(s) are provided to the digital camera and the reprogrammable memory is reprogrammed to store the corresponding firmware component(s) to thereby customize the digital camera.

Patent
01 Apr 2004
TL;DR: In this article, techniques to improve quality of images that may be blurred or underexposed (e.g., because of camera shake, taken in dim lighting conditions, or taken of high action scenes) are described.
Abstract: Techniques are disclosed to improve quality of images that may be blurred or underexposed (e.g., because of camera shake, taken in dim lighting conditions, or taken of high action scenes). The techniques may be implemented in a digital camera, digital video camera, or a digital camera capable of capturing video. In one described implementation, a digital camera includes an image sensor, a storage device, and a processing unit. The image sensor captures two images from a same scene which are stored on the storage device. The processing unit enhances the captured images with luminance correction.

Patent
16 Aug 2004
TL;DR: In this paper, an apparatus is provided for communicating over a network images captured by a digital camera (18), such as a camera without an on-board network interface, which includes a housing separate from the camera having a processing unit with memory for storage of images, a camera interface card (12) received in a memory card slot of the digital camera, and a cable (16) or wireless connection coupling the interface card to the processing unit (14) for data communication.
Abstract: An apparatus is provided for communicating over a network images captured by a digital camera (18), such as a digital camera (18) without an on-board network interface. The apparatus includes a housing separate from the digital camera having a processing unit with memory for storage of images, a camera interface card (12) received in a memory card slot of the digital camera (18), and a cable (16) or wireless connection (31) coupling the camera interface card to the processing unit (14) for data communication. The apparatus emulates a memory card to the digital camera (18), such that the digital camera's electronics operate with the memory of the processing unit (14) through the camera interface card (12), as if such memory was on a memory card located hi slot of the digital camera (18). Images captured by the digital camera (18) are transferred, via the camera interface card (12) and cable (16), to memory of the processing unit (14), and the digital camera (18) can access images stored in memory of the processing unit (14). The processing unit (14) has a wireless data network interface (30) and Ethernet communication interface (32), whereby captured images stored in memory of the processing unit (14) are queued hi real-time for network transfer, and subsequently transferred via one of the network communication interfaces, to a computer system, such as an web site or file server, at a network destination address configurable in the processing unit (14). Data may be inputted by the user before and/or after image capture for association with images prior to their network transfer. The housing for the processing unit may be shaped like a motor drive unit and attached to the bottom of the camera (18), or worn by the user of the camera (18) in the form of a belt pack or backpack.

Patent
09 Sep 2004
TL;DR: In this article, a networkable camera system is described that is able to provide up to a 360° field of view and is operable during day and night conditions by utilizing thermal imagers.
Abstract: Systems and methods are disclosed herein to provide improved cameras and camera systems. For example, in accordance with an embodiment of the present invention, a networkable camera system is disclosed that is able to provide up to a 360° field of view and is operable during day and night conditions by utilizing thermal imagers.

Patent
26 Feb 2004
TL;DR: In this article, a mobile device with an integrated camera responsive to signals from a camera activator is used to switch from an active application program in which the user is editing a document to a camera application by activating the activator.
Abstract: A mobile device with an integrated camera responsive to signals from a camera activator The mobile device includes application programs capable of editing documents The user triggers the device operating system to switch from an active application program in which the user is editing a document to a camera application by activating the camera activator The user then captures an image by again triggering the camera activator, whereupon the active application is restored and the image data is inserted within the document The captured image is directly inserted into an input field within the open document in the active application

Patent
09 Mar 2004
TL;DR: A communication system and device, such as wiring harness for a portable point-of-view camera includes a power cord, a recording cord and a camera cord and other devices to facilitate receipt, transference, or recordation of communication signals and information as discussed by the authors.
Abstract: A communication system and device, such as wiring harness for a portable point-of-view camera includes a power cord, a recording cord and a camera cord and other devices to facilitate receipt, transference, or recordation of communication signals and information. The three cords may be mutually interconnected and can be respectively joined with a power source, a recording device, and a camera. A microphone or other devices may be integrated into or associated with the wiring harness or the camera. The technology may be directed to, for example, activities such as law enforcement operations; military operations; and counter-terrorism measures and operations.

Proceedings ArticleDOI
23 Aug 2004
TL;DR: An anonymous video capturing system, called "stealth vision", which protects the privacy of objects by fading out their appearance in an image captured with a mobile camera by determined in 3D (three-dimensional) space instead of 2D image space.
Abstract: We propose an anonymous video capturing system, called "stealth vision", which protects the privacy of objects by fading out their appearance. In order to avoid difficulty in detecting the region of human faces (privacy-protected regions) in an image captured with a mobile camera, the fade-out areas are determined in 3D (three-dimensional) space instead of 2D image space. The 3D position of the captured object is estimated with a simple algorithm, which projects the foreground region in the overhead image onto several horizontal 3D planes and extracts the 3D position while merging the projecting results. By projecting the 3D information onto an image plane of mobile camera, the region to use for the anonymizing process is determined. Experimental results show that our system successfully protects the privacy of target objects.

Proceedings ArticleDOI
01 Jan 2004
TL;DR: A novel miniaturized 3D camera that delivers range images in video real-time based on the time-of-flight (TOF) principle and under optimum conditions achieves a distance resolution of a few mm over a measurement range of several meters.
Abstract: While our world is three-dimensional, today's cameras only allow for the acquisition of images that are two-dimensional. This paper presents a novel miniaturized 3D camera that delivers range images in video real-time. The camera is based on the time-of-flight (TOF) principle and under optimum conditions achieves a distance resolution of a few mm over a measurement range of several meters. The ability to capture the entire environment in three dimensions represents completely new possibilities, and many applications are expected to directly profit from this powerful imaging technology. In particular, in the field of mobile robotics, miniaturized 3D cameras enable the solution of navigation problems, such as obstacle avoidance, map building, localization, and path planning.

Proceedings ArticleDOI
20 Apr 2004
TL;DR: The use of a "smart camera " to accelerate two very different image processing applications, one from the area of medical image processing and the other from computational fluid dynamics both exhibit speedups of more than 20 times over software implementations on a 1.5 GHz PC.
Abstract: We demonstrate the use of a "smart camera " to accelerate two very different image processing applications. The smart camera consists of a high quality video camera and frame grabber connected directly to an FPGA processing board. The advantages of this setup include minimizing the movement of large datasets and minimizing the latency by starting to process data before a complete frame has been acquired. The two applications, one from the area of medical image processing and the other from computational fluid dynamics both exhibit speedups of more than 20 times over software implementations on a 1.5 GHz PC. This smart camera setup is enabling image processing implementations that have not, before now, been achievable in real time.

Patent
08 Jan 2004
TL;DR: An image data analysis security camera having internal logic circuits and remote user controls is presented in this article, where the camera samples an initial image and compares subsequent images thereto, if a deviation between the two images is detected, the camera will initiate a remote alarm.
Abstract: An image data analysis security camera having internal logic circuits and remote user controls The image data analysis security camera samples an initial image and compares subsequent images thereto, if a deviation between the two images is detected the image data analysis camera will initiate a remote alarm The image data analysis security camera may also be provided with wireless communication capabilities and an internal battery thereby enabling the user to move the camera to another location quickly and easily

Proceedings ArticleDOI
25 Apr 2004
TL;DR: It is suggested that providing a camera that is controlled independently from the orientation of the vehicle may facilitate wayfinding tasks and there is evidence to support the use of separate cameras and interfaces for different navigational subtasks.
Abstract: A video stream from a single camera is often the foundation for situational awareness in teleoperation activities. Poor camera placement, narrow field-of-view and other camera properties can significantly impair the operator's perceptual link to the environment, inviting cognitive mistakes and general disorientation. This paper provides a brief overview of viewpoint control research for 3D virtual environments (VE) to motivate a user study that evaluates the effectiveness of viewpoint controls on a simulated robotic vehicle. Findings suggest that providing a camera that is controlled independently from the orientation of the vehicle may facilitate wayfinding tasks. Moreover, there is evidence to support the use of separate cameras and interfaces for different navigational subtasks.

Patent
05 Oct 2004
TL;DR: In this article, a video surveillance system that automatically keeps track of a moving object in an accurate and efficient manner is presented, where a rotation unit tilts and pans the visible-light integrating camera and/or infrared camera, under the control of a tracking controller.
Abstract: A video surveillance system that automatically keeps track of a moving object in an accurate and efficient manner. The system has two cameras for surveillance. One is a visible-light integrating camera that has a frame integration function to capture visible-light images of objects, and the other is an infrared camera for taking infrared images. A rotation unit tilts and pans the visible-light integrating camera and/or infrared camera, under the control of a tracking controller. Video output signals of those cameras are processed by image processors. The tracking controller operates with commands from a system controller, so that it will keep track of a moving object with the visible-light integrating camera in a first period and with the infrared camera in a second period.

Proceedings ArticleDOI
Jiang Xu1, Wayne Wolf1, Joerg Henkel, Srimat Chakradhar, Tiehan Lv 
16 Feb 2004
TL;DR: It is found that network is a performance bottleneck in the design, and the system using an optimized NoC can outperform one using a bus by 132%, and the simulations are based upon recorded real communication traces, which give more accurate system performance.
Abstract: In this paper we study bus-based and switch-based on-chip networks for an embedded video application, the smart camera SoC (system on chip). We analyze network performance and overall system performance in detail. We explore system performance using crossbars with different sizes, fixed size but different numbers of ports, and different numbers of shared memories. We find that network is a performance bottleneck in our design, and the system using an optimized NoC can outperform one using a bus by 132%. Our simulations are based upon recorded real communication traces, which give more accurate system performance. Our study finds that for the Smart Camera system, a 16-bit/port 3/spl times/3 crossbar with two shared memories shows 85.7% performance improvement over the bus-based model and also has less maximum network throughput than the bus-based model. This design example illustrates a methodology to quickly and accurately estimate the performance of NoC's at architecture level.