An imaging system for a vehicle includes an imaging device having a field of view exteriorly and forward of the vehicle in its direction of travel, and an image processor operable to process the captured images in accordance with an algorithm. The algorithm comprises a sign recognition routine and a character recognition routine. The image processor processes the image data captured by the imaging device to detect signs in the field of view of the imaging device and applies the sign recognition routine to determine a sign type of the detected sign. The image processor is operable to apply the character recognition routine to the image data to determine information on the detected sign. The image processor applies the character recognition routine to the captured images in response to an output of the sign recognition routine being indicative of the detected sign being a sign type of interest.

Imaging system for vehicle

A mobile robot guest for interacting with a human resident performs a room-traversing search procedure prior to interacting with the resident, and may verbally query whether the resident being sought is present. Upon finding the resident, the mobile robot may facilitate a teleconferencing session with a remote third party, or interact with the resident in a number of ways. For example, the robot may carry on a dialogue with the resident, reinforce compliance with medication or other schedules, etc. In addition, the robot incorporates safety features for preventing collisions with the resident; and the robot may audibly announce and/or visibly indicate its presence in order to avoid becoming a dangerous obstacle. Furthermore, the mobile robot behaves in accordance with an integral privacy policy, such that any sensor recording or transmission must be approved by the resident.

Companion robot for personal interaction

A forward-facing vision system for a vehicle includes a forward-facing camera disposed in a windshield electronics module attached at a windshield of the vehicle and viewing through the windshield. A control includes a processor that, responsive to processing of captured image data, detects taillights of leading vehicles during nighttime conditions and, responsive to processing of captured image data, detects lane markers on a road being traveled by the vehicle. The control, responsive to lane marker detection and a determination that the vehicle is drifting out of a traffic lane, may control a steering system of the vehicle to mitigate such drifting, with the steering system manually controllable by a driver of the vehicle irrespective of control by the control. The processor, based at least in part on detection of lane markers via processing of captured image data, determines curvature of the road being traveled by the vehicle.

Vision system for vehicle

A vehicular vision system includes a camera having a lens and a CMOS photosensor array having a plurality of photosensor elements. The camera is disposed at an interior portion of a vehicle equipped with the vehicular vision system. The camera one of (i) views exterior of the equipped vehicle through the windshield of the equipped vehicle and forward of the equipped vehicle and (ii) views from the windshield of the equipped vehicle into the interior cabin of the equipped vehicle. A control includes an image processor that processes image data captured by the photosensor array. The image processor processes captured image data to detect an object viewed by the camera. The photosensor array is operable at a plurality of exposure periods and at least one exposure period of the plurality of exposure periods is dynamically variable.

Vehicular vision system

An interior rearview mirror system and assembly includes a variable reflectivity reflective element and a video display screen disposed behind the reflective element and operable to display images viewable through the reflective element by a person viewing the interior rearview mirror assembly when it is normally mounted in a vehicle. The video display screen may be operable to brighten or enhance the intensity of images displayed by the video display screen responsive to a dimming condition of the variable reflectivity reflective element. The mirror system may include an image sensor and a decoder that decodes an output signal of the image sensor. The decoder has a microprocessor operable to control the video display screen, such that the captured image data are processed and images are displayed via operation of a common microprocessor. A compass chip may connect to a vehicle wire harness that extends from a vehicle headliner.

Interior mirror assembly with display

A synthetic image viewed from a virtual viewpoint above a car is created from images captured by cameras for imaging the surroundings of the car. In the synthetic image, an illustrated or real image of the car is displayed in the area where the car is present. The area which is not imaged by any of the cameras is displayed as a blind spot.

Image processing device and monitoring system

The image processor of the present invention generates a more natural synthesized image from camera images taken with a plurality of cameras capturing the surroundings of a vehicle. A parameter storage section stores a plurality of image synthesis parameter groups representing the correspondence between the camera images and the synthesized image and having different spatial or temporal resolution relations. A parameter selection section selects the image synthesis parameter group according to the output of a vehicle motion detection section for detecting the motion of the vehicle such as the driving speed and direction. An image synthesis section generates the synthesized image from the camera images according to the selected image synthesis parameter group.

Image processor and monitoring system

An image generating apparatus comprising: a camera or a plurality of cameras; space reconstructing means for mapping the input image from said camera, into a predetermined space model of a predetermined three-dimensional space; point-of-view converting means of synthesizing an image viewed from an arbitrary virtual point of view in said predetermined three-dimensional space by referencing to said space data mapped by said space reconstructing means; and displaying means of displaying the image converted by said point-of-view converting means.

Method and apparatus for displaying a synthesized image viewed from a virtual point of view

A synthesized image showing the situation around a vehicle is produced from images taken with cameras capturing the surroundings of the vehicle and presented to a display. A position computation section computes position information and the reliability of the position information, for a plurality of points in the camera images. An image variable-synthesis section produces a first synthesized image from the camera images using the position information. An image fixed-synthesis section produces a second synthesized image by road surface projection, for example, without use of the position information. A synthesis scheme selection section selects either one of the first and second synthesized images according to the reliability as the synthesized image to be presented.

Vehicle surroundings monitoring device, and image production method/program

An image forming device comprises one or more cameras, space reconfiguration means for mapping an input image from the camera to a predetermined space model of a predetermined three-dimensional space, viewpoint conversion means for producing an image viewed from a virtual viewpoint in the predetermined three-dimensional space by referring to the space data mapped by the space reconfiguration means, and display means for displaying the image converted by the viewpoint conversion means.

Kunio Nobori

Papers

Image processing device and monitoring system

Image processor and monitoring system

Method and apparatus for displaying a synthesized image viewed from a virtual point of view

Vehicle surroundings monitoring device, and image production method/program

Method and apparatus for displaying image