An imaging system for a vehicle includes an imaging device having a field of view exteriorly and forward of the vehicle in its direction of travel, and an image processor operable to process the captured images in accordance with an algorithm. The algorithm comprises a sign recognition routine and a character recognition routine. The image processor processes the image data captured by the imaging device to detect signs in the field of view of the imaging device and applies the sign recognition routine to determine a sign type of the detected sign. The image processor is operable to apply the character recognition routine to the image data to determine information on the detected sign. The image processor applies the character recognition routine to the captured images in response to an output of the sign recognition routine being indicative of the detected sign being a sign type of interest.

Imaging system for vehicle

A forward-facing vision system for a vehicle includes a forward-facing camera disposed in a windshield electronics module attached at a windshield of the vehicle and viewing through the windshield. A control includes a processor that, responsive to processing of captured image data, detects taillights of leading vehicles during nighttime conditions and, responsive to processing of captured image data, detects lane markers on a road being traveled by the vehicle. The control, responsive to lane marker detection and a determination that the vehicle is drifting out of a traffic lane, may control a steering system of the vehicle to mitigate such drifting, with the steering system manually controllable by a driver of the vehicle irrespective of control by the control. The processor, based at least in part on detection of lane markers via processing of captured image data, determines curvature of the road being traveled by the vehicle.

Vision system for vehicle

A vehicular vision system includes a camera having a lens and a CMOS photosensor array having a plurality of photosensor elements. The camera is disposed at an interior portion of a vehicle equipped with the vehicular vision system. The camera one of (i) views exterior of the equipped vehicle through the windshield of the equipped vehicle and forward of the equipped vehicle and (ii) views from the windshield of the equipped vehicle into the interior cabin of the equipped vehicle. A control includes an image processor that processes image data captured by the photosensor array. The image processor processes captured image data to detect an object viewed by the camera. The photosensor array is operable at a plurality of exposure periods and at least one exposure period of the plurality of exposure periods is dynamically variable.

Vehicular vision system

An alert system for a vehicle includes a video display, an interior visual alert device disposed at an interior rearview mirror assembly, a driver side visual alert device disposed at a driver side exterior rearview mirror assembly and a passenger side visual alert device disposed at a passenger side exterior rearview mirror assembly. A control is operable to activate at least one of the alert devices in response to a detection of an object rearward of the vehicle. The alert devices are viewable by the driver of the vehicle when activated and are operable to guide or prompt the driver to check the images captured by a rearward facing camera and displayed in the vehicle cabin by the video display so that the driver can verify the nature and type of a potential hazard rearward of the vehicle.

Alert system for vehicle

A driver assistance system for a vehicle includes an imaging device having a field of view forward of a vehicle and in a direction of travel of the equipped vehicle, an image processor operable to process image data captured by the imaging device, and a global positioning system operable to determine a geographical location of the vehicle. The equipped vehicle includes an adaptive speed control system for controlling the speed of the equipped vehicle. The adaptive speed control system may reduce the speed of the equipped vehicle responsive at least in part to a detection of a curve in the road ahead of the equipped vehicle via processing by the image processor of image data captured by the imaging device.

Driver assistance system for vehicle

Apparatus for adaptively and interactively lighting a scene includes a digital light projector that includes a light emitter and a digital light processor optically coupled to the emitter such that the emitter light is projected onto respective individual fields of view of a field of regard illuminating the scene in accordance with a projector control signal. A camera adjacent to the projector is operative to detect light reflected or projected from the illuminated scene and generate a signal corresponding to the detected light. A signal processor coupled to the projector and the camera is operative to receive the camera signal, process the received signal into a light projector control signal in accordance with an associated set of instructions, and apply the control signal to the light projector such that the light projected onto the respective individual fields of view of the illuminating array is controlled in accordance with the instructions.

Adaptive and interactive scene illumination

A method and apparatus for steering energy over a wide field of view is disclosed. The apparatus comprises a beam steering system for directing a first beam from an optical source across an image plane and a WFOV optical system having the image plane, the WFOV optical system mapping the directed first beam incident on the image plane with a second beam extending angularly across the field of view. The method comprises the steps of directing a first beam from a optical source onto an image plane, optically mapping the directed first beam incident on the image plane with a second beam extending angularly across a field of view, and steering the first beam across the image plane.

Method and apparatus for hemispherical retargeting

A camera on a robotic arm end effector is used to locate a workpiece coordinate system transformation in rotation and translation with respect to the end effector coordinate system by successively measuring an offset between a target affixed to the workpiece and its expected location. The target reflects energy from a light beam provided by a light beam source. A beam splitter is used to align the light beam with a line of sight of the camera.

Apparatus and method to optically locate workpiece for robotic operations

Systems and methods are provided for collision prevention in robot manufacturing environments. One embodiment is an apparatus that includes a robot. The robot includes an end effector that operates within a manufacturing cell, and actuators defining a kinematic chain that reorients the end effector within the manufacturing cell. The robot also includes an imaging system mounted with the end effector, and a controller that identifies a position and orientation of a mirror. The controller is able to direct the actuators to orient the imaging system towards the mirror, to acquire a point cloud of 3D positions by operating the imaging system to scan an image in the mirror, and to revise the 3D positions in the point cloud by folding the 3D positions about a surface defined by the mirror. The robot is also able to determine a volume occupied by the robot within the manufacturing cell based on the revised positions, and to direct the robot to operate based on the volume to prevent collisions within the manufacturing cell.

Collision prevention in robotic manufacturing environments

An apparatus for measuring edge features of a work piece includes an optical sensor assembly and a reference device The reference device includes a contact surface configured to contact a surface of the work piece adjacent to an edge of the work piece and a marked surface including a plurality of markings indicating positions relative to the contact surface The reference device is configured to be coupled to a portion of the optical sensor assembly such that the optical sensor assembly is positioned to capture an image representing a portion of the marked surface and an edge feature of the work piece

Jerald A. Hull

Papers

Adaptive and interactive scene illumination

Method and apparatus for hemispherical retargeting

Apparatus and method to optically locate workpiece for robotic operations

Collision prevention in robotic manufacturing environments

Edge feature measurement