Humans perceive the three-dimensional structure of the world with apparent ease. However, despite all of the recent advances in computer vision research, the dream of having a computer interpret an image at the same level as a two-year old remains elusive. Why is computer vision such a challenging problem and what is the current state of the art? Computer Vision: Algorithms and Applications explores the variety of techniques commonly used to analyze and interpret images. It also describes challenging real-world applications where vision is being successfully used, both for specialized applications such as medical imaging, and for fun, consumer-level tasks such as image editing and stitching, which students can apply to their own personal photos and videos. More than just a source of recipes, this exceptionally authoritative and comprehensive textbook/reference also takes a scientific approach to basic vision problems, formulating physical models of the imaging process before inverting them to produce descriptions of a scene. These problems are also analyzed using statistical models and solved using rigorous engineering techniques Topics and features: structured to support active curricula and project-oriented courses, with tips in the Introduction for using the book in a variety of customized courses; presents exercises at the end of each chapter with a heavy emphasis on testing algorithms and containing numerous suggestions for small mid-term projects; provides additional material and more detailed mathematical topics in the Appendices, which cover linear algebra, numerical techniques, and Bayesian estimation theory; suggests additional reading at the end of each chapter, including the latest research in each sub-field, in addition to a full Bibliography at the end of the book; supplies supplementary course material for students at the associated website, http://szeliski.org/Book/. Suitable for an upper-level undergraduate or graduate-level course in computer science or engineering, this textbook focuses on basic techniques that work under real-world conditions and encourages students to push their creative boundaries. Its design and exposition also make it eminently suitable as a unique reference to the fundamental techniques and current research literature in computer vision.

/pdf/computer-vision-algorithms-and-applications-25dn6wu83j.pdf

Computer Vision: Algorithms and Applications

Cell phones and other portable devices are equipped with a variety of technologies by which existing functionality can be improved, and new functionality can be provided. Some relate to visual search capabilities, and determining appropriate actions responsive to different image inputs. Others relate to processing of image data. Still others concern metadata generation, processing, and representation. Yet others relate to coping with fixed focus limitations of cell phone cameras, e.g., in reading digital watermark data. Still others concern user interface improvements. A great number of other features and arrangements are also detailed.

Methods and Systems for Content Processing

Disclosed herein is a multi-functional hand-held device capable of configuring user inputs based on how the device is to be used. Preferably, the multifunctional hand-held device has at most only a few physical buttons, keys, or switches so that its display size can be substantially increased. The multifunctional hand-held device also incorporates a variety of input mechanisms, including touch sensitive screens, touch sensitive housings, display actuators, audio input, etc. The device also incorporates a user-configurable GUI for each of the multiple functions of the devices.

Multi-functional hand-held device

An electronic device has a display and has a touch sensitive bezel surrounding the display. Areas on the bezel are designated for controls used to operate the electronic device. Visual guides corresponding to the controls are displayed on the display adjacent the areas of the bezel designated for the controls. Touch data is generated by the bezel when a user touches an area of the bezel. The device determines which of the controls has been selected based on which designated area is associated with the touch data from the bezel. The device then initiates the determined control. The device can have a sensor for determining the orientation of the device. Based on the orientation, the device can alter the areas designated on the bezel for the controls and can alter the location of the visual guides for the display so that they match the altered areas on the bezel.

Electronic device having display and surrounding touch sensitive bezel for user interface and control

A portable electronic device displays a plurality of icons (e.g., graphical objects) in a region in a touch-sensitive display; detects a predefined user action, with respect to the touch-sensitive display, for initiating a predefined user interface reconfiguration process; and varies positions of one or more icons in the plurality of icons in response to detecting the predefined user action. The varying includes varying the positions of the one or more icons about respective average positions.

Portable electronic device with interface reconfiguration mode

The VideoMouse is a mouse that uses a camera as its input sensor. A real-time vision algorithm determines the six degree-of-freedom mouse posture, consisting of 2D motion, tilt in the forward/back and left/right axes, rotation of the mouse about its vertical axis, and some limited height sensing. Thus, a familiar 2D device can be extended for three-dimensional manipulation, while remaining suitable for standard 2D GUI tasks. We describe techniques for mouse functionality, 3D manipulation, navigating large 2D spaces, and using the camera for lightweight scanning tasks.

https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/Hinckley-UIST99.pdf

The VideoMouse: a camera-based multi-degree-of-freedom input device

A pad for a computer input device includes a top surface over which the input device is slid and a bottom surface, opposite the top surface, for contacting a support surface The bottom surface having a raised pivot portion allowing movement of the pad about the pivot portion

Method and apparatus for computer input using six degrees of freedom

We have developed an easy-to-use and cost-effective system to construct textured 3D animated face models from videos with minimal user interaction. This is a particularly challenging task for faces due to a lack of prominent textures. We develop a robust system by following a model-based approach: we make full use of generic knowledge of faces in head motion determination, head tracking, model fitting, and multiple-view bundle adjustment. Our system first takes, with an ordinary video camera, images of a face of a person sitting in front of the camera turning their head from one side to the other. After five manual clicks on two images to indicate the position of the eye corners, nose tip and mouth corners, the system automatically generates a realistic looking 3D human head model that can be animated immediately (different poses, facial expressions and talking). A user, with a PC and a video camera, can use our system to generate his/her face model in a few minutes. The face model can then be imported in his/her favorite game, and the user sees themselves and their friends take part in the game they are playing. We have demonstrated the system on a laptop computer live at many events, and constructed face models for hundreds of people. It works robustly under various environment settings.

Robust and Rapid Generation of Animated Faces from Video Images: A Model-Based Modeling Approach

A computer input device and computer system are provided that determine if the input device is at an edge of a pattern on a working surface based on an image of the working surface captured by the input device. An audio control message is generated based on the input device being positioned on the edge of the pattern and the audio control message is used to cause a speaker to generate an audio signal.

Generating audio signals based on input device position

Systems and method are provided for conducting an auction to match an advertising payload to an available advertising impression. In the auction, a dynamic floor price is provided. The dynamic floor price provides a way for a publisher to incorporate the internal value of the available impression into the auction process, while still allowing the publisher to maximize the value of the available impression by exposing the impression to bids from outside parties. The dynamic floor price can be calculated based on both internal valuations of an available impression as well as external valuations derived from feedback from prior auctions. To facilitate determination of a dynamic floor prices, advertisers and available impressions can be categorized into various segments.

Erik J. Hanson

Papers

The VideoMouse: a camera-based multi-degree-of-freedom input device

Method and apparatus for computer input using six degrees of freedom

Robust and Rapid Generation of Animated Faces from Video Images: A Model-Based Modeling Approach

Generating audio signals based on input device position

Dynamic Floor Pricing for Managing Exchange Monetization