Systems and methods for augmented and virtual reality

Systems, methodologies, and other embodiments associated with a transportation planning system having an interactive map-based user interface are described. One exemplary computer-implemented method may include accessing a transportation plan having elements like actionable loads and displaying a map of a region related to the transportation plan. The method may also include providing a user interface object for accessing elements of the transportation plan and establishing a dedicated connection between the user interface object and a transportation plan data server. The method may also include displaying an interactive graphical image associated with the user interface object and receiving user inputs concerning a transportation plan element(s) having a dedicated connection to the user interface object. In response to receiving a user input the method may display additional information associated with the transportation plan element, facilitate editing a transportation plan element, facilitate updating and redisplaying the interactive graphical image, and so on.

Interactive map-based user interface for transportation planning

A physical security system having a plurality of sensors and a sensor report aggregator. The sensors may detect a large number of physical activities. The aggregator may cluster a large number of detected reports to a small number of sets of reports. The sets of reports may be reduced to hypotheses. From the hypotheses, the aggregator may develop hypotheses about the physical environment which the sensors are monitoring in view of a security reference model. The security reference model may include, but not be limited to, facility models, physical security models, and/or attack models. The hypotheses may have probabilities assigned to them according to their certitude of likelihood and severity of danger.

Physical security management system

Systems and approaches are provided for tracking an object using multiple tracking processes. By combining multiple lightweight tracking processes, object tracking can be robust, use a limited amount of power, and enable a computing device to respond to input corresponding to the motion of the object in real time. The multiple tracking processes can be run in parallel to determine the position of the object by selecting the results of the best performing tracker under certain heuristics or combining the results of multiple tracking processes in various ways. Further, other sensor data of a computing device can be used to improve the results provided by one or more of the tracking processes.

Multi-tracker object tracking

In a system and method for assessing and modifying fatigue, an input device receives current work-rest pattern and/or sleep data from an individual. A data aggregation and processing platform combines the current work-rest pattern and/or sleep data with previous data related to the individual to generate a fatigue assessment result, a diagnostic assessment result, and a corrective intervention result. At least one output display outputs the fatigue assessment result, diagnostic assessment result and corrective intervention result in a user-readable format to a user. The user uses this information to revise the work-rest pattern to reduce or control future fatigue risk.

Systems and methods for assessing equipment operator fatigue and using fatigue-risk-informed safety-performance-based systems and methods to replace or supplement prescriptive work-rest regulations

A computer software facility for generating and implementing a temporal map depicting a relationship between locations in a warehouse or distribution center is described. The facility tracks the movement in the warehouse, including the time it takes for mobile elements to move between a pair of identifiable locations. Based on the tracking, the facility produces movement time records for multiple location pairs in the warehouse. The facility then generates a map of the warehouse. Where information for specific pairs of identifiable locations is not available, the facility may derive movement time information based on actual movement times for related location pairs. The generated map can be used as part of a computer application for tasks such as scheduling the picking of items, evaluating employee performance, organizing the storage of items in the warehouse, and other uses.

Time-based warehouse movement maps

The amount of resources needed for an electronic device to track and/or interact with a user is reduced by utilizing a predicted relative position of that user. In some embodiments, a full 360° scan is performed using at least one image capture element to locate a primary direction to a user of the device. Once this direction is determined, a smaller range (e.g., 45°) centered around that direction can be used to capture, analyze, or provide information for the user. As the user moves, the determined direction is updated and the range adjusted accordingly. If the user moves outside the range, the device can increase the size of the range until the user is located, and the range can again be decreased around the determined direction. Such approaches limit the amount of image or audio information that must be captured and/or analyzed to track the relative position of a user.

Using spatial information with device interaction

Image information displayed on an electronic device can be modified based at least in part upon a relative position of a user with respect to a device. Mapping, topological or other types of positional data can be used to render image content from a perspective that is consistent with a viewing angle for the current relative position of the user. As that viewing angle changes, as a result of movement of the user and/or the device, the content can be re-rendered or otherwise updated to display the image content from a perspective that reflects the change in viewing angle. Simulations of effects such as parallax and occlusions can be used with the change in perspective to provide a consistent user experience that provides a sense of three-dimensional content even when that content is rendered on a two-dimensional display. Lighting, shading and/or other effects can be used to enhance the experience.

Simulating three-dimensional features

An electronic device including two or more display elements can provide enhanced functionality with improved rates of power consumption. A user can cause information that does not change rapidly to be provided or moved to a relatively static display element, such as an electronic ink display, which enables that information to be displayed for a period of time with little additional power consumption. Similarly, content (e.g., video) that changes rapidly can be displayed on a relatively dynamic display element, such as and LCD or OLED display. Each display can be touch sensitive, such that a user can move content between the displays by pressing on, or making a motion in contact with, at least one of the displays. Various modes can be activated which cause certain types of content to be displayed on the dynamic and/or static display element.

Multi-display type device interactions

A facility for scheduling the picking of a plurality of items specified for an item shipment is described. When a first-picked item of the plurality is picked, the facility selects a first period of time of a target length during which the first-picked item is expected to arrive at a sorting machine. For each of the items specified for the item shipment other than the first-picked item, the facility designates a picking period for the item that, when shifted forward in time by an amount of time the item will take to arrive at the sorting machine once picked, falls completely within the first period of time.

Dennis Hodge

Papers

Time-based warehouse movement maps

Using spatial information with device interaction

Simulating three-dimensional features

Multi-display type device interactions

Continuous item picking in a distribution center using coordinated item picking periods