An intelligent automated assistant system engages with the user in an integrated, conversational manner using natural language dialog, and invokes external services when appropriate to obtain information or perform various actions. The system can be implemented using any of a number of different platforms, such as the web, email, smartphone, and the like, or any combination thereof. In one embodiment, the system is based on sets of interrelated domains and tasks, and employs additional functionally powered by external services with which the system can interact.

Intelligent Automated Assistant

A virtual assistant uses context information to supplement natural language or gestural input from a user. Context helps to clarify the user's intent and to reduce the number of candidate interpretations of the user's input, and reduces the need for the user to provide excessive clarification input. Context can include any available information that is usable by the assistant to supplement explicit user input to constrain an information-processing problem and/or to personalize results. Context can be used to constrain solutions during various phases of processing, including, for example, speech recognition, natural language processing, task flow processing, and dialog generation.

Using context information to facilitate processing of commands in a virtual assistant

Remote sensing big data computing

A method and apparatus are provided for building an intelligent automated assistant. Embodiments of the present invention rely on the concept of “active ontologies” (e.g., execution environments constructed in an ontology-like manner) to build and run applications for use by intelligent automated assistants. In one specific embodiment, a method for building an automated assistant includes interfacing a service-oriented architecture that includes a plurality of remote services to an active ontology, where the active ontology includes at least one active processing element that models a domain. At least one of the remote services is then registered for use in the domain.

Method and apparatus for building an intelligent automated assistant

The method includes automatically, without user input and without regard to whether a digital assistant application has been separately invoked by a user, determining that the electronic device is in a vehicle. In some implementations, determining that the electronic device is in a vehicle comprises detecting that the electronic device is in communication with the vehicle (e.g., via a wired or wireless communication techniques and/or protocols). The method also includes, responsive to the determining, invoking a listening mode of a virtual assistant implemented by the electronic device. In some implementations, the method also includes limiting the ability of a user to view visual output presented by the electronic device, provide typed input to the electronic device, and the like.

Automatically adapting user interfaces for hands-free interaction

A method and system that provide browser-based functions by injected into a web page a control button, form text field or similar browser-based function control such that both the browser controls and the content of the web page can be transformed for accessibility. A proxy machine retrieves a web page for a user, and then injects the user selected browser function controls into the web page itself. The injected browser controls are supported by web-based application services, preferably resident in an intermediary proxy machine, for producing web content that is representative of that function. The web page is transformed into a style that is accessible for that particular user, such as magnifying the page, reformatting background schemes, etc. The user can select which browser function buttons are injected into the web page, and as the web page is transformed for accessibility, the browser controls on the page are likewise transformed.

Method and system for providing browser functions on a web page for client-specific accessibility

A method and system that provide a central repository for client specific accessibility applications to a user from an accessible server. The repository is updated on a periodic basis with new solutions provided by the service provider, who also manages licensing agreements between the user and the owner of the accessibility application. Accessibility programs, such as page magnification, screen readers, background changes, input modification, etc., are downloaded into the client device being used by the user customer by clicking link buttons from a web page generated by the service provider's server. The accessibility programs downloaded are then resident on the client device until changed by the user. In a preferred embodiment, the service provider also provides a universal transcoding service to apply the user selected accessibility transformations to any type of client device used by the user.

Method and system for providing a central repository for client-specific accessibility

A method and system using directive script in a web intermediary proxy machine that provides the function of a transcoder. The intermediary machine's transcoders are controlled by directive script that directs the order and properties of transcoder operations executed on one or more transcoders in the intermediary machine. These directive scripts are stored in an on-the-fly modifiable directive database accessible to the web intermediary proxy machine. The user's client machine browser passes an HTTP request to the web intermediary machine, which passes the HTTP request to a web content server, which returns an HTML response back to the web intermediary machine. This HTML response is sent to at least one transcoder that resides in or is at least accessible to the intermediary proxy machine. The transcoder identifies the type of device being used by the client from the HTTP request. The user's preference transcoding settings are retrieved in the form of directives from a directive script, preferably in XML format, retrieved from a settings database, and applied to the transcoders. The tailored transcoded response is then sent back to the user's client machine.

Method and system of use of transcode directives for distributed control of transcoding servers

A central algorithm in production systems is the pattern match among rule predicates and current data. Systems like OPS5 and its various derivatives use the RETE algorithm for this function. This paper describes and analyses several augmentations of the basic RETE algorithm that are incorporated into an experimental production system, YES/OPS, which achieve significant improvement in efficiency and rule clarity.

/pdf/advances-in-rete-pattern-matching-4y6ozb3zr2.pdf

Advances in rete pattern matching

A method and system using for establishing an intermediary connection between a client device and a secure website using a web proxy machine. In the preferred embodiment, a secure connection is established between the web proxy and the secure content server. A response from the content server, typically in HTML format, is sent to the proxy machine through a secure connection. The proxy machine is then able to manipulate the secure response from the secure server, in ways such as transcoding the response to a format readable by the user device, storing sensitive financial data in cookies in the proxy machine, and to return a response from the content provider to the client device with or preferably without cookies.

Beth R. Tibbitts

Papers

Method and system for providing browser functions on a web page for client-specific accessibility

Method and system for providing a central repository for client-specific accessibility

Method and system of use of transcode directives for distributed control of transcoding servers

Advances in rete pattern matching

System and method for transcoding support of web content over secure connections