Systems and methods for managing data, such as metadata. In one exemplary method, metadata from files created by several different software applications are captured, and the captured metadata is searched. The type of information in metadata for one type of file differs from the type of information in metadata for another type of file. Other methods are described and data processing systems and machine readable media are also described.

Methods And Systems For Managing Data

Access to heterogeneous data sources may be obtained by interactively determining transformations for use in mapping at least one source data component from at least one data source to a target data component. Selection of at least one the source data component is detected. A corresponding list of representative data examples is generated for each selected source data component. A resulting list of representative data examples is compiled for the target data component from the lists of representative data examples of the selected source data components, the resulting list of data examples being representative of the target data component. A modification of an example is identified from the resulting list of examples representative of the target data component, the example being modified as a single textual entity. At least one transformation is determined, by inferring from the modified example, to be applied to at least one source data component.

Methods for interactively defining transforms and for generating queries by manipulating existing query data

A method of establishing at least one variable of a new view of data, is disclosed where the variable is obtained from at least one data source (150-153). The method identifies at least one display type (1202, FIG. 15, 17 18), each display type having at least one corresponding template of data to be used by the new view of data. The template includes a plurality of data component slots (1250-1254) related according to the semantics of the identified display type. One or more data components to be included in the view of data are then identified, each identified data component being associated (1222) with a slot in the template. A list of recommendations is then formed for one or more unspecified data components of the new view of data, the recommendations being based on the semantics of the display type and the identified data components. Finally at least one data component from the list of recommendations is identified as a variable for said new view of data. Also disclosed is a method of learning unknown relationships among data components across a plurality of heterogeneous data sources, and a method for recommending relevant data components for view creation across a plurality of heterogeneous data sources.

Method of using recommendations to visually create new views of data across heterogeneous sources

A high level transformation method and apparatus for converting data formats in the context of network applications, among other places. A flexible transformation mechanism is provided that facilitates generation of translation machine code on the fly. A translator is dynamically generated by a translator compiler engine. The translator compiler engine implemented according to the present invention uses a pair of formal machine-readable format description (FMRFDs) and a corresponding data map (DMAP) to generate executable machine code native to the translator platform CPU. When fed an input stream, the translator generates an output stream by executing the native object code generated on the fly by the translator compiler engine. In addition, the translator may be configured to perform a bi-directional translation between the two streams as well as translation between two distinct protocol sequences.

Method and apparatus of data exchange using runtime code generator and translator

Methods, programs (120) and apparatus (100) are disclosed for accessing and heterogenous data sources (150-153) and presenting information obtained therefrom. Specifically, the data sources may have hierarchical data, which may be presented by identifying a context data node from the data, the context data node having one or more descendent data nodes. At least one data pattern is determined in the descendent data nodes. At least one display type is assigned to the current context data node on the basis of the at least one data pattern. Thereafter, the method presents at least a subset of the descendent data nodes according to one of the assigned display types. Also disclosed is a method of browsing an hierarchically-represented data source. A user operation is interpreted to identify a context data node from the data source, the context data node having one or more descendent data nodes. At least one data pattern in the descendent data nodes is then determined and at least one display type is assigned to the current context data node on the basis of the at least one data pattern. A subset of the descendent data nodes is then presented according to one of the assigned display types, the subset including at least one hyperlink (3401,3402) having as its target a descendant data node of the current context data node. A further user operation is then interpreted to select the at least one hyperlink, the selection resulting in the current context data node being replaced with the data node corresponding to the target of the selected hyperlink. These steps may be repeated until no further hyperlinks to descendent data nodes are included in the subset. Other methods associated with access and presentation are also disclosed.

Method for presenting hierarchical data

A system and method is described for importing data from a source computer system, manipulating and transforming of that data, and exporting the data to a target computer system under control of a script processor using stored metadata definitions. Metadata is used to describe the properties of the data being manipulated. The system includes a means for manipulating the metadata definitions. The metadata definitions are created to import data into the system, export data from the system, create views of the external data, store generic format data within the system, manipulate generic format data within the system and to control data flow through the system. Data is imported into the system using an import data definition to map the external data into an import data bag. Data imported into an import data bag becomes independent of the original data source. Data is manipulated within the system using script control commands and data is transformed within the system using rule sets that act upon data bags. Data is exported from the system using an export data definition to map the import data bag into the required export data bag format and then to write data in the export data bag to the external data target.

Darin Ellis

Papers

A system for transforming and exchanging data between distributed heterogeneous computer systems