scispace - formally typeset
Patent

Multi-dimensional OLAP (On Line Analytical Processing) inquiry processing method facing column storage data warehouse

Yansong Zhang, +1 more
Reads0
Chats0
TLDR
In this article, a multi-dimensional OLAP (On Line Analytical Processing) inquiry processing method facing a column storage data warehouse is presented. But the method is not suitable for the case of large data sets.
Abstract
The invention discloses a multi-dimensional OLAP (On Line Analytical Processing) inquiry processing method facing a column storage data warehouse. In the multi-dimensional OLAP inquiry processing method, the OLAP inquiry is decomposed into a bitmap filtering operation, a grouping operation and an aggregation operation. In the bitmap filtering operation, firstly, the predication is executed on a dimension table and a predicate vector bitmap is generated; and a connection operation is converted into a direct dimension table record access operation by surrogate key address mapping so as to implement access according to the positions. In the grouping operation, the pre-generation of grouping units is carried out on fact table records which meet the filtering conditions according to grouping attributes in an SQL (Structured Query Language) command and increasing IDs (identity) are distributed. In the aggregation operation, the grouping aggregation calculation which is carried out according to a grouping item of a grouping filtering vector of a fact table is implemented by carrying out column scanning on the metric attribute of the fact table for once. According to the invention, all OLAP processing tasks can be completed only by carrying out column scanning on the fact table for once, so that the cost of repeatedly scanning is avoided.

read more

Citations
More filters
Patent

Multi-dimensional analysis method for multi-level storage data

TL;DR: In this paper, a multi-dimensional analysis method for multi-level storage data is proposed, where a calculation engine automatically generates an aggregate calculating sentence, corresponding to a next-level calculation node, of the multidimensional analysis model according to routing information.
Patent

Memory database OLTP and OLAP concurrency query optimization method

TL;DR: In this paper, a memory database OLTP and OLAP concurrency query optimization method is proposed, which includes the steps that (1) by means of two query processing engines, independent storage engines are adopted to a dimension table and a fact table; (2) the dimension table is updated through an embedded concurrency control mechanism of the independent storage engine, and (3) the fact table is equivalent to multiple continuous arrays in logic and maintains two dynamic data structures, namely a read record pointer and a write record pointer.
Patent

Information processing method and device

TL;DR: In this article, an information processing method and device are used for improving the accuracy of a prediction result provided for marketers, thereby reducing the operating cost, which is mainly used in the business marketing technology.
Patent

Object storage using multiple dimensions of object information

TL;DR: In this article, a storage management module collects information about objects (e.g., data objects) in a storage system and determines a storage solution for each determined grouping, and then direct storage of the objects in the groupings according to the determined storage solutions.
Patent

OLAP star connection query optimizing method under CPU and GPU mixing framework

Zhang Yansong, +1 more
TL;DR: In this paper, an OLAP (On-Line Analytical Processing) star connection query optimization method under a CPU and GPU (Graphics Processing Unit) mixing framework is proposed, which comprises the following steps: first, filtering and optimizing an OAP star connection operation through bitmap connection indexing, buffering high-frequently accessed connecting bitmap in a GPU buffer memory, next, loading fact table external key attribute group satisfying the connection filtering condition into the GPU buffer, and finally switching the whole table scanning of the big fact table of the internal memory into accessing randomly according to the
References
More filters
Patent

Apparatus, systems and methods for data storage and/or retrieval based on a database model-agnostic, schema-agnostic and workload-agnostic data storage and access models

TL;DR: In this article, a database access model and storage structure that efficiently support concurrent OLTP and OLAP activity independently of the data model or schema used, is described, and the storage structure and access model presented avoid the need to design schemas for particular workloads or query patterns.