Teldware’s Method for Improving Performance Receives a Patent
by Eyjólfur Gislason
Teldware’s Method for Improving Performance in a Data Warehousing Environment Receives a Patent
March 18, 2014
Teldware Sp/f announced today the issuance by the US Patent Office of a patent that recognizes the company’s method for improving performance in a data warehousing environment.
The patent (#8,676,772) involves storing and maintaining a query-optimized representation of a dataset – including summary data – where the data is arranged in a large number of small database tables. The result is the significantly faster, more reliably consistent performance of a frontend data access application. The performance is at a level which was previously unattainable.
The invention enables a new category of applications, where interactive query performance (with typical 0.2 to 2.5 seconds response time) is no longer limited by the confines present in fitting the data into memory. Now, by using the techniques disclosed in the patent, response time is decoupled from the size of the underlying data warehouse. The patent also discloses a simplified ETL (extract-transform-load) process that becomes an ESL (extract-split-load) process, reducing the complexity and increasing the agility of adding data to the data warehouse.
Furthermore, the patent discloses a method of partitioning data according to multiple redundant partitioning schemes, and maintains redundant summary tables at the partition level. This technique removes problems of inconsistent data between aggregated and non-aggregated data tables, which improves performance by using fewer resources for summary table maintenance. Computational resources are further reduced by comparing split data portions with other split data portions from a previous extraction, and propagating only those portions that are new or changed.
Finally, the patent discloses a method of reducing the computational resources required to load data into the data warehouse by eliminating the need for indexes on most tables in the data warehouse. The result is better speed all around.
In the end, the technology in patent #8,676,772 creates a new standard in what is considered “best practices” in the design of data warehouses.
Comments are closed.