AMBERSTONE

Amberstone is designed to be used as part of the data pipeline feeding a time series reporting system. In this scenario, machine generated data flows into the data warehouse throughout the day. When it arrives, the data is loaded into Amberstone for long term storage and aggregation. After the data is loaded, Amberstone outputs time series aggregate tables which are loaded into a database for reporting. The reporting system uses the aggregate tables to generate on-demand time series reports and pivot tables for end users... Amberstone's compression strategy is two pronged. The first part of the strategy is to store data in column oriented fact tables. This design allows compression to be applied on individual columns, which can result in very high compression rates. Amberstone's second approach is to provide built-in functions at load time that replace text data with surrogate integer keys. This approach creates on-the-fly star schemas from machine generated data, and leads to very..