Clone
Wail Alkowaileet <wael.y.k@gmail.com>
committed
on 07 Nov 18
[ASTERIXDB-2422][STO] Introduce compressed storage
- user model changes: yes
- Add new configuration in the with-caluse to enable compress… Show more
[ASTERIXDB-2422][STO] Introduce compressed storage

- user model changes: yes

 - Add new configuration in the with-caluse to enable compression

 - Add new nc configuration in the config file

- storage format changes: yes

 - Pages of the primary index can be compressed

 - Add a companion file (Look Aside File) with the compressed index

 - Allow optional values in the LocalResource

 - Add compression information in Metadata.Dataset

- interface changes: yes

 - ICCApplicationContext:

   - Add getCompressionManager()

 - IBufferCache:

   - Add getCompressedFileWriter(int fileId)

 - ICachedPageInternal:

   - Add setCompressedPageOffset(long offset)

   - Add getCompressedPageOffset()

   - Add setCompressedPageSize(int size)

   - Add getCompressedPageSize()

Details:

 - Add new integration test for this patch

 - Fix ASTERIXDB-2464

 - Add ddl-with-clause type validator

Additional details in the design document:

https://cwiki.apache.org/confluence/display/ASTERIXDB/Compression+in+AsterixDB

Change-Id: Idde6f37c810c30c7f1a5ee8bcbc1e3e5f4410031

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2857

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Show less