Clone Tools
  • last updated 14 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Added filters to AsterixDB's primary and secondary indexes.

Change-Id: If16b2758bb25392c8dd0405d7d59ae503efad3f0

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/82

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 114 more files in changeset.
Add external indexes

This change include the following:

1. additional data parser for external data that parse hdfs records using Hive serdes.

2. allow users to create external data. this includes:

a) changes in metadata external dataset details.

b) addition of a new metadata index to store external file's statuses.

c) the pipeline for building the B-Tree and R-Tree indexes.

d) hyracks operators to fetch records with their RIDs using different formats.

e) hyracks operators to lookup and parse external records.

f) test cases for indexing and index access of different hdfs file formats.

g) exposing the secondary indexes over external data to the compiler.

3. adding a new aql command to refresh external datasets. this includes

a) global recovery on system startup.

b) changes in the aql parser.

c) construction of bulk modify pipelines and additional operators to perform local commit and abort operations (using 2PC protocol).

4. Added copyright header to all new files

5. Added additional test cases to test left outer join on external data

Change-Id: I1065a473299f6027eb073aeeba3a56d137f6f98e

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/70

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 146 more files in changeset.
some small cleanup

  1. … 4 more files in changeset.
Adjust creation of Rtree to reflect the new LSM Rtree Optimization

  1. … 2 more files in changeset.
changes to fix issue 727

  1. … 6 more files in changeset.
remove debug logging

move print methods to the 'debugging section'

generate methods to print a record as JSON

  1. … 4 more files in changeset.
disable debugging checks fix LockManagerDeterministicUnitTest some cleanup

  1. … 2 more files in changeset.
some more cleanup (mostly removal of debug/logging code)

  1. … 1 more file in changeset.
some cleanup

better attempt to fix the bug minor cleanup

  1. … 4 more files in changeset.
a fix and a bunch of debugging changes

  1. … 4 more files in changeset.
add DeadlockTracker

RecoveryManager change from issue 695

reduced log record size by removing old operation/value and generalized undo operation by not using physical delete operation in LSM btree

  1. … 1 more file in changeset.
Merge branch 'master' into zheilbron/asterix_msr_demo

Conflicts:

asterix-transactions/src/main/java/edu/uci/ics/asterix/transaction/management/service/locking/ConcurrentLockManager.java

  1. … 1 more file in changeset.
Merge branch 'master' into zheilbron/asterix_msr_demo

Conflicts:

asterix-algebra/src/main/java/edu/uci/ics/asterix/optimizer/rules/RemoveUnusedOneToOneEquiJoinRule.java

asterix-app/src/test/resources/metadata/results/basic/meta17.adm

asterix-app/src/test/resources/metadata/results/basic/meta17/meta17.1.adm

asterix-app/src/test/resources/metadata/results/basic/metadata_datatype.adm

asterix-app/src/test/resources/metadata/results/basic/metadata_datatype/metadata_datatype.1.adm

asterix-app/src/test/resources/runtimets/testsuite.xml

asterix-common/src/main/java/edu/uci/ics/asterix/common/config/AsterixExternalProperties.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/MetadataManager.java

asterix-transactions/src/main/java/edu/uci/ics/asterix/transaction/management/service/locking/ConcurrentLockManager.java

  1. … 14 more files in changeset.
Merge branch 'master' into westmann/locks

32 bits are not enough for LockManagerStats

no allocation of job slot during unlock

do not keep the monitor on jobArenaMgr unnecessarily

put some detailed logging behind a DEBUG_MODE guard small cleanup

add DummyLockManager

Merge branch 'master' into zheilbron/asterix_msr_demo

Conflicts:

asterix-app/src/main/java/edu/uci/ics/asterix/hyracks/bootstrap/NCApplicationEntryPoint.java

asterix-app/src/test/resources/metadata/results/basic/meta17/meta17.1.adm

asterix-app/src/test/resources/metadata/results/basic/metadata_datatype/metadata_datatype.1.adm

asterix-common/src/main/java/edu/uci/ics/asterix/common/config/AsterixExternalProperties.java

asterix-common/src/main/java/edu/uci/ics/asterix/common/transactions/ILockManager.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/MetadataManager.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/MetadataNode.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/entitytupletranslators/DatasetTupleTranslator.java

  1. … 14 more files in changeset.
always lock the whole dataset in PrimaryIndexSearchOperationCallback manage the dataset lock cache in the lock calls on the datset itself

log the right counters

move request counters into separate class comment out some detailed logging

s/Stats/RecordManagerStats/

  1. … 5 more files in changeset.
merge from master

  1. … 17 more files in changeset.