Clone Tools
  • last updated 17 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Change folder structure for Java repackage

Change only the folders, not the files, for our package name change.

This will break the build, and needs to be followed by a change to

the package name in all of the source files. However performing

the folder move and file change in two steps lets Git understand

that the files are the same, and lets us track revisions across

those files.

Change-Id: Iefd2a576415ebc1416cba2a3334d2b64f042ba92

Reviewed-on: https://asterix-gerrit.ics.uci.edu/306

Tested-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -39
    • +0
    ./AsterixVirtualBufferCacheProvider.java
    • -126
    • +0
    ./CorrelatedPrefixMergePolicy.java
    • -68
    • +0
    ./CorrelatedPrefixMergePolicyFactory.java
    • -25
    • +0
    ./ITransactionSubsystemProvider.java
    • -196
    • +0
    ./PrimaryIndexOperationTracker.java
    • -34
    • +0
    ./TransactionSubsystemProvider.java
  1. … 3787 more files in changeset.
Add Apache RAT License Auditor plugin, and fix missing licenses

Change-Id: Ic0fa0b7836e8a69d0d8beed83f9c3b41c168afd4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/263

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -2
    • +2
    ./AsterixVirtualBufferCacheProvider.java
    • -2
    • +2
    ./CorrelatedPrefixMergePolicyFactory.java
  1. … 1537 more files in changeset.
AsterixDB changes for: 1. fix "writerCount!=0" issue 2. protect deactivate/activate call of an index by its opTracker.

Note that this change includes https://asterix-gerrit.ics.uci.edu/#/c/269/.

Change-Id: I4669d49fd1cf9b058f7e0da233ad45c6c78b5797

Reviewed-on: https://asterix-gerrit.ics.uci.edu/279

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -8
    • +13
    ./PrimaryIndexOperationTracker.java
Temp dataset support: 1. DDLs for creating a temporary dataset 2. Garbage collection for temporary dataset 3. Reading, inserting, and deleting data from (to) a temporary dataset is locking-free (except metadata locks) and logging-free (except flush/merge/job-commit logs).

Change-Id: Id0960acd1b4dfbfa7685dba227634572ca50b126

Reviewed-on: https://asterix-gerrit.ics.uci.edu/241

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

  1. … 251 more files in changeset.
Fixing LSMHarness issue.

Change-Id: I8afc0f189f5a64cc56be4a89903999c7c90a65c1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/252

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -27
    • +27
    ./PrimaryIndexOperationTracker.java
Modified locking on DatasetLifeCycleManager

Change-Id: Ia5ab435f53879ba1d08b6dee24eb4969c5ad16e3

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/206

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -17
    • +50
    ./PrimaryIndexOperationTracker.java
  1. … 10 more files in changeset.
This change integrates a run statement for running Pregelix jobs into the AQL.

Therefore it also provides a new FlushOperator to flush all memory components of a dataset to disc.

Change-Id: I1f97cfdc79943abf035a7342bb777d59af6518e9

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/193

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

  1. … 22 more files in changeset.
Added flush logs and enabled non-sharp checkpoints

The following commits from your working branch will be included:

commit c11a22cfd916041c806409c6d8e66dd6ea162b7b

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Tue Nov 18 23:12:19 2014 -0800

Defined Startup LSN

commit 95a8752072e53ef62a11c39799f296209a3c622c

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Tue Nov 18 20:22:08 2014 -0800

Revised Checkpoint Logic

commit ea4baa22089ba5d3eaff3d5c787828efcbff8ad9

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Thu Nov 13 10:25:45 2014 -0800

added comments

commit 8991554f840f50d800a619fc2ac327f1c024e838

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Wed Nov 12 23:34:25 2014 -0800

Added a method to the interface

commit a31e36b0b8234fe876b42e0cdc4543e4e73314a1

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Wed Nov 12 22:57:51 2014 -0800

Refactored getMinFirstLSN code

commit 25f62d585b2f279e78711efd2d327c777919f62c

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Tue Nov 11 14:05:34 2014 -0800

Added flush logs

Change-Id: I13fb61c04b6b510b6e8af68d2a0e7e14859f519d

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/182

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

    • -8
    • +39
    ./PrimaryIndexOperationTracker.java
  1. … 31 more files in changeset.
Fix for Hyracks interface change due to Virtual Pages

Change-Id: Iedf7b1f27e3539563729e76e531bf10ecd5f6143

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/110

Reviewed-by: Sattam Alsubaiee <salsubaiee@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Added a new merge policy, called correlated-prefix.

Change-Id: I8f961eb28b4ea460f6326c8b4acaea02b50819e9

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/108

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +125
    ./CorrelatedPrefixMergePolicy.java
    • -0
    • +68
    ./CorrelatedPrefixMergePolicyFactory.java
  1. … 28 more files in changeset.
Add external indexes

This change include the following:

1. additional data parser for external data that parse hdfs records using Hive serdes.

2. allow users to create external data. this includes:

a) changes in metadata external dataset details.

b) addition of a new metadata index to store external file's statuses.

c) the pipeline for building the B-Tree and R-Tree indexes.

d) hyracks operators to fetch records with their RIDs using different formats.

e) hyracks operators to lookup and parse external records.

f) test cases for indexing and index access of different hdfs file formats.

g) exposing the secondary indexes over external data to the compiler.

3. adding a new aql command to refresh external datasets. this includes

a) global recovery on system startup.

b) changes in the aql parser.

c) construction of bulk modify pipelines and additional operators to perform local commit and abort operations (using 2PC protocol).

4. Added copyright header to all new files

5. Added additional test cases to test left outer join on external data

Change-Id: I1065a473299f6027eb073aeeba3a56d137f6f98e

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/70

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 150 more files in changeset.
Fixed a deadlock when stopping the dataset life cycle manager.

add logic for manually triggered state dumps

  1. … 6 more files in changeset.
fix and cleanup DatasetLifecycleManager state dump

Merge remote-tracking branch 'origin/raman/master_feeds_merge' into zheilbron/asterix_msr_demo

Conflicts:

.gitignore

asterix-algebra/src/main/java/edu/uci/ics/asterix/optimizer/rules/FeedScanCollectionToUnnest.java

asterix-algebra/src/main/java/edu/uci/ics/asterix/optimizer/rules/IntroduceMaterializationForInsertWithSelfScanRule.java

asterix-algebra/src/main/java/edu/uci/ics/asterix/optimizer/rules/UnnestToDataScanRule.java

asterix-app/src/main/java/edu/uci/ics/asterix/api/common/AsterixAppRuntimeContext.java

asterix-app/src/main/java/edu/uci/ics/asterix/api/common/AsterixAppRuntimeContextProdiverForRecovery.java

asterix-app/src/main/java/edu/uci/ics/asterix/aql/translator/AqlTranslator.java

asterix-app/src/test/resources/metadata/results/basic/issue_251_dataset_hint_2/issue_251_dataset_hint_2.1.adm

asterix-app/src/test/resources/metadata/results/basic/issue_251_dataset_hint_3/issue_251_dataset_hint_3.1.adm

asterix-app/src/test/resources/metadata/results/basic/issue_251_dataset_hint_4/issue_251_dataset_hint_4.1.adm

asterix-app/src/test/resources/metadata/results/basic/meta02/meta02.1.adm

asterix-app/src/test/resources/metadata/results/basic/meta09/meta09.1.adm

asterix-app/src/test/resources/metadata/results/basic/meta16/meta16.1.adm

asterix-app/src/test/resources/metadata/results/basic/meta17/meta17.1.adm

asterix-app/src/test/resources/metadata/results/basic/metadata_dataset/metadata_dataset.1.adm

asterix-app/src/test/resources/metadata/results/basic/metadata_datatype/metadata_datatype.1.adm

asterix-app/src/test/resources/runtimets/results/cross-dataverse/cross-dv02/cross-dv02.1.adm

asterix-app/src/test/resources/runtimets/results/cross-dataverse/cross-dv04/cross-dv04.1.adm

asterix-app/src/test/resources/runtimets/results/cross-dataverse/cross-dv19/cross-dv19.1.adm

asterix-app/src/test/resources/runtimets/results/user-defined-functions/udf23/udf23.1.adm

asterix-aql/src/main/java/edu/uci/ics/asterix/aql/expression/FeedDetailsDecl.java

asterix-aql/src/main/java/edu/uci/ics/asterix/aql/expression/InternalDetailsDecl.java

asterix-aql/src/main/java/edu/uci/ics/asterix/aql/expression/visitor/AQLPrintVisitor.java

asterix-aql/src/main/javacc/AQL.jj

asterix-common/src/main/java/edu/uci/ics/asterix/common/transactions/IAsterixAppRuntimeContextProvider.java

asterix-external-data/src/main/java/edu/uci/ics/asterix/external/dataset/adapter/FileSystemBasedAdapter.java

asterix-installer/src/main/java/edu/uci/ics/asterix/installer/driver/InstallerUtil.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/MetadataNode.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/bootstrap/MetadataBootstrap.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/bootstrap/MetadataRecordTypes.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/declared/DatasetDataSource.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/entities/InternalDatasetDetails.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/entitytupletranslators/DatasetTupleTranslator.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/feeds/FeedMetaOperatorDescriptor.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/feeds/FeedUtil.java

asterix-om/src/main/java/edu/uci/ics/asterix/om/functions/AsterixExternalFunctionInfo.java

asterix-om/src/main/java/edu/uci/ics/asterix/om/util/AsterixAppContextInfo.java

asterix-transactions/src/main/java/edu/uci/ics/asterix/transaction/management/opcallbacks/SecondaryIndexModificationOperationCallbackFactory.java

asterix-transactions/src/main/java/edu/uci/ics/asterix/transaction/management/resource/LSMBTreeLocalResourceMetadata.java

asterix-transactions/src/main/java/edu/uci/ics/asterix/transaction/management/service/logging/LogManager.java

asterix-transactions/src/main/java/edu/uci/ics/asterix/transaction/management/service/transaction/AsterixRuntimeComponentsProvider.java

  1. … 53 more files in changeset.
cosmetic changes

  1. … 213 more files in changeset.
Merged master into salsubaiee/master_change_lsm_merge_policy

  1. … 16 more files in changeset.
Allowed user to specify the merging policy

  1. … 58 more files in changeset.
Modified storage config paramters.

  1. … 3 more files in changeset.
Support for full compaction command.

  1. … 31 more files in changeset.
addressed code review comments

fixed recovery bugs

  1. … 7 more files in changeset.
Reset the total size accumulated so far when restarting a new search for components to be merged.

Added a new merge policy.

    • -0
    • +78
    ./PrefixMergePolicy.java
  1. … 1 more file in changeset.
checkpoint towards fixing diskComponents' LSN

  1. … 10 more files in changeset.
fixed bugs related to rollback and primary key length

    • -6
    • +25
    ./PrimaryIndexOperationTracker.java
  1. … 21 more files in changeset.
checkpoint towards fixing LSN related issues(issue 591, 609, and 614) and more

  1. … 26 more files in changeset.
Merge branch 'master' into dev/asterix_msr

Conflicts:

asterix-app/src/main/java/edu/uci/ics/asterix/api/common/AsterixAppRuntimeContext.java

asterix-app/src/main/java/edu/uci/ics/asterix/api/common/AsterixAppRuntimeContextProviderForRecovery.java

asterix-common/src/main/java/edu/uci/ics/asterix/common/api/IAsterixAppRuntimeContext.java

asterix-common/src/main/java/edu/uci/ics/asterix/common/transactions/IAsterixAppRuntimeContextProvider.java

asterix-common/src/main/java/edu/uci/ics/asterix/common/transactions/ITransactionSubsystem.java

asterix-common/src/main/java/edu/uci/ics/asterix/common/transactions/LogUtil.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/bootstrap/MetadataBootstrap.java

asterix-om/src/main/java/edu/uci/ics/asterix/om/util/AsterixAppContextInfo.java

asterix-transactions/src/main/java/edu/uci/ics/asterix/transaction/management/resource/LSMBTreeLocalResourceMetadata.java

asterix-transactions/src/main/java/edu/uci/ics/asterix/transaction/management/resource/LSMInvertedIndexLocalResourceMetadata.java

asterix-transactions/src/main/java/edu/uci/ics/asterix/transaction/management/resource/LSMRTreeLocalResourceMetadata.java

asterix-transactions/src/main/java/edu/uci/ics/asterix/transaction/management/service/logging/IndexLoggerRepository.java

asterix-transactions/src/main/java/edu/uci/ics/asterix/transaction/management/service/logging/IndexResourceManager.java

asterix-transactions/src/main/java/edu/uci/ics/asterix/transaction/management/service/logging/LogManager.java

asterix-transactions/src/main/java/edu/uci/ics/asterix/transaction/management/service/recovery/RecoveryManager.java

asterix-transactions/src/main/java/edu/uci/ics/asterix/transaction/management/service/transaction/TransactionSubsystem.java

asterix-transactions/src/test/java/edu/uci/ics/asterix/transaction/management/test/TransactionSimulator.java

    • -27
    • +125
    ./DatasetLifecycleManager.java
  1. … 18 more files in changeset.
Wait for io properly. Added additional commentes.

Cleanup memory when a dataset has been dropped.