Clone Tools
  • last updated 16 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Move AsterixDB to Subfolder

    • -250
    • +0
    ./tw_for_indexleftouterjoin_nested.adm
  1. … 44147 more files in changeset.
ASTERIXDB-1044 Allow Reading large records from HDFS

This change tests reading of HDFS records larger than 8192.

The fix for the issue was merged previously.

Change-Id: I3cf52be4bc0fd8af2555062eeb421d7235088d98

Reviewed-on: https://asterix-gerrit.ics.uci.edu/529

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 5 more files in changeset.
Added support of typed indexes over open fields & indexes over nested fields

Open indexes requires user to provide a type along with a indexed field name.

This type would be enforced for all the indexed records, i.e. index cannot be created if in some records a field with provided name has a different type.

Index-specific rewrite rules match provided type with the inferred types of other arguments in join\select statements and trigger index rewrite.

Nested indexes use the same semantics as the regular indexes, with exception that field could be located arbitrarily deep inside nested structure

Change-Id: I53d00aba243ccf7cf79cf7d775dd305813d24f98

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/97

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

    • -0
    • +21
    ./spatialDataNested.json
    • -0
    • +250
    ./tw_for_indexleftouterjoin_nested.adm
  1. … 1790 more files in changeset.
Add external indexes

This change include the following:

1. additional data parser for external data that parse hdfs records using Hive serdes.

2. allow users to create external data. this includes:

a) changes in metadata external dataset details.

b) addition of a new metadata index to store external file's statuses.

c) the pipeline for building the B-Tree and R-Tree indexes.

d) hyracks operators to fetch records with their RIDs using different formats.

e) hyracks operators to lookup and parse external records.

f) test cases for indexing and index access of different hdfs file formats.

g) exposing the secondary indexes over external data to the compiler.

3. adding a new aql command to refresh external datasets. this includes

a) global recovery on system startup.

b) changes in the aql parser.

c) construction of bulk modify pipelines and additional operators to perform local commit and abort operations (using 2PC protocol).

4. Added copyright header to all new files

5. Added additional test cases to test left outer join on external data

Change-Id: I1065a473299f6027eb073aeeba3a56d137f6f98e

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/70

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

    • binary
    ./external-indexing-test.rc
    • binary
    ./external-indexing-test.seq
    • -0
    • +11
    ./external-indexing-test.txt
    • -0
    • +250
    ./tw_for_indexleftouterjoin.adm
  1. … 146 more files in changeset.
Merged asterix_lsm_stabilization upto r1547

git-svn-id: https://asterixdb.googlecode.com/svn/trunk/asterix@1622 eaa15691-b419-025a-1212-ee371bd00084

  1. … 6217 more files in changeset.
merged asterix_stabilization r620:1109

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_temporal_functionality@1113 eaa15691-b419-025a-1212-ee371bd00084

  1. … 1429 more files in changeset.
Reviewer:Yingyi 1) Fix issues 14, 230, 238, 239, 245 2) Simplication of ADM/Delimited parser factories. 3) Additional test cases that use simulated feeds. 4) Additional test cases for external datasets over HDFS. 5) Code refactoring in asterix-external-data module.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization@1094 eaa15691-b419-025a-1212-ee371bd00084

  1. … 122 more files in changeset.