asterixdb

Clone Tools
  • last updated 15 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Tests for issue 224

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_fix_issue_224@1119 eaa15691-b419-025a-1212-ee371bd00084

rename hyracks-hdfs-scheduler to hyracks-hdfs

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_asterix_stabilization@2792 123451ca-8445-de46-9d55-352943316053

    • -83
    • +0
    /hyracks/hyracks-hdfs-scheduler/pom.xml
    • -0
    • +81
    /hyracks/hyracks-hdfs/pom.xml
  1. … 8 more files in changeset.
rename package

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_asterix_stabilization@2791 123451ca-8445-de46-9d55-352943316053

add generalized hdfs read/writer operators

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_asterix_stabilization@2790 123451ca-8445-de46-9d55-352943316053

    • -1
    • +13
    /hyracks/hyracks-hdfs-scheduler/pom.xml
merged from asterix_stabilization for r1113:1117

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_temporal_functionality@1118 eaa15691-b419-025a-1212-ee371bd00084

  1. … 23 more files in changeset.
Merged fullstack_staging -r 2426:2786

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_ioc@2788 123451ca-8445-de46-9d55-352943316053

Modified Yarn driver to accept extra jar files

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_ioc@2786 123451ca-8445-de46-9d55-352943316053

add the hyracks-hdfs-scheduler module

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_asterix_stabilization@2782 123451ca-8445-de46-9d55-352943316053

    • -0
    • +71
    /hyracks/hyracks-hdfs-scheduler/pom.xml
Merged asterix_stabilization r1006:r1115.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_fix_issue_224@1117 eaa15691-b419-025a-1212-ee371bd00084

Merged hyracks_lsm_tree r2599:r2780.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_experiments@2781 123451ca-8445-de46-9d55-352943316053

implemented recovery mechanism, but still need to wire up interface of getting LSNs from LSM Index

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_lsm_stabilization@1115 eaa15691-b419-025a-1212-ee371bd00084

merged hyracks_lsm_tree into branch -r2751:2779

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree_bloom_filter@2780 123451ca-8445-de46-9d55-352943316053

merge changes from asterix_stabilization_yfix

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization@1114 eaa15691-b419-025a-1212-ee371bd00084

merged asterix_stabilization r620:1109

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_temporal_functionality@1113 eaa15691-b419-025a-1212-ee371bd00084

  1. … 1418 more files in changeset.
All lsm indexes (BTree, RTree, and inverted index) are now using bloom filters whenever possible.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree_bloom_filter@2776 123451ca-8445-de46-9d55-352943316053

  1. … 47 more files in changeset.
Added changes for integration with fullstack_asterix_stabilization

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization@1110 eaa15691-b419-025a-1212-ee371bd00084

Merged fullstack_asterix_stabilization -r 2770:2771

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_staging@2772 123451ca-8445-de46-9d55-352943316053

Ignored eclipse files in SVN

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_asterix_stabilization@2771 123451ca-8445-de46-9d55-352943316053

Created branch for Asterix to use

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_asterix_stabilization@2770 123451ca-8445-de46-9d55-352943316053

Merged fullstack_staging_bigmerge_target -r 2735:2760

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_staging@2768 123451ca-8445-de46-9d55-352943316053

added default value for dataset cardinality hint

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_issue_251@1109 eaa15691-b419-025a-1212-ee371bd00084

address code revew feedback, changed type for cardinality hint to Long from Int 2) fixed indx value in DatasetTupleTranslator

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_issue_251@1108 eaa15691-b419-025a-1212-ee371bd00084

added additional runtime test for all dataset types when created with hints

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_issue_251@1107 eaa15691-b419-025a-1212-ee371bd00084

Utilized bloom filters in LSM-BTree point search.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree_bloom_filter@2764 123451ca-8445-de46-9d55-352943316053

    • -0
    • +7
    /hyracks-storage-am-lsm-common/pom.xml
Support for hints in create dataset statement.

ASTERIX allows user to give additional information in form of hints.

These hints can come handy in scenarios such as determining other parameters like the size of bloom filter to hold data.

To begin with, the onyl hint supported by Asterix is the 'CARDINALITY' hint.

CARDINALITY gives the expected number of tuples in the dataset.

An example create dataset statement that provides hints is given below:-

create dataset X(TypeY)

partitioned by key id

hints (CARDINALITY=2500);

Please note that hints are case-insensitive.

Test Cases:-

Positive

asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_1.aql

asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_2.aql

asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_3.aql

asterix-app/src/test/resources/metadata/queries/basic/issue_251_dataset_hint_4.aql

Negative

asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_1.aql

asterix-app/src/test/resources/metadata/queries/exception/issue_251_dataset_hint_error_2.aql

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_issue_251@1105 eaa15691-b419-025a-1212-ee371bd00084

  1. … 16 more files in changeset.
Merged hyracks_asterix_stabilization_left_outer_join

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_staging_bigmerge_target@2760 123451ca-8445-de46-9d55-352943316053

fix the binary hash function family issue in hivesterix

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_staging_bigmerge_target@2759 123451ca-8445-de46-9d55-352943316053

merged hyracks_lsm_tree into branch -r2707:2751

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree_bloom_filter@2752 123451ca-8445-de46-9d55-352943316053

branch for issue 251- hints in create dataset statement

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_issue_251@1103 eaa15691-b419-025a-1212-ee371bd00084

Made sure bloom filters don't hold latches after insertion is over (pages are still pinned). Changed the bloom filter insertion to use a bulkload-like interface. Changed the bulkload interface for all indexes to accept number of elements hint. Various bug fixes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree_bloom_filter@2751 123451ca-8445-de46-9d55-352943316053

  1. … 11 more files in changeset.