hyracks-storage-am-common

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
new branch for merging lsm and fullstack

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_lsm_staging@3014 123451ca-8445-de46-9d55-352943316053

  1. … 1792 more files in changeset.
added interface to get a snapshot of active indexes from the lifecycle manager; added interface for lsm indexes to inspect their component in order to extract metadata information

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2943 123451ca-8445-de46-9d55-352943316053

  1. … 1 more file in changeset.
Minor changes in the index's dataflow operators to pass bloom filter information.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree_bloom_filter@2799 123451ca-8445-de46-9d55-352943316053

  1. … 31 more files in changeset.
Made sure bloom filters don't hold latches after insertion is over (pages are still pinned). Changed the bloom filter insertion to use a bulkload-like interface. Changed the bulkload interface for all indexes to accept number of elements hint. Various bug fixes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree_bloom_filter@2751 123451ca-8445-de46-9d55-352943316053

  1. … 22 more files in changeset.
changes towards recovery

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2735 123451ca-8445-de46-9d55-352943316053

  1. … 11 more files in changeset.
changes towards recovery

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2715 123451ca-8445-de46-9d55-352943316053

  1. … 3 more files in changeset.
Integrated bloom filters with LSM-BTree during flushes, merges, and bulkload. All tests pass except the merge test due to what it seems a bug in the cleanup after merges if there are no search threads accessing the disk components. Next is to use bloom filters during search and also with other lsm indexes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree_bloom_filter@2706 123451ca-8445-de46-9d55-352943316053

  1. … 30 more files in changeset.
added some comments while reviewing the IndexLifecycleManager

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2700 123451ca-8445-de46-9d55-352943316053

major reworking of all lsm indexes with respect to synchronization and interfacing with the lsmharness

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2681 123451ca-8445-de46-9d55-352943316053

  1. … 66 more files in changeset.
Allowing LSM file managers to be initialized with a starting IO device index. Using that mechanism, the first disk component of the i-th partition of an Asterix LSM index is written on the i-th IO device (further components are assigned to IO devices in a round robin fashion).

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2585 123451ca-8445-de46-9d55-352943316053

  1. … 14 more files in changeset.
* The cleanup of the merged components in the LSM indexes is now the responsibility of either: the last existing search thread (in case the merge process is over and there are still search threads accessing the merged components), or the merge thread itself (in case the merge process is over and there are no search threads accessing the merged components). * Allowed concurrent merges to occur at the same time instead of the old design which only allowed one merge process at a time per LSM index.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2573 123451ca-8445-de46-9d55-352943316053

  1. … 30 more files in changeset.
Added exception handling in the rtree bulkload, to release all latches in case the bulkload failed. The btree bulkload already does that.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2554 123451ca-8445-de46-9d55-352943316053

  1. … 2 more files in changeset.
Minor amendment to my multicomparator changes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2538 123451ca-8445-de46-9d55-352943316053

  1. … 8 more files in changeset.
Finished implementing performance-optimized MultiComparators.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_multicomparator_opt@2506 123451ca-8445-de46-9d55-352943316053

  1. … 2 more files in changeset.
Checkpointing progress on implementing a length-partitioned inverted index.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_length_filter@2455 123451ca-8445-de46-9d55-352943316053

  1. … 15 more files in changeset.
changes for adding proper search/modification callbacks

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2436 123451ca-8445-de46-9d55-352943316053

  1. … 12 more files in changeset.
Fixed issue in LSM indexes where OS file handles would not be closed properly if destroy() was called after deactivate(). This issue caused 'too many open files' during the Asterix runtime tests on a 32-bit Ubuntu.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2418 123451ca-8445-de46-9d55-352943316053

  1. … 5 more files in changeset.
Added LSM insert/delete operator that uses 'try' operations and partial flushing of Hyracks frames to avoid deadlocks with LSM component flushes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2414 123451ca-8445-de46-9d55-352943316053

  1. … 8 more files in changeset.
Added 'try' versions of LSM index operations to allow their caller to avoid potential deadlocks involving LSM flushes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2413 123451ca-8445-de46-9d55-352943316053

  1. … 8 more files in changeset.
Changed lsm io operation callback such that actions can be taken before and after executing the operation. This mechanism is going to be used by Asterix to inject the last lsn into components.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2412 123451ca-8445-de46-9d55-352943316053

  1. … 8 more files in changeset.
Fixed a space calculation bug in the the btree interior frame split. Formatted the code.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2411 123451ca-8445-de46-9d55-352943316053

  1. … 4 more files in changeset.
Changed operation tracker interface and implementations.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2404 123451ca-8445-de46-9d55-352943316053

  1. … 72 more files in changeset.
Changed operation tracker to include an externally called completeOperation() for finally declaring an operation inactive on an lsm index.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2363 123451ca-8445-de46-9d55-352943316053

  1. … 5 more files in changeset.
Split IOperationCallbackProvider into ISearchOperationCallbackFactory and IModificationOperationCallbackFactory since we are going to have a variety of implementations for them in Asterix.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2361 123451ca-8445-de46-9d55-352943316053

  1. … 29 more files in changeset.
Modified operation callback to include the after image in before().

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2360 123451ca-8445-de46-9d55-352943316053

  1. … 13 more files in changeset.
Changed the split in the rtree to be non-recursive by making sure the split can successfully insert the new tuple in either split pages assuming tuples are not bigger than half of the page size. Added test cases for the new rtree page split. Fixed a bug in the page header size calculations in btree and rtree.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2359 123451ca-8445-de46-9d55-352943316053

  1. … 11 more files in changeset.
Changed the btree page split to use tuples sizes in order to determine which tuples are going to move to the new page and added a test case.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2355 123451ca-8445-de46-9d55-352943316053

  1. … 4 more files in changeset.
- Changed the tree index interfaces so split return a boolean to indicate if the new tuple has been successfully inserted in either left or right page. - Removed unused code from the rtree frames.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2347 123451ca-8445-de46-9d55-352943316053

  1. … 7 more files in changeset.
added NOOP indexOperation

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1955 123451ca-8445-de46-9d55-352943316053

made naming of ILSMIndexAccessor implementations consistent; removed unused IIndexBulkloadContext interface; made AntimatterAwareTupleAccesor a singleton; miscellaneous cleanup in each of the ILSMIndex implementations;

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1953 123451ca-8445-de46-9d55-352943316053

  1. … 17 more files in changeset.