Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
new branch for merging lsm and fullstack

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_lsm_staging@3014 123451ca-8445-de46-9d55-352943316053

    • -640
    • +0
    ./hyracks/storage/am/lsm/btree/impls/LSMBTree.java
  1. … 1792 more files in changeset.
Minor changes based on Zack's code review.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2942 123451ca-8445-de46-9d55-352943316053

  1. … 2 more files in changeset.
Removed un-needed try catch.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2939 123451ca-8445-de46-9d55-352943316053

Make sure to close cursors whenever they are not needed anymore.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2938 123451ca-8445-de46-9d55-352943316053

Fixed the issue of not locking in-memory anti-mattered tuples in the LSM_BTree range cursor which may result in reading un-committed data.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2931 123451ca-8445-de46-9d55-352943316053

  1. … 4 more files in changeset.
Fixed a bug that could lead to wrong identification of LSM-BTree point searches.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2928 123451ca-8445-de46-9d55-352943316053

Optimized point search queries in LSM-BTree to open cursors sequentially (if they get the green light from their corresponding bloom filters). This optimization can also improve secondary-to-primary index lookup.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2895 123451ca-8445-de46-9d55-352943316053

    • -0
    • +128
    ./hyracks/storage/am/lsm/btree/impls/LSMBTreeSearchCursor.java
Minor variable renaming change.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2821 123451ca-8445-de46-9d55-352943316053

Minor changes in the index's dataflow operators to pass bloom filter information.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree_bloom_filter@2799 123451ca-8445-de46-9d55-352943316053

  1. … 34 more files in changeset.
All lsm indexes (BTree, RTree, and inverted index) are now using bloom filters whenever possible.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree_bloom_filter@2776 123451ca-8445-de46-9d55-352943316053

    • -16
    • +30
    ./hyracks/storage/am/lsm/btree/impls/LSMBTree.java
  1. … 54 more files in changeset.
Utilized bloom filters in LSM-BTree point search.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree_bloom_filter@2764 123451ca-8445-de46-9d55-352943316053

  1. … 4 more files in changeset.
Made sure bloom filters don't hold latches after insertion is over (pages are still pinned). Changed the bloom filter insertion to use a bulkload-like interface. Changed the bulkload interface for all indexes to accept number of elements hint. Various bug fixes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree_bloom_filter@2751 123451ca-8445-de46-9d55-352943316053

    • -46
    • +42
    ./hyracks/storage/am/lsm/btree/impls/LSMBTree.java
  1. … 25 more files in changeset.
changes towards recovery

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2735 123451ca-8445-de46-9d55-352943316053

  1. … 11 more files in changeset.
Fixed a bug in the lsm btree file manager.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree_bloom_filter@2730 123451ca-8445-de46-9d55-352943316053

Integrated bloom filters with LSM-BTree during flushes, merges, and bulkload. All tests pass except the merge test due to what it seems a bug in the cleanup after merges if there are no search threads accessing the disk components. Next is to use bloom filters during search and also with other lsm indexes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree_bloom_filter@2706 123451ca-8445-de46-9d55-352943316053

    • -35
    • +111
    ./hyracks/storage/am/lsm/btree/impls/LSMBTree.java
  1. … 24 more files in changeset.
added option to conditionally flush an LSM index when it is being deactivated; added missing file from previous commit

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2702 123451ca-8445-de46-9d55-352943316053

  1. … 6 more files in changeset.
added proper IO Opcallback for when LSM indexes are deactivatd

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2701 123451ca-8445-de46-9d55-352943316053

  1. … 62 more files in changeset.
major reworking of all lsm indexes with respect to synchronization and interfacing with the lsmharness

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2681 123451ca-8445-de46-9d55-352943316053

    • -189
    • +171
    ./hyracks/storage/am/lsm/btree/impls/LSMBTree.java
    • -0
    • +47
    ./hyracks/storage/am/lsm/btree/impls/LSMBTreeMutableComponent.java
  1. … 59 more files in changeset.
minor cleanup: fixed typo; swapped sync objects for sync on 'this'

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2612 123451ca-8445-de46-9d55-352943316053

  1. … 8 more files in changeset.
getWrite/ReadDevices returns Set instead of List; RTree IO operations now also returns buddy btree devices; hid merge/flush behind internal interface;

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2611 123451ca-8445-de46-9d55-352943316053

  1. … 13 more files in changeset.
merged the creation and scheduling of flushes and merge IO operations to a single call

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2610 123451ca-8445-de46-9d55-352943316053

  1. … 18 more files in changeset.
removed flush controller; ILSMIndex replaces the functionality

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2609 123451ca-8445-de46-9d55-352943316053

  1. … 67 more files in changeset.
Allowing LSM file managers to be initialized with a starting IO device index. Using that mechanism, the first disk component of the i-th partition of an Asterix LSM index is written on the i-th IO device (further components are assigned to IO devices in a round robin fashion).

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2585 123451ca-8445-de46-9d55-352943316053

  1. … 13 more files in changeset.
* The cleanup of the merged components in the LSM indexes is now the responsibility of either: the last existing search thread (in case the merge process is over and there are still search threads accessing the merged components), or the merge thread itself (in case the merge process is over and there are no search threads accessing the merged components). * Allowed concurrent merges to occur at the same time instead of the old design which only allowed one merge process at a time per LSM index.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2573 123451ca-8445-de46-9d55-352943316053

    • -19
    • +49
    ./hyracks/storage/am/lsm/btree/impls/LSMBTree.java
  1. … 27 more files in changeset.
Refactored the LSM-indexes to use common abstract class. Added new ILSMComponent interface to represents the LSMComponents instead of passing Objects all around the place. Removed the component finalizers classes and cleaned the file manager API. Fixed couple of bugs. Cleaned the code and changed the names of many methods.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2552 123451ca-8445-de46-9d55-352943316053

    • -164
    • +126
    ./hyracks/storage/am/lsm/btree/impls/LSMBTree.java
    • -0
    • +70
    ./hyracks/storage/am/lsm/btree/impls/LSMBTreeComponent.java
    • -0
    • +42
    ./hyracks/storage/am/lsm/btree/impls/LSMBTreeComponentFactory.java
  1. … 45 more files in changeset.
Minor amendment to my multicomparator changes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2538 123451ca-8445-de46-9d55-352943316053

  1. … 8 more files in changeset.
fixed null pointer exception during undo for rollback

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2495 123451ca-8445-de46-9d55-352943316053

changes to handle null pointer exception when creating OPTracker

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2456 123451ca-8445-de46-9d55-352943316053

  1. … 2 more files in changeset.
Fixed issue in LSM indexes where OS file handles would not be closed properly if destroy() was called after deactivate(). This issue caused 'too many open files' during the Asterix runtime tests on a 32-bit Ubuntu.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2418 123451ca-8445-de46-9d55-352943316053

  1. … 5 more files in changeset.
Fixed a space calculation bug in the the btree interior frame split. Formatted the code.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2411 123451ca-8445-de46-9d55-352943316053

  1. … 6 more files in changeset.