Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
added proper IO Opcallback for when LSM indexes are deactivatd

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2701 123451ca-8445-de46-9d55-352943316053

  1. … 63 more files in changeset.
major reworking of all lsm indexes with respect to synchronization and interfacing with the lsmharness

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2681 123451ca-8445-de46-9d55-352943316053

    • -0
    • +35
    ./LSMRTreeImmutableComponent.java
    • -0
    • +56
    ./LSMRTreeMutableComponent.java
    • -66
    • +65
    ./LSMRTreeWithAntiMatterTuples.java
    • -1
    • +1
    ./LSMRTreeWithAntiMatterTuplesComponentFactory.java
  1. … 53 more files in changeset.
minor cleanup: fixed typo; swapped sync objects for sync on 'this'

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2612 123451ca-8445-de46-9d55-352943316053

  1. … 8 more files in changeset.
getWrite/ReadDevices returns Set instead of List; RTree IO operations now also returns buddy btree devices; hid merge/flush behind internal interface;

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2611 123451ca-8445-de46-9d55-352943316053

  1. … 11 more files in changeset.
merged the creation and scheduling of flushes and merge IO operations to a single call

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2610 123451ca-8445-de46-9d55-352943316053

  1. … 16 more files in changeset.
removed flush controller; ILSMIndex replaces the functionality

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2609 123451ca-8445-de46-9d55-352943316053

  1. … 68 more files in changeset.
Allowing LSM file managers to be initialized with a starting IO device index. Using that mechanism, the first disk component of the i-th partition of an Asterix LSM index is written on the i-th IO device (further components are assigned to IO devices in a round robin fashion).

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2585 123451ca-8445-de46-9d55-352943316053

  1. … 14 more files in changeset.
* The cleanup of the merged components in the LSM indexes is now the responsibility of either: the last existing search thread (in case the merge process is over and there are still search threads accessing the merged components), or the merge thread itself (in case the merge process is over and there are no search threads accessing the merged components). * Allowed concurrent merges to occur at the same time instead of the old design which only allowed one merge process at a time per LSM index.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2573 123451ca-8445-de46-9d55-352943316053

    • -17
    • +19
    ./LSMRTreeCursorInitialState.java
    • -16
    • +13
    ./LSMRTreeWithAntiMatterTuples.java
    • -2
    • +2
    ./LSMRTreeWithAntiMatterTuplesSearchCursor.java
  1. … 22 more files in changeset.
Refactored the LSM-indexes to use common abstract class. Added new ILSMComponent interface to represents the LSMComponents instead of passing Objects all around the place. Removed the component finalizers classes and cleaned the file manager API. Fixed couple of bugs. Cleaned the code and changed the names of many methods.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2552 123451ca-8445-de46-9d55-352943316053

    • -0
    • +76
    ./LSMRTreeComponent.java
    • -0
    • +46
    ./LSMRTreeComponentFactory.java
    • -91
    • +122
    ./LSMRTreeWithAntiMatterTuples.java
    • -0
    • +42
    ./LSMRTreeWithAntiMatterTuplesComponentFactory.java
  1. … 40 more files in changeset.
Fixed a few remaining issues regarding closing of OS file handles.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2419 123451ca-8445-de46-9d55-352943316053

  1. … 1 more file in changeset.
Fixed issue in LSM indexes where OS file handles would not be closed properly if destroy() was called after deactivate(). This issue caused 'too many open files' during the Asterix runtime tests on a 32-bit Ubuntu.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2418 123451ca-8445-de46-9d55-352943316053

  1. … 5 more files in changeset.
Changed lsm io operation callback such that actions can be taken before and after executing the operation. This mechanism is going to be used by Asterix to inject the last lsn into components.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2412 123451ca-8445-de46-9d55-352943316053

  1. … 9 more files in changeset.
Another round of interface changes for the operation tracker.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2405 123451ca-8445-de46-9d55-352943316053

    • -2
    • +8
    ./LSMRTreeWithAntiMatterTuplesSearchCursor.java
  1. … 18 more files in changeset.
Changed operation tracker interface and implementations.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2404 123451ca-8445-de46-9d55-352943316053

  1. … 69 more files in changeset.
removed unnecessary retrying of inserts code from LSMHarness and ILSMIndexes; added ILSMIndexInternal interface that the ILSMHarness uses to talk to ILSMIndexes (internally) -- this allows properly exposed interfaces to an "outside" user;

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1954 123451ca-8445-de46-9d55-352943316053

  1. … 5 more files in changeset.
made naming of ILSMIndexAccessor implementations consistent; removed unused IIndexBulkloadContext interface; made AntimatterAwareTupleAccesor a singleton; miscellaneous cleanup in each of the ILSMIndex implementations;

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1953 123451ca-8445-de46-9d55-352943316053

  1. … 13 more files in changeset.
added IInMemoryFreePageManager & IInMemoryBufferCache interfaces

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1949 123451ca-8445-de46-9d55-352943316053

    • -10
    • +12
    ./LSMRTreeWithAntiMatterTuples.java
  1. … 22 more files in changeset.
Removed unused package edu.uci.ics.hyracks.storage.am.common.lifecycle; Removed usesless IndexType class; Removed duplicate copy of IExperimentRunner; Removed getIOManager() call from ILSMIndexFileManager; IIndexOperationContext: startOperation() --rename--> setOperation(); Changed ILSMIOOperationScheduler.scheduleOperation() to throw HyracksDataException;

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1946 123451ca-8445-de46-9d55-352943316053

  1. … 25 more files in changeset.
renamed IIndexOpContext and its methods for clarity

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1922 123451ca-8445-de46-9d55-352943316053

  1. … 33 more files in changeset.
fixed bug in index lifecycle: create() clears the in-memory state of an index instance as it should

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1901 123451ca-8445-de46-9d55-352943316053

  1. … 2 more files in changeset.
Fixed a few multi-threading issues in the lsm-inverted-index. Still some more to go.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1871 123451ca-8445-de46-9d55-352943316053

    • -1
    • +1
    ./LSMRTreeWithAntiMatterTuplesSearchCursor.java
  1. … 18 more files in changeset.
Added tests for gram-based indexes, and hashed tokens.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1868 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./LSMRTreeWithAntiMatterTuplesSearchCursor.java
  1. … 22 more files in changeset.
First steps to getting delete working.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1851 123451ca-8445-de46-9d55-352943316053

  1. … 11 more files in changeset.
Implemented lsm-inverted-index merge. Added test.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1850 123451ca-8445-de46-9d55-352943316053

  1. … 17 more files in changeset.
Implemented lsm inverted index range search cursor that is used in merges.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1847 123451ca-8445-de46-9d55-352943316053

    • -9
    • +2
    ./LSMRTreeWithAntiMatterTuplesSearchCursor.java
  1. … 9 more files in changeset.
Added component finalizer for lsm inverted index. Started to implement corresponding index file manager.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1832 123451ca-8445-de46-9d55-352943316053

  1. … 14 more files in changeset.
More cleaning and prepwork.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1808 123451ca-8445-de46-9d55-352943316053

    • -46
    • +0
    ./LSMRTreeInMemoryFreePageManager.java
  1. … 60 more files in changeset.
Reworked in-memory inverted index that buffers insertions. Still needs testing.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1804 123451ca-8445-de46-9d55-352943316053

  1. … 20 more files in changeset.
removed traces of search op callback in RTrees

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1796 123451ca-8445-de46-9d55-352943316053

  1. … 4 more files in changeset.
added LRU strategy to index lifecycle manager

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1789 123451ca-8445-de46-9d55-352943316053

  1. … 6 more files in changeset.