Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Changed partitioning field in length-partitioned inverted indexes from integer to short.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_length_filter@2486 123451ca-8445-de46-9d55-352943316053

    • -5
    • +4
    ./api/IInvertedIndexSearchModifier.java
    • -14
    • +14
    ./inmemory/PartitionedInMemoryInvertedIndex.java
    • -3
    • +3
    ./ondisk/PartitionedOnDiskInvertedIndex.java
    • -2
    • +2
    ./search/ConjunctiveSearchModifier.java
    • -6
    • +6
    ./search/EditDistanceSearchModifier.java
    • -9
    • +9
    ./search/PartitionedTOccurrenceSearcher.java
    • -4
    • +4
    ./util/PartitionedInvertedIndexTokenizingTupleIterator.java
  1. … 3 more files in changeset.
Changed the search algorithm for in-memory length-partitioned inverted indexes to only latch one inverted list at a time.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_length_filter@2485 123451ca-8445-de46-9d55-352943316053

    • -12
    • +14
    ./inmemory/InMemoryInvertedListCursor.java
    • -10
    • +0
    ./inmemory/PartitionedInMemoryInvertedIndex.java
    • -7
    • +0
    ./ondisk/PartitionedOnDiskInvertedIndex.java
    • -1
    • +0
    ./search/PartitionedTOccurrenceSearcher.java
  1. … 1 more file in changeset.
Implemented length-partitioned LSM inverted index. Still some cleanup needed.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_length_filter@2467 123451ca-8445-de46-9d55-352943316053

    • -3
    • +4
    ./impls/LSMInvertedIndexOpContext.java
    • -0
    • +56
    ./impls/PartitionedLSMInvertedIndex.java
    • -4
    • +0
    ./inmemory/InMemoryInvertedListCursor.java
    • -11
    • +16
    ./inmemory/PartitionedInMemoryInvertedIndex.java
    • -0
    • +48
    ./ondisk/PartitionedOnDiskInvertedIndexFactory.java
  1. … 9 more files in changeset.
Implemented in-memory component for length-partitioned inverted indexes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_length_filter@2466 123451ca-8445-de46-9d55-352943316053

    • -0
    • +31
    ./api/IPartitionedInvertedIndex.java
    • -4
    • +8
    ./inmemory/InMemoryInvertedIndexAccessor.java
    • -6
    • +9
    ./inmemory/InMemoryInvertedIndexOpContext.java
    • -9
    • +16
    ./inmemory/InMemoryInvertedListCursor.java
    • -0
    • +136
    ./inmemory/PartitionedInMemoryInvertedIndex.java
    • -0
    • +31
    ./inmemory/PartitionedInMemoryInvertedIndexAccessor.java
    • -0
    • +36
    ./inmemory/PartitionedInMemoryInvertedIndexOpContext.java
    • -6
    • +31
    ./ondisk/PartitionedOnDiskInvertedIndex.java
    • -18
    • +10
    ./search/InvertedListPartitions.java
    • -53
    • +63
    ./search/PartitionedTOccurrenceSearcher.java
    • -68
    • +0
    ./util/InvertedIndexTokenizingNumTokensTupleIterator.java
  1. … 7 more files in changeset.
Refactored code for better sharing. Added new test for on-disk component of length-partitioned inverted index.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_length_filter@2465 123451ca-8445-de46-9d55-352943316053

    • -85
    • +5
    ./ondisk/PartitionedOnDiskInvertedIndex.java
    • -0
    • +154
    ./search/AbstractTOccurrenceSearcher.java
    • -0
    • +102
    ./search/InvertedListPartitions.java
    • -129
    • +9
    ./search/PartitionedTOccurrenceSearcher.java
    • -133
    • +9
    ./search/TOccurrenceSearcher.java
  1. … 1 more file in changeset.
Implemented bulk loading and basic search for the on-disk components of length-partitioned inverted indexes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_length_filter@2462 123451ca-8445-de46-9d55-352943316053

    • -1
    • +1
    ./api/IInvertedIndexSearchModifier.java
    • -4
    • +26
    ./ondisk/PartitionedOnDiskInvertedIndex.java
    • -1
    • +1
    ./search/ConjunctiveSearchModifier.java
    • -2
    • +2
    ./search/EditDistanceSearchModifier.java
    • -0
    • +330
    ./search/InvertedListMerger.java
    • -385
    • +37
    ./search/PartitionedTOccurrenceSearcher.java
    • -298
    • +21
    ./search/TOccurrenceSearcher.java
  1. … 2 more files in changeset.
Checkpointing progress on implementing a length-partitioned inverted index.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_length_filter@2455 123451ca-8445-de46-9d55-352943316053

    • -0
    • +20
    ./api/IObjectFactory.java
    • -35
    • +41
    ./ondisk/OnDiskInvertedIndex.java
    • -0
    • +5
    ./ondisk/OnDiskInvertedIndexOpContext.java
    • -0
    • +145
    ./ondisk/PartitionedOnDiskInvertedIndex.java
    • -0
    • +27
    ./search/ArrayListFactory.java
    • -0
    • +34
    ./search/InvertedListCursorFactory.java
    • -0
    • +607
    ./search/PartitionedTOccurrenceSearcher.java
    • -0
    • +139
    ./search/SearchResult.java
    • -140
    • +68
    ./search/TOccurrenceSearcher.java
    • -95
    • +0
    ./search/TOccurrenceSearcherSuffixProbeOnly.java
    • -134
    • +0
    ./search/TOccurrenceSearcherSuffixScanOnly.java
    • -0
    • +51
    ./util/ObjectCache.java
  1. … 3 more files in changeset.
First steps in preparing the inverted-index testing framework to deal with length partitioning.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_length_filter@2454 123451ca-8445-de46-9d55-352943316053

    • -0
    • +4
    ./api/IInvertedIndexSearchModifier.java
    • -0
    • +10
    ./search/ConjunctiveSearchModifier.java
    • -0
    • +10
    ./search/EditDistanceSearchModifier.java
    • -0
    • +10
    ./search/JaccardSearchModifier.java
    • -0
    • +68
    ./util/InvertedIndexTokenizingNumTokensTupleIterator.java
    • -6
    • +6
    ./util/InvertedIndexTokenizingTupleIterator.java
  1. … 2 more files in changeset.
Some generalizations to support length filtering.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_length_filter@2453 123451ca-8445-de46-9d55-352943316053

    • -24
    • +40
    ./ondisk/OnDiskInvertedIndex.java
Fixed issue in LSM indexes where OS file handles would not be closed properly if destroy() was called after deactivate(). This issue caused 'too many open files' during the Asterix runtime tests on a 32-bit Ubuntu.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2418 123451ca-8445-de46-9d55-352943316053

  1. … 4 more files in changeset.
Added LSM insert/delete operator that uses 'try' operations and partial flushing of Hyracks frames to avoid deadlocks with LSM component flushes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2414 123451ca-8445-de46-9d55-352943316053

    • -3
    • +3
    ./dataflow/LSMInvertedIndexInsertUpdateDeleteOperator.java
    • -0
    • +10
    ./impls/LSMInvertedIndexAccessor.java
  1. … 7 more files in changeset.
Added 'try' versions of LSM index operations to allow their caller to avoid potential deadlocks involving LSM flushes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2413 123451ca-8445-de46-9d55-352943316053

    • -2
    • +24
    ./impls/LSMInvertedIndexAccessor.java
  1. … 8 more files in changeset.
Another round of interface changes for the operation tracker.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2405 123451ca-8445-de46-9d55-352943316053

    • -2
    • +12
    ./impls/LSMInvertedIndexOpContext.java
    • -2
    • +7
    ./impls/LSMInvertedIndexRangeSearchCursor.java
    • -1
    • +4
    ./impls/LSMInvertedIndexSearchCursor.java
    • -1
    • +2
    ./impls/LSMInvertedIndexSearchCursorInitialState.java
  1. … 19 more files in changeset.
Changed operation tracker interface and implementations.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2404 123451ca-8445-de46-9d55-352943316053

    • -7
    • +8
    ./dataflow/LSMInvertedIndexDataflowHelper.java
    • -5
    • +5
    ./dataflow/LSMInvertedIndexDataflowHelperFactory.java
    • -1
    • +2
    ./impls/LSMInvertedIndexOpContext.java
    • -0
    • +5
    ./inmemory/InMemoryInvertedIndexOpContext.java
    • -0
    • +5
    ./ondisk/OnDiskInvertedIndexOpContext.java
  1. … 66 more files in changeset.
Split IOperationCallbackProvider into ISearchOperationCallbackFactory and IModificationOperationCallbackFactory since we are going to have a variety of implementations for them in Asterix.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2361 123451ca-8445-de46-9d55-352943316053

    • -5
    • +8
    ./dataflow/AbstractLSMInvertedIndexOperatorDescriptor.java
    • -4
    • +5
    ./dataflow/LSMInvertedIndexBulkLoadOperatorDescriptor.java
    • -4
    • +7
    ./dataflow/LSMInvertedIndexCreateOperatorDescriptor.java
    • -3
    • +5
    ./dataflow/LSMInvertedIndexInsertUpdateDeleteOperator.java
    • -4
    • +5
    ./dataflow/LSMInvertedIndexSearchOperatorDescriptor.java
  1. … 38 more files in changeset.
Modified operation callback to include the after image in before().

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2360 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./dataflow/AbstractLSMInvertedIndexOperatorDescriptor.java
    • -2
    • +2
    ./dataflow/LSMInvertedIndexBulkLoadOperatorDescriptor.java
    • -2
    • +2
    ./dataflow/LSMInvertedIndexCreateOperatorDescriptor.java
    • -2
    • +2
    ./dataflow/LSMInvertedIndexInsertUpdateDeleteOperator.java
    • -2
    • +2
    ./dataflow/LSMInvertedIndexSearchOperatorDescriptor.java
  1. … 22 more files in changeset.
removed unnecessary retrying of inserts code from LSMHarness and ILSMIndexes; added ILSMIndexInternal interface that the ILSMHarness uses to talk to ILSMIndexes (internally) -- this allows properly exposed interfaces to an "outside" user;

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1954 123451ca-8445-de46-9d55-352943316053

  1. … 5 more files in changeset.
made naming of ILSMIndexAccessor implementations consistent; removed unused IIndexBulkloadContext interface; made AntimatterAwareTupleAccesor a singleton; miscellaneous cleanup in each of the ILSMIndex implementations;

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1953 123451ca-8445-de46-9d55-352943316053

    • -12
    • +12
    ./impls/LSMInvertedIndexAccessor.java
    • -11
    • +11
    ./impls/LSMInvertedIndexRangeSearchCursorInitialState.java
    • -9
    • +9
    ./impls/LSMInvertedIndexSearchCursor.java
    • -7
    • +7
    ./impls/LSMInvertedIndexSearchCursorInitialState.java
  1. … 13 more files in changeset.
added IInMemoryFreePageManager & IInMemoryBufferCache interfaces

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1949 123451ca-8445-de46-9d55-352943316053

    • -4
    • +4
    ./dataflow/LSMInvertedIndexDataflowHelper.java
  1. … 22 more files in changeset.
Removed unused package edu.uci.ics.hyracks.storage.am.common.lifecycle; Removed usesless IndexType class; Removed duplicate copy of IExperimentRunner; Removed getIOManager() call from ILSMIndexFileManager; IIndexOperationContext: startOperation() --rename--> setOperation(); Changed ILSMIOOperationScheduler.scheduleOperation() to throw HyracksDataException;

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1946 123451ca-8445-de46-9d55-352943316053

    • -1
    • +1
    ./impls/LSMInvertedIndexOpContext.java
    • -2
    • +2
    ./inmemory/InMemoryInvertedIndexAccessor.java
    • -1
    • +1
    ./inmemory/InMemoryInvertedIndexOpContext.java
    • -20
    • +15
    ./ondisk/OnDiskInvertedIndex.java
    • -1
    • +1
    ./ondisk/OnDiskInvertedIndexOpContext.java
  1. … 19 more files in changeset.
replaced the IIndexArtifactMap interface with the ILocalResourceRepository interface

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1942 123451ca-8445-de46-9d55-352943316053

    • -12
    • +14
    ./dataflow/AbstractLSMInvertedIndexOperatorDescriptor.java
    • -1
    • +3
    ./dataflow/LSMInvertedIndexBulkLoadOperatorDescriptor.java
    • -2
    • +4
    ./dataflow/LSMInvertedIndexCreateOperatorDescriptor.java
    • -1
    • +2
    ./dataflow/LSMInvertedIndexInsertUpdateDeleteOperator.java
    • -1
    • +3
    ./dataflow/LSMInvertedIndexSearchOperatorDescriptor.java
  1. … 42 more files in changeset.
renamed IIndexOpContext and its methods for clarity

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1922 123451ca-8445-de46-9d55-352943316053

    • -3
    • +3
    ./dataflow/LSMInvertedIndexInsertUpdateDeleteOperator.java
    • -6
    • +6
    ./impls/LSMInvertedIndexOpContext.java
    • -3
    • +3
    ./impls/LSMInvertedIndexSearchCursorInitialState.java
    • -6
    • +6
    ./inmemory/InMemoryInvertedIndexAccessor.java
    • -5
    • +5
    ./inmemory/InMemoryInvertedIndexOpContext.java
    • -4
    • +4
    ./ondisk/OnDiskInvertedIndexOpContext.java
    • -3
    • +3
    ./ondisk/OnDiskInvertedIndexRangeSearchCursor.java
  1. … 23 more files in changeset.
fixed bug in jaccard occurrence threshold computation to always return a positive (non-zero) value

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1902 123451ca-8445-de46-9d55-352943316053

fixed bug in index lifecycle: create() clears the in-memory state of an index instance as it should

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1901 123451ca-8445-de46-9d55-352943316053

  1. … 2 more files in changeset.
More index operator cleanup for better code sharing with the lsm inverted index.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1894 123451ca-8445-de46-9d55-352943316053

    • -0
    • +60
    ./dataflow/LSMInvertedIndexInsertUpdateDeleteOperator.java
    • -2
    • +2
    ./dataflow/LSMInvertedIndexSearchOperatorDescriptor.java
    • -134
    • +29
    ./dataflow/LSMInvertedIndexSearchOperatorNodePushable.java
    • -2
    • +1
    ./inmemory/InMemoryInvertedIndexAccessor.java
    • -5
    • +14
    ./ondisk/OnDiskInvertedIndexSearchCursor.java
  1. … 10 more files in changeset.
set ignore properties

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1892 123451ca-8445-de46-9d55-352943316053

    • -3
    • +3
    ./dataflow/LSMInvertedIndexDataflowHelperFactory.java
More index operator cleanup.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1885 123451ca-8445-de46-9d55-352943316053

    • -2
    • +5
    ./dataflow/LSMInvertedIndexBulkLoadOperatorDescriptor.java
    • -98
    • +0
    ./dataflow/LSMInvertedIndexBulkLoadOperatorNodePushable.java
    • -1
    • +1
    ./dataflow/LSMInvertedIndexDataflowHelper.java
    • -1
    • +1
    ./dataflow/LSMInvertedIndexSearchOperatorNodePushable.java
    • -1
    • +1
    ./impls/LSMInvertedIndexOpContext.java
  1. … 52 more files in changeset.
First phase of cleaning up index operators for better code sharing.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1884 123451ca-8445-de46-9d55-352943316053

    • -5
    • +7
    ./api/IInvertedIndexOperatorDescriptor.java
    • -87
    • +14
    ./dataflow/AbstractLSMInvertedIndexOperatorDescriptor.java
    • -10
    • +10
    ./dataflow/LSMInvertedIndexBulkLoadOperatorDescriptor.java
    • -10
    • +10
    ./dataflow/LSMInvertedIndexCreateOperatorDescriptor.java
    • -54
    • +0
    ./dataflow/LSMInvertedIndexCreateOperatorNodePushable.java
    • -28
    • +13
    ./dataflow/LSMInvertedIndexDataflowHelper.java
    • -9
    • +8
    ./dataflow/LSMInvertedIndexSearchOperatorDescriptor.java
  1. … 12 more files in changeset.
Switched inverted-index operators to lsm-inverted-index. Minor cleaning for better code sharing.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1883 123451ca-8445-de46-9d55-352943316053

    • -3
    • +3
    ./api/IInvertedIndexOperatorDescriptor.java
    • -157
    • +0
    ./dataflow/AbstractInvertedIndexOperatorDescriptor.java
    • -0
    • +157
    ./dataflow/AbstractLSMInvertedIndexOperatorDescriptor.java
    • -56
    • +0
    ./dataflow/InvertedIndexBulkLoadOperatorDescriptor.java
    • -96
    • +0
    ./dataflow/InvertedIndexBulkLoadOperatorNodePushable.java
    • -52
    • +0
    ./dataflow/InvertedIndexCreateOperatorDescriptor.java
    • -53
    • +0
    ./dataflow/InvertedIndexCreateOperatorNodePushable.java
    • -52
    • +0
    ./dataflow/InvertedIndexDataflowHelper.java
    • -33
    • +0
    ./dataflow/InvertedIndexDataflowHelperFactory.java
    • -64
    • +0
    ./dataflow/InvertedIndexSearchOperatorDescriptor.java
    • -163
    • +0
    ./dataflow/InvertedIndexSearchOperatorNodePushable.java
    • -0
    • +56
    ./dataflow/LSMInvertedIndexBulkLoadOperatorDescriptor.java
    • -0
    • +98
    ./dataflow/LSMInvertedIndexBulkLoadOperatorNodePushable.java
    • -0
    • +52
    ./dataflow/LSMInvertedIndexCreateOperatorDescriptor.java
    • -0
    • +54
    ./dataflow/LSMInvertedIndexCreateOperatorNodePushable.java
  1. … 27 more files in changeset.
Properly Using op callbacks in the lsm inverted index.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1882 123451ca-8445-de46-9d55-352943316053

    • -17
    • +16
    ./impls/LSMInvertedIndexAccessor.java
    • -1
    • +9
    ./impls/LSMInvertedIndexOpContext.java
    • -0
    • +5
    ./impls/LSMInvertedIndexRangeSearchCursor.java
    • -4
    • +12
    ./impls/LSMInvertedIndexSearchCursor.java
    • -4
    • +6
    ./impls/LSMInvertedIndexSearchCursorInitialState.java
  1. … 2 more files in changeset.