Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
First steps in preparing the inverted-index testing framework to deal with length partitioning.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_length_filter@2454 123451ca-8445-de46-9d55-352943316053

    • -0
    • +4
    ./api/IInvertedIndexSearchModifier.java
    • -0
    • +10
    ./search/ConjunctiveSearchModifier.java
    • -0
    • +10
    ./search/EditDistanceSearchModifier.java
    • -0
    • +10
    ./search/JaccardSearchModifier.java
    • -0
    • +68
    ./util/InvertedIndexTokenizingNumTokensTupleIterator.java
    • -6
    • +6
    ./util/InvertedIndexTokenizingTupleIterator.java
  1. … 2 more files in changeset.
Some generalizations to support length filtering.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_length_filter@2453 123451ca-8445-de46-9d55-352943316053

    • -24
    • +40
    ./ondisk/OnDiskInvertedIndex.java
Fixed issue in LSM indexes where OS file handles would not be closed properly if destroy() was called after deactivate(). This issue caused 'too many open files' during the Asterix runtime tests on a 32-bit Ubuntu.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2418 123451ca-8445-de46-9d55-352943316053

  1. … 4 more files in changeset.
Added LSM insert/delete operator that uses 'try' operations and partial flushing of Hyracks frames to avoid deadlocks with LSM component flushes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2414 123451ca-8445-de46-9d55-352943316053

    • -3
    • +3
    ./dataflow/LSMInvertedIndexInsertUpdateDeleteOperator.java
    • -0
    • +10
    ./impls/LSMInvertedIndexAccessor.java
  1. … 7 more files in changeset.
Added 'try' versions of LSM index operations to allow their caller to avoid potential deadlocks involving LSM flushes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2413 123451ca-8445-de46-9d55-352943316053

    • -2
    • +24
    ./impls/LSMInvertedIndexAccessor.java
  1. … 8 more files in changeset.
Another round of interface changes for the operation tracker.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2405 123451ca-8445-de46-9d55-352943316053

    • -2
    • +12
    ./impls/LSMInvertedIndexOpContext.java
    • -2
    • +7
    ./impls/LSMInvertedIndexRangeSearchCursor.java
    • -1
    • +4
    ./impls/LSMInvertedIndexSearchCursor.java
    • -1
    • +2
    ./impls/LSMInvertedIndexSearchCursorInitialState.java
  1. … 19 more files in changeset.
Changed operation tracker interface and implementations.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2404 123451ca-8445-de46-9d55-352943316053

    • -7
    • +8
    ./dataflow/LSMInvertedIndexDataflowHelper.java
    • -5
    • +5
    ./dataflow/LSMInvertedIndexDataflowHelperFactory.java
    • -1
    • +2
    ./impls/LSMInvertedIndexOpContext.java
    • -0
    • +5
    ./inmemory/InMemoryInvertedIndexOpContext.java
    • -0
    • +5
    ./ondisk/OnDiskInvertedIndexOpContext.java
  1. … 66 more files in changeset.
Split IOperationCallbackProvider into ISearchOperationCallbackFactory and IModificationOperationCallbackFactory since we are going to have a variety of implementations for them in Asterix.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2361 123451ca-8445-de46-9d55-352943316053

    • -5
    • +8
    ./dataflow/AbstractLSMInvertedIndexOperatorDescriptor.java
    • -4
    • +5
    ./dataflow/LSMInvertedIndexBulkLoadOperatorDescriptor.java
    • -4
    • +7
    ./dataflow/LSMInvertedIndexCreateOperatorDescriptor.java
    • -3
    • +5
    ./dataflow/LSMInvertedIndexInsertUpdateDeleteOperator.java
    • -4
    • +5
    ./dataflow/LSMInvertedIndexSearchOperatorDescriptor.java
  1. … 38 more files in changeset.
Modified operation callback to include the after image in before().

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@2360 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./dataflow/AbstractLSMInvertedIndexOperatorDescriptor.java
    • -2
    • +2
    ./dataflow/LSMInvertedIndexBulkLoadOperatorDescriptor.java
    • -2
    • +2
    ./dataflow/LSMInvertedIndexCreateOperatorDescriptor.java
    • -2
    • +2
    ./dataflow/LSMInvertedIndexInsertUpdateDeleteOperator.java
    • -2
    • +2
    ./dataflow/LSMInvertedIndexSearchOperatorDescriptor.java
  1. … 22 more files in changeset.
removed unnecessary retrying of inserts code from LSMHarness and ILSMIndexes; added ILSMIndexInternal interface that the ILSMHarness uses to talk to ILSMIndexes (internally) -- this allows properly exposed interfaces to an "outside" user;

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1954 123451ca-8445-de46-9d55-352943316053

  1. … 5 more files in changeset.
made naming of ILSMIndexAccessor implementations consistent; removed unused IIndexBulkloadContext interface; made AntimatterAwareTupleAccesor a singleton; miscellaneous cleanup in each of the ILSMIndex implementations;

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1953 123451ca-8445-de46-9d55-352943316053

    • -12
    • +12
    ./impls/LSMInvertedIndexAccessor.java
    • -11
    • +11
    ./impls/LSMInvertedIndexRangeSearchCursorInitialState.java
    • -9
    • +9
    ./impls/LSMInvertedIndexSearchCursor.java
    • -7
    • +7
    ./impls/LSMInvertedIndexSearchCursorInitialState.java
  1. … 13 more files in changeset.
added IInMemoryFreePageManager & IInMemoryBufferCache interfaces

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1949 123451ca-8445-de46-9d55-352943316053

    • -4
    • +4
    ./dataflow/LSMInvertedIndexDataflowHelper.java
  1. … 22 more files in changeset.
Removed unused package edu.uci.ics.hyracks.storage.am.common.lifecycle; Removed usesless IndexType class; Removed duplicate copy of IExperimentRunner; Removed getIOManager() call from ILSMIndexFileManager; IIndexOperationContext: startOperation() --rename--> setOperation(); Changed ILSMIOOperationScheduler.scheduleOperation() to throw HyracksDataException;

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1946 123451ca-8445-de46-9d55-352943316053

    • -1
    • +1
    ./impls/LSMInvertedIndexOpContext.java
    • -2
    • +2
    ./inmemory/InMemoryInvertedIndexAccessor.java
    • -1
    • +1
    ./inmemory/InMemoryInvertedIndexOpContext.java
    • -20
    • +15
    ./ondisk/OnDiskInvertedIndex.java
    • -1
    • +1
    ./ondisk/OnDiskInvertedIndexOpContext.java
  1. … 19 more files in changeset.
replaced the IIndexArtifactMap interface with the ILocalResourceRepository interface

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1942 123451ca-8445-de46-9d55-352943316053

    • -12
    • +14
    ./dataflow/AbstractLSMInvertedIndexOperatorDescriptor.java
    • -1
    • +3
    ./dataflow/LSMInvertedIndexBulkLoadOperatorDescriptor.java
    • -2
    • +4
    ./dataflow/LSMInvertedIndexCreateOperatorDescriptor.java
    • -1
    • +2
    ./dataflow/LSMInvertedIndexInsertUpdateDeleteOperator.java
    • -1
    • +3
    ./dataflow/LSMInvertedIndexSearchOperatorDescriptor.java
  1. … 42 more files in changeset.
renamed IIndexOpContext and its methods for clarity

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1922 123451ca-8445-de46-9d55-352943316053

    • -3
    • +3
    ./dataflow/LSMInvertedIndexInsertUpdateDeleteOperator.java
    • -6
    • +6
    ./impls/LSMInvertedIndexOpContext.java
    • -3
    • +3
    ./impls/LSMInvertedIndexSearchCursorInitialState.java
    • -6
    • +6
    ./inmemory/InMemoryInvertedIndexAccessor.java
    • -5
    • +5
    ./inmemory/InMemoryInvertedIndexOpContext.java
    • -4
    • +4
    ./ondisk/OnDiskInvertedIndexOpContext.java
    • -3
    • +3
    ./ondisk/OnDiskInvertedIndexRangeSearchCursor.java
  1. … 23 more files in changeset.
fixed bug in jaccard occurrence threshold computation to always return a positive (non-zero) value

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1902 123451ca-8445-de46-9d55-352943316053

fixed bug in index lifecycle: create() clears the in-memory state of an index instance as it should

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1901 123451ca-8445-de46-9d55-352943316053

  1. … 2 more files in changeset.
More index operator cleanup for better code sharing with the lsm inverted index.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1894 123451ca-8445-de46-9d55-352943316053

    • -0
    • +60
    ./dataflow/LSMInvertedIndexInsertUpdateDeleteOperator.java
    • -2
    • +2
    ./dataflow/LSMInvertedIndexSearchOperatorDescriptor.java
    • -134
    • +29
    ./dataflow/LSMInvertedIndexSearchOperatorNodePushable.java
    • -2
    • +1
    ./inmemory/InMemoryInvertedIndexAccessor.java
    • -5
    • +14
    ./ondisk/OnDiskInvertedIndexSearchCursor.java
  1. … 10 more files in changeset.
set ignore properties

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_lsm_tree@1892 123451ca-8445-de46-9d55-352943316053

    • -3
    • +3
    ./dataflow/LSMInvertedIndexDataflowHelperFactory.java
More index operator cleanup.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1885 123451ca-8445-de46-9d55-352943316053

    • -2
    • +5
    ./dataflow/LSMInvertedIndexBulkLoadOperatorDescriptor.java
    • -98
    • +0
    ./dataflow/LSMInvertedIndexBulkLoadOperatorNodePushable.java
    • -1
    • +1
    ./dataflow/LSMInvertedIndexDataflowHelper.java
    • -1
    • +1
    ./dataflow/LSMInvertedIndexSearchOperatorNodePushable.java
    • -1
    • +1
    ./impls/LSMInvertedIndexOpContext.java
  1. … 52 more files in changeset.
First phase of cleaning up index operators for better code sharing.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1884 123451ca-8445-de46-9d55-352943316053

    • -5
    • +7
    ./api/IInvertedIndexOperatorDescriptor.java
    • -87
    • +14
    ./dataflow/AbstractLSMInvertedIndexOperatorDescriptor.java
    • -10
    • +10
    ./dataflow/LSMInvertedIndexBulkLoadOperatorDescriptor.java
    • -10
    • +10
    ./dataflow/LSMInvertedIndexCreateOperatorDescriptor.java
    • -54
    • +0
    ./dataflow/LSMInvertedIndexCreateOperatorNodePushable.java
    • -28
    • +13
    ./dataflow/LSMInvertedIndexDataflowHelper.java
    • -9
    • +8
    ./dataflow/LSMInvertedIndexSearchOperatorDescriptor.java
  1. … 12 more files in changeset.
Switched inverted-index operators to lsm-inverted-index. Minor cleaning for better code sharing.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1883 123451ca-8445-de46-9d55-352943316053

    • -3
    • +3
    ./api/IInvertedIndexOperatorDescriptor.java
    • -157
    • +0
    ./dataflow/AbstractInvertedIndexOperatorDescriptor.java
    • -0
    • +157
    ./dataflow/AbstractLSMInvertedIndexOperatorDescriptor.java
    • -56
    • +0
    ./dataflow/InvertedIndexBulkLoadOperatorDescriptor.java
    • -96
    • +0
    ./dataflow/InvertedIndexBulkLoadOperatorNodePushable.java
    • -52
    • +0
    ./dataflow/InvertedIndexCreateOperatorDescriptor.java
    • -53
    • +0
    ./dataflow/InvertedIndexCreateOperatorNodePushable.java
    • -52
    • +0
    ./dataflow/InvertedIndexDataflowHelper.java
    • -33
    • +0
    ./dataflow/InvertedIndexDataflowHelperFactory.java
    • -64
    • +0
    ./dataflow/InvertedIndexSearchOperatorDescriptor.java
    • -163
    • +0
    ./dataflow/InvertedIndexSearchOperatorNodePushable.java
    • -0
    • +56
    ./dataflow/LSMInvertedIndexBulkLoadOperatorDescriptor.java
    • -0
    • +98
    ./dataflow/LSMInvertedIndexBulkLoadOperatorNodePushable.java
    • -0
    • +52
    ./dataflow/LSMInvertedIndexCreateOperatorDescriptor.java
    • -0
    • +54
    ./dataflow/LSMInvertedIndexCreateOperatorNodePushable.java
  1. … 27 more files in changeset.
Properly Using op callbacks in the lsm inverted index.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1882 123451ca-8445-de46-9d55-352943316053

    • -17
    • +16
    ./impls/LSMInvertedIndexAccessor.java
    • -1
    • +9
    ./impls/LSMInvertedIndexOpContext.java
    • -0
    • +5
    ./impls/LSMInvertedIndexRangeSearchCursor.java
    • -4
    • +12
    ./impls/LSMInvertedIndexSearchCursor.java
    • -4
    • +6
    ./impls/LSMInvertedIndexSearchCursorInitialState.java
  1. … 2 more files in changeset.
Adapted inverted index lifecycle calls to latest interfaces.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1881 123451ca-8445-de46-9d55-352943316053

    • -8
    • +6
    ./dataflow/InvertedIndexBulkLoadOperatorNodePushable.java
    • -4
    • +1
    ./dataflow/InvertedIndexCreateOperatorNodePushable.java
    • -1
    • +1
    ./dataflow/InvertedIndexDataflowHelper.java
    • -6
    • +4
    ./dataflow/InvertedIndexSearchOperatorNodePushable.java
Forgot a file.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1874 123451ca-8445-de46-9d55-352943316053

    • -0
    • +34
    ./ondisk/FixedSizeElementInvertedListBuilderFactory.java
Fixed incorrect sharing of inverted-list builder causing the multi-threaded tests to break. Finished multi-threading tests.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1873 123451ca-8445-de46-9d55-352943316053

    • -0
    • +20
    ./api/IInvertedListBuilderFactory.java
    • -1
    • +0
    ./ondisk/FixedSizeElementInvertedListCursor.java
    • -4
    • +6
    ./ondisk/OnDiskInvertedIndexFactory.java
    • -0
    • +1
    ./ondisk/OnDiskInvertedIndexRangeSearchCursor.java
  1. … 6 more files in changeset.
Fixed a few multi-threading issues in the lsm-inverted-index. Still some more to go.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1871 123451ca-8445-de46-9d55-352943316053

    • -2
    • +1
    ./impls/LSMInvertedIndexRangeSearchCursor.java
    • -1
    • +1
    ./impls/LSMInvertedIndexSearchCursor.java
    • -8
    • +16
    ./inmemory/InMemoryInvertedListCursor.java
    • -3
    • +2
    ./ondisk/OnDiskInvertedIndexRangeSearchCursor.java
  1. … 11 more files in changeset.
Checkpointing lsm-inverted-index multi thread test. Still needs some debugging.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1870 123451ca-8445-de46-9d55-352943316053

    • -1
    • +3
    ./impls/LSMInvertedIndexRangeSearchCursor.java
  1. … 15 more files in changeset.
Added tests for gram-based indexes, and hashed tokens.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1868 123451ca-8445-de46-9d55-352943316053

    • -2
    • +5
    ./impls/LSMInvertedIndexSearchCursor.java
    • -3
    • +3
    ./inmemory/InMemoryInvertedListCursor.java
    • -1
    • +1
    ./ondisk/OnDiskInvertedIndexRangeSearchCursor.java
    • -2
    • +3
    ./search/TOccurrenceSearcherSuffixProbeOnly.java
    • -2
    • +3
    ./search/TOccurrenceSearcherSuffixScanOnly.java
    • -18
    • +15
    ./tokenizers/DelimitedUTF8StringBinaryTokenizerFactory.java
    • -1
    • +0
    ./tokenizers/HashedUTF8NGramTokenFactory.java
    • -0
    • +42
    ./tokenizers/NGramUTF8StringBinaryTokenizerFactory.java
  1. … 14 more files in changeset.
Improved and fixed a few bugs in the lsm inverted index tests.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1867 123451ca-8445-de46-9d55-352943316053

    • -0
    • +5
    ./search/ConjunctiveSearchModifier.java
    • -0
    • +5
    ./search/EditDistanceSearchModifier.java
  1. … 9 more files in changeset.