Vikas Saurabh

OAK-8603: Composite Node Store + Counter Index: allow indexing from scratch / reindex
OAK-8603: Composite Node Store + Counter Index: allow indexing from scratch / reindex

Minor refactoring

OAK-8535: oak-it-osgi fails with encrypted credentials in settings.xml (backport r1864683 from trunk)

OAK-8532: Osgi based test to verify tika setup is working (backport r1864667, r1864674 and r1864681 from trunk)

Useful versions are referred from versions.properties resource.

Some bundles are hard-coded to their version in the test itself as they seem

to be only useful for poi and any OSGi setup that would use poi would

anyway need to wrap poi into a bundle and hence would most likely inline

these hard-coded ones as well (where OSGi resolution would help catch

errors in those cases).

OAK-8535: oak-it-osgi fails with encrypted credentials in settings.xml (backport r1864683 from trunk)

OAK-8532: Osgi based test to verify tika setup is working (backport r1864667, r1864674 and r1864681 from trunk)

Useful versions are referred from versions.properties resource.

Some bundles are hard-coded to their version in the test itself as they seem

to be only useful for poi and any OSGi setup that would use poi would

anyway need to wrap poi into a bundle and hence would most likely inline

these hard-coded ones as well (where OSGi resolution would help catch

errors in those cases).

OAK-8597: lc command is unable to construct OakDirectory (backport r1866457 from trunk)

OAK-8597: lc command is unable to construct OakDirectory
OAK-8589: NPE in IndexDefintionBuilder with existing property rule without "name" property
OAK-8554: IndexCopier#waitForCopyCompletion doesn't reset interrupted flag after catching InterruptedException
OAK-8543: Javadoc of IndexCopier#waitForCopyCompletion refers to boolean return
OAK-8542: Test failure: ConcurrentCopyOnReadDirectoryTest.concurrentPrefetchWithTimeout

This test was added in OAK-8513 and was adding elements to a

non-synchronized list using multiple threads.

Also, removed non-required (and dangling) initialization of thread pool in setup.

OAK-8535: oak-it-osgi fails with encrypted credentials in settings.xml
OAK-8534: Rat plugin failure in oak-it-osgi

... was caused by resources added in r1864667 for OAK-8532

OAK-8533: Rat plugin failure in oak-it-osgi

... was caused by resources added in r1864667 for OAK-8532

OAK-8532: Osgi based test to verify tika setup is working

Useful versions are referred from versions.properties resource.

Some bundles are hard-coded to their version in the test itself as they seem

to be only useful for poi and any OSGi setup that would use poi would

anyway need to wrap poi into a bundle and hence would most likely inline

these hard-coded ones as well (where OSGi resolution would help catch

errors in those cases).

  1. /oak/trunk/oak-it-osgi/src/test/resources/org
OAK-7251: BinaryTextExtractor should not ignore parse exception - they should at least be logged at DEBUG in all cases (backport r1823671 from trunk)

OAK-8526: IndexDefinitionBuilder should support setting up index tags (backport r1864349,r1864353 from trunk)

OAK-8114: IndexDefinitionBuilder should be smarter when to reindex while updating a definition (backport r1855522 from trunk)

Applying work done by Nitin Gupta at https://github.com/apache/jackrabbit-oak/pull/122. Thanks Nitin for the contribution.

Did a few more changes on top:

* check refresh only when reindex isn't required

* we had forgotten that index tags also don't require reindexing

OAK-8041: IndexDefinitnionBuider should support facets and boost for property definitions (backport r1853435 from trunk)

OAK-8526: IndexDefinitionBuilder should support setting up index tags (backport r1864353 from trunk)

OAK-8526: IndexDefinitionBuilder should support setting up index tags
OAK-8526: IndexDefinitionBuilder should support setting up index tags (backport r1864349 from trunk)

OAK-8114: IndexDefinitionBuilder should be smarter when to reindex while updating a definition (backport r1855522 from trunk)

Applying work done by Nitin Gupta at https://github.com/apache/jackrabbit-oak/pull/122. Thanks Nitin for the contribution.

Did a few more changes on top:

* check refresh only when reindex isn't required

* we had forgotten that index tags also don't require reindexing

OAK-8526: IndexDefinitionBuilder should support setting up index tags
OAK-8513: Concurrent index access via CopyOnRead directory can lead to reading directly off of remote
OAK-8513: Concurrent index access via CopyOnRead directory can lead to reading directly off of remote

Adding ignored unit test

OAK-8514: CoR should log a warn when opening remote index file when prefetch is enabled
OAK-8497: Remove oak-search-elastic declaration to skip baseline plugin
OAK-7981: Implement elastic search support based off of oak-search

Basic index and query is be working.

Little bit of tests shows things (settings, mapping, a couple of docs)

do perist fine on ES instance.

Also, at least simple queries should be working (as is asserted in a

test as well).

TODO (in no specific order):

* currently all string (apart from path, ancestor, etc) get mapped as

string - that means all would get analyzed and need to be searched with

'keyword' sub-field from keyword/equality pov. Maybe mapping (and hence

querying would need improving)

* batch indexing

* batch/scroll searching

* implement faceting, suggestion, spellcheck, more-like-this, excerpt

(anything else??)

* cost estimation

* whether lucene and es client bundles need to be inlined

  1. /oak/trunk/oak-search-elastic/src/main/java/org
  2. … 42 more files in changeset.