Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-7393: Revisit Drill tests to ensure that patching is executed before any test run

- Added BaseTest with patchers and extended all tests from it.

- Added a test to java-exec module to ensure that all tests there are inherited from BaseTest.

- Revised exception handling in the patchers, now it's individual for each patching method.

closes #1910

  1. … 138 more files in changeset.
DRILL-7314: Use TupleMetadata instead of concrete implementation

1. Add ser / de implementation for TupleMetadata interface based on types.

2. Replace TupleSchema usage where possible.

3. Move patcher classes into commons.

4. Upgrade some dependencies and general refactoring.

  1. … 40 more files in changeset.
DRILL-7113: Fix creation of filter conditions for IS NULL and IS NOT NULL for MapR-DB format plugin

close apache/drill#1704

  1. … 1 more file in changeset.
DRILL-6969: Fix inconsistency of reading MaprDB JSON tables using hive plugin when native reader is enabled

closes #1610

  1. … 9 more files in changeset.
DRILL-6878: Use DrillPushRowKeyJoinToScan rule on DrillJoin pattern to account for DrillSemiJoin

closes #1568

  1. … 13 more files in changeset.
DRILL-6691: Unify checkstyle-config.xml files.

closes #1550

  1. … 20 more files in changeset.
Fixed imports for DRILL-6381

  1. … 7 more files in changeset.
DRILL-6844: Query with ORDER BY DESC on indexed column does not pick secondary index.

  1. … 2 more files in changeset.
DRILL-6381: Address review comments (part 2): fix formatting issues and add javadoc.

  1. … 24 more files in changeset.
DRILL-6496: Added print methods for debugging tests, and fixed missing log statement in VectorUtils.

closes #1336

  1. … 33 more files in changeset.
DRILL-6438: Remove excess logging form the tests. - Removed usages of System.out and System.err from the test and replaced with loggers

closes #1284

  1. … 89 more files in changeset.
DRILL-6320: Fixed license headers.

closes #1207

  1. … 2060 more files in changeset.
DRILL-6381: (Part 4) Enhance MapR-DB plugin to support querying secondary indexes

  1. Implementation of the index descriptor for MapR-DB.

2. MapR-DB specific costing for covering and non-covering indexes.

3. Discovery componenent to discover the indexes available for a MapR-DB table including CAST functional indexes.

4. Utility functions to build a canonical index descriptor.

5. Statistics: fetch and initialize statistcs from MapR-DB for a query condition. Maintain a query-scoped cache for the statistics. Utility functions to compute selectivity.

6. Range Partitioning: partitioning function that takes into account the tablet map to find out where a particular rowkey belongs.

7. Restricted Scan: support doing restricted (i.e skip) scan through lookups on the rowkey. Added a group-scan and record reader for this.

8. MD-3726: Simple Order by queries (without limit) when an index is used are showing regression.

9. MD-3995: Do not pushdown limit 0 past project with CONVERT_FROMJSON

10. MD-4259 : Account for limit during hashcode computation

Co-authored-by: Aman Sinha <asinha@maprtech.com>

Co-authored-by: chunhui-shi <cshi@maprtech.com>

Co-authored-by: Gautam Parai <gparai@maprtech.com>

Co-authored-by: Padma Penumarthy <ppenumar97@yahoo.com>

Co-authored-by: Hanumath Rao Maduri <hmaduri@maprtech.com>

Conflicts:

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/MapRDBFormatMatcher.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/MapRDBPushProjectIntoScan.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/JsonTableGroupScan.java

exec/java-exec/src/main/java/org/apache/drill/exec/planner/index/rules/DbScanSortRemovalRule.java

exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/SortPrel.java

exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/TopNPrel.java

Fix additional compilation issues.

    • -0
    • +171
    ./com/mapr/drill/maprdb/tests/index/IndexHintPlanTest.java
    • -0
    • +1715
    ./com/mapr/drill/maprdb/tests/index/IndexPlanTest.java
    • -0
    • +176
    ./com/mapr/drill/maprdb/tests/index/LargeTableGen.java
    • -0
    • +186
    ./com/mapr/drill/maprdb/tests/index/LargeTableGenBase.java
    • -0
    • +115
    ./com/mapr/drill/maprdb/tests/index/StatisticsTest.java
    • -0
    • +127
    ./com/mapr/drill/maprdb/tests/index/TableIndexCmd.java
  1. … 25 more files in changeset.
DRILL-6381: (Part 2) MapRDB plugin update to 6.0.1

1. MD-3960: Update Drill to build with MapR-6.0.1 libraries

  2. MD-3995: Do not pushdown limit 0 past project with CONVERT_FROMJSON

3. MD-4054: Restricted scan limit is changed to dynamically read rows using the rowcount of the rightside instead of 4096.

4. MD-3688: Impersonating a view owner doesn't work with security disabled in 6.0

5. MD-4492: Missing limit pushdown changes in JsonTableGroupScan

Co-authored-by: chunhui-shi <cshi@maprtech.com>

Co-authored-by: Gautam Parai <gparai@maprtech.com>

Co-authored-by: Vlad Rozov <vrozov@mapr.com>

Conflicts:

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/MapRDBFormatPlugin.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/MapRDBSubScan.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/binary/BinaryTableGroupScan.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/CompareFunctionsProcessor.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/JsonConditionBuilder.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/JsonTableGroupScan.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/MaprDBJsonRecordReader.java

exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/PrelUtil.java

pom.xml

    • -0
    • +52
    ./com/mapr/drill/maprdb/tests/json/TestFieldPathHelper.java
    • -0
    • +158
    ./com/mapr/drill/maprdb/tests/json/TestScanRanges.java
  1. … 57 more files in changeset.
DRILL-6833: Support for pushdown of rowkey based joins

closes #1532

  1. … 12 more files in changeset.
DRILL-5783, DRILL-5841, DRILL-5894: Rationalize test temp directories

This change includes:

DRILL-5783:

- A unit test is created for the priority queue in the TopN operator.

- The code generation classes passed around a completely unused function registry reference in some places so it is removed.

- The priority queue had unused parameters for some of its methods so it is removed.

DRILL-5841:

- Created standardized temp directory classes DirTestWatcher, SubDirTestWatcher, and BaseDirTestWatcher. And updated all unit tests to use them.

DRILL-5894:

- Removed the dfs_test storage plugin for tests and replaced it with the already existing dfs storage plugin.

Misc:

- General code cleanup.

- Removed unnecessary use of String.format in the tests.

This closes #984

  1. … 365 more files in changeset.
DRILL-5864: Selecting a non-existing field from a MapR-DB JSON table fails with NPE.

  1. … 5 more files in changeset.
DRILL-5838: Fix MaprDB filter pushdown for the case of nested field (reg. of DRILL-4264)

Use FieldPath.asPathString() method instead of creating custom string representation of SchemaPath

closes #972

  1. … 2 more files in changeset.
DRILL-4951: Do Guava.patch earlier so we can run single Hbase's unit test through command line or IDE

closes #636

  1. … 2 more files in changeset.
Use DBDocumentReaderBase instead of DBDocumentReader.

  1. … 2 more files in changeset.
DRILL-4199: Add Support for HBase 1.X

  1. … 7 more files in changeset.
MD-789: Query with condition involving addition of DATE and INTERVAL types returns no results [MapR-DB JSON Tables]

+ Added `enablePushdown` option to enable/disable all filter pushdown, enabled by default.

  1. … 1 more file in changeset.
MD-572: Column names in MapR-DB JSON tables are case-sensitive

Disable pushdown of both filter and projects (by default set to false).

This will allow Drill to handle both of these operators in a case-insensitive way.

  1. … 4 more files in changeset.
MD-771: Query with nested functions within a sub-query on MapR-DB JSON Tables fail with ClassCastException

Fix for failing test cases.

  1. … 2 more files in changeset.
Refactoring code for better organization.

+ Adding skeleton streams plugin.

  1. … 46 more files in changeset.
MD-726: Add support for `read_numbers_as_double` and `all_text_mode` options

+ MD-773: Add support to push-down filters on Date, Time and Timestamp

+ Fix the offsets in Date and Time data types in returned values

+ Updated support for DATE, TIME, and TIMESTAMP types

+ Modified unit-tests to check for operation push-down

  1. … 13 more files in changeset.
MD-741: Cannot select array elements by index in MapR-DB JSON Tables

  1. … 2 more files in changeset.
MD-548: Remove reference to mapr-release pom.

* Bumped the Drill+plugin version to 1.6.0-SNAPSHOT.

* Updated MapR client artifacts to 5.1.0.

* Added missing Apache license headers to few files.

* Added a base test class BaseJsonTest for all OJAI Unit tests.

* Invoke GuavaPatcher from BaseJsonTest.

    • -0
    • +47
    ./com/mapr/drill/maprdb/tests/json/BaseJsonTest.java
  1. … 6 more files in changeset.
MD-703: Cannot select `_id` field from MapR-DB JSON Table

+ Included Smidth's fix for column shuffling.

+ Fix the private-drill-mapr-plugin build.

  1. … 4 more files in changeset.
MAPR-22405: DocumentStream interface in OJAI API need not be parametrized

  1. … 1 more file in changeset.