Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-7702: Update ZooKeeper and Curator, exclude org.codehaus.jackson

  1. … 12 more files in changeset.
DRILL-7330: Implement metadata usage for all format plugins

  1. … 59 more files in changeset.
DRILL-7620: Fix plugin mutability issues

A recent commit made the plugin registry more strict about

the rule that, once a plugin is registered, it must be

immutable. A flaw enforcing that rule in the UI put the

registry in an inconsistent state.

Also

* Registry-specific errors

* Push more operations from UI layer into registry

* Clean up semantics of "resolve" for plugins

* Add more unit tests

* Better handling of "bad" plugins

* Force plugin names to lower case

* Fix comparison bugs in some format plugins

    • -2
    • +3
    ./JsonTableRangePartitionFunction.java
  1. … 100 more files in changeset.
DRILL-7634: Rollup of code cleanup changes

Collection of code cleanup changes. The most significant

is to create constants for function names.

closes #2020

    • -10
    • +11
    ./CompareFunctionsProcessor.java
  1. … 125 more files in changeset.
DRILL-7376: Drill ignores Hive schema for MaprDB tables when group scan has star column

  1. … 3 more files in changeset.
DRILL-7314: Use TupleMetadata instead of concrete implementation

1. Add ser / de implementation for TupleMetadata interface based on types.

2. Replace TupleSchema usage where possible.

3. Move patcher classes into commons.

4. Upgrade some dependencies and general refactoring.

  1. … 39 more files in changeset.
DRILL-7316: Move classes from org.apache.drill.metastore into org.apache.drill.exec.metastore package in java-exec module

  1. … 31 more files in changeset.
DRILL-7313: Use Hive schema for MaprDB native reader when field was empty

- Added all_text_mode option for hive maprDB Json

- Improved logic to convert Hive's schema into Drill's one

- Added unit tests for schema conversion

    • -7
    • +13
    ./RestrictedJsonTableGroupScan.java
  1. … 24 more files in changeset.
DRILL-7150: Fix timezone conversion for timestamp from MaprDB after the transition from PDT to PST closes #1729

  1. … 1 more file in changeset.
DRILL-7118: Filter not getting pushed down on MapR-DB tables.

closes #1708

DRILL-7113: Fix creation of filter conditions for IS NULL and IS NOT NULL for MapR-DB format plugin

close apache/drill#1704

  1. … 1 more file in changeset.
DRILL-7200: Update Calcite to 1.19.0 / 1.20.0

  1. … 46 more files in changeset.
DRILL-6969: Fix inconsistency of reading MaprDB JSON tables using hive plugin when native reader is enabled

closes #1610

    • -11
    • +46
    ./CompareFunctionsProcessor.java
  1. … 7 more files in changeset.
DRILL-6691: Unify checkstyle-config.xml files.

closes #1550

    • -3
    • +3
    ./JsonTableRangePartitionFunction.java
    • -1
    • +0
    ./ProjectionPassthroughVectorWriter.java
  1. … 23 more files in changeset.
Fixed imports for DRILL-6381

    • -1
    • +1
    ./ProjectionPassthroughVectorWriter.java
  1. … 6 more files in changeset.
DRILL-6793: FragmentExecutor cannot send its final state for the case when RootExec root wasn't initialized

closes #1506

  1. … 5 more files in changeset.
DRILL-6381: Address code review comments (part 3).

DRILL-6381: Add missing joinControl logic for INTERSECT_DISTINCT.

- Modified HashJoin's probe phase to process INTERSECT_DISTINCT.

- NOTE: For build phase, the functionality will be same as for SemiJoin when it is added later.

DRILL-6381: Address code review comment for intersect_distinct.

DRILL-6381: Rebase on latest master and fix compilation issues.

DRILL-6381: Generate protobuf files for C++ native client.

DRILL-6381: Use shaded Guava classes. Add more comments and Javadoc.

    • -2
    • +2
    ./JsonTableRangePartitionFunction.java
  1. … 32 more files in changeset.
DRILL-6381: Address review comments (part 2): fix formatting issues and add javadoc.

    • -2
    • +2
    ./JsonTableRangePartitionFunction.java
  1. … 26 more files in changeset.
DRILL-6381: Address code review comments.

    • -1
    • +1
    ./JsonTableRangePartitionFunction.java
  1. … 11 more files in changeset.
DRILL-6824: Handle schema changes in MapRDBJsonRecordReader closes #1518

    • -26
    • +101
    ./MaprDBJsonRecordReader.java
  1. … 3 more files in changeset.
DRILL-6724: Dump operator context to logs when error occurs during query execution

closes #1455

  1. … 102 more files in changeset.
DRILL-6422: Replace guava imports with shaded ones

  1. … 981 more files in changeset.
DRILL-6454: Native MapR DB plugin support for Hive MapR-DB json table

closes #1314

  1. … 16 more files in changeset.
DRILL-6320: Fixed license headers.

closes #1207

  1. … 2064 more files in changeset.
DRILL-6094: Decimal data type enhancements

Add ExprVisitors for VARDECIMAL

Modify writers/readers to support VARDECIMAL

- Added usage of VarDecimal for parquet, hive, maprdb, jdbc;

- Added options to store decimals as int32 and int64 or fixed_len_byte_array or binary;

Add UDFs for VARDECIMAL data type

- modify type inference rules

- remove UDFs for obsolete DECIMAL types

Enable DECIMAL data type by default

Add unit tests for DECIMAL data type

Fix mapping for NLJ when literal with non-primitive type is used in join conditions

Refresh protobuf C++ source files

Changes in C++ files

Add support for decimal logical type in Avro.

Add support for date, time and timestamp logical types.

Update Avro version to 1.8.2.

  1. … 200 more files in changeset.
DRILL-6381: (Part 4) Enhance MapR-DB plugin to support querying secondary indexes

  1. Implementation of the index descriptor for MapR-DB.

2. MapR-DB specific costing for covering and non-covering indexes.

3. Discovery componenent to discover the indexes available for a MapR-DB table including CAST functional indexes.

4. Utility functions to build a canonical index descriptor.

5. Statistics: fetch and initialize statistcs from MapR-DB for a query condition. Maintain a query-scoped cache for the statistics. Utility functions to compute selectivity.

6. Range Partitioning: partitioning function that takes into account the tablet map to find out where a particular rowkey belongs.

7. Restricted Scan: support doing restricted (i.e skip) scan through lookups on the rowkey. Added a group-scan and record reader for this.

8. MD-3726: Simple Order by queries (without limit) when an index is used are showing regression.

9. MD-3995: Do not pushdown limit 0 past project with CONVERT_FROMJSON

10. MD-4259 : Account for limit during hashcode computation

Co-authored-by: Aman Sinha <asinha@maprtech.com>

Co-authored-by: chunhui-shi <cshi@maprtech.com>

Co-authored-by: Gautam Parai <gparai@maprtech.com>

Co-authored-by: Padma Penumarthy <ppenumar97@yahoo.com>

Co-authored-by: Hanumath Rao Maduri <hmaduri@maprtech.com>

Conflicts:

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/MapRDBFormatMatcher.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/MapRDBPushProjectIntoScan.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/JsonTableGroupScan.java

exec/java-exec/src/main/java/org/apache/drill/exec/planner/index/rules/DbScanSortRemovalRule.java

exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/SortPrel.java

exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/TopNPrel.java

Fix additional compilation issues.

    • -0
    • +237
    ./JsonTableRangePartitionFunction.java
    • -0
    • +184
    ./RestrictedJsonTableGroupScan.java
  1. … 28 more files in changeset.
DRILL-6381: (Part 2) MapRDB plugin update to 6.0.1

1. MD-3960: Update Drill to build with MapR-6.0.1 libraries

  2. MD-3995: Do not pushdown limit 0 past project with CONVERT_FROMJSON

3. MD-4054: Restricted scan limit is changed to dynamically read rows using the rowcount of the rightside instead of 4096.

4. MD-3688: Impersonating a view owner doesn't work with security disabled in 6.0

5. MD-4492: Missing limit pushdown changes in JsonTableGroupScan

Co-authored-by: chunhui-shi <cshi@maprtech.com>

Co-authored-by: Gautam Parai <gparai@maprtech.com>

Co-authored-by: Vlad Rozov <vrozov@mapr.com>

Conflicts:

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/MapRDBFormatPlugin.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/MapRDBSubScan.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/binary/BinaryTableGroupScan.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/CompareFunctionsProcessor.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/JsonConditionBuilder.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/JsonTableGroupScan.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/MaprDBJsonRecordReader.java

exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/PrelUtil.java

pom.xml

    • -0
    • +80
    ./AllTextValueWriter.java
    • -0
    • +42
    ./DocumentReaderVectorWriter.java
    • -0
    • +75
    ./FieldPathHelper.java
    • -0
    • +49
    ./FieldTransferVectorWriter.java
    • -0
    • +65
    ./IdOnlyVectorWriter.java
    • -329
    • +209
    ./MaprDBJsonRecordReader.java
    • -0
    • +51
    ./NumbersAsDoubleValueWriter.java
    • -0
    • +214
    ./OjaiFunctionsProcessor.java
    • -0
    • +194
    ./OjaiValueWriter.java
    • -0
    • +83
    ./ProjectionPassthroughVectorWriter.java
  1. … 48 more files in changeset.
DRILL-5730: Mock testing improvements and interface improvements

closes #1045

  1. … 223 more files in changeset.
DRILL-6833: Support for pushdown of rowkey based joins

closes #1532

  1. … 12 more files in changeset.
DRILL-6049: Misc. hygiene and code cleanup changes

close apache/drill#1085

  1. … 123 more files in changeset.