drill

Clone Tools
  • last updated 22 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-6021:Show shutdown button when authentication is not enabled

closes #1127

add vitalii and kamesh to the team list

DRILL-6172: setValueCount of VariableLengthVectors throws IOB exception when called with 0 value after clearing vectors

close apache/drill#1124

DRILL-6323: Lateral Join - Refactor, fix various issues with LATERAL: a)Override prefetch call in BuildSchema phase for LATERAL, b)EMIT handling in buildSchema, c)Issue when in multilevel Lateral case schema change is observed only on right side of UNNEST, d)Handle SelectionVector in incoming batch, e) Handling Schema change, f) Updating joinIndexes correctly when producing multiple output batches for current left&right inputs. Added tests for a)EMIT handling in buildSchema, b)Multiple UNNEST at same level, c)Multilevel Lateral, d)Multilevel Lateral with Schema change on left/right or both branches, e) Left LATERAL join f)Schema change for UNNEST and Non-UNNEST columns, g)Error outcomes from left&right, h) Producing multiple output batches for given incoming, i) Consuming multiple incoming into single output batch

DRILL-6154: NaN, Infinity issues

- changed comparison rules for NaN, Infinity values. For now NaN is the biggest value, Infinity - second biggest value

- fixed min, max, trunc functions for NaN, Infinity values

- made drill use original sqrt function instead of power(x,0.5) substitution

close apache/drill#1123

DRILL-6164: Heap memory leak during parquet scan and OOM

closes #1122

DRILL-6436: Storage Plugin to have name and context moved to AbstractStoragePlugin

closes #1282

DRILL-6174: Parquet filter pushdown improvements.

Added support IS [NOT] NULL/TRUE/FALSE operator for the parquet filter pushdown.

Added timestamp/date/time implicit/explicit casts.

closes #1131

DRILL-6027: Initial implementation of HashJoin spill, without memory limits checks yet

  1. … 16 more files in changeset.
DRILL-6153: Operator framework

closes #1121

DRILL-6115: SingleMergeExchange is not scaling up when many minor fragments are allocated for a query.

DRILL-6115: Refactoring the existing code.

close apache/drill#1110

  1. … 3 more files in changeset.
DRILL-6027: - Added memory claculator - Added unit tests and docs. - Fixed IOB caused by output vector allocation. - Don't double count records that were spilled in HashJoin

  1. … 41 more files in changeset.
add committer names to team page

update docs for DRILL-5964

DRILL-6381: (Part 2) MapRDB plugin update to 6.0.1

1. MD-3960: Update Drill to build with MapR-6.0.1 libraries

  2. MD-3995: Do not pushdown limit 0 past project with CONVERT_FROMJSON

3. MD-4054: Restricted scan limit is changed to dynamically read rows using the rowcount of the rightside instead of 4096.

4. MD-3688: Impersonating a view owner doesn't work with security disabled in 6.0

5. MD-4492: Missing limit pushdown changes in JsonTableGroupScan

Co-authored-by: chunhui-shi <cshi@maprtech.com>

Co-authored-by: Gautam Parai <gparai@maprtech.com>

Co-authored-by: Vlad Rozov <vrozov@mapr.com>

Conflicts:

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/MapRDBFormatPlugin.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/MapRDBSubScan.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/binary/BinaryTableGroupScan.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/CompareFunctionsProcessor.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/JsonConditionBuilder.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/JsonTableGroupScan.java

contrib/format-maprdb/src/main/java/org/apache/drill/exec/store/mapr/db/json/MaprDBJsonRecordReader.java

exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/PrelUtil.java

pom.xml

  1. … 48 more files in changeset.
DRILL-6381: (Part 1) Secondary Index framework

  1. Secondary Index planning interfaces and abstract classes like DBGroupScan, DbSubScan, IndexDecriptor etc.

  2. Statistics and Cost model interfaces/classes: PluginCost, Statistics, StatisticsPayload, AbstractIndexStatistics

  3. ScanBatch and RecordReader to support repeatable scan

  4. Secondary Index execution related interfaces: RangePartitionSender, RowKeyJoin, PartitionFunction

5. MD-3979: Query using cast index plan fails with NPE

Co-authored-by: Aman Sinha <asinha@maprtech.com>

Co-authored-by: chunhui-shi <cshi@maprtech.com>

Co-authored-by: Gautam Parai <gparai@maprtech.com>

Co-authored-by: Padma Penumarthy <ppenumar97@yahoo.com>

Co-authored-by: Hanumath Rao Maduri <hmaduri@maprtech.com>

Conflicts:

exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/ScanBatch.java

exec/java-exec/src/main/java/org/apache/drill/exec/planner/common/DrillRelOptUtil.java

exec/java-exec/src/main/java/org/apache/drill/exec/planner/logical/DrillTable.java

protocol/src/main/java/org/apache/drill/exec/proto/UserBitShared.java

protocol/src/main/java/org/apache/drill/exec/proto/beans/CoreOperatorType.java

protocol/src/main/protobuf/UserBitShared.proto

  1. … 30 more files in changeset.
add kafka sp doc

add kafka sp doc

DILL-6148: TestSortSpillWithException is sometimes failing.

closes #1120

DRILL-6123: Limit batch size for Merge Join based on memory

closes #1107

DRILL-6144: Make direct memory amount configurable in tests.

This closes #1118

edits for JJ transform

  1. … 10 more files in changeset.
DRILL-6143: Made FragmentsRunner's rpc timeout larger to reduce random failures and made it configurable as a SystemOption.

closes #1119

DRILL-6324: Unnest - Initial Implementation

- Based on Flatten

- Implement unnestRecords in UnnestTemplate

- Remove unnecessary code inherited from Flatten/Project. Add schema change handling.

- Fix build failure after rebase since RecordBatchSizer used by UNNEST was relocated to a different package

- Add unit tests

- Handling of input row splitting across multiple batches. Also do not kill incoming in killIncoming.

- Schema change generated by Unnest

edits to put headings in order

    • -7
    • +7
    /_docs/tutorials/050-analyzing-highly-dynamic-datasets.md
add opentsdb SP doc, update other docs so titles have quotes

    • -6
    • +6
    /_docs/developer-information/rest-api/010-submitting-queries-from-the-rest-api-when-impersonation-is-enabled-and-authentication-is-disabled.md
    • -2
    • +2
    /_docs/install/050-starting-drill-in-distributed-mode.md
    • -2
    • +2
    /_docs/install/060-starting-the-web-ui.md
    • -2
    • +2
    /_docs/install/070-identifying-multiple-drill-versions-in-a-cluster.md
DRILL-6294: Changes to support Calcite 1.16.0 , and remove deprecated API usage

closes #1198

  1. … 25 more files in changeset.
DRILL-6140: Correctly list Operators in Profiles Page

Operators listed in Profiles Page don't always correspond with operator specified in Physical Plan.

This commit fixes that by using the PhysicalPlan as a reference, but reverts to the inferred names in the event of an Exchange-based operator

closes #1116

DRILL-6138: Move RecordBatchSizer to org.apache.drill.exec.record package

This closes #1115

DRILL-6114: Metadata revisions

Support for union vectors, list vectors, repeated list vectors. Refactored metadata classes.

closes #1112

  1. … 59 more files in changeset.