Clone Tools
  • last updated 14 mins ago
Constraints: committers
Constraints: files
Constraints: dates
DRILL-6494: Drill Plugins Handler

- Storage Plugins Handler service is used op the Drill start-up stage and it updates storage plugins configs from

storage-plugins-override.conf file. If plugins configs are present in the persistence store - they are updated,

otherwise bootstrap plugins are updated and the result configs are loaded to persistence store. If the enabled

status is absent in the storage-plugins-override.conf file, the last plugin config enabled status persists.

- 'drill.exec.storage.action_on_plugins_override_file' Boot option is added. This is the action, which should be

performed on the storage-plugins-override.conf file after successful updating storage plugins configs.

Possible values are: "none" (default), "rename" and "remove".

- The "NULL" issue with updating Hive plugin config by REST is solved. But clients are still being instantiated for disabled

plugins - DRILL-6412.

- "org.honton.chas.hocon:jackson-dataformat-hocon" library is added for the proper deserializing HOCON conf file

- additional refactoring: "com.typesafe:config" and "org.apache.commons:commons-lang3" are placed into DependencyManagement

block with proper versions; correct properties for metrics in "drill-override-example.conf" are specified

closes #1345

    • -0
    • +65
  1. … 20 more files in changeset.
DRILL-6579: Added sanity checks to the Parquet reader to avoid infinite loops

closes #1361

DRILL-6578: Handle query cancellation in Parquet reader

closes #1360

DRILL-6577: Change Hash-Join fallback default to false

closes #1359

DRILL-6647: Update Calcite version to 1.17.0

closes #1425



add global query list doc

Add Global Query List doc

DRILL-6559: Travis timing out

* Excluding contrib module tests and all exec TPCH unit tests for travis full build.

* Introducing new TRAVIS profile

* Travis build is faster for 4-5 mins

closes #1364

DRILL-6537: Limit the batch size for buffering operators based on how much memory they get

closes #1342

DRILL-6516: Fix memory leak issue with Sort and StreamingAgg together

DRILL-6570: Fixed IndexOutofBoundException in Parquet Reader

DRILL-6560: Enhanced the batch statistics logging enablement

closes #1355

typo edits for decimal storage format

DRILL-6561: Lateral excluding the columns from output container provided by projection push into rules

This closes #1356

DRILL-6475: Unnest: Null fieldId Pointer.

closes #1381

DRILL-6557: Use size in bytes during Hive statistics calculation if present

1. Check size in bytes presence in stats before fetching input splits and use it if present.

2. Add log trace suggesting to use ANALYZE command before running queries if statistics is unavailable and Drill had to fetch all input splits.

3. Minor refactoring / cleanup in HiveMetadataProvider class.

closes #1357

DRILL-6548: IllegalStateException: Unexpected EMIT outcome received in buildSchema phase

closes #1352

DRILL-6498: Support for EMIT outcome in ExternalSortBatch

* DRILL-6498: Support for EMIT outcome in ExternalSortBatch

* Updated TestTopNEmitOutcome to use RowSetComparison for comparing expected and actual output batches produced

closes #1323

DRILL-6553: Fix TopN for unnest operator

closes #1353

DRILL-6549: batch sizing for nested loop join

closes #1363

DRILL-6531 doc edit

DRILL-6589: Push transitive closure predicate(s) past aggregates

closes #1372

drill 1.14 doc updates

DRILL-6554: Minor code improvements in parquet statistics handling

closes #1349

DRILL-6503: Performance improvements in lateral

closes #1328

doc for drill 1.14

DRILL-6310: limit batch size for hash aggregate

closes #1324

DRILL-6515: Render a link between the Unnest operator and it's source

* DRILL-6515: Render a link between the Unnest operator and it's source

1. Unnest operator is expected to specify srcOp=##-## to help identify the source of its input.

2. Implicit Source Map is leveraged to capture implicit data flow pipelines between Unnest and Lateral. (Can be expanded to other operators too).

3. In addition, code refactored for more readability.

* Minor comment updates

* Minor Update

Converted implicitSrc to a local variable

closes #1327