Clone Tools
  • last updated 15 mins ago
Constraints: committers
Constraints: files
Constraints: dates
DRILL-6440: Unnest unit tests and fixes for stats

- Add unit test with mock input, nested lateral and unnest and project.

- Fix unit test involving batch limits, ignore map tests

- Fix input row count stats.

closes #1283

doc edits

    • -2
    • +2
dox edits

DRILL-6302: Fixed NPE in Drillbit close method

closes #1217

DRILL-6320: Fixed license headers.

closes #1207

  1. … 2052 more files in changeset.
DRILL-6320: Added license-maven-plugin to the pom.

DRILL-6295: PartitionerDecorator may close partitioners while CustomRunnable are active during query cancellation

This closes #1208

DRILL-6318: Push down limit past flatten is incorrect

closes #1204

    • -0
    • +12
DRILL-5977: Implement Filter Pushdown in Drill-Kafka plugin

closes #1272

DRILL-6307: Handle empty batches in record batch sizer correctly

closes #1228

DRILL-6311: No logging information in drillbit.log / drillbit.out

closes #1202

DRILL-6094: Decimal data type enhancements

Add ExprVisitors for VARDECIMAL

Modify writers/readers to support VARDECIMAL

- Added usage of VarDecimal for parquet, hive, maprdb, jdbc;

- Added options to store decimals as int32 and int64 or fixed_len_byte_array or binary;

Add UDFs for VARDECIMAL data type

- modify type inference rules

- remove UDFs for obsolete DECIMAL types

Enable DECIMAL data type by default

Add unit tests for DECIMAL data type

Fix mapping for NLJ when literal with non-primitive type is used in join conditions

Refresh protobuf C++ source files

Changes in C++ files

Add support for decimal logical type in Avro.

Add support for date, time and timestamp logical types.

Update Avro version to 1.8.2.

  1. … 187 more files in changeset.
edit spnego and impersonation docs

DRILL-6327: Update unary operators to handle IterOutcome.EMIT Note: Handles for Non-Blocking Unary operators (like Filter/Project/etc) with EMIT Iter.Outcome

closes #1240

edit to spnego doc

DRILL-6375 : Support for ANY_VALUE aggregate function

closes #1256

  1. … 22 more files in changeset.
minor edit


Add SPNEGO content

    • -0
    • +148
    • -2
    • +4
DRILL-143: Support CGROUPs resource management

Introduces the DRILLBIT_CGROUP option in drill-env.sh.

The startup script checks if the specified CGroup (ver 2) is available and tries to apply it to the launched Drillbit JVM.

This would benefit not just Drill-on-YARN usecases, but any setup that would like CGroups for enforcement of (cpu) resources management.

(Also introduced SYS_CGROUP_DIR to account for possible non default locations of CGroup).

e.g when Drillbit is configured to use `drillcpu` cgroup


[root@maprlabs ~]# /opt/mapr/drill/apache-drill-1.14.0-SNAPSHOT/bin/drillbit.sh restart

Stopping drillbit


Starting drillbit, logging to /var/log/drill/drillbit.out

WARN: Drillbit's CPU resource usage will be managed under the CGroup : drillcpu (up to 4.00 cores allowed)


e.g. Non-existent CGroup `droolcpu` is used


[root@kk127 ~]# /opt/mapr/drill/apache-drill-1.14.0-SNAPSHOT/bin/drillbit.sh restart

Stopping drillbit


Starting drillbit, logging to /var/log/drill/drillbit.out

ERROR: cgroup droolcpu does not found. Ensure that daemon is running and cgroup exists


closes #1200

    • -0
    • +10
    • -0
    • +39
DRILL-6296: Add operator metrics for batch sizing for merge join

closes #1181

DRILL-6286: Fixed incorrect reference to shutdown in drillbit.log

closes #1196

DRILL-6273: Removed dependency licensed under Category X

closes #1195

    • -0
    • +24
    • -0
    • +24
DRILL-6300: Refresh protobuf C++ source files

close apache/drill#1194

DRILL-6299: Fixed a filter pushed down issue when a column doesn't have stats

close apache/drill#1192

DRILL-6270: Added general option --jvm, which can be used to set the remote debug jvm options.

The option is not needed for drillbit startup, you can set the jvm properties directly after the start command.


bin/drill-embedded --jvm "[JVM options]"

bin/sqlline -u "jdbc:drill:zk=zkaddr:port" --jvm "[JVM options]"

bin/drillbit.sh start [JVM options]

sqlline.bat -u "jdbc:drill:zk=local" --jvm "[JVM options]"

closes #1210

    • -5
    • +13
DRILL-5937: drill-module.conf : Changed timeout to 30 seconds, ExecConstant.java : Changed comment

DRILL-5937: ExecConstant.java : removed comment

DRILL-5937: CheckStyle fix

close apache/drill#1190

DRILL-6103: lsb_release: command not found

close apache/drill#1191

Thanks to Sanel Zukan for providing a small patch that checks for /etc/fedora-release path. This is more common, than lsb_release command on Linux distros.

DRILL-6321: Lateral Join and Unnest - initial implementation for parser and planning

  1. … 12 more files in changeset.