drill

Clone Tools
  • last updated 11 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-6114: Metadata revisions

Support for union vectors, list vectors, repeated list vectors. Refactored metadata classes.

closes #1112

  1. … 59 more files in changeset.
DRILL-5902: Queries encounter random failure due to RPC connection timed out

close apache/drill#1113

minor edit

add option exec.java.compiler.exp_in_method_size to docs

DRILL-6323: Lateral Join - Initial implementation

DRILL-6322: Lateral Join: Common changes - Add new iterOutcome, Operatortypes, MockRecordBatch for testing

Added new Iterator State EMIT, added operatos LATERA_JOIN & UNNEST in CoreOperatorType and added LateralContract interface

Implementation of MockRecordBatch to test operator behavior for different IterOutcomes. a) Creates new output container for schema change cases. b) Doesn't create new container for each next() call without schema change, since the operator in test expects the ValueVector object in it's incoming batch to be same unless a OK_NEW_SCHEMA case is hit. Since setup() method of operator in test will store the reference to value vector received in first batch

This closes #1211

DRILL-6137: Fixed join error when one file partition is empty

DRILL-6128: Wrong Result with Nested Loop Join

This closes #1109

DRILL-6321: Customize Drill's conformance. Allow support to APPLY keywords

close apache/drill#1224

Conflicts:

exec/java-exec/src/main/java/org/apache/drill/exec/planner/sql/SqlConverter.java

Fix checkstyle

DRILL-6130: Fix NPE during physical plan submission for various storage plugins

1. Fixed ser / de issues for Hive, Kafka, Hbase plugins.

2. Added physical plan submission unit test for all storage plugins in contrib module.

3. Refactoring.

closes #1108

  1. … 12 more files in changeset.
DRILL-6129: Fixed query failure due to nested column data type change

This closes #1106

DRILL-6125: Fix possible memory leak when query is cancelled or finished.

close apache/drill#1105

edits

DRILL-6119: The OpenTSDB storage plugin is not included in the Drill distribution

closes #1102

minor edits

update docs for NaN infinity type support and bounds checking behavior change

DRILL-6089: Removed ordering trait from HashJoin in planner and verified the planner does not assume HashJoin preserves ordering.

closes #1117

DRILL-6106: Use valueOf method instead of constructor since valueOf has a higher performance by caching frequently requested values.

closes #1099

minor edit

    • -2
    • +2
    /_docs/developer-information/rest-api/010-submitting-queries-from-the-rest-api-when-impersonation-is-enabled-and-authentication-is-disabled.md
minor edit

    • -2
    • +2
    /_docs/developer-information/rest-api/010-submitting-queries-from-the-rest-api-when-impersonation-is-enabled-and-authentication-is-disabled.md
Doc updates per DRILL-5726

    • -2
    • +2
    /_docs/developer-information/rest-api/010-submitting-queries-from-the-rest-api-when-impersonation-is-enabled-and-authentication-is-disabled.md
DRILL-6102: Fix ConcurrentModificationException in the BaseAllocator's print method

closes #1100

DRILL-5868: Support SQL syntax highlighting of queries

Based on the commit for DRILL-5981 (PR #1043), this commit further leverages the Ace JavaScript library with customizations specific to Drill.

This commit introduces the following to the Query Editor (including the Edit Query tab within an existing profile to rerunning the query).

1. Syntax highlighting (This is supported for submitted query profiles

2. Autocomplete supported in editors

3. Specifying Drill specific keywords and functions in visible autocomplete

4. Key snippets (template SQLs) allowing for rapid writing of syntax:

i. Query System Tables

ii. CView, CTAS and CTempTAS

iii. Alter Session

iv. Explain and Select * queries

NOTE: The lists for #3 and #4 are not exhaustive. As more features are added to Drill, these lists can be expanded.

Updates based on review comments

1. Disabled warning message

2. Extended reserved keyword list

3. Fixed bugs

List:

Update 1: Bug fix for when Impersonation is enabled

Update 2: Remove the duplicate editor that might get injected

Update 3: Removed trailing whitespaces in Javascripts

close apache/drill#1084

Doc updates per DRILL-5726

    • -0
    • +67
    /_docs/developer-information/rest-api/010-submitting-queries-from-the-rest-api-when-impersonation-is-enabled-and-authentication-is-disabled.md
    • -2
    • +4
    /_docs/install/050-starting-drill-in-distributed-mode.md
    • -4
    • +6
    /_docs/install/060-starting-the-web-ui.md
DRILL-6100: Intermittent failure while reading Parquet file footer during planning phase

close apache/drill#1097

minor edit

edit JDBC SQuirreL on Windows doc per MD-1728

DRILL-6099: Push limit past flatten(project) without pushdown into scan

closes #1096

DRILL-3993: Fix typo in DrillRelBuilder Javadoc

DRILL-6090: While connecting to drill-bits using JDBC Driver through Zookeeper, a lot of "Curator-Framework-0" threads are created if connection to drill-bit is not successful(no drill-bits are up/reachable)

I am using Drill JDBC driver 1.12.0 to connect to MapR-DB. I am finding the available drill-bits using Zookeepers. When drill-bits are not up or not reachable, the connection is failed with exception: "Failure in connecting to Drill: oadd.org.apache.drill.exec.rpc.RpcException: Failure setting up ZK for client", which is expected, but number of threads created by ZKClusterCoordinator just keeps on increasing.

Steps to reproduce the issue

Setup a connection with a drill-bit using Apache Drill JDBC driver 1.12.0 through Zookeeper hosts(port 5181)

Now stop the drill-bit services or block the drill-bit IPs using iptable rules

Truncate catalina logs

Try to connect to the drill-bit/hit a code path that requires connection to drill-bits.

Take thread dump using kill -QUIT <java process id>

grep -c "Curator-Framework-0" catalina.out

Observe that the curator framework thread just keep on accumulating

RCA:

ZKClusterCoordinator creates curator threads in the constructor

ZKClusterCoordinator is instantiated by DrillClient.connect

DrillClient.connect is called in DrillConnectionImpl constructor

Fix:

Call DrillConnectionImpl .cleanup() from all the catch blocks in the DrillConnectionImpl constructor.

close apache/drill#1094