protocol

Clone Tools
  • last updated 18 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-7502: Invalid codegen for typeof() with UNION

Also fixes DRILL-6362: typeof() reports NULL for primitive

columns with a NULL value.

typeof() is meant to return "NULL" if a UNION has a NULL

value, but the column type when known, such as for non-UNION

columns.

Also fixes DRILL-7499: sqltypeof() function with an array returns

"ARRAY", not type. This was due to treating REPEATED like LIST.

Handling of the Union vector in code gen is problematic

with about three special cases. Existing code handled two

of the cases. This change handles the third case.

Figuring out the change required poking around quite a bit

of unclear code. Added comments and restructuring to make

that code a bit more clear.

The fix modified code gen for the Union Holder. It can now

"go back in time" to add the union reader at the point we

need it.

closes #1945

  1. … 54 more files in changeset.
[maven-release-plugin] prepare for next development iteration

  1. … 36 more files in changeset.
[maven-release-plugin] prepare release drill-1.17.0

  1. … 36 more files in changeset.
DRILL-4303: ESRI Shapefile (shp) Format Plugin

    • -0
    • +1
    ./src/main/protobuf/UserBitShared.proto
  1. … 20 more files in changeset.
DRILL-7177: Format Plugin for Excel Files

closes #1749

    • -0
    • +1
    ./src/main/protobuf/UserBitShared.proto
  1. … 16 more files in changeset.
DRILL-7273: Introduce operators for handling metadata

closes #1886

    • -0
    • +2
    ./src/main/protobuf/UserBitShared.proto
  1. … 155 more files in changeset.
DRILL-7294: Regenerate protobufs

  1. … 94 more files in changeset.
DRILL-7294: Prevent generating java beans using protostuff to avoid overriding classes with the same simple name declared as nested in the proto files

closes #1808

  1. … 7 more files in changeset.
[maven-release-plugin] prepare for next development iteration

  1. … 31 more files in changeset.
[maven-release-plugin] prepare release drill-1.16.0

  1. … 31 more files in changeset.
[maven-release-plugin] prepare release drill-1.16.0

  1. … 31 more files in changeset.
DRILL-7188: Revert DRILL-6642: Update protocol-buffers version

1. Updated protobuf to version 3.6.1

2. Added protobuf to the root pom dependency management

3. Added classes BoundedByteString and LiteralByteString for compatibility with HBase

4. Added ProtobufPatcher to provide compatibility with MapR-DB and HBase

    • -2795
    • +1481
    ./src/main/java/org/apache/drill/exec/proto/BitControl.java
    • -12040
    • +7578
    ./src/main/java/org/apache/drill/exec/proto/UserProtos.java
  1. … 30 more files in changeset.
DRILL-7048: Implement JDBC Statement.setMaxRows() with System Option

This introduces support for JDBC's Statement.setMaxRows(int) API, which can help Drill execute a query much faster if it knows that not ALL the records in the resultset will be consumed upfront.

This Commit introduces the core changes to support the feature within Drill's execution engine

Protobuf Changes

1. RunQuery: Added "autolimit_rowcount"

2. QueryProfile: Added "autoLimit"

3. Regenerated Java and C++ client files

REST API support

1. Support for REST server to interpret a submitted query and also for rendering this information for an executed query

2. Updates to the Freemarker templates (for WebUI)

3. Safety check within Javascript (for WebUI)

JDBC API support

1. Introduces backend execution of 'ALTER SESSION' to apply the auto-limiting of resultset size

2. Added Unit Tests for PreparedStatement and Statement objects

3. Added getter setter methods to be skipped in testing for org.apache.drill.jdbc.test.Drill2489CallsAfterCloseThrowExceptionsTest.testclosedPreparedStmtOfOpenConnMethodsThrowRight()

Updates based on review comments

Additional Updates

Test Cleanup

1. Revert Drill2489 hack

2. Formatting in *StatementTest

3. Removal f redundant `statement.close()`

4. Manage new Exception thrown when setting invalid maxRow values

Final updates

1. Test changes

2. Trim trailing spaces in auto-limit value (Javascript)

3. Before & After annotations to synchronize changes to system values for MaxRows(auto-limit)

Reorganized tests due to synchronized locking

Removed conflicting JsonCreator in QueryWrapper

Additional test cleanup

closes #1714

    • -0
    • +1
    ./src/main/protobuf/UserBitShared.proto
  1. … 27 more files in changeset.
DRILL-7096: Develop vector for canonical Map<K,V>

- Added new type DICT;

- Created value vectors for the type for single and repeated modes;

- Implemented corresponding FieldReaders and FieldWriters;

- Made changes in EvaluationVisitor to be able to read values from the map by key;

- Made changes to DrillParquetGroupConverter to be able to read Parquet's MAP type;

- Added an option `store.parquet.reader.enable_map_support` to disable reading MAP type as DICT from Parquet files;

- Updated AvroRecordReader to use new DICT type for Avro's MAP;

- Added support of the new type to ParquetRecordWriter.

  1. … 107 more files in changeset.
DRILL-7014: Format plugin for LTSV files closes #1627

    • -0
    • +1
    ./src/main/protobuf/UserBitShared.proto
  1. … 14 more files in changeset.
DRILL-6582: SYSLOG (RFC-5424) Format Plugin closes #1530

    • -0
    • +1
    ./src/main/protobuf/UserBitShared.proto
  1. … 18 more files in changeset.
DRILL-6946: Implement java.sql.Connection setSchema and getSchema methods in DrillConnectionImpl closes #1596

  1. … 6 more files in changeset.
[maven-release-plugin] prepare for next development iteration

  1. … 29 more files in changeset.
[maven-release-plugin] prepare release drill-1.15.0

  1. … 29 more files in changeset.
DRILL-6925: Unable to generate Protobuf

- use ${maven.multiModuleProjectDirectory}/header to find header file from any submodule

- suppress UnresolvedMavenProperty, since IDE expects that property should be set explicitly

- update "kr.motd.maven:os-maven-plugin" github.com/trustin/os-maven-plugin to the latest 1.6.1 version

- correction of ${user.name} propery for "maven-jar-plugin" <Built-By>

- update "apache-rat-plugin" to solve undefined "excludeSubprojects" in IDE

- regenerate Java and C++ protobuf files

closes #1585

  1. … 6 more files in changeset.
DRILL-6900: maven-release-plugin failure on the release:perform stage

- downgrade maven-javadoc-plugin version

- update some Drill maven plugins versions and move them to pluginManagement block

- bump up lowest maven version supported by Drill in correspondence to org.apache.maven dependencies

closes #1574

  1. … 6 more files in changeset.
DRILL-6834: Introduce option to disable result set for DDL queries for JDBC connection

- Added session-scoped option `drill.exec.fetch_resultset_for_ddl` to control whether update count or result set should be returned for JDBC connection session. By default the option is set to `true` which ensures that result set is returned;

- Updated Drill JDBC: `DrillCursor` and `DrillStatement` to achieve desired behaviour.

closes #1549

    • -0
    • +4
    ./src/main/protobuf/UserBitShared.proto
  1. … 22 more files in changeset.
DRILL-6642: Update protocol-buffers version

1. Updated protobuf to version 3.6.1

2. Added protobuf to the root pom dependency management

3. Added classes BoundedByteString and LiteralByteString for compatibility with HBase

4. Added ProtobufPatcher to provide compatibility with MapR-DB and HBase

closes #1639

    • -1489
    • +2803
    ./src/main/java/org/apache/drill/exec/proto/BitControl.java
    • -7549
    • +12013
    ./src/main/java/org/apache/drill/exec/proto/UserProtos.java
  1. … 30 more files in changeset.
DRILL-1328: Support table statistics

    • -0
    • +2
    ./src/main/protobuf/UserBitShared.proto
  1. … 50 more files in changeset.
DRILL-6792: Find the right probe side fragment wrapper & fix DrillBuf reference count bugs & tune the execution flow & support left deep tree

closes #1504

  1. … 25 more files in changeset.
DRILL-6731: Move the BFs aggregating work from the Foreman to the RuntimeFilter

  1. … 14 more files in changeset.
[maven-release-plugin] prepare release drill-1.14.0

  1. … 30 more files in changeset.
DRILL-6639: Exception happens while displaying operator profiles for some queries

    • -0
    • +8
    ./src/main/protobuf/UserBitShared.proto
  1. … 15 more files in changeset.
DRILL-6639: Exception happens while displaying operator profiles for some queries

closes #1404

    • -0
    • +8
    ./src/main/protobuf/UserBitShared.proto
  1. … 15 more files in changeset.
DRILL-6635: PartitionLimit for Lateral/Unnest Protobuf changes to add new operator PartitionLimit

    • -0
    • +1
    ./src/main/protobuf/UserBitShared.proto
  1. … 2 more files in changeset.