Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-7761: Drill fails with OOM for the case of large filter conditions

  1. … 1 more file in changeset.
DRILL-7759: Code compilation exception for queries containing (untyped) NULL

  1. … 2 more files in changeset.
DRILL-7739: Allow implicit casts from required to nullable data type

closes #2080

    • -5
    • +16
    ./exec/fn/impl/TestVarArgFunctions.java
  1. … 2 more files in changeset.
DRILL-7741: Columns are missing when using convert_from function

closes #2081

    • -0
    • +22
    ./exec/vector/complex/writer/TestJsonReader.java
  1. … 1 more file in changeset.
DRILL-7707: Unable to analyze table metadata is it resides in non-writable workspace

    • -0
    • +36
    ./exec/sql/TestMetastoreCommands.java
  1. … 2 more files in changeset.
DRILL-7734: Revise the result set reader

Revised into two forms: push (for streaming JSON results) and

pull (for one operator reading from another).

closes #2077

    • -7
    • +6
    ./test/BufferingQueryEventListener.java
    • -0
    • +162
    ./test/QueryBatchIterator.java
    • -0
    • +44
    ./test/QueryRowSetReader.java
    • -0
    • +84
    ./test/StatementParser.java
  1. … 8 more files in changeset.
DRILL-7716: Create Format Plugin for SPSS Files

  1. … 19 more files in changeset.
DRILL-7725: Updates to the EVF2 framework

* Supports internal implicit columns

* Better support for standard conversions

* Handle several reader corner cases

* Simplified file reader

closes #2073

    • -12
    • +33
    ./exec/physical/impl/scan/ScanTestUtils.java
    • -0
    • +124
    ./exec/physical/impl/scan/v3/TestFixedReceiver.java
  1. … 67 more files in changeset.
DRILL-7724: Refactor metadata controller batch

Also changed for (;;) infinite loops to

while (true) as preferred by IntelliJ.

    • -1
    • +1
    ./exec/physical/rowSet/TestRowSet.java
  1. … 19 more files in changeset.
DRILL-7717: Support Mongo extended types in V2 JSON loader

Adds support for Mongo extended types to the JSON loader.

Refactors the JSON code to make such extensions easier.

Added support for provided schema with extended types.

    • -0
    • +238
    ./exec/store/easy/json/loader/TestBasics.java
    • -0
    • +570
    ./exec/store/easy/json/loader/TestExtendedArrays.java
    • -0
    • +562
    ./exec/store/easy/json/loader/TestExtendedTypes.java
    • -0
    • +449
    ./exec/store/easy/json/loader/TestExtendedWithSchema.java
    • -0
    • +248
    ./exec/store/easy/json/loader/TestMessageParser.java
    • -9
    • +9
    ./exec/store/easy/json/loader/TestObjects.java
    • -20
    • +155
    ./exec/store/easy/json/loader/TestScalars.java
    • -3
    • +28
    ./exec/store/easy/json/loader/TestUnknowns.java
    • -6
    • +6
    ./exec/store/easy/json/loader/TestVariant.java
  1. … 83 more files in changeset.
DRILL-7710: Fix TestMetastoreCommands#testDefaultSegment test

    • -6
    • +1
    ./exec/sql/TestInfoSchemaWithMetastore.java
DRILL-7711: Add data path, parameter filter pushdown to HTTP plugin

Adds an option to specify the path to data so the plugin will

ignore REST message "overhead" except the actual data.

Allows specifying HTTP URL parameters as filter push-downs from

SQL.

* Revised scan cost model to allow a scan more freedom

to define cost. Needed to ensure that filter push-down

is actually accepted by Calcite.

* Reduced size of HTTP scan plan by including on the one

needed connection config rather than all of them.

* Revised URL building so that the proxy sees the full

URL after adding parameters, etc.

* Many code refinements.

* Added more details to README

  1. … 32 more files in changeset.
DRILL-7703: Support for 3+D arrays in EVF JSON loader

Revises the EVF-based JSON loader to support nested

repeated lists.

    • -0
    • +3
    ./exec/store/easy/json/loader/TestObjects.java
    • -19
    • +146
    ./exec/store/easy/json/loader/TestRepeatedList.java
    • -0
    • +3
    ./exec/store/easy/json/loader/TestScalars.java
    • -0
    • +27
    ./exec/store/easy/json/loader/TestUnknowns.java
    • -0
    • +3
    ./exec/store/easy/json/loader/TestVariant.java
  1. … 8 more files in changeset.
DRILL-7701: EVF V2 Scan Framework

Revises the scan framework to use the revised schema resolution

introduced in DRILL-7696.

    • -0
    • +59
    ./exec/physical/impl/scan/v3/BaseMockBatchReader.java
    • -0
    • +204
    ./exec/physical/impl/scan/v3/BaseScanTest.java
    • -0
    • +93
    ./exec/physical/impl/scan/v3/ScanFixture.java
    • -0
    • +533
    ./exec/physical/impl/scan/v3/TestScanBasics.java
    • -0
    • +275
    ./exec/physical/impl/scan/v3/TestScanEarlySchema.java
    • -0
    • +378
    ./exec/physical/impl/scan/v3/TestScanLateSchema.java
    • -0
    • +329
    ./exec/physical/impl/scan/v3/TestScanOuputSchema.java
    • -0
    • +203
    ./exec/physical/impl/scan/v3/TestScanOverflow.java
    • -0
    • +115
    ./exec/physical/impl/scan/v3/file/BaseFileScanTest.java
    • -0
    • +375
    ./exec/physical/impl/scan/v3/file/TestFileScan.java
    • -0
    • +262
    ./exec/physical/impl/scan/v3/file/TestFileScanLifecycle.java
    • -0
    • +109
    ./exec/physical/impl/scan/v3/file/TestImplicitColumnLoader.java
  1. … 43 more files in changeset.
DRILL-7437: Storage Plugin for Generic HTTP REST API

  1. … 35 more files in changeset.
DRILL-6168: Revise format plugin table functions

Allows table functions to inherit properties from a

defined format plugin.

Also DRILL-7612: enforces immutability for all format plugins.

    • -28
    • +42
    ./exec/physical/impl/writer/TestTextWriter.java
    • -2
    • +10
    ./exec/store/TestPluginRegistry.java
    • -2
    • +2
    ./exec/store/httpd/TestHTTPDLogReader.java
    • -85
    • +87
    ./exec/store/log/TestLogReader.java
    • -1
    • +1
    ./exec/store/pcap/TestPcapEVFReader.java
    • -3
    • +1
    ./exec/store/pcap/TestSessionizePCAP.java
  1. … 37 more files in changeset.
DRILL-7603 and DRILL-7604: Add schema, options to REST query

Update and revision of work originally done by dobesv.

DRILL-7603: Allow default schema to be set for HTTP queries

DRILL-7604: Allow session options to be set in HTTP queries

Merges the above two. Separates running a REST query from the

JSON representation. Allows setting all option types from

a string (as required by DRILL-7604).

Added default schema to query profile query editor.

Made the two query editors a bit more similar visually,

but see DRILL-7697 for more work needed.

Added a utility to run a server for UI teseting without

a full build.

    • -5
    • +27
    ./exec/server/options/OptionValueTest.java
    • -0
    • +43
    ./exec/server/rest/InteractiveUI.java
    • -9
    • +15
    ./exec/server/rest/RestServerTest.java
    • -10
    • +91
    ./exec/server/rest/TestQueryWrapper.java
  1. … 14 more files in changeset.
DRILL-7696: EVF v2 scan schema resolution

Provides the mechanism to resolve the scan schema from a

projection list, provided schema, early reader schema and

actual reader schema.

    • -0
    • +58
    ./exec/physical/impl/scan/v3/file/FileScanUtils.java
    • -0
    • +38
    ./exec/physical/impl/scan/v3/file/MockFileNames.java
    • -0
    • +149
    ./exec/physical/impl/scan/v3/file/TestFileDescrip.java
    • -0
    • +555
    ./exec/physical/impl/scan/v3/file/TestImplicitColumnResolver.java
    • -0
    • +357
    ./exec/physical/impl/scan/v3/schema/TestProjectedPath.java
    • -0
    • +1052
    ./exec/physical/impl/scan/v3/schema/TestScanSchemaTrackerMaps.java
    • -0
    • +276
    ./exec/physical/impl/scan/v3/schema/TestSchemaTrackerDefined.java
  1. … 61 more files in changeset.
DRILL-7675: Work around for partitions sender memory use

Adds an ad-hoc system/session option to limit partition sender

memory use. See DRILL-7686 for the underlying issue.

Also includes code cleanup and diagnostic tools.

closes #2047

  1. … 15 more files in changeset.
DRILL-7683: Add "message parsing" to new JSON loader

Adds the ability to parse "extra" JSON around the data payload,

as often needed for a REST API.

closes #2045

    • -0
    • +179
    ./exec/store/easy/json/parser/TestJsonParserMessage.java
  1. … 11 more files in changeset.
DRILL-7673: View set query fails with NPE for non-existing option

closes #2043

  1. … 1 more file in changeset.
DRILL-7672: Make metadata type required when reading from / writing into Drill Metastore

1. Upgraded Iceberg version and removed unneeded code for In / NotIn Expressions.

2. Updated Metastore Read / Modify interfaces to support required metadata types:

a. introduced abstract Read / Modify classes with boilerplate code;

b. added delete operation with filter and metadata type;

c. added metadata type validator which checks supported metadata types for each component;

d. made purge operation terminal;

e. made necessary changes in REAME.md files.

3. Added / updated unit tests.

closes #2042

  1. … 41 more files in changeset.
DRILL-7651: Increase timeout for TestLargeFileCompilation to avoid GitHub Action failures and fix concurrent issue in TestTpchDistributedConcurrent

    • -75
    • +84
    ./TestTpchDistributedConcurrent.java
    • -66
    • +97
    ./exec/compile/TestLargeFileCompilation.java
DRILL-7643: Fix issues with using columns with the same name as a reserved keyword

closes #2028

    • -3
    • +11
    ./exec/sql/TestMetastoreCommands.java
    • -2
    • +2
    ./exec/store/parquet/TestParquetMetadataCache.java
  1. … 6 more files in changeset.
DRILL-7640: EVF-based JSON Loader

Builds on the JSON structure parser and several other PRs

to provide an enhanced, robust mechanism to read JSON data

into value vectors via the EVF. This is not the JSON reader,

rather it is the "V2" version of the JsonProcessor which

does the actual JSON parsing/loading work.

closes #2023

    • -16
    • +1
    ./exec/physical/rowSet/TestSchemaBuilder.java
    • -0
    • +67
    ./exec/store/easy/json/loader/BaseJsonLoaderTest.java
    • -0
    • +313
    ./exec/store/easy/json/loader/TestObjects.java
    • -0
    • +301
    ./exec/store/easy/json/loader/TestRepeatedList.java
    • -0
    • +427
    ./exec/store/easy/json/loader/TestScalarArrays.java
    • -0
    • +552
    ./exec/store/easy/json/loader/TestScalars.java
    • -0
    • +255
    ./exec/store/easy/json/loader/TestUnknowns.java
    • -0
    • +172
    ./exec/store/easy/json/loader/TestVariant.java
    • -2
    • +18
    ./test/rowSet/RowSetComparison.java
  1. … 30 more files in changeset.
DRILL-7330: Implement metadata usage for all format plugins

    • -0
    • +1106
    ./exec/metastore/TestMetastoreWithEasyFormatPlugin.java
    • -2
    • +6
    ./exec/physical/impl/scan/ScanTestUtils.java
    • -43
    • +34
    ./exec/sql/TestMetastoreCommands.java
  1. … 54 more files in changeset.
DRILL-7603: Allow default schema to be set for HTTP queries

This allows REST API requests and Web UI requests to specify a

default

schema. Otherwise this is not possible for HTTP clients because the

"USE" command requires a session, which HTTP clients do not have.

closes #1996

    • -2
    • +2
    ./exec/server/rest/RestServerTest.java
    • -1
    • +9
    ./exec/server/rest/TestQueryWrapper.java
  1. … 3 more files in changeset.
DRILL-7633: Fixes for union and repeated list accessors

Minor fixes and cleanup for the obscure union and

repeated list types in the column accesor framework.

Added variant type typeString() function

    • -5
    • +10
    ./test/rowSet/RowSetComparison.java
  1. … 4 more files in changeset.
DRILL-7631: Updates to the Json Structure Parser

Revised how "look-ahead" works. Added support for unknown

types.

closes #2016

    • -0
    • +325
    ./exec/store/easy/json/parser/BaseTestJsonParser.java
    • -0
    • +401
    ./exec/store/easy/json/parser/TestJsonParserArrays.java
    • -0
    • +327
    ./exec/store/easy/json/parser/TestJsonParserBasics.java
    • -0
    • +97
    ./exec/store/easy/json/parser/TestJsonParserErrors.java
    • -0
    • +161
    ./exec/store/easy/json/parser/TestJsonParserObjects.java
    • -0
    • +294
    ./exec/store/easy/json/parser/TestJsonParserUnknowns.java
  1. … 15 more files in changeset.
DRILL-7429: Wrong column order when selecting complex data using Hive storage plugin

  1. … 4 more files in changeset.