drill

Clone Tools
  • last updated 11 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-3781: Group by system function in schema-based table.

Fix is in Calcite-886. Add unit test and bump forked Calcite version in Drill.

DRILL-3786: Query with window function fails with IllegalFormatConversionException

this closes #239

DRILL-2274: Unable to allocate sv2 buffer after repeated attempts : JOIN, Order by used in query

- when ExternalSortBatch.newSV2() couldn't allocate a new SV2 it spills the spilledBatchGroups instead of batchGroups, otherwise no memory will be released for the sort's allocator

- copierAllocator is closed as soon as possible to free more memory for the sort

this closes #172

DRILL-3811: AtomicRemainder incorrectly accounts for transferred allocations

this closes #163

DRILL-3809: Make PrelFinalizer have instances rather than a single Prel since RelShuttleImpl has internal state.

DRILL-2583, DRILL-3428: Catch exceptions, and throw UserException#dataReadError with more context. This closes #161

+ Added convenient method to UserException for String.format(...)

Bridget user auth change, Venki review DRILL-3725/3622

    • -3
    • +3
    /_docs/install/060-starting-the-web-ui.md
DRILL-3779: Fix NPE in mergeAndSpill(). Add more debug logging messages. Make copier per-batch memory limit power of 2. Get rid of some warnings. Add a few comments.

Address review comments.

Close apache/drill#160

fix links

    • -1
    • +1
    /_docs/query-data/080-monitoring-and-canceling-queries-in-the-Drill-Web-UI.md
docs.json for UI > Console change

web ui > web console

    • -52
    • +52
    /_docs/configure-drill/076-configuring-user-impersonation-with-hive-authorization.md
    • -18
    • +18
    /_docs/configure-drill/078-configuring-web-ui-and-rest-api-security.md
    • -9
    • +9
    /_docs/install/060-starting-the-web-ui.md
  1. … 12 more files in changeset.
add Aman's comment DRILL-2743 from 8/21

Bridget's 1.2 changes

DRILL-2748: Improve cost estimation for Drill logical aggregation in query planner.

DRILL-1065: Support for ALTER ... RESET statement

+ Support for "SET option = value" statement (assumes scope as SESSION)

+ Bump Calcite version to include CALCITE-823 (Parser support for "ALTER

... RESET" statement). This commit includes a breaking change:

SqlSetOption#getName now returns a SqlIdentifier rather than a String

=> option names are multi-part identifiers, and do not

require escaping

+ Add rule in CompoundIdentifierConverter (+ Override annotations)

+ Improve error messages in SetOptionHandler

+ Add documentation (CompoundIdentifierConverter, OptionValue,

SessionOptionManager, SystemOptionManager)

- Does not include support for deleting short lived options

+ Default ExecutionControls option value should be at SYSTEM level

+ Change asserts to preconditions in SystemOptionManager

+ Add a precondition to TypeValidator's ctor to ensure default value are

set at SYSTEM level

this closes #159

DRILL-2908: Fix Parquet for var length vectors where encoding changes across pages. Add unit tests. Add option to make parquet page size and disctionary page size configurable at session level. This closes #162

    • binary
    /exec/java-exec/src/test/resources/parquet/int96_impala_1.parquet
DRILL-3581: Upgrade to Guava 18.0

- Replace Stopwatch constructors with .createStarted() or .createUnstarted()

- Stop using InputSupplier and Closeables.closeQuietly

- Clean up quiet closes to log or (preferably) propagate.

- Add log4j to enforcer exclusions.

- Update HBaseTestSuite to add patching of Closeables.closeQuietly() and Stopwatch legacy methods. Only needed when running HBaseMiniCluster.

- Remove log4j from HBase's pom to provide exception logging.

- Remove log4j from Hive's shaded pom.

- Update Catastrophic failures to use the same pattern to ensure reporting.

- Update test framework to avoid trying IPv6 resolution. (This removes 90s pause from HBase startup in my tests)

This closes #361.

This closes #157.

  1. … 51 more files in changeset.
DRILL-3778: Add missed part of DRILL-3160 (making JDBC Javadoc available).

This closes #158

Main:

Configured Javadoc generation (title, package groups, version in headers).

Added link to JDBC page in Drill documentation site.

Edited/fixed some JDBC Javadoc comments.

Added explicit SQLConversionOverflowException to throws clauses for Javadoc

effect.

Added some imports for Javadoc references.

Misc.:

Fixed a couple Javadoc syntax errors.

Fixed POM indentation.

DRILL-3160: Make JDBC Javadoc documentation available to users

Delete deprecated Jackson access proxies.

Disable TestExampleQueries.testTextPartitions() until DRILL-3774 is fixed.

Reduce test time by not waiting 2 seconds for newly submitted tasks before shutting down RPC thread pool.

DRILL-3201: Support security for access through Web UI

  1. … 9 more files in changeset.
DRILL-3735: For partition pruning divide up the partition lists into sublists of 64K each and iterate over each sublist.

Add abstract base class for various partition descriptors. Add logging messages in PruneScanRule for better debuggability.

Address review comments.

Close apache/drill#156

reverting a fix no longer needed after DRILL-3767

DRILL-3767: SchemaPath.getCompoundPath(String...strings) reverses it's input array

this closes #155

DRILL-1942-readers: - add extends AutoCloseable to RecordReader, and rename cleanup() to close(). - fix many warnings - formatting fixes

DRILL-1942-readers:

- renamed cleanup() to close in the new JdbcRecordReader

Close apache/drill#154

Daniel's changes

remove Step 1, there is no other step

minor edit

minor edits

DRILL-2354

DRILL-2757

typo

web UI security

web ui security updates

format bullets

remove impersonation

web ui security

fix link

obsolete stuff

obsolete

fix per Daniel

web ui security update

typo

Bridget's 1.2 window func updates

Bridget's fixes

    • -0
    • +121
    /_docs/configure-drill/078-configuring-web-ui-and-rest-api-security.md
    • binary
    /_docs/img/web-ui-admin-view.png
    • binary
    /_docs/img/web-ui-login.png
    • binary
    /_docs/img/web-ui-user-view.png
  1. … 30 more files in changeset.
DRILL-3746: Get Hive partition values from MetaStore instead of from parsing the partition location path

1) Added a partition with custom location to test Hive table. Existing partition tests now work after the fix.

2) Enabled a test which was disabled previously due to a bug in interpreter code which is fixed recently.

This closes #151

DRILL-3280, DRILL-3360, DRILL-3601, DRILL-3649: Add test cases

Fix is in CALCITE-820

Close apache/drill#152

DRILL-3773: Fix Mongo FieldSelection

Mongo plugin was previously rewriting a complex (multi-level) column reference as a simple selection of the top level field.

This changeset does not change this behavior in terms of the filter sent to mongo, but it add the original selected column to the list that will be read in by the JSON reader once that data is returned from mongo.

What this means is that we will be requesting more data from mongo that necessary (as we were previously), but this will be leveraging the existing functionality in the JSON reader to grab only the sub-selection actually requested in the query. This allows for difficult schema changes to be avoided by projecting only columns without schema changes.

This also fixes and adds unit tests for FieldSelection that cause wrong results when selecting a nested column and its parent.