Clone
 

sudheesh katkam <skatkam@maprtech.com> in drill

Add Sudheesh's PGP Key

DRILL-4987: Use ImpersonationUtil to get process user’s groups in RemoteFunctionRegistry

closes #642

DRILL-4972: Remove setDaemon(true) call in WorkManager.StatusThread

closes #633

DRILL-4950: Remove incorrect false condition; consume all empty batches

closes #621

DRILL-4499: Remove 16 unused classes

This closes #426

DRILL-4654: Add new metrics to the MetricRegistry

+ New metrics:

- drill.queries.enqueued

number of queries that have been submitted to the drillbit but have

not started

- drill.queries.running

number of running queries for which this drillbit is the foreman

- drill.queries.completed

number of completed queries (or cancelled or failed) for which this

drillbit was the foreman

- drill.fragments.running

number of query fragments that are running in the drillbit

- drill.allocator.root.used

amount of memory used in bytes by the internal memory allocator

- drill.allocator.root.peak

peak amount of memory used in bytes by the internal memory allocator

- fd.usage

ratio of used to total file descriptors (on *nix systems)

+ Rename "current" to "used" for RPC allocator current memory usage to

follow convention

+ Borrow SystemPropertyUtil class from Netty

+ Configure DrillMetrics through system properties

+ Remove unused methods and imports

closes #495

    • -13
    • +1
    /common/src/main/resources/drill-module.conf
DRILL-4623: Disable epoll transport by default

closes #486

DRILL-4588: Enable JMX reporting

closes #469

DRILL-3743: Fail active result listeners if server connection is closed

+ Remove dead code

+ Improve error and logging messages

closes #460

DRILL-3623: For limit 0 queries, optionally use a shorter execution path when result column types are known

+ "planner.enable_limit0_optimization" option is disabled by default

+ Print plan in PlanTestBase if TEST_QUERY_PRINTING_SILENT is set

+ Fix DrillTestWrapper to verify expected and actual schema

+ Correct the schema of results in TestInbuiltHiveUDFs#testXpath_Double

This closes #405

DRILL-6574: Add option to push LIMIT(0) on top of SCAN (late limit 0 optimization)

DRILL-4281: Support authorized proxy users to impersonate other users

closes #400

DRILL-4362: Exclude log4j for hbase dependency under mapr profile

This closes #366

DRILL-3921: Initialize the underlying record reader lazily in HiveRecordReader

This closes #197

+ OperatorContextImpl has a lazily initialized executor service that is

a decorator around the worker pool. This service is used through

#runCallableAs to run a callable task as the given proxy user.

+ Unit tests use partition student table with chained impersonation to

exercise running multiple delegate callables (creates multiple readers,

a reader per partition).

+ Remove unused WorkManager#shutdownAndAwaitTermination method

DRILL-3340: Part 2: Reverting 1a589ab and committing latest patch

Add operator metrics registry for metric definitions

+ Display metrics as a table within an operator profile panel

+ Rename FragmentStats#getOperatorStats to newOperatorStats

DRILL-2583, DRILL-3428: Catch exceptions, and throw UserException#dataReadError with more context. This closes #161

+ Added convenient method to UserException for String.format(...)

DRILL-1065: Support for ALTER ... RESET statement

+ Support for "SET option = value" statement (assumes scope as SESSION)

+ Bump Calcite version to include CALCITE-823 (Parser support for "ALTER

... RESET" statement). This commit includes a breaking change:

SqlSetOption#getName now returns a SqlIdentifier rather than a String

=> option names are multi-part identifiers, and do not

require escaping

+ Add rule in CompoundIdentifierConverter (+ Override annotations)

+ Improve error messages in SetOptionHandler

+ Add documentation (CompoundIdentifierConverter, OptionValue,

SessionOptionManager, SystemOptionManager)

- Does not include support for deleting short lived options

+ Default ExecutionControls option value should be at SYSTEM level

+ Change asserts to preconditions in SystemOptionManager

+ Add a precondition to TypeValidator's ctor to ensure default value are

set at SYSTEM level

this closes #159

DRILL-3583: Deprecate UserException#build method to avoid mishaps. This closes #123

DRILL-2650: Mark query end time when closing the Foreman

this closes #80

DRILL-3455: If fragments on unregistered Drillbits finished successfully, do not fail the query

+ DRILL-3448: Flipped the atLeastOneFailure condition in QueryManager

+ fixes in DrillbitStatusListener interface

+ logs from implementations of DrillbitStatusListener

DRILL-2304: Manage options with lowercase names

This closes #90

Major refactoring:

+ Removed unnecessary methods from OptionManagers, and refactored implementations

+ Removed OptionAdmin interface, which was a delegate to validators

Other fixes:

+ Added CaseInsensitiveMap

+ Moved OptionValue creation from TypeValidators to SetOptionHandler

+ Fixed error message in BaseOptionManager

+ Added documentation for all OptionManagers, and OptionValidator

DRILL-2304: Addressing Jason's review comments (1)

+ Use generic Map rather than CaseInsensitiveMap for member variables and parameters

+ SessionOptionManager should use a ConcurrentHashMap

DRILL-3497: Throw UserException#validationError instead of SetOptionException and ExpressionParsingException for options

This closes #98

+ Fixed bug in PositiveLongValidator (0 is not positive)

+ Added UserExceptionMatcher for unit tests

DRILL-3497: Addressing Jason's review comments (1)

DRILL-3122: Ignore OptionType for option status

DRILL-3341: Avoid recomputing stats in ProfileWrapper

+ Small optimizations and comments in OperatorWrapper and FragmentWrapper

+ Comparator renames for consistency

+ Move TableBuilder#toString logic to TableBuilder#build

+ Incorrect field names in profile page for failed queries

DRILL-3340: Added operator names and metric names to query profile before writing it to store

+ Rename: FragmentStats#getOperatorStats => newOperatorStats

+ Documentation

this closes #216

DRILL-3450: Moved methods from AbstractStatusReporter and NonRootStatusReporter to FragmentStatusReporter

+ Removed StatusReporter interface

+ Refactored FragmentStatusReporter

DRILL-3096: Fixed logging in FragmentExecutor

DRILL-3319: Replaced UserException#build() method with #build(Logger) method to log from the correct class

+ Fixed docs in UserException

+ Created loggers, and changed logger visibility to private

  1. … 23 more files in changeset.
DRILL-3190: Check for transitions from CANCELLATION_REQUESTED state + Moved state transition checks to QueryManager

DRILL-2903: General improvements to tests in TestDrillbitResilience + Added RepeatTestRule to tests that are flaky + Added Controls.Builder to create controls string in tests + Added @Ignore to failing tests (filed JIRAs)

Other fixes:

+ Added @Override to ScanBatch#close to avoid potential bugs

+ Added docs link in ProtobufLengthDecoder

+ Fixed logging issue in CountDownLatchImpl

  1. … 3 more files in changeset.