Clone Tools
  • last updated 20 mins ago
Constraints: committers
Constraints: files
Constraints: dates
DRILL-4328: Fix backward compatibility regression caused by DRILL-4198

DRILL-4322: Add underlying exception message when IOException causes DROP TABLE failure

This closes #344

DRILL-2653: Improve web UI experience when there is an error in a storage plugin configuration

Fixed success message, made the error messages red

This closes #343

DRILL-4327: Fix rawtypes warnings in drill codebase

Fixing most rawtypes warning issues in drill modules.

Closes #347

  1. … 63 more files in changeset.
DRILL-4203: Fix DrillVersionInfo to make it provide a valid version number even during the unit tests.

This is now a build-time generated class, rather than one that looks on the

classpath for META-INF files.

This pattern for file generation with parameters passed from the POM files

was borrowed from parquet-mr.

    • -0
    • +90
DRILL-4196 Fix to stop returning no more data when output batch is full during merge.

DRILL-4314: Unit Test Framework can support schema check

Closes #339

DRILL-4313: CPP client - Improve method to pick random drillbit from a cluster. Update build for protobuf changes. This closes #346

    • -40
    • +325
DRILL-4291: Fix Missing classes when trying to query varchar[] using JDBC

- Create a new simplified version of the Hadoop Text class that doesn't include massive dependencies.

- Update Vectors to use new Text class.

- Update the jdbc-all module to have a test which also includes complex types.

- Clean up exclusions in Jdbc jar file to reduce file size.

- Add an enforcer rule that ensures the adbc-all jar exclusions are maintained in the future.

This closes #336.

    • -0
    • +25
DRILL-4295: Removes obsolete protobuf-generated files

These files are obsolete protobuf-generated files, whose definition has been


Cleaning src/main/java files before calling protobuf compiler so that obsolete

files are removed from the directory.

Closes #333

update link to latest odbc driver location

updates to installing ODBC driver pages to post link to new drivers for Drill 1.4

DRILL-4288: Removes obsolete protobuf-generated files

This closes #332.

DRILL-4279: Improve performance for skipAll query against Text/JSON/Parquet table.

DRILL-4260: Adding support for some custom window frames

this includes the following JIRAs:




this closes #340

  1. … 8 more files in changeset.
DRILL-4278: Heap memory leak issues

- Fix issue where WorkspaceConfig was not returning consistent hashCode()s for equal objects.

- Fix issue where we were misusing recycler causing object reference leaks

This closes #331.

DRILL-4285: Bumps FMPP version to 0.9.15/FreeMarker to 2.3.21

FMPP 0.9.14 pom.xml specifies a version range for FreeMarker dependency,

which should be okay except that latest SNAPSHOT version doesn't resolve


FMPP 0.9.15 now uses a fixed stable version (2.3.21).

This closes #330.

DRILL-2517: (Prototype from Adam) Apply directory-based pruning before reading file.

DRILL-4287: During initial DrillTable creation don't read the metadata cache file; instead do it during ParquetGroupScan.

Maintain state in FileSelection to keep track of whether certain operations have been done on that selection.

Remove ParquetFileSelection since its only purpose was to carry the metadata cache information which is not needed anymore.




Resolve issues after rebasing:

1) JsonIgnore fileSelection in ParquetGroupScan

2) FileSysemPartitionDescriptor change.



DRILL-4287: Address code review comments and follow-up changes after rebasing:

- In FileSelection: updated call to the Stopwatch, set all flags appropriately in minusDirectories(), modify supportDirPruning()

- In ParquetGroupScan: Simplify directory checking in constructor, set the parquetTableMetadata field after reading metadata cache.

- Fix unit tests to use an alias for the reserved dir<N> columns as partition-by columns.

More follow-up changes:

- Get rid of fileSelection attribute in ParquetGroupScan

- Initialize entries after expanding the selection when metadata cache is used

- For non-metadata cache, don't do any expansion in the constructor; let init() handle it

- In FileSystemPartitionDescriptor, the createPartitionSublists is modified to check for parquet scan

When reading from metadata cache , ensure selection root does not contain the scheme and authority prefix. Minor refactoring.

Address code review comments and fix a bug. Simplify FileSelection state management based on review comment.

close apache/drill#376

DRILL-4131: Move RPC allocators under Drill's root allocator & accounting

- Allow settings to be set to ensure RPC reservation and maximums (currently unset by default). Defaults set in drill-module.conf

- Add new metrics to report RPC layer memory consumption.

- Check for memory leaks from RPC layer at shutdown.

- Add a multi-Drillbit single JVM safe DrillMetrics.register()

- Remove invalid verifyAllocator checks while RPC connection (and PING/PONG) are maintained

This closes #327.

DRILL-4277: Fix for JdbcPrel serialization issue.

This closes #326.

    • -0
    • +1
    • -0
    • +1
Jacques' simplification

Rahul's change

john omernik's change

remove dead links, clarify reqmts

odbc driver links, DRILL-4239

DRILL-4256: Create HiveConf per HiveStoragePlugin and reuse it wherever needed.

Creating new instances of HiveConf() are very costly, we should avoid creating new ones as much as possible.

Also get rid of hiveConfigOverride and use HiveConf in HiveStoregPlugin wherever we need the HiveConf.

DRILL-4270: Create a separate WindowFramer that supports the FRAME clause

separate DefaultFrameTemplate into 2 implementations: one that supports custom frames (aggregations, first_value, last_value) and one that doesn't

this closes #322

DRILL-4241: Various Type Fixes

DRILL-4241: Fixing the build, make RAT and checkstyle happy.

DRILL-4246: Fix Allocator concurrency bug and improve error detection

- Rename the internal DrillBuf field to udle to better express its purpose.

- Rename AllocatorManager to AllocationManager to better express its purpose.

- Address situation where dangling ledger could be transferred into while it was being released released by protecting association and release inside the AllocationManager.

- Add allocator assertions to ensure allocator operations are done while the allocator is open.

- Simplify AllocationManager locking model.

- Exclude HDFS reference to netty-all

- Improve debugging messages for allocators (and fix debug message bugs)

This closes #323.