drill

Clone Tools
  • last updated 26 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-4128: Fix NPE when calling getString on a JDBC ResultSet when the type is not varchar

DRILL-4331: Fix TestFlattenPlanning.testFlattenPlanningAvoidUnnecessaryProject test for Java8

Test TestFlattenPlanning.testFlattenPlanningAvoidUnnecessaryProject fails with Java8

because of Map order differences between Java7 and Java8. Test now checks for both

options.

Closes #351

Adding Jason's GPG key

Adding Jason's GPG key

DRILL-4323: Handle skipAll query when use HiveDrillNativeParquetScan

Do not add Project when no column is needed to be read out from Scan (e.g., select count(*) from hive.table)

DRILL-4328: Fix backward compatibility regression caused by DRILL-4198

DRILL-4322: Add underlying exception message when IOException causes DROP TABLE failure

This closes #344

DRILL-2653: Improve web UI experience when there is an error in a storage plugin configuration

Fixed success message, made the error messages red

This closes #343

DRILL-4327: Fix rawtypes warnings in drill codebase

Fixing most rawtypes warning issues in drill modules.

Closes #347

  1. … 63 more files in changeset.
DRILL-4203: Fix DrillVersionInfo to make it provide a valid version number even during the unit tests.

This is now a build-time generated class, rather than one that looks on the

classpath for META-INF files.

This pattern for file generation with parameters passed from the POM files

was borrowed from parquet-mr.

    • -0
    • +90
    /common/src/main/java/org/apache/drill/version/Generator.java
DRILL-4196 Fix to stop returning no more data when output batch is full during merge.

DRILL-4314: Unit Test Framework can support schema check

Closes #339

DRILL-4313: CPP client - Improve method to pick random drillbit from a cluster. Update build for protobuf changes. This closes #346

    • -40
    • +325
    /contrib/native/client/src/protobuf/BitControl.pb.cc
DRILL-4291: Fix Missing classes when trying to query varchar[] using JDBC

- Create a new simplified version of the Hadoop Text class that doesn't include massive dependencies.

- Update Vectors to use new Text class.

- Update the jdbc-all module to have a test which also includes complex types.

- Clean up exclusions in Jdbc jar file to reduce file size.

- Add an enforcer rule that ensures the adbc-all jar exclusions are maintained in the future.

This closes #336.

    • -0
    • +25
    /exec/jdbc-all/src/test/resources/types.json
DRILL-4295: Removes obsolete protobuf-generated files

These files are obsolete protobuf-generated files, whose definition has been

removed.

Cleaning src/main/java files before calling protobuf compiler so that obsolete

files are removed from the directory.

Closes #333

update link to latest odbc driver location

updates to installing ODBC driver pages to post link to new drivers for Drill 1.4

DRILL-4288: Removes obsolete protobuf-generated files

This closes #332.

DRILL-4279: Improve performance for skipAll query against Text/JSON/Parquet table.

DRILL-4260: Adding support for some custom window frames

this includes the following JIRAs:

DRILL-4261: Add support for RANGE BETWEEN UNBOUNDED PRECEDING AND UNBOUNDED FOLLOWING

DRILL-4262: add support for ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW

DRILL-4263: add support for RANGE BETWEEN CURRENT ROW AND CURRENT ROW

this closes #340

  1. … 8 more files in changeset.
DRILL-4278: Heap memory leak issues

- Fix issue where WorkspaceConfig was not returning consistent hashCode()s for equal objects.

- Fix issue where we were misusing recycler causing object reference leaks

This closes #331.

DRILL-4285: Bumps FMPP version to 0.9.15/FreeMarker to 2.3.21

FMPP 0.9.14 pom.xml specifies a version range for FreeMarker dependency,

which should be okay except that latest SNAPSHOT version doesn't resolve

anymore.

FMPP 0.9.15 now uses a fixed stable version (2.3.21).

This closes #330.

DRILL-2517: (Prototype from Adam) Apply directory-based pruning before reading file.

DRILL-4287: During initial DrillTable creation don't read the metadata cache file; instead do it during ParquetGroupScan.

Maintain state in FileSelection to keep track of whether certain operations have been done on that selection.

Remove ParquetFileSelection since its only purpose was to carry the metadata cache information which is not needed anymore.

Conflicts:

exec/java-exec/src/main/java/org/apache/drill/exec/planner/FileSystemPartitionDescriptor.java

exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/ParquetFileSelection.java

Resolve issues after rebasing:

1) JsonIgnore fileSelection in ParquetGroupScan

2) FileSysemPartitionDescriptor change.

Conflicts:

exec/java-exec/src/main/java/org/apache/drill/exec/planner/FileSystemPartitionDescriptor.java

DRILL-4287: Address code review comments and follow-up changes after rebasing:

- In FileSelection: updated call to the Stopwatch, set all flags appropriately in minusDirectories(), modify supportDirPruning()

- In ParquetGroupScan: Simplify directory checking in constructor, set the parquetTableMetadata field after reading metadata cache.

- Fix unit tests to use an alias for the reserved dir<N> columns as partition-by columns.

More follow-up changes:

- Get rid of fileSelection attribute in ParquetGroupScan

- Initialize entries after expanding the selection when metadata cache is used

- For non-metadata cache, don't do any expansion in the constructor; let init() handle it

- In FileSystemPartitionDescriptor, the createPartitionSublists is modified to check for parquet scan

When reading from metadata cache , ensure selection root does not contain the scheme and authority prefix. Minor refactoring.

Address code review comments and fix a bug. Simplify FileSelection state management based on review comment.

close apache/drill#376

DRILL-4131: Move RPC allocators under Drill's root allocator & accounting

- Allow settings to be set to ensure RPC reservation and maximums (currently unset by default). Defaults set in drill-module.conf

- Add new metrics to report RPC layer memory consumption.

- Check for memory leaks from RPC layer at shutdown.

- Add a multi-Drillbit single JVM safe DrillMetrics.register()

- Remove invalid verifyAllocator checks while RPC connection (and PING/PONG) are maintained

This closes #327.

DRILL-4277: Fix for JdbcPrel serialization issue.

This closes #326.

    • -0
    • +1
    /contrib/storage-jdbc/src/test/resources/jdbcmulti/file1.json
    • -0
    • +1
    /contrib/storage-jdbc/src/test/resources/jdbcmulti/file2.json
Jacques' simplification

Rahul's change

john omernik's change

remove dead links, clarify reqmts

odbc driver links, DRILL-4239