drill

Clone Tools
  • last updated 24 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
edit to metadata caching doc

DRILL-4363: Row count based pruning for parquet table used in Limit n query.

Modify two existint unit testcase:

1) TestPartitionFilter.testMainQueryFalseCondition(): rowCount pruning applied after false condition is transformed into LIMIT 0

2) TestLimitWithExchanges.testPushLimitPastUnionExchange(): modify the testcase to use Json source, so that it does not mix with PushLimitIntoScanRule.

edit to hive metadata caching

DRILL-4339: Reverse the function signature change made to AbstractRecordReader.setColumns() in DRILL-4279.

updated json

adding new hive metadata caching doc

DRILL-3944: Drill MAXDIR Unknown variable or type FILE_SEPARATOR. This closes #391

DRILL-4354: Remove sessions in anonymous (auth disabled) WebUI access

DRILL-4346: Handle NumberFormatException when casting empty string to int in hbase/maprdb

- Made replacing of functions casting for nullable input varbinary and var16char types are working (in CastFunctions.java setting 'drill.exec.functions.cast_empty_string_to_null = true' didn't work);

- Added new generated classes for casting varbinary and var16char to int (CastEmptyStringVarTypesToNullableNumeric template and Casts.tdd data);

- Created a test (in TestHBaseQueries.java) for checking an empty string to integer casting in maprdb/hbase table;

- Small design changes according to comments in review (import statements, prefixes ...).

This closes #384

MAPR-22405: DocumentStream interface in OJAI API need not be parametrized

Temporary fix for build issue with generated dependency-reduced-pom.xml

This generated pom file was being discovered and maven was trying to

run the target directory in jdbc-all as a submodule.

This change reverts to the default output location (the module root)

and adds corresponding .gitignore and RAT exclude entries.

More investigation of why this became an issue when we added the

maven-enforcer plugin to the module (and only appears when running a release)

will come in DRILL-4336.

Also updated intergration test for the jdbc-all jar with small

path change, as changing the location of the dependency-reduced-pom.xml

actually changed the directory the test was being executed from.

DRILL-4375: Fix the maven release profile

This generated pom file was being discovered and maven was trying to

run the target directory in jdbc-all as a submodule.

This change reverts to the default output location (the module root)

and adds corresponding .gitignore and RAT exclude entries. NOTE:

this is considered bad practice as generated files should appear in

the target directory and be removed upon a maven clean. This default

location is considered to be a known shortcoming of the shade plugin.

Also updated integration test for the jdbc-all jar with small

path change, as changing the location of the dependency-reduced-pom.xml

actually changed the directory the test was being executed from.

Closes #402

MD-670: Querying MapR-DB JSON Tables returns no results

* Use DocumentReader API to emit "_id" field instead of handling it as a special case.

* Update the DrillBuf reference field when reallocation happen.

* Catch the correct exception when schema change happens and include the field name in the warning message.

+ Get rid of unused code.

DRILL-4128: Fix NPE when calling getString on a JDBC ResultSet when the type is not varchar

DRILL-4128: Fix NPE when calling getString on a JDBC ResultSet when the type is not varchar

DRILL-4331: Fix TestFlattenPlanning.testFlattenPlanningAvoidUnnecessaryProject test for Java8

Test TestFlattenPlanning.testFlattenPlanningAvoidUnnecessaryProject fails with Java8

because of Map order differences between Java7 and Java8. Test now checks for both

options.

Closes #351

Adding Jason's GPG key

Adding Jason's GPG key

DRILL-4323: Handle skipAll query when use HiveDrillNativeParquetScan

Do not add Project when no column is needed to be read out from Scan (e.g., select count(*) from hive.table)

DRILL-4328: Fix backward compatibility regression caused by DRILL-4198

DRILL-4322: Add underlying exception message when IOException causes DROP TABLE failure

This closes #344

DRILL-2653: Improve web UI experience when there is an error in a storage plugin configuration

Fixed success message, made the error messages red

This closes #343

DRILL-4327: Fix rawtypes warnings in drill codebase

Fixing most rawtypes warning issues in drill modules.

Closes #347

  1. … 63 more files in changeset.
DRILL-4203: Fix DrillVersionInfo to make it provide a valid version number even during the unit tests.

This is now a build-time generated class, rather than one that looks on the

classpath for META-INF files.

This pattern for file generation with parameters passed from the POM files

was borrowed from parquet-mr.

    • -0
    • +90
    /common/src/main/java/org/apache/drill/version/Generator.java
DRILL-4196 Fix to stop returning no more data when output batch is full during merge.

DRILL-4314: Unit Test Framework can support schema check

Closes #339

DRILL-4313: CPP client - Improve method to pick random drillbit from a cluster. Update build for protobuf changes. This closes #346

    • -40
    • +325
    /contrib/native/client/src/protobuf/BitControl.pb.cc
DRILL-4291: Fix Missing classes when trying to query varchar[] using JDBC

- Create a new simplified version of the Hadoop Text class that doesn't include massive dependencies.

- Update Vectors to use new Text class.

- Update the jdbc-all module to have a test which also includes complex types.

- Clean up exclusions in Jdbc jar file to reduce file size.

- Add an enforcer rule that ensures the adbc-all jar exclusions are maintained in the future.

This closes #336.

    • -0
    • +25
    /exec/jdbc-all/src/test/resources/types.json
DRILL-4295: Removes obsolete protobuf-generated files

These files are obsolete protobuf-generated files, whose definition has been

removed.

Cleaning src/main/java files before calling protobuf compiler so that obsolete

files are removed from the directory.

Closes #333

update link to latest odbc driver location