Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-7314: Use TupleMetadata instead of concrete implementation

1. Add ser / de implementation for TupleMetadata interface based on types.

2. Replace TupleSchema usage where possible.

3. Move patcher classes into commons.

4. Upgrade some dependencies and general refactoring.

  1. … 40 more files in changeset.
DRILL-7196: Queries are still runnable on disabled plugins

- Storage client is not created anymore for disabled plugins

- GET "/storage/{name}.json" endpoint now working with

plugin configuration directly, without client instantination.

It have increased UI responsitivity.

- Hbase and mongo base test classes refactored to honor enabled

plugin attribute

- Fixed path contructor for mongo test datasets:

Now it is cross-platform

- Fixed test json files format which using plugin definitions

- Code cleanup

    • -15
    • +15
    ./java/org/apache/drill/hbase/BaseHBaseTest.java
    • -15
    • +16
    ./resources/hbase/hbase_scan_screen_physical.json
    • -16
    • +17
    ./resources/hbase/hbase_scan_screen_physical_column_select.json
    • -16
    • +17
    ./resources/hbase/hbase_scan_screen_physical_family_select.json
  1. … 103 more files in changeset.
DRILL-7188: Revert DRILL-6642: Update protocol-buffers version

1. Updated protobuf to version 3.6.1

2. Added protobuf to the root pom dependency management

3. Added classes BoundedByteString and LiteralByteString for compatibility with HBase

4. Added ProtobufPatcher to provide compatibility with MapR-DB and HBase

  1. … 40 more files in changeset.
DRILL-7200: Update Calcite to 1.19.0 / 1.20.0

  1. … 45 more files in changeset.
DRILL-6642: Update protocol-buffers version

1. Updated protobuf to version 3.6.1

2. Added protobuf to the root pom dependency management

3. Added classes BoundedByteString and LiteralByteString for compatibility with HBase

4. Added ProtobufPatcher to provide compatibility with MapR-DB and HBase

closes #1639

  1. … 40 more files in changeset.
DRILL-6422: Replace guava imports with shaded ones

    • -2
    • +2
    ./java/org/apache/drill/hbase/BaseHBaseTest.java
  1. … 981 more files in changeset.
DRILL-6656: Disallow extra semicolons and multiple statements on the same line.

closes #1415

  1. … 139 more files in changeset.
DRILL-6496: Added print methods for debugging tests, and fixed missing log statement in VectorUtils.

closes #1336

    • -4
    • +4
    ./java/org/apache/drill/hbase/BaseHBaseTest.java
  1. … 31 more files in changeset.
DRILL-6489: Fix filter push down for Hbase & Mapr-DB binary tables when convert function is used in a view

  1. … 1 more file in changeset.
DRILL-4020: The not-equal operator returns incorrect results when used on the HBase row key

- Added a condition that checks if the filter to the scan specification doesn't have NOT_EQUAL operator

- Added testFilterPushDownRowKeyNotEqual() to TestHBaseFilterPushDown

closes #309

  1. … 1 more file in changeset.
Revert "DRILL-4020: The not-equal operator returns incorrect results when used on the HBase row key"

This reverts commit 0d5eda83fe34928ff60629e6a4903d43a1d82582.

  1. … 1 more file in changeset.
DRILL-6438: Remove excess logging form the tests. - Removed usages of System.out and System.err from the test and replaced with loggers

closes #1284

    • -1
    • +0
    ./java/org/apache/drill/hbase/BaseHBaseTest.java
  1. … 89 more files in changeset.
DRILL-6386: Remove unused imports and star imports.

  1. … 231 more files in changeset.
DRILL-6422: Update guava to 23.0 and shade it

- Fix compilation errors for new version of Guava.

- Remove usage of deprecated API

- Shade guava and add dependencies to the shaded version

- Ban unshaded package

- Introduce drill-shaded module and move guava-shaded under it

- Add methods to convert shaded guava lists to the unshaded ones

- Add instruction for publishing artifacts to the Apache repository

    • -1
    • +1
    ./java/org/apache/drill/hbase/BaseHBaseTest.java
  1. … 82 more files in changeset.
DRILL-6320: Fixed license headers.

closes #1207

    • -1
    • +1
    ./java/org/apache/drill/hbase/BaseHBaseTest.java
  1. … 2054 more files in changeset.
DRILL-6130: Fix NPE during physical plan submission for various storage plugins

1. Fixed ser / de issues for Hive, Kafka, Hbase plugins.

2. Added physical plan submission unit test for all storage plugins in contrib module.

3. Refactoring.

closes #1108

  1. … 26 more files in changeset.
DRILL-6106: Use valueOf method instead of constructor since valueOf has a higher performance by caching frequently requested values.

closes #1099

  1. … 11 more files in changeset.
DRILL-5783, DRILL-5841, DRILL-5894: Rationalize test temp directories

This change includes:

DRILL-5783:

- A unit test is created for the priority queue in the TopN operator.

- The code generation classes passed around a completely unused function registry reference in some places so it is removed.

- The priority queue had unused parameters for some of its methods so it is removed.

DRILL-5841:

- Created standardized temp directory classes DirTestWatcher, SubDirTestWatcher, and BaseDirTestWatcher. And updated all unit tests to use them.

DRILL-5894:

- Removed the dfs_test storage plugin for tests and replaced it with the already existing dfs storage plugin.

Misc:

- General code cleanup.

- Removed unnecessary use of String.format in the tests.

This closes #984

    • -3
    • +3
    ./java/org/apache/drill/hbase/BaseHBaseTest.java
  1. … 363 more files in changeset.
DRILL-3993: Fix failed tests after Calcite update

- fix temporary table errors according to updated logic;

- fixed errors when we trying to make select from hbase table with schema name in query (example: "SELECT row_key FROM hbase.TestTableNullStr) from hbase schema (did "USE hbase" before). Added test for it;

- added fix for views which were created on Calcite 1.4 and test for it.

  1. … 6 more files in changeset.
DRILL-5743: Handling column family and column scan for hbase

closes #975

  1. … 2 more files in changeset.
DRILL-5830: Resolve regressions to MapR DB from DRILL-5546

- Back out HBase changes

- Code cleanup

- Test utilities

- Fix for DRILL-5829

closes #968

    • -1
    • +1
    ./java/org/apache/drill/hbase/BaseHBaseTest.java
  1. … 22 more files in changeset.
DRILL-5781: Fix unit test failures to use tests config even if default config is available

closes #942

  1. … 8 more files in changeset.
DRILL-5761: Disable Lilith ClassicMultiplexSocketAppender by default. Unify logback files.

  1. … 13 more files in changeset.
DRILL-5752 this change includes:

1. Increased test parallelism and fixed associated bugs

2. Added test categories and categorized tests appropriately

- Don't exclude anything by default

- Increase test timeout

- Fixed flakey test

closes #940

  1. … 255 more files in changeset.
DRILL-4963: Fix issues with dynamically loaded overloaded functions

close #701

  1. … 26 more files in changeset.
DRILL-4951: Do Guava.patch earlier so we can run single Hbase's unit test through command line or IDE

closes #636

    • -5
    • +0
    ./java/org/apache/drill/hbase/BaseHBaseTest.java
  1. … 2 more files in changeset.
DRILL-4199: Add Support for HBase 1.X

Highlights of the changes:

* Replaced the old HBase APIs (HBaseAdmin/HTable) with the new HBase 1.1 APIs (Connection/Admin/Table).

* Added HBaseConnectionManager class which which manages the life-cycle of HBase connections inside a Drillbit process.

* Updated HBase dependencies version to 1.1.3 and 1.1.1-mapr-1602-m7-5.1.0 for default and "mapr" profiles respectively.

* Added `commons-logging` dependency in the `provided` scope to allow HBase test cluster to come up for Unit tests.

* Relaxed banned dependency rule for `commons-logging` library for `storage-hbase` module alone, in provided scope only.

* Removed the use of many deprecated APIs throughout the modules code.

* Added some missing test to HBase storage plugin's test suit.

* Move the GuavaPatcher code to main code execution path.

* Log a message if GuavaPatcher fails instead of exiting.

All unit tests are green.

Closes #443

    • -8
    • +7
    ./java/org/apache/drill/hbase/BaseHBaseTest.java
    • -90
    • +0
    ./java/org/apache/drill/hbase/GuavaPatcher.java
    • -198
    • +174
    ./java/org/apache/drill/hbase/TestTableGenerator.java
  1. … 30 more files in changeset.
DRILL-4275: create TransientStore for short-lived objects; refactor PersistentStore to introduce pagination mechanism

  1. … 100 more files in changeset.
DRILL-4358: Fix NPE in UserServer.close()

- Also remove untested CustomSerDe's from CustomTunnel.

- Fix GuavaPatcher copy-paste comment mistake.

closes #362

    • -7
    • +1
    ./java/org/apache/drill/hbase/GuavaPatcher.java
  1. … 2 more files in changeset.
DRILL-4346: Handle NumberFormatException when casting empty string to int in hbase/maprdb

- Made replacing of functions casting for nullable input varbinary and var16char types are working (in CastFunctions.java setting 'drill.exec.functions.cast_empty_string_to_null = true' didn't work);

- Added new generated classes for casting varbinary and var16char to int (CastEmptyStringVarTypesToNullableNumeric template and Casts.tdd data);

- Created a test (in TestHBaseQueries.java) for checking an empty string to integer casting in maprdb/hbase table;

- Small design changes according to comments in review (import statements, prefixes ...).

This closes #384

  1. … 8 more files in changeset.