Clone Tools
  • last updated 14 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-7530: Fix class names in loggers

1. Fix incorrect class names for loggers.

2. Minor code cleanup.

closes #1957

  1. … 55 more files in changeset.
DRILL-7393: Revisit Drill tests to ensure that patching is executed before any test run

- Added BaseTest with patchers and extended all tests from it.

- Added a test to java-exec module to ensure that all tests there are inherited from BaseTest.

- Revised exception handling in the patchers, now it's individual for each patching method.

closes #1910

  1. … 138 more files in changeset.
DRILL-7388: Kafka improvements

1. Upgraded Kafka libraries to 2.3.1 (DRILL-6739).

2. Added new options to support the same features as native JSON reader:

a. store.kafka.reader.skip_invalid_records, default: false (DRILL-6723);

b. store.kafka.reader.allow_nan_inf, default: true;

c. store.kafka.reader.allow_escape_any_char, default: false.

3. Fixed issue when Kafka topic contains only one message (DRILL-7388).

4. Replaced Gson parser with Jackson to parse JSON in the same manner as Drill native Json reader.

5. Performance improvements: Kafka consumers will be closed async, fixed issue with resource leak (DRILL-7290), moved to debug unnecessary info logging.

6. Updated bootstrap-storage-plugins.json to reflect actual Kafka connection properties.

7. Added unit tests.

8. Refactoring and code clean up.

closes #1901

  1. … 26 more files in changeset.
DRILL-6961: Handle exceptions during queries to information_schema

closes #1833

  1. … 7 more files in changeset.
DRILL-7164: KafkaFilterPushdownTest is sometimes failing to pattern match correctly

closes #1760

  1. … 1 more file in changeset.
DRILL-7068: Support memory adjustment framework for resource management with Queues. closes #1677

  1. … 37 more files in changeset.
DRILL-6733: Unit tests from KafkaFilterPushdownTest are failing in some environments.

Added a check that prevents the cluster tear down if TestKafkaSuit is not running.

DRILL-6625: Intermittent failures in Kafka unit tests Unit test changes to fix intermittent kafka producer and consumer errors.

- Increase the value of REQUEST_TIMEOUT_MS_CONFIG to accomadate slower systems.

- Increase the value of producer RETRIES_CONFIG to 3 (from 0).

- Prevent producer to send duplicate messages due to retries by enabling Idempotent producer.

- Increase consumer poll timeout (from 200 ms).

- The design of `TestKafkaSuit` is very similar to design of `MongoTestSuit` and hence would require changes similar to the ones made in [storage-mongo/pom.xml](https://github.com/apache/drill/pull/923/commits/f5dfa56f33a46b92e2f9de153d82a16a77642ddf#diff-e110e2cbfd77d27e85d5121529c612bfR83).

- Current behavior is surefire runs test classes twice - once as a part of `TestKafkaSuit` and the other by directly running classes. To prevent the latter from happening, changes were made in `pom.xml` for `storage-mongo` plugin.

closes #1463

  1. … 1 more file in changeset.
DRILL-6422: Replace guava imports with shaded ones

  1. … 982 more files in changeset.
DRILL-6496: Added print methods for debugging tests, and fixed missing log statement in VectorUtils.

closes #1336

  1. … 33 more files in changeset.
DRILL-5977: Implement Filter Pushdown in Drill-Kafka plugin

closes #1272

    • -0
    • +359
    ./org/apache/drill/exec/store/kafka/KafkaFilterPushdownTest.java
  1. … 10 more files in changeset.
DRILL-6130: Fix NPE during physical plan submission for various storage plugins

1. Fixed ser / de issues for Hive, Kafka, Hbase plugins.

2. Added physical plan submission unit test for all storage plugins in contrib module.

3. Refactoring.

closes #1108

    • -0
    • +40
    ./org/apache/drill/exec/store/kafka/TestQueryConstants.java
  1. … 21 more files in changeset.
DRILL-4779: Kafka storage plugin (Kamesh Bhallamudi & Anil Kumar Batchu)

closes #1052

    • -0
    • +134
    ./org/apache/drill/exec/store/kafka/KafkaMessageGenerator.java
    • -0
    • +109
    ./org/apache/drill/exec/store/kafka/KafkaQueriesTest.java
    • -0
    • +92
    ./org/apache/drill/exec/store/kafka/KafkaTestBase.java
    • -0
    • +106
    ./org/apache/drill/exec/store/kafka/MessageIteratorTest.java
    • -0
    • +40
    ./org/apache/drill/exec/store/kafka/QueryConstants.java
    • -0
    • +107
    ./org/apache/drill/exec/store/kafka/TestKafkaSuit.java
  1. … 29 more files in changeset.
DRILL-5989: Categories some tests to speed up smoke tests. Made travis run tests.

closes #1053

  1. … 28 more files in changeset.