Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-7530: Fix class names in loggers

1. Fix incorrect class names for loggers.

2. Minor code cleanup.

closes #1957

    • -1
    • +0
    ./TestLateralJoinCorrectnessBatchProcessing.java
  1. … 54 more files in changeset.
DRILL-7506: Simplify code gen error handling

Pushes code gen error handling close to the code gen itself to

allow clearer error messages. Doing so avoids the need to bubble

code gen exceptions up the call stack, resulting in cleaner

operator code.

closes #1948

  1. … 40 more files in changeset.
DRILL-7487: Removes the unused OUT_OF_MEMORY iterator status

See JIRA ticket for full explanation.

closes #1930

  1. … 42 more files in changeset.
DRILL-7393: Revisit Drill tests to ensure that patching is executed before any test run

- Added BaseTest with patchers and extended all tests from it.

- Added a test to java-exec module to ensure that all tests there are inherited from BaseTest.

- Revised exception handling in the patchers, now it's individual for each patching method.

closes #1910

    • -1
    • +2
    ./TestHashJoinHelperSizeCalculatorImpl.java
    • -1
    • +2
    ./TestHashTableSizeCalculatorConservativeImpl.java
    • -1
    • +2
    ./TestHashTableSizeCalculatorLeanImpl.java
  1. … 132 more files in changeset.
DRILL-7441: Fix issues with fillEmpties, offset vectors

Fixes subtle issues with offset vectors and "fill empties"

logic.

Drill has an informal standard that if a batch has no rows, then

offset vectors within that batch should have zero size. Contrast

this with batches of size 1 that should have offset vectors of

size 2. Changed to enforce this rule throughout.

Nullable, repeated and variable-width vectors have "fill empties"

logic that is used in two places: when setting the value count and

when preparing to write a new value. The current logic is not

quite right for either case. Added tests and fixed the code to

properly handle each case.

Revised the batch validator to enforce the offset-vector length of 0 for

0-sized batches rule. The result was much simpler code.

Added tools to easily print a batch, restoring some code that

was recently lost when the RowSet classes were moved.

Code cleanup in all files touched.

Added logic to "dirty" allocated buffers when testing to ensure

logic is not sensitive to the "pristine" state of new buffers.

Added logic to the column writers to enforce the zero-size-batch rule

for offset vectors. Added unit tests for this case.

Fixed the column writers to set the "lastSet" mutator value for

nullable types since other code relies on this value.

Removed the "setCount" field in nullable vectors: turns out

it is not actually used.

closes #1896

  1. … 43 more files in changeset.
DRILL-7350: Move RowSet related classes from test folder

    • -2
    • +2
    ./TestLateralJoinCorrectnessBatchProcessing.java
  1. … 290 more files in changeset.
DRILL-7314: Use TupleMetadata instead of concrete implementation

1. Add ser / de implementation for TupleMetadata interface based on types.

2. Replace TupleSchema usage where possible.

3. Move patcher classes into commons.

4. Upgrade some dependencies and general refactoring.

  1. … 40 more files in changeset.
DRILL-7310: Move schema-related classes from exec module to be able to use them in metastore module

closes #1816

  1. … 101 more files in changeset.
DRILL-7302: Bump Apache Avro to 1.9.0

Apache Avro 1.9.0 brings a lot of new features:

Deprecate Joda-Time in favor of Java8 JSR310 and setting it as default

Remove support for Hadoop 1.x

Move from Jackson 1.x to 2.9

Add ZStandard Codec

Lots of updates on the dependencies to fix CVE's

Remove Jackson classes from public API

Apache Avro is built by default with Java 8

Apache Avro is compiled and tested with Java 11 to guarantee compatibility

Apache Avro MapReduce is compiled and tested with Hadoop 3

Apache Avro is now leaner, multiple dependencies were removed: guava, paranamer, commons-codec, and commons-logging

and many, many more!

close apache/drill#1812

    • -1
    • +1
    ./TestLateralJoinCorrectnessBatchProcessing.java
  1. … 4 more files in changeset.
DRILL-7183: TPCDS query 10, 35, 69 take longer with sf 1000 when Statistics are disabled. This commit reverts the changes done for DRILL-6997.

  1. … 5 more files in changeset.
DRILL-7016: Wrong query result with RuntimeFilter enabled when order of join and filter condition is swapped

close apache/drill#1628

    • -0
    • +178
    ./TestHashJoinJPPDCorrectness.java
  1. … 1 more file in changeset.
DRILL-6997: Semijoin is changing the join ordering for some tpcds queries.

close apache/drill#1620

  1. … 6 more files in changeset.
DRILL-6901: Move schema builder to src/main

Moves the SchemaBuilder class out of the src/test name space into the src/main namespace. Specifically, into the existing record.metadata package.

Many files changed in this move. Corrected two minor issues: import of the wrong Arrays class and unnecessary annotations.

    • -1
    • +1
    ./TestLateralJoinCorrectnessBatchProcessing.java
  1. … 86 more files in changeset.
DRILL-6889: Exclude Drill unit tests to avoid Travis timing out

closes #1567

  1. … 11 more files in changeset.
Drill 6735: Implement Semi-Join for the Hash-Join operator (#1522)

    • -0
    • +3
    ./TestHashJoinHelperSizeCalculatorImpl.java
    • -10
    • +10
    ./TestPostBuildCalculationsImpl.java
  1. … 15 more files in changeset.
DRILL-6792: Find the right probe side fragment wrapper & fix DrillBuf reference count bugs & tune the execution flow & support left deep tree

closes #1504

  1. … 27 more files in changeset.
DRILL-6798: Planner changes to support semi-join.

    • -0
    • +118
    ./TestSemiJoin.java
  1. … 19 more files in changeset.
DRILL-6755: Avoid building Hash Table for inner/left join when probe side is empty

- Preparations and cleanup for DRILL-6755

clsoes #1480

  1. … 3 more files in changeset.
DRILL-6517: Hash Join handling uninitialized vector container

    • -0
    • +212
    ./TestHashJoinOutcome.java
  1. … 2 more files in changeset.
DRILL-6422: Replace guava imports with shaded ones

    • -1
    • +1
    ./TestHashTableSizeCalculatorConservativeImpl.java
    • -1
    • +1
    ./TestHashTableSizeCalculatorLeanImpl.java
  1. … 975 more files in changeset.
DRILL-6566: Reduce Hash Agg Batch size and estimate when low available memory (#1438)

DRILL-6566: Reduce Hash Agg Batch size and estimate when mem available is low

    • -1
    • +1
    ./TestHashJoinHelperSizeCalculatorImpl.java
  1. … 8 more files in changeset.
DRILL-6656: Disallow extra semicolons and multiple statements on the same line.

closes #1415

  1. … 144 more files in changeset.
DRILL-6644: Don't reserve space for incoming probe batches unnecessarily during the build phase.

git closes #1409

    • -25
    • +79
    ./TestBuildSidePartitioningImpl.java
    • -24
    • +103
    ./TestPostBuildCalculationsImpl.java
  1. … 5 more files in changeset.
DRILL-6617: Changing name of implicit RowId column from implicitColumn to implicitRIDColumn.

closes #1401

    • -17
    • +17
    ./TestLateralJoinCorrectness.java
    • -1
    • +1
    ./TestLateralJoinCorrectnessBatchProcessing.java
  1. … 19 more files in changeset.
DRILL-6617: Planner Side changed to propagate $drill_implicit_field$ information.

    • -14
    • +21
    ./TestLateralJoinCorrectness.java
  1. … 36 more files in changeset.
DRILL-6619: Lateral changes for implicit column Lateral changes to support batch processing from right side. It also fixes memory leak issue with LimitRecordBatch Added debug logging for Lateral and fixed a memory related issue in Limit

    • -137
    • +206
    ./TestLateralJoinCorrectness.java
    • -0
    • +1007
    ./TestLateralJoinCorrectnessBatchProcessing.java
  1. … 2 more files in changeset.
DRILL-6606: Fixed bug in HashJoin that caused it not to return OK_NEW_SCHEMA in some cases.

closes #1384

  1. … 1 more file in changeset.
DRILL-6453: Fix deadlock caused by reading from left and right inputs in HashJoin simultaneously.

closes #1408

    • -0
    • +101
    ./TestBatchSizePredictorImpl.java
    • -40
    • +235
    ./TestBuildSidePartitioningImpl.java
    • -0
    • +39
    ./TestHashJoinMemoryCalculator.java
    • -82
    • +0
    ./TestHashJoinMemoryCalculatorImpl.java
    • -4
    • +4
    ./TestHashTableSizeCalculatorConservativeImpl.java
    • -4
    • +4
    ./TestHashTableSizeCalculatorLeanImpl.java
    • -41
    • +351
    ./TestPostBuildCalculationsImpl.java
  1. … 11 more files in changeset.
DRILL-6561: Lateral excluding the columns from output container provided by projection push into rules

This closes #1356

    • -1
    • +159
    ./TestLateralJoinCorrectness.java
  1. … 5 more files in changeset.
DRILL-6503: Performance improvements in lateral

closes #1328

  1. … 3 more files in changeset.