Clone Tools
  • last updated 26 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-7502: Invalid codegen for typeof() with UNION

Also fixes DRILL-6362: typeof() reports NULL for primitive

columns with a NULL value.

typeof() is meant to return "NULL" if a UNION has a NULL

value, but the column type when known, such as for non-UNION

columns.

Also fixes DRILL-7499: sqltypeof() function with an array returns

"ARRAY", not type. This was due to treating REPEATED like LIST.

Handling of the Union vector in code gen is problematic

with about three special cases. Existing code handled two

of the cases. This change handles the third case.

Figuring out the change required poking around quite a bit

of unclear code. Added comments and restructuring to make

that code a bit more clear.

The fix modified code gen for the Union Holder. It can now

"go back in time" to add the union reader at the point we

need it.

closes #1945

  1. … 53 more files in changeset.
DRILL-7326: Support repeated lists for CTAS parquet format

closes #1844

    • -0
    • +2
    ./repeated_list_of_maps.json
  1. … 4 more files in changeset.
DRILL-6318: Push down limit past flatten is incorrect

closes #1204

  1. … 3 more files in changeset.
DRILL-4927 (part 2): Add support for Null Equality Joins (mixed comparators)

This changes are a subset of the original pull request from DRILL-4539 (PR-462).

- Added changes to support mixed comparators;

- Added tests for it.

closes #635

    • -0
    • +32
    ./nullEqualJoin1.json
    • -0
    • +32
    ./nullEqualJoin2.json
  1. … 10 more files in changeset.
DRILL-4653: Malformed JSON should not stop the entire query from progressing

This closes #518

    • -0
    • +10
    ./drill4653/file.json
  1. … 8 more files in changeset.
DRILL-3232: Promotable writer

  1. … 30 more files in changeset.
DRILL-3229: Implement Union type vector

  1. … 54 more files in changeset.
DRILL-3476: Merge paths in FieldSelection

Conflicts:

exec/java-exec/src/test/java/org/apache/drill/exec/store/json/TestJsonRecordReader.java

  1. … 2 more files in changeset.
DRILL-3353: Fix dropping nested fields

Use the SchemaChangeCallBack in more places to track schema changes

Reset the ephemeral transfer pair when making a new transfer pair for Map or RepeatedMap

  1. … 16 more files in changeset.
DRILL-3318: Bump calcite version to 1.1.0-drill-r9 Added unit test

  1. … 2 more files in changeset.
DRILL-2823: Use implicit casts for comparisons of expression in the join condition

    • -0
    • +1
    ./implicit_cast_join_1.json
  1. … 5 more files in changeset.
DRILL-1832: Add unit tests for Json file with null values

    • -0
    • +43
    ./drill-1832-1-result.json
    • -0
    • +1
    ./drill-1832-2-result.json
  1. … 1 more file in changeset.
DRILL-2350: Improve exception handling and error messages in JSON reader.

  1. … 7 more files in changeset.
DRILL-2099: Fix flatten after sort

    • -0
    • +7
    ./flatten_post_sort.json
  1. … 3 more files in changeset.
DRILL-2309: Fix reduce aggregate rule to create new aggregate calls based on input row type

  1. … 2 more files in changeset.
DRILL-1062: Implemented null ordering (NULLS FIRST/NULLS LAST).

Primary:

- Split "compare_to" function templates (for sorting) into

"compare_to_nulls_high" and "compare_to_nulls_low" versions.

- Added tests to verify ORDER BY ordering.

- Added tests to verify merge join order correctness.

- Implemented java.sql.DatabaseMetaData.nullsAreSortedHigh(), etc.

Secondary:

- Eliminated DateInterfaceFunctions.java template (merged into other).

- Renamed comparison-related template data objects and file names.

- Eliminated unused template macros, function template classes.

- Overhauled Order.Ordering; added unit test.

- Regularized some generated-class names.

Miscellaneous:

- Added toString() to ExpressionPosition, Order.Ordering, JoinStatus.

- Fixed some typos.

- Fixed some comment syntax.

    • -0
    • +24
    ./nullableOrdered1.json
    • -0
    • +16
    ./nullableOrdered2.json
  1. … 49 more files in changeset.
DRILL-1460: Implement "read_numbers_as_double" option for JSON reader

Conflicts:

contrib/storage-mongo/src/main/java/org/apache/drill/exec/store/mongo/MongoRecordReader.java

exec/java-exec/src/main/java/org/apache/drill/exec/ExecConstants.java

exec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl/conv/JsonConvertFrom.java

exec/java-exec/src/main/java/org/apache/drill/exec/server/options/SystemOptionManager.java

exec/java-exec/src/main/java/org/apache/drill/exec/store/easy/json/JSONRecordReader.java

exec/java-exec/src/main/java/org/apache/drill/exec/vector/complex/fn/JsonReader.java

Conflicts:

exec/java-exec/src/main/java/org/apache/drill/exec/vector/complex/fn/JsonReader.java

exec/java-exec/src/test/java/org/apache/drill/exec/store/json/TestJsonRecordReader.java

    • -0
    • +2
    ./mixed_number_types.json
  1. … 7 more files in changeset.
DRILL-1953: alter session set store.json.all_text_mode does not work as documented

  1. … 4 more files in changeset.
DRILL-2066: Clear target vectors before performing transfer()

    • -0
    • +1
    ./repeatedmap_sort_bug.json
  1. … 4 more files in changeset.
DRILL-1887: Add code-gen for explicitly comparing null values for hash table keys and make corresponding change for hash aggregation and hash join.

Add test cases for joins and aggregations on nullable columns.

  1. … 5 more files in changeset.
DRILL-1748: Fix SplitUpComplexExpressions rule when using Item operator

  1. … 2 more files in changeset.
DRILL-1741: kvgen support for complex values (maps/ lists)

    • -0
    • +59
    ./kvgen_complex_input.json
  1. … 3 more files in changeset.
DRILL-1634: Fix issue in complex type expression type resolution, when Drill queries a nested array.

code clean up.

add comment of code change.

  1. … 2 more files in changeset.
DRILL-1544 : Support escape character in "like" or "similar to" SQL operator.

Conflicts:

exec/java-exec/src/test/java/org/apache/drill/TestExampleQueries.java

  1. … 2 more files in changeset.
DRILL-1534: Implement Mappify UDF to transform map into a repeated map with key, value pairs

  1. … 4 more files in changeset.
DRILL-1333: Flatten operator for allowing more complex queryies against repeated data.

    • -0
    • +106
    ./input2_modified.json
    • -0
    • +6
    ./repeated_list_bug.json
  1. … 33 more files in changeset.
DRILL-1402: Add check-style rules for trailing space, TABs and blocks without braces

  1. … 439 more files in changeset.
DRILL-927: Run-time code generation support for reading Complex Type.

Fix in RepeatedMapVector.

  1. … 23 more files in changeset.
Add support for RepeatedMapVector, MapVector and RepeatedListVector.

  1. … 135 more files in changeset.
DRILL-364: Fix VarChar casting

  1. … 5 more files in changeset.