Clone Tools
  • last updated 16 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-7592: Add missing licenses and update plugins exclusion list and fix licenses

closes #1989

  1. … 85 more files in changeset.
DRILL-7251: Read Hive array w/o nulls

1. HiveFieldConverter replaced by Hive writers for primitives

2. Created HiveValueWriterFactory and HiveListWriter to implement arrays support

4. Readers generation replaced by HiveDefaultRecordReader and HiveTextRecordReader

5. Few reader initializers replaced by one

6. Added method to repeated vardecimal writer

7. Minor fix for array column in View

  1. … 53 more files in changeset.
DRILL-6094: Decimal data type enhancements

Add ExprVisitors for VARDECIMAL

Modify writers/readers to support VARDECIMAL

- Added usage of VarDecimal for parquet, hive, maprdb, jdbc;

- Added options to store decimals as int32 and int64 or fixed_len_byte_array or binary;

Add UDFs for VARDECIMAL data type

- modify type inference rules

- remove UDFs for obsolete DECIMAL types

Enable DECIMAL data type by default

Add unit tests for DECIMAL data type

Fix mapping for NLJ when literal with non-primitive type is used in join conditions

Refresh protobuf C++ source files

Changes in C++ files

Add support for decimal logical type in Avro.

Add support for date, time and timestamp logical types.

Update Avro version to 1.8.2.

  1. … 201 more files in changeset.
DRILL-4982: Separate Hive reader classes for different data formats to improve performance.

1, Separating Hive reader classes allows optimization to apply on different classes in optimized ways. This separation effectively avoid the performance degradation of scan.

2, Do not apply Skip footer/header mechanism on most Hive formats. This skip mechanism introduces extra checks on each incoming records.

close apache/drill#638

  1. … 6 more files in changeset.
DRILL-4459: Resolve SchemaChangeException while querying hive json table

- Replace drill var16char to varchar datatype for hive string datatype

- Change testGenericUDF() and testUDF() to use VarChar instead of Var16Char

- Add unit test for hive GET_JSON_OBJECT UDF

closes #431

  1. … 11 more files in changeset.
DRILL-3745: Hive CHAR not supported

  1. … 11 more files in changeset.
DRILL-1192: Hive Scalar UDFs: Add Date, TimeStamp and Decimal type support

Also following refactoring:

+ Minimize the number of variables in HiveTypes.tdd

+ Make use of Hive TypeEntries and Hive AbstractPrimitiveObjectInspector to simplify Drill ObjectInspectors implementations.

Test:

+ Add Hive UDF test implementations and testcases to cover all supported types (passing data into Hive UDF and reading data returned from Hive UDF).

  1. … 14 more files in changeset.
DRILL-1024: Move hive storage code out of 'exec/java-exec' into 'contrib/storage-hive' module.

+ Create two modules in contrib/storage-hive

++ contrib/storage-hive/hive-exec-shade: creates shaded hive-exec.jar

++ contrib/storage-hive/core: contains Hive storage code (schema, record reader and functions)

+ Update TestHiveUDFs.java to use BaseTestQuery instead of SimpleRootExec

  1. … 70 more files in changeset.