Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-7463: Apache license is not added to the generated classes

closes #1916

  1. … 2 more files in changeset.
DRILL-7440: Failure during loading of RepeatedCount functions

closes #1894

  1. … 3 more files in changeset.
DRILL-1709: Add desc alias for describe command

closes #1881

  1. … 2 more files in changeset.
DRILL-6096: Provide mechanism to configure text writer configuration

1. Usage of format plugin configuration allows to specify line and field delimiters, quotes and escape characters.

2. Usage of system / session options allows to specify if writer should add headers, force quotes.

closes #1873

    • -9
    • +3
    ./templates/StringOutputRecordWriter.java
  1. … 19 more files in changeset.
DRILL-7252: Read Hive map using Dict<K,V> vector

  1. … 16 more files in changeset.
DRILL-7168: Implement ALTER SCHEMA ADD / REMOVE commands

  1. … 15 more files in changeset.
DRILL-7326: Support repeated lists for CTAS parquet format

closes #1844

    • -0
    • +13
    ./templates/EventBasedRecordWriter.java
    • -2
    • +105
    ./templates/ParquetOutputRecordWriter.java
  1. … 3 more files in changeset.
DRILL-7307: casthigh for decimal type can lead to the issues with VarDecimalHolder

- Fixed code-gen for VarDecimal type

- Fixed code-gen issue with nullable holders for simple cast functions

with passed constants as arguments.

- Code-gen now honnoring DataType.Optional type defined by UDF for

NULL-IF-NULL functions.

  1. … 9 more files in changeset.
DRILL-7273: Introduce operators for handling metadata

closes #1886

    • -1
    • +1
    ./templates/JsonBaseStatisticsRecordWriter.java
    • -0
    • +79
    ./templates/StatisticsRecordCollector.java
    • -23
    • +1
    ./templates/StatisticsRecordWriter.java
    • -3
    • +7
    ./templates/StatisticsRecordWriterImpl.java
  1. … 150 more files in changeset.
DRILL-7237: Fix single_value aggregate function for variable length types

- Add implementations of single_value for complex data types

closes #1782

    • -117
    • +120
    ./templates/AggrTypeFunctions1.java
    • -57
    • +67
    ./templates/ComplexAggrFunctions1.java
    • -2
    • +11
    ./templates/DateIntervalAggrFunctions1.java
    • -31
    • +7
    ./templates/Decimal/DecimalAggrTypeFunctions1.java
    • -2
    • +7
    ./templates/VarCharAggrFunctions1.java
  1. … 3 more files in changeset.
DRILL-4782 / DRILL-7139: Fix DATE_ADD and TO_TIME functions

- cast function for the day interval changed to round milliseconds to complete days

- ToDateTypeFunctions#toTime now returning milliseconds of day

- updated the way how DayInterval subtracts and adds, to follow the cast function logic

UT core updates:

- added vectorValue function to the queryBuilder to simplify retrieving value of the vector

- refactored singleton query result functions at queryBuilder

    • -10
    • +19
    ./templates/CastStringTypesToInterval.java
  1. … 4 more files in changeset.
DRILL-6974: SET option command modification

- ALTER ... RESET ... and ALTER ... SET ... sub-parsers separated to 2

different SqlCall classes with same parent SqlSetOption

- parserImpls modified to handle new syntax of ALTER... SET...

expresion:

a) ALTER ... SET option.name - option.value - setting option value

b) ALTER ... SET option.name - display option value

- Handler for SqlSetOption separated to SetOptionHandler and

ResetOptionhandler for better representation of handled statements

- Base abstract class AbstractSqlSetHandler created to not repeat

shared implementation of same functions

- SetOptionHandler covered with unit tests for each statement

form.

Fix issues stated in the review

closes #1763

  1. … 9 more files in changeset.
DRILL-7167: Implemented DESCRIBE TABLE statement

- altered parser implementation to honor DESCRIBE TABLE syntax

- extended test coverage to check the new statement

closes #1747

  1. … 1 more file in changeset.
DRILL-7138: Implement command to describe schema for table

closes #1719

  1. … 6 more files in changeset.
DRILL-7096: Develop vector for canonical Map<K,V>

- Added new type DICT;

- Created value vectors for the type for single and repeated modes;

- Implemented corresponding FieldReaders and FieldWriters;

- Made changes in EvaluationVisitor to be able to read values from the map by key;

- Made changes to DrillParquetGroupConverter to be able to read Parquet's MAP type;

- Added an option `store.parquet.reader.enable_map_support` to disable reading MAP type as DICT from Parquet files;

- Updated AvroRecordReader to use new DICT type for Avro's MAP;

- Added support of the new type to ParquetRecordWriter.

    • -0
    • +10
    ./templates/AbstractRecordWriter.java
    • -0
    • +9
    ./templates/EventBasedRecordWriter.java
    • -0
    • +9
    ./templates/ParquetOutputRecordWriter.java
  1. … 104 more files in changeset.
DRILL-6965: Implement schema table function parameter

1. Added common schema table function parameter with can be used as single unit or with format plugin table function parameters.

2. Allowed creating schema without columns, in case if user needs only to indicate table properties.

3. Added unit tests.

closes #1777

  1. … 30 more files in changeset.
DRILL-7063: Seperate metadata cache file into summary, file metadata

closes #1723

  1. … 18 more files in changeset.
DRILL-7200: Update Calcite to 1.19.0 / 1.20.0

  1. … 46 more files in changeset.
DRILL-4858: REPEATED_COUNT on an array of maps and an array of arrays is not implemented

- Implemented 'repeated_count' function for repeated MAP and repeated LIST;

- Updated RepeatedListReader and RepeatedMapReader implementations to return correct value from size() method

- Moved repeated_count to freemarker template and added support for more repeated types for the function

closes #1641

    • -0
    • +62
    ./templates/RepeatedCountFunctions.java
  1. … 8 more files in changeset.
DRILL-7058: Refresh command to support subset of columns closes #1666

  1. … 5 more files in changeset.
DRILL-6967: Fix TIMESTAMPDIFF function for QUARTER qualifier

closes #1609

  1. … 1 more file in changeset.
DRILL-6962: Function coalesce returns an Error when none of the columns in coalesce exist in a parquet file

- Updated UntypedNullVector to hold value count when vector is allocated and transfered to another one;

- Updated RecordBatchLoader and DrillCursor to handle case when only UntypedNull values are present in RecordBatch (special case when data buffer is null but actual values are present);

- Added functions to cast UntypedNull value to other types for use in UDFs;

- Moved UntypedReader, UntypedHolderReaderImpl and UntypedReaderImpl from org.apache.drill.exec.vector.complex.impl to org.apache.drill.exec.vector package.

closes #1614

    • -0
    • +61
    ./templates/CastUntypedNull.java
  1. … 15 more files in changeset.
DRILL-6964: Implement CREATE / DROP SCHEMA commands

Note: this PR only adds support for CREATE / DROP SCHEMA commands which allow to store and delete schema. Schema usage during querying the data will be covered in other PRs.

1. Added parser methods / handles to parse CREATE / DROP schema commands.

2. Added SchemaProviders classes to separate ways of schema provision (file, table function).

3. Added schema parsing using ANTLR4 (lexer, parser, visitors).

4. Added appropriate unit tests.

close apache/drill#1615

  1. … 34 more files in changeset.
DRILL-3610: Add TIMESTAMPADD and TIMESTAMPDIFF functions

closes #1528

  1. … 4 more files in changeset.
DRILL-6862: Update Calcite to 1.18.0

1. Moved Calcite dependency from profile hadoop-default to general dependency managment

2. Updated Calcite version to 1.18.0-drill-r0 and Avatica version to 1.13.0

3. Hook.REL_BUILDER_SIMPLIFY moved to static block, cause now it can't be removed (fixes DRILL-6830)

4. Removed WrappedAccessor, since it was workaround fixed in CALCITE-1408

5. Fixed setting of multiple options in TestBuilder

6. Timstampadd type inference aligned with CALCITE-2699

7. Dependency update caused 417 kB increase of jdb-all jar size, so the maxsize limit was

increased from 39.5 to 40 MB

8. Added test into TestDrillParquetReader to ensure that DRILL-6856 was

fixed by Calcite update

close apache/drill#1631

  1. … 12 more files in changeset.
DRILL-6084: Show Drill functions in WebUI for autocomplete

Building on top of DRILL-3988 and leveraging DRILL-5868, this allows support for Drill functions to be now available in the WebUI.

If users wants UDFs to show up, they should place the UDF jars in the `$DRILL_HOME/jars/3rdparty` directory so that this can be loaded during the Drillbit's startup.

Concept of internal Drill functions are introduced. With this, internal Drill functions like `ConvertToNullableXYZ` has been marked as internal.

The WebUI will not show these functions. However, they are still visible in `sys.functions` table with an additional column indicating that it is an internal function.

Tests have been added as a part of this commit to verify the internal functions concept.

    • -1
    • +1
    ./templates/CastEmptyStringVarTypesToNullableNumeric.java
    • -1
    • +2
    ./templates/ConvertToNullableHolder.java
  1. … 12 more files in changeset.
DRILL-1328: Support table statistics

  1. … 51 more files in changeset.
DRILL-6797: Fix UntypedNull handling for complex types

    • -0
    • +3
    ./templates/EventBasedRecordWriter.java
  1. … 13 more files in changeset.
DRILL-6768: Improve to_date, to_time and to_timestamp and corresponding cast functions to handle empty string when option is enabled closes #1494

    • -0
    • +99
    ./templates/CastStringTypesToDate.java
    • -0
    • +111
    ./templates/CastStringTypesToInterval.java
    • -90
    • +0
    ./templates/CastVarCharInterval.java
  1. … 16 more files in changeset.
DRILL-6710: Disallow negative scale for decimal data type

    • -2
    • +3
    ./templates/Decimal/DecimalAggrTypeFunctions1.java
    • -0
    • +1
    ./templates/Decimal/DecimalAggrTypeFunctions3.java
    • -2
    • +4
    ./templates/Decimal/DecimalFunctions.java
  1. … 10 more files in changeset.