drill

Clone Tools
  • last updated a few seconds ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Move Using Saiku Analytics with Apache Drill to Ecosystem section

    • -2
    • +200
    /_docs/ecosystem/010-using-saiku-analytics-with-apache-drill.md
add saiku analytics placeholder

    • -3
    • +4
    /_docs/ecosystem/010-using-saiku-analytics-with-apache-drill.md
add ecosystem section to docs

add ecosystem section to docs, change snappy to none per PR-1435

    • -0
    • +5
    /_docs/171-ecosystem.md
    • -0
    • +7
    /_docs/ecosystem/010-using-saiku-analytics-with-apache-drill.md
edit

DRILL-6492: Ensure schema / workspace case insensitivity in Drill

1. StoragePluginsRegistryImpl was updated:

a. for backward compatibility at init to convert all existing storage plugins names to lower case, in case of duplicates, to log warning and skip the duplicate.

b. to wrap persistent plugins registry into case insensitive store wrapper (CaseInsensitivePersistentStore) to ensure all given keys are converted into lower case when performing insert, update, delete, search operations.

c. to load system storage plugins dynamically by @SystemStorage annotation.

2. StoragePlugins class was updated to stored storage plugins configs by name in case insensitive map.

3. SchemaUtilities.searchSchemaTree method was updated to convert all schema names into lower case to ensure that are they are matched case insensitively (all schemas are stored in Drill in lower case).

4. FileSystemConfig was updated to store workspaces by name in case insensitive hash map.

5. All plugins schema factories are now extend AbstractSchemaFactory to ensure that given schema name is converted to lower case.

6. New method areTableNamesAreCaseInsensitive was added to AbstractSchema to indicate if schema tables names are case insensitive. By default, false. Schema implementation is responsible for table names case insensitive search in case it supports one. Currently, information_schema, sys and hive do so.

7. System storage plugins (information_schema, sys) were refactored to ensure their schema, table names are case insensitive, also the annotation @SystemPlugin and additional constructor were added to allow dynamically load system plugins at storage plugin registry during init phase.

8. MetadataProvider was updated to concert all schema filter conditions into lower case to ensure schema would be matched case insensitively.

9. ShowSchemasHandler, ShowTablesHandler, DescribeTableHandler were updated to ensure schema / tables names (this depends if schema supports case insensitive table names) would be found case insensitively.

git closes #1439

  1. … 41 more files in changeset.
DRILL-6696: IOBE in Operator Metric Registry

DRILL-6694: NPE in UnnestRecordBatch when query uses a column name not present in data

closes #1434

DRILL-6685: Fixed exception when reading Parquet data

DRILL-6689: Include query user information to drillbit.log

closes #1432

DRILL-6687: Updated with review comments

DRILL-6687: Improve RemovingRecordBatch to do transfer when all records needs to be copied Add optimization in SelectionVector2 to enable RemovingRecordBatch to transfer ValueVectors from incoming to output container when all records needs to be copied. Modified FilterRecordBatch and LimitRecordBatch to play by this optimization

  1. … 5 more files in changeset.
DRILL-6676: Add Union, List and Repeated List types to Result Set Loader

Adds required functionalty to the list and repeated list vectors.

Row set accessor changes

Adds a "variant" type to model both unions and (non-repeated) lists (which can act as a repeated union, among other things.)

Adds union, list and repeated list support to the result set loader and associated classes.

Copied much of the general documentation from my private Wiki into mark-down files.

closes #1429

  1. … 53 more files in changeset.
DRILL-6663: Fixed shutdown button

closes #1424

DRILL-6670: Align Parquet TIMESTAMP_MICROS logical type handling with earlier versions + minor fixes

closes #1428

edit for PR 1423

DRILL-6674: Minor fixes to avoid auto boxing cost in logging in LateralJoinBatch

doc edits for 1.14

edit doc

updates for drill 1.14

doc updates for 1.14 release process

    • -4
    • +4
    /_docs/install/047-installing-drill-on-the-cluster.md
    • -0
    • +562
    /_docs/rn/001-1.14.0-rn.md
    • -0
    • +294
    /_docs/rn/002-1.13.0-rn.md
    • -2
    • +2
    /_docs/tutorials/050-analyzing-highly-dynamic-datasets.md
    • -0
    • +31
    /blog/_posts/2018-08-05-drill-1.14-released.md
DRILL-6653: Unsupported Schema change exception where there is no schema change

closes #1422

edit to lateral join doc

DRILL-6671: Multi level lateral unnest join is throwing an exception during materializing the plan.

closes #1426

DRILL-6664: Limit the maximum parquet reader batch rows to 64k

DRILL-6662: Access AWS access key ID and secret access key using Credential Provider API for S3 storage plugin

closes #1419

update nav with new doc - lateral join

add lateral join doc and update from clause

    • -0
    • +236
    /_docs/sql-reference/sql-commands/071-lateral-join.md
updates for limit 0

DRILL-6645: Transform TopN in Lateral Unnest pipeline to Sort and Limit.

closes #1417