common

Clone Tools
  • last updated 25 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-6094: Decimal data type enhancements

Add ExprVisitors for VARDECIMAL

Modify writers/readers to support VARDECIMAL

- Added usage of VarDecimal for parquet, hive, maprdb, jdbc;

- Added options to store decimals as int32 and int64 or fixed_len_byte_array or binary;

Add UDFs for VARDECIMAL data type

- modify type inference rules

- remove UDFs for obsolete DECIMAL types

Enable DECIMAL data type by default

Add unit tests for DECIMAL data type

Fix mapping for NLJ when literal with non-primitive type is used in join conditions

Refresh protobuf C++ source files

Changes in C++ files

Add support for decimal logical type in Avro.

Add support for date, time and timestamp logical types.

Update Avro version to 1.8.2.

  1. … 195 more files in changeset.
DRILL-6289: Cluster view should show more relevant information

Protobuf change to carry HTTP port info

Allow CORS for access to remote Drillbit metrics

Cross-origin resource sharing (CORS) is required to ensure that the WebServer is able serve REST calls for status pages.

Materialize relevant metrics

1. Heap memory (incl usage)

2. Heap memory (incl usage)

3. Average System Load (last 1 min)

4. Option to view from other nodes (pop out)

5. Added Glyphicons

Update System Table and related tests

1. Updated System Table to show HTTP port

2. Updated unit tests

Skip updating remote bit info when HTTPS (SSL) or Authentication is enabled.

Default CpuGaugeSet is public; Added Gauges

* CPU Utiization by Drill

* Uptime

Show ALL Buttons, but do HTTPS Check

Reduce power button to icon

Allowing CORS for /status/metrics only

Accounting for situations when JVM does not report Process CPU Load

i.e. returned value is negative.

See https://docs.oracle.com/javase/7/docs/jre/api/management/extension/com/sun/management/OperatingSystemMXBean.html#getProcessCpuLoad()

Addressed shutdown security conditions

Added C++ Client Protobuf

Added steps for Protobuf generation to protocol/readme.txt

This closes #1203

    • -0
    • +101
    ./src/main/java/org/apache/drill/exec/metrics/CpuGaugeSet.java
  1. … 15 more files in changeset.
DRILL-6340 Output Batch Control in Project using the RecordBatchSizer

Changes required to implement Output Batch Sizing in Project using the RecordBatchSizer.

closes #1302

  1. … 56 more files in changeset.
DRILL-6282: Update Drill's Metrics dependencies

- Replacing com.codahale.metrics with last io.dropwizard.metrics Metrics for Drill

- com.yammer.metrics is removed, since isn't used directly by Drill

closes #1189

  1. … 8 more files in changeset.
DRILL-6280: Cleanup execution of BuildTimeScan during maven build

closes #1177

  1. … 3 more files in changeset.
DRILL-6250: Sqlline start command with password appears in the sqlline.log

closes #1174

DRILL-6249: Adding more unit testing documentation.

close apache/drill#1251

  1. … 28 more files in changeset.
Update version to 1.14.0-SNAPSHOT

  1. … 30 more files in changeset.
DRILL-6053: Avoid excessive locking in LocalPersistentStore

closes #1163

  1. … 17 more files in changeset.
DRILL-6027: Initial implementation of HashJoin spill, without memory limits checks yet

  1. … 30 more files in changeset.
DRILL-5730: Mock testing improvements and interface improvements

closes #1045

  1. … 222 more files in changeset.
DRILL-6049: Misc. hygiene and code cleanup changes

close apache/drill#1085

  1. … 121 more files in changeset.
Update version to 1.13.0-SNAPSHOT

  1. … 29 more files in changeset.
[maven-release-plugin] prepare release drill-1.12.0

  1. … 29 more files in changeset.
DRILL-5989: Categories some tests to speed up smoke tests. Made travis run tests.

closes #1053

  1. … 31 more files in changeset.
DRILL-5987: Use one version of javassist

closes #1048

  1. … 2 more files in changeset.
DRILL-5986: Update jackson-databind version to 2.7.9.1

closes #1046

  1. … 4 more files in changeset.
DRILL-5922: - The QueryContext was never closed when the Foreman finished, so it's child allocator was never closed. Now it is. - The PlanSplitter created a QueryContext temporarily to construct an RPC message but never closed it. Now the temp QueryContext is closed. - The waitForExit method was error prone. Changed it to use the standard condition variable pattern. - Fixed timeouts in graceful shutdown tests

  1. … 6 more files in changeset.
DRILL-5783, DRILL-5841, DRILL-5894: Rationalize test temp directories

This change includes:

DRILL-5783:

- A unit test is created for the priority queue in the TopN operator.

- The code generation classes passed around a completely unused function registry reference in some places so it is removed.

- The priority queue had unused parameters for some of its methods so it is removed.

DRILL-5841:

- Created standardized temp directory classes DirTestWatcher, SubDirTestWatcher, and BaseDirTestWatcher. And updated all unit tests to use them.

DRILL-5894:

- Removed the dfs_test storage plugin for tests and replaced it with the already existing dfs storage plugin.

Misc:

- General code cleanup.

- Removed unnecessary use of String.format in the tests.

This closes #984

    • -0
    • +46
    ./src/main/java/org/apache/drill/common/util/DrillFileUtils.java
    • -0
    • +167
    ./src/test/java/org/apache/drill/test/DirTestWatcher.java
    • -0
    • +193
    ./src/test/java/org/apache/drill/test/SubDirTestWatcher.java
    • -0
    • +104
    ./src/test/java/org/apache/drill/test/TestTools.java
  1. … 358 more files in changeset.
DRILL-5819: Default value of security.admin.user_groups and security.admin.users is true

closes #983

  1. … 10 more files in changeset.
DRILL-5832: Change OperatorFixture to use system option manager

- Rename FixtureBuilder to ClusterFixtureBuilder

- Provide alternative way to reset system/session options

- Fix for DRILL-5833: random failure in TestParquetWriter

- Provide strict, but clear, errors for missing options

closes #970

  1. … 51 more files in changeset.
DRILL-5809 made the storage format of system options backwards compatible, and avoided storing unnecessary option info.

- Fixed forward compatability issue

- Added error message for debugging

- Fix flakey test

- Cleaned up bad logging

- Applied comments

closes #957

    • -0
    • +61
    ./src/test/java/org/apache/drill/testutils/DirTestWatcher.java
  1. … 19 more files in changeset.
DRILL-5694: Handle OOM in HashAggr by spill and retry, reserve memory, spinner

  1. … 19 more files in changeset.
DRILL-5761: Disable Lilith ClassicMultiplexSocketAppender by default. Unify logback files.

    • -0
    • +53
    ./src/test/resources/logback-test.xml
  1. … 12 more files in changeset.
DRILL-5752 this change includes:

1. Increased test parallelism and fixed associated bugs

2. Added test categories and categorized tests appropriately

- Don't exclude anything by default

- Increase test timeout

- Fixed flakey test

closes #940

    • -0
    • +25
    ./src/test/java/org/apache/drill/categories/HiveStorageTest.java
    • -0
    • +25
    ./src/test/java/org/apache/drill/categories/JdbcStorageTest.java
    • -0
    • +25
    ./src/test/java/org/apache/drill/categories/JdbcTest.java
    • -0
    • +25
    ./src/test/java/org/apache/drill/categories/KuduStorageTest.java
    • -0
    • +25
    ./src/test/java/org/apache/drill/categories/MemoryTest.java
    • -0
    • +25
    ./src/test/java/org/apache/drill/categories/OperatorTest.java
    • -0
    • +25
    ./src/test/java/org/apache/drill/categories/OptionsTest.java
    • -0
    • +25
    ./src/test/java/org/apache/drill/categories/ParquetTest.java
    • -0
    • +26
    ./src/test/java/org/apache/drill/categories/PlannerTest.java
    • -0
    • +25
    ./src/test/java/org/apache/drill/categories/SecurityTest.java
    • -0
    • +25
    ./src/test/java/org/apache/drill/categories/SlowTest.java
    • -0
    • +25
    ./src/test/java/org/apache/drill/categories/SqlFunctionTest.java
  1. … 251 more files in changeset.
DRILL-5723: Added System Internal Options That can be Modified at Runtime Changes include:

1. Addition of internal options.

2. Refactoring of OptionManagers and OptionValidators.

3. Fixed ambiguity in the meaning of an option type, and changed its name to accessibleScopes.

4. Updated javadocs in the Option System classes.

5. Added RestClientFixture for testing the Rest API.

6. Fixed flakey test in TestExceptionInjection caused by race condition.

7. Fixed various tests which started zookeeper but failed to shut it down at the end of tests.

8. Added port hunting to the Drill Webserver for testing

9. Fixed various flaky tests

10. Fix compile issue

closes #923

  1. … 85 more files in changeset.
Update version to 1.12.0-SNAPSHOT

  1. … 27 more files in changeset.
[maven-release-plugin] prepare release drill-1.11.0

  1. … 27 more files in changeset.
DRILL-5431: SSL Support (Java) - Java client server SSL implementation

Also enable OpenSSL support

Also fix exclusions and java-exec pom file to eliminate netty-tcnative as a transitive dependency on all projects

  1. … 30 more files in changeset.
DRILL-5560: Create configuration file for distribution specific configuration This closes #848

  1. … 1 more file in changeset.