drill

Clone Tools
  • last updated 19 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-4134: Allocator Improvements

- make Allocator mostly lockless

- change BaseAllocator maps to direct references

- add documentation around memory management model

- move transfer and ownership methods to DrillBuf

- Improve debug messaging.

- Fix/revert sort changes

- Remove unused fragment limit flag

- Add time to HistoricalLog events

- Remove reservation amount from RootAllocator constructor (since not allowed)

- Fix concurrency issue where allocator is closing at same moment as incoming batch transfer, causing leaked memory and/or query failure.

- Add new AutoCloseables.close(Iterable<AutoCloseable>)

- Remove extraneous DataResponseHandler and Impl (and update TestBitRpc to use smarter mock of FragmentManager)

- Remove the concept of poison pill record batches, using instead FragmentContext.isOverMemoryLimit()

- Update incoming data batches so that they are transferred under protection of a close lock

- Improve field names in IncomingBuffers and move synchronization to collectors as opposed to IncomingBuffers (also change decrementing to decrementToZero rather than two part check).

This closes #238.

  1. … 105 more files in changeset.
DRILL-4089: make JSON pretty printing configurable Use system dependent line-feed to seperate records when pretty printing is turned off refactor ExecConstants to eliminate unneeded modifier & accessor declarations

DRILL-4056: Fix corruption bug reading string data out of Avro

- Fix issue where we are reading a byte array without considering length

- Removed use of unnecessary Holder objects.

- Added restriction on batch size produced by a single call to next.

- Add some basic result verification to avro tests.

This closes #266

DRILL-4056: Fix corruption bug reading string data out of Avro

- Fix issue where we are reading a byte array without considering length

- Removed use of unnecessary Holder objects.

- Added restriction on batch size produced by a single call to next.

- Add some basic result verification to avro tests.

fixes fm Yulyia & DRILL-3971

minor edit

    • -1
    • +1
    /_docs/tutorials/070-analyzing-data-using-window-functions.md
DRILL-4081: Handle schema changes in ExternalSort

closes #257

  1. … 3 more files in changeset.
DRILL-4047: Support querying a table with options

- simplify DrillOperatorTable; separate TranslatableTable from DrillTable

- fix table name in error message; improve tests debugability

- FormatCreator refactor

Update calcite fork version to r9

This closes #246

  1. … 6 more files in changeset.
DRILL-2601: log the query text and query id right at the beginning of foreman's runSQL().

Roll forward to 1.4.0-SNAPSHOT

    • -1
    • +1
    /contrib/data/tpch-sample-data/pom.xml
  1. … 12 more files in changeset.
make subsection links work on safari

safari link fix

Neeraja's blog > tutorial

minor edit

align table

fix tut intro

    • -3
    • +3
    /_docs/configure-drill/030-configuring-a-multitenant-cluster-introduction.md
  1. … 11 more files in changeset.
DRILL-4083: ScanPrel's CPU cost should not be zero even if column count is zero

close apache/drill#253

DRILL-4082: Better error message when multiple versions of the same function are found by the classpath scanner

This closes #252

Added Tokyo meetup

DRILL-4134: Add new allocator

  1. … 14 more files in changeset.
DRILL-4134: Clean up close behaviors.

DRILL-4071: Detect nested holistic expressions while traversing filter tree for partition pruning

New Apache direct download link

DRILL-2517: (Prototype from Mehant) Move directory based partition pruning to logical phase.

DRILL-4065: Maintain a cache of created UserGroupInformation objects so that we don't accidentally generate thousands of FileSystem objects & threads.

DRILL-4065: Maintain a cache of created UserGroupInformation objects so that we don't accidentally generate thousands of FileSystem objects & threads.

DRILL-3791: MySQL tests for JDBC plugin

This commit adds integration tests for the JDBC plugin with MySQL. It

also refactors the existing Derby tests to have the same general pattern

as the MySQL tests: data is defined in an external .sql file and maven

is used to start/stop external resources for testing.

Add tests for ENUM and YEAR types.

Tests for the CLOB type with Derby.

This closes #251

DRILL-3987: (CLEANUP) Final cleanups to get complete working build/distribution

- small cleanups

- move Hook to drill-adbc

- update distribution assembly to include new modules

This closes #250

    • -1
    • +13
    /common/src/main/resources/drill-module.conf
  1. … 17 more files in changeset.
DRILL-3987: (MOVE) Move logical expressions and operators out of common. Move to new drill-logical model.

  1. … 199 more files in changeset.
DRILL-3987: (REFACTOR) Remove any parent Drill dependencies for drill-memory-base.

DRILL-3987: (CLEANUP) Delete unused files

DRILL-3987: (REFACTOR) Extract BoundsChecking check from AssertionUtil. Remove unused file.

DRILL-3987: (MOVE) Extract RPC, memory-base and memory-impl as separate modules.

  1. … 127 more files in changeset.
DRILL-3987: (REFACTOR) Working TPCH unit tests

- Rename DecimalUtility.integerSize to INTEGER_SIZE as is constant

- Refactor BufferManager from BufferManagerImpl

DRILL-3987: (REFACTOR) Common and Vector modules building.

- Extract Accountor interface from Implementation

- Separate FMPP modules to separate out Vector Needs versus external needs

- Separate out Vector classes from those that are VectorAccessible.

- Cleanup Memory Exception hiearchy

  1. … 91 more files in changeset.
DRILL-3987: (MOVE) Extract key vector, field reader, complex/field writer classes.

  1. … 171 more files in changeset.