Clone Tools
  • last updated 22 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
DRILL-5978: Updating of Apache and MapR Hive libraries to 2.3.2 and 2.1.2-mapr-1710 versions respectively

* Improvements to allow of reading Hive bucketed transactional ORC tables;

* Updating hive properties for tests and resolving dependencies and API conflicts:

- Fix for "hive.metastore.schema.verification", MetaException(message: Version information

not found in metastore) https://cwiki.apache.org/confluence/display/Hive/Hive+Schema+Tool

METASTORE_SCHEMA_VERIFICATION="false" property is added

- Added METASTORE_AUTO_CREATE_ALL="true", properties to tests, because some additional

tables are necessary in Hive metastore

- Disabling calcite CBO for (Hive's CalcitePlanner) for tests, because it is in conflict

with Drill's Calcite version for Drill unit tests. HIVE_CBO_ENABLED="false" property

- jackson and parquet libraries are relocated in hive-exec-shade module

- org.apache.parquet:parquet-column Drill version is added to "hive-exec" to

allow of using Parquet empty group on MessageType level (PARQUET-278)

- Removing of commons-codec exclusion from hive core. This dependency is

necessary for hive-exec and hive-metastore.

- Setting Hive internal properties for transactional scan:

HiveConf.HIVE_TRANSACTIONAL_TABLE_SCAN and for schema evolution: HiveConf.HIVE_SCHEMA_EVOLUTION,

IOConstants.SCHEMA_EVOLUTION_COLUMNS, IOConstants.SCHEMA_EVOLUTION_COLUMNS_TYPES

- "io.dropwizard.metrics:metrics-core" with last 4.0.2 version is added to dependencyManagement block in Drill root POM

- Exclusion of "hive-exec" in "hive-hbase-handler" is already in Drill root dependencyManagement POM

- Hive Calcite libraries are excluded (Calcite CBO was disabled)

- "jackson-core" dependency is added to DependencyManagement block in Drill root POM file

- For MapR Hive 2.1 client older "com.fasterxml.jackson.core:jackson-databind" is included

- "log4j:log4j" dependency is excluded from "hive-exec", "hive-metastore", "hive-hbase-handler".

close apache/drill#1111

  1. … 14 more files in changeset.
DRILL-5917: Ban org.json:json library in Drill

This closes #1031

  1. … 6 more files in changeset.
DRILL-3993: Changes to support Calcite 1.13

- fixed all compiling errors (main changes were: Maven changes, chenges RelNode -> RelRoot, implementing some new methods from updated interfaces, chenges some literals, logger changes);

- fixed unexpected column errors, validation errors and assertion errors after Calcite update;

- fixed describe table/schema statement according to updated logic;

- added fixes with time-intervals;

- changed precision of BINARY to 65536 (was 1048576) according to updated logic (Calcite overrides bigger precision to own maxPrecision);

- ignored some incorrect tests with DRILL-3244;

- changed "Table not found" message to "Object not found within" according to new Calcite changes.

  1. … 70 more files in changeset.
DRILL-5712: Update the pom files with dependency exclusions for commons-codec

closes #903

  1. … 7 more files in changeset.
Update version to 1.12.0-SNAPSHOT

  1. … 27 more files in changeset.
[maven-release-plugin] prepare release drill-1.11.0

  1. … 27 more files in changeset.
DRILL-5545: Update POM to add support for running findbugs

  1. … 1 more file in changeset.
DRILL-5496: Fix for failed Hive connection

If the Hive server restarts, Drill either hangs or continually reports

errors when retrieving schemas. The problem is that the Hive plugin

tries to handle connection failures, but does not do so correctly for

the secure connection case. The problem is complex, see DRILL-5496 for

details.

This is a workaround: we discard the entire Hive schema cache when we

encounter an unhandled connection exception, then we rebuild a new one.

This is not a proper fix; for that we'd have to restructure the code.

This will, however, solve the immediate problem until we do the needed

restructuring.

  1. … 5 more files in changeset.
Update version to 1.11.0-SNAPSHOT

  1. … 27 more files in changeset.
[maven-release-plugin] prepare release drill-1.10.0

  1. … 27 more files in changeset.
Update version to 1.10.0-SNAPSHOT

  1. … 27 more files in changeset.
[maven-release-plugin] prepare release drill-1.9.0

  1. … 27 more files in changeset.
Update version to 1.9.0-SNAPSHOT.

  1. … 26 more files in changeset.
[maven-release-plugin] prepare release drill-1.8.0

  1. … 26 more files in changeset.
Update version to 1.8.0-SNAPSHOT.

  1. … 26 more files in changeset.
[maven-release-plugin] prepare release drill-1.7.0

  1. … 26 more files in changeset.
Update version to 1.7.0-SNAPSHOT

  1. … 26 more files in changeset.
[maven-release-plugin] prepare release drill-1.6.0

  1. … 26 more files in changeset.
Update version to 1.6.0-SNAPSHOT

  1. … 26 more files in changeset.
[maven-release-plugin] prepare release drill-1.5.0

  1. … 26 more files in changeset.
Roll forward to 1.5.0-SNAPSHOT

  1. … 26 more files in changeset.
[maven-release-plugin] prepare release drill-1.4.0

  1. … 26 more files in changeset.
[maven-release-plugin] prepare release drill-1.3.0

  1. … 20 more files in changeset.
Roll forward to 1.4.0-SNAPSHOT

  1. … 26 more files in changeset.
move version to 1.3.0-SNAPSHOT

  1. … 17 more files in changeset.
Tag release drill-1.2.0

  1. … 17 more files in changeset.
DRILL-3581: Upgrade to Guava 18.0

- Replace Stopwatch constructors with .createStarted() or .createUnstarted()

- Stop using InputSupplier and Closeables.closeQuietly

- Clean up quiet closes to log or (preferably) propagate.

- Add log4j to enforcer exclusions.

- Update HBaseTestSuite to add patching of Closeables.closeQuietly() and Stopwatch legacy methods. Only needed when running HBaseMiniCluster.

- Remove log4j from HBase's pom to provide exception logging.

- Remove log4j from Hive's shaded pom.

- Update Catastrophic failures to use the same pattern to ensure reporting.

- Update test framework to avoid trying IPv6 resolution. (This removes 90s pause from HBase startup in my tests)

This closes #361.

This closes #157.

  1. … 65 more files in changeset.
Roll forward to 1.2.0-SNAPSHOT development versions

  1. … 16 more files in changeset.
Tag 1.1.0 release in pom files.

  1. … 16 more files in changeset.
[maven-release-plugin] prepare release drill-1.1.0

  1. … 16 more files in changeset.