Clone
Vitalii Diravka <vitalii.diravka@gmail.com>
committed
on 13 Nov 17
DRILL-5978: Updating of Apache and MapR Hive libraries to 2.3.2 and 2.1.2-mapr-1710 versions respectively
* Improvements to allow of readi… Show more
DRILL-5978: Updating of Apache and MapR Hive libraries to 2.3.2 and 2.1.2-mapr-1710 versions respectively

 * Improvements to allow of reading Hive bucketed transactional ORC tables;

 * Updating hive properties for tests and resolving dependencies and API conflicts:

 - Fix for "hive.metastore.schema.verification", MetaException(message: Version information

 not found in metastore) https://cwiki.apache.org/confluence/display/Hive/Hive+Schema+Tool

 METASTORE_SCHEMA_VERIFICATION="false" property is added

 - Added METASTORE_AUTO_CREATE_ALL="true", properties to tests, because some additional

 tables are necessary in Hive metastore

 - Disabling calcite CBO for (Hive's CalcitePlanner) for tests, because it is in conflict

 with Drill's Calcite version for Drill unit tests. HIVE_CBO_ENABLED="false" property

 - jackson and parquet libraries are relocated in hive-exec-shade module

 - org.apache.parquet:parquet-column Drill version is added to "hive-exec" to

 allow of using Parquet empty group on MessageType level (PARQUET-278)

 - Removing of commons-codec exclusion from hive core. This dependency is

 necessary for hive-exec and hive-metastore.

 - Setting Hive internal properties for transactional scan:

 HiveConf.HIVE_TRANSACTIONAL_TABLE_SCAN and for schema evolution: HiveConf.HIVE_SCHEMA_EVOLUTION,

 IOConstants.SCHEMA_EVOLUTION_COLUMNS, IOConstants.SCHEMA_EVOLUTION_COLUMNS_TYPES

 - "io.dropwizard.metrics:metrics-core" with last 4.0.2 version is added to dependencyManagement block in Drill root POM

 - Exclusion of "hive-exec" in "hive-hbase-handler" is already in Drill root dependencyManagement POM

 - Hive Calcite libraries are excluded (Calcite CBO was disabled)

 - "jackson-core" dependency is added to DependencyManagement block in Drill root POM file

 - For MapR Hive 2.1 client older "com.fasterxml.jackson.core:jackson-databind" is included

 - "log4j:log4j" dependency is excluded from "hive-exec", "hive-metastore", "hive-hbase-handler".

close apache/drill#1111

Show less

master + 5 more