Clone Tools
  • last updated 28 mins ago
Constraints: committers
Constraints: files
Constraints: dates
DRILL-5783, DRILL-5841, DRILL-5894: Rationalize test temp directories

This change includes:


- A unit test is created for the priority queue in the TopN operator.

- The code generation classes passed around a completely unused function registry reference in some places so it is removed.

- The priority queue had unused parameters for some of its methods so it is removed.


- Created standardized temp directory classes DirTestWatcher, SubDirTestWatcher, and BaseDirTestWatcher. And updated all unit tests to use them.


- Removed the dfs_test storage plugin for tests and replaced it with the already existing dfs storage plugin.


- General code cleanup.

- Removed unnecessary use of String.format in the tests.

This closes #984

  1. … 365 more files in changeset.
DRILL-4956: Temporary tables support

close apache/drill#666

  1. … 41 more files in changeset.
DRILL-4108: Handle non existing cols for query w extractHeader

Closes #269

  1. … 7 more files in changeset.
DRILL-3423: Adding HTTPd Log Parsing functionality including full pushdown, type remapping and wildcard support. Pushed through the requested columns for push down to the parser. Added more tests to cover a few more use cases. Ensured that user query fields are now completely consistent with returned values.

  1. … 13 more files in changeset.
DRILL-951: Add support for csv header row parsing

This closes #232

  1. … 9 more files in changeset.
DRILL-3963: Add Sequence file support.

- File Support

- Add test for sequencefile reader in Impersonation test suite.

- Create hadoop based record reader under user proxy.

- Fix impersonation test for sequence file and add one for Avro.

This closes #214

  1. … 13 more files in changeset.
DRILL-3718: After TextReader finishes reading a field surrounded by double quotes, the reader would skip whitespaces only if those whitespaces are not used as delimiter

  1. … 7 more files in changeset.
DRILL-3423: Initial HTTPD log plugin. Needs tests. Would be good to improve the timestamp and cookies behaviors since we can make those more type specific.

  1. … 6 more files in changeset.
DRILL-2006: Updated Text reader. Increases variations of text files Drill can work with.

Text reader is heavily inspired by uniVocity parser although it is now byte based and customized for Drill's memory representations.

Also updated the RecordReader interface so that OperatorContext is presented at setup time rather than being a separate call.

  1. … 43 more files in changeset.
DRILL-1540: Provide a fallback data format in case Drill is unable to determine one

+ added "storageformat" to ignored list to avoid failure in existing cluster.

  1. … 6 more files in changeset.
DRILL-1512: Avro record reader

Reader for Avro data files.


- All primitive types

- Arrays

- Nested records

- Enums


- Endpoint affinity

- Recursive data types

- Complex types: Maps, Fixed, Unions

  1. … 15 more files in changeset.
DRILL-1133: Default cp and dfs storage plugin instances do not appear in Drill Web UI after installing Drill.

* Modified StoragePluginRegistry to scan for ALL 'bootstrap-storage-plugins.json' files in the classpath instead of only the first one.

* Moved 'hbase' and 'hive' plugin instance definitions to their own module from 'java-exec'.

* Renamed the test storage plugin instances to 'dfs_test' and 'hive_test' and updated the test cases to reflect this change.

    • -34
    • +22
  1. … 28 more files in changeset.
DRILL-972: Add newline if no delimiter is specified; avoid rescanning (contains DRILL-950).

  1. … 6 more files in changeset.
Enable View persistence, Storage Plugin and System option persistence.




    • -0
    • +54
  1. … 167 more files in changeset.