Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Expected Hash Table footprint size calculation fix

- Fix the expected hash table footprint size calculation

based on the cardinality. An operand was missing.

Change-Id: I9eb658a189fcf3d68978f627959c67d0c2641a29

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1738

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 4 more files in changeset.
ASTERIXDB-1556, ASTERIXDB-1733: Hash Group By and Hash Join conform to the memory budget

- External Hash Group By and Hash Join now conform to the memory budget (compiler.groupmemory and compiler.joinmemory)

- For Optimzed Hybrid Hash Join, we calculate the expected hash table size when the build phase is done and

try to spill one or more partitions if the freespace can't afford the hash table size.

- For External Hash Group By, the number of hash entries (hash table size) is calculated based on

an estimation of the aggregated tuple size and possible hash values for the given field size in that tuple.

- Garbage Collection feature has been added to SerializableHashTable. For external hash group-by,

whenever we spill a data partition to the disk, we also check the ratio of garbage in the hash table.

If it's greater than the given threshold, we conduct a GC on Hash Table.

Change-Id: I2b323e9a2141b4c1dd1652a360d2d9354d3bc3f5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1056

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -239
    • +484
    ./SerializableHashTable.java
    • -0
    • +542
    ./SimpleSerializableHashTable.java
  1. … 39 more files in changeset.
Removed some new byte[] creation and implemented explicit resource release

- Removed some new byte[] creation (mainly for toByteArray() method)

- Implemented Explicit resource release during a hash join

- Refactorered Hash-join code to remove repetitive same condition check

Change-Id: I55195696a3db09c14b8debdd78f5f68d701b9129

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1378

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 11 more files in changeset.
working partition join.

    • -0
    • +102
    ./RunFilePointer.java
  1. … 6 more files in changeset.
clean up.

  1. … 1 more file in changeset.
Sonar fixes and other clean up items.

Change-Id: Ieb72a0fef3c181282cc4c71b881a7cb52da86818

Reviewed-on: https://asterix-gerrit.ics.uci.edu/999

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 66 more files in changeset.
sonar update

  1. … 45 more files in changeset.
great merge - hyracks

  1. … 65 more files in changeset.
Move Hyracks to subfolder

    • -0
    • +158
    ./AbstractHeap.java
    • -0
    • +23
    ./IResetableComparable.java
    • -0
    • +24
    ./IResetableComparableFactory.java
    • -0
    • +40
    ./ISerializableTable.java
    • -0
    • +221
    ./MinMaxHeap.java
    • -0
    • +323
    ./SerializableHashTable.java
  1. … 4414 more files in changeset.