hadoop

Clone Tools
  • last updated a few seconds ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HADOOP-16708. HadoopExecutors cleanup to only log at debug.

Contributed by David Mollitor.

Change-Id: Ib501a3ed6ed299ccd3c773c4dc086441a5728e73

HADOOP-16585. [Tool:NNloadGeneratorMR] Multiple threads are using same id for creating file LoadGenerator#write. Contributed by Ranith Sardar.

HADOOP-16677. Recalculate the remaining timeout millis correctly while throwing an InterupptedException in SocketIOWithTimeout. (#1687)

HADOOP-16677. Recalculate the remaining timeout millis correctly while throwing an InterupptedException in SocketIOWithTimeout. (#1687)

(cherry picked from commit df6b3162c11987ba5299c69cb251332228dacf36)

(cherry picked from commit 975f669141add885d631685d693e81c44c190751)

HADOOP-16677. Recalculate the remaining timeout millis correctly while throwing an InterupptedException in SocketIOWithTimeout. (#1687)

(cherry picked from commit df6b3162c11987ba5299c69cb251332228dacf36)

HADOOP-16676. Backport HADOOP-16152 to branch-3.2. Contributed by Siyao Meng.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14959: [SBNN read] access time should be turned off (#1706) Contributed by Chao Sun.

HDFS-14959: [SBNN read] access time should be turned off (#1706) Contributed by Chao Sun.

(cherry picked from commit 97ec34e117af71e1a9950b8002131c45754009c7)

(cherry picked from commit 0c12d633b9797f2cb14246fe020993b2e9123e82)

HDFS-14959: [SBNN read] access time should be turned off (#1706) Contributed by Chao Sun.

(cherry picked from commit 97ec34e117af71e1a9950b8002131c45754009c7)

HADOOP-16656. Document FairCallQueue configs in core-default.xml. Contributed by Siyao Meng.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14922. Prevent snapshot modification time got change on startup. Contributed by hemanthboyina.

HADOOP-16665. Filesystems to be closed if they failed during initialize().

Contributed by Steve Loughran.

This FileSystem instantiation so if an IOException or RuntimeException is

raised in the invocation of FileSystem.initialize() then a best-effort

attempt is made to close the FS instance; exceptions raised that there

are swallowed.

The S3AFileSystem is also modified to do its own cleanup if an

IOException is raised during its initialize() process, it being the

FS we know has the "potential" to leak threads, especially in

extension points (e.g AWS Authenticators) which spawn threads.

Change-Id: Ib84073a606c9d53bf53cbfca4629876a03894f04

YARN-9537. Add configuration to disable AM preemption. Contributed by ZhouKang

HADOOP-16477. S3A delegation token tests fail if fs.s3a.encryption.key set.

Contributed by Steve Loughran.

Change-Id: I843989f32472bbdefbd4fa504b26c7a614ab1cee

YARN-9697. Efficient allocation of Opportunistic containers. Contributed by Abhishek Modi.

HADOOP-16702. Move documentation of hadoop-cos to under src directory.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

HADOOP-16701. Fix broken links in site index.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

HDFS-14979 Allow Balancer to submit getBlocks calls to Observer Nodes when possible. Contributed by Erik Krogen.

(cherry picked from 586defe7113ed246ed0275bb3833882a3d873d70)

HDFS-14979 Allow Balancer to submit getBlocks calls to Observer Nodes when possible. Contributed by Erik Krogen.

(cherry picked from 586defe7113ed246ed0275bb3833882a3d873d70)

(cherry picked from dec765b329d3947f30273c0e7f0c4eb607ec42c9)

(cherry picked from 5cf36aa2b19aad8677e1a7553ff1f05805f772b7)

(cherry picked from 4d46d9b04e5ff4a6459568b33abf21c597c4c5a6)

HDFS-14979 Allow Balancer to submit getBlocks calls to Observer Nodes when possible. Contributed by Erik Krogen.

(cherry picked from 586defe7113ed246ed0275bb3833882a3d873d70)

(cherry picked from dec765b329d3947f30273c0e7f0c4eb607ec42c9)

(cherry picked from 5cf36aa2b19aad8677e1a7553ff1f05805f772b7)

HDFS-14979 Allow Balancer to submit getBlocks calls to Observer Nodes when possible. Contributed by Erik Krogen.

(cherry picked from 586defe7113ed246ed0275bb3833882a3d873d70)

(cherry picked from dec765b329d3947f30273c0e7f0c4eb607ec42c9)

HDFS-14979 Allow Balancer to submit getBlocks calls to Observer Nodes when possible. Contributed by Erik Krogen.

YARN-9865. Capacity scheduler: add support for combined %user + %secondary_group mapping. Contributed by Manikandan R

YARN-9965. Fix NodeManager failing to start when Hdfs Auxillary Jar is set. Contributed by Prabhu Joseph.

HDFS-14975. Add CR for SetECPolicyCommand usage. Contributed by Fei Hui.

HDFS-14962. RBF: ConnectionPool#newConnection() error log wrong protocol class (#1699). Contributed by Yuxuan Wang.

HDFS-14928. UI: unifying the WebUI across different components. Contributed by Xieming Li

HDFS-14720. DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE. Contributed by hemanthboyina.

(cherry picked from commit 320008bb7cc558b1300398178bd2f48cbf0b6c80)

HDFS-14720. DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE. Contributed by hemanthboyina.

(cherry picked from commit 320008bb7cc558b1300398178bd2f48cbf0b6c80)

HDFS-14720. DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE. Contributed by hemanthboyina.