hadoop

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HADOOP-7002. Wrong description of copyFromLocal and copyToLocal in documentation. Contributed by Andras Bokor.

(cherry picked from commit 19f26a020e2e5cec2ceb28d796c63c83bc8ac506)

HADOOP-14698. Make copyFromLocals -t option available for put as well. Contributed by Andras Bokor.

HADOOP-17055. Remove residual code of Ozone (#2039)

(cherry picked from commit d9838f2d42eaadd0769167847af4e8f2963817fb)

    • -3
    • +0
    /dev-support/bin/dist-layout-stitching
HDFS-13183. Addendum: Standby NameNode process getBlocks request to reduce Active load. Contributed by Xiaoqiao He.

MAPREDUCE-7278. Speculative execution behavior is observed even when mapreduce.map.speculative and mapreduce.reduce.speculative are false

Contributed by Tarun Parimi.

(cherry picked from commit 10db97df1c8562a9e29b00e60d5bde1773c09188)

Revert "FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping. Contributed by Gergely Pollak"

This reverts commit 9ce913a7bf720944d0305960bbf1899461b8628b.

Reverting because of missing Jira-ID in the commit message

YARN-6492. Generate queue metrics for each partition. Contributed by Manikandan R

(cherry picked from commit c30c23cb665761e997bcfc1dc00908f70b069fa2)

HDFS-15369. Refactor method VolumeScanner#runLoop(). Contributed by Yang Yun.

HDFS-15363. BlockPlacementPolicyWithNodeGroup should validate if it is initialized by NetworkTopologyWithNodeGroup. Contributed by hemanthboyina.

(cherry picked from commit 4d22d1c58f0eb093775f0fe4f39ef4be639ad752)

HADOOP-17040. Fix intermittent failure of ITestBlockingThreadPoolExecutorService. (#2020)

(cherry picked from commit 968531463375ebf29ba3186c13b5f8685df10d25)

HADOOP-17049. javax.activation-api and jakarta.activation-api define overlapping classes (#2027)

* Removed javax.activation-api from dependency

(cherry picked from commit 52b21de1d8857151461341fbcf2fdb38c64485b1)

FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping. Contributed by Gergely Pollak

(cherry picked from commit ac4540dd8e2872b113a61107b0a4a66beeec8649)

YARN-10108. FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping. Contributed by Gergely Pollak

(cherry picked from commit ac4540dd8e2872b113a61107b0a4a66beeec8649)

YARN-10228. Relax restriction of file path character in yarn.service.am.java.opts. Contributed by Bilwa S T via eyang

HDFS-15293. Relax the condition for accepting a fsimage when receiving a checkpoint. Contributed by Chen Liang

(cherry picked from commit 7bb902bc0d0c62d63a8960db444de3abb0a6ad22)

Revert "HDFS-15202 Boost short circuit cache (rebase PR-1884) (#2016)"

This reverts commit ad9a6a0ee3d6cb3bde5e23c73151c0857d47ffd4.

Revert "HDFS-13183. Standby NameNode process getBlocks request to reduce Active load. Contributed by Xiaoqiao He."

This reverts commit acae31aa2824bf50fe9291148357b4f5c76a9329.

HDFS-15202 Boost short circuit cache (rebase PR-1884) (#2016)

(cherry picked from commit 2abcf7762ae74b936e1cedb60d5d2b4cc4ee86ea)

HDFS-15207. VolumeScanner skip to scan blocks accessed during recent scan peroid. Contributed by Yang Yun.

(cherry picked from commit 50caba1a92cb36ce78307d47ed7624ce216562fc)

HDFS-13183. Standby NameNode process getBlocks request to reduce Active load. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit a3f44dacc1fa19acc4eefd1e2505e54f8629e603)

HDFS-13183. Standby NameNode process getBlocks request to reduce Active load. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit a3f44dacc1fa19acc4eefd1e2505e54f8629e603)

HDFS-15202 Boost short circuit cache (rebase PR-1884) (#2016)

Added parameter dfs.client.short.circuit.num improving HDFS-client's massive reading performance by create few instances ShortCircuit caches instead of one. It helps avoid locks and lets CPU do job.

(cherry picked from commit 86e6aa8eec538e142044e2b6415ec1caff5e9cbd)

HADOOP-17042. Hadoop distcp throws 'ERROR: Tools helper ///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not found'. Contributed by Aki Tanaka.

(cherry picked from commit 27601fc79ed053ce978ac18a2c5706d32e58019f)

HDFS-15356. Unify configuration `dfs.ha.allow.stale.reads` to DFSConfigKeys. Contributed by Xiaoqiao He.

(cherry picked from commit 178336f8a8bb291eb355bede729082f2f0382216)

Revert "HADOOP-14557. Document HADOOP-8143 (Change distcp to have -pb on by default)."

This reverts commit 44350fdf495f5cf1bb15b1fe6f6e9587d3de0a59.

It is related to the rollback of HADOOP-8143.

Change-Id: If48e3dd670c920ada702dc36461ff398fe9d35cc

Revert "HADOOP-8143. Change distcp to have -pb on by default."

This reverts commit dd65eea74b1f9dde858ff34df8111e5340115511.

Change-Id: I74180cf59d5bbad8c9f66cb331535addcbea863e

YARN-10265. Upgrade Netty-all dependency to latest version 4.1.50 to fix ARM support issue. Contributed by liusheng

    • -1
    • +1
    /hadoop-hdfs-project/hadoop-hdfs/pom.xml
YARN-9898. Dependency netty-all-4.1.27.Final doesn't support ARM platform. Contributed by liusheng.

    • -1
    • +1
    /hadoop-hdfs-project/hadoop-hdfs/pom.xml
Revert "SPNEGO TLS verification"

This reverts commit 0f27c04c23c53f625ecea75ed914375eaf6b9538.

YARN-10260. Allow transitioning queue from DRAINING to RUNNING state. Contributed by Bilwa S T

(cherry picked from commit fff1d2c1226ec23841b04dd478e8b97f31abbeba)