hadoop

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HDFS-14303. Addendum: check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu.

HADOOP-16555. Update commons-compress to 1.19. (#1425) Contributed by YiSheng Lien.

(cherry picked from commit 1843c4688a3040c48f6834d166494cbf68b5e4fd)

Conflicts:

LICENSE-binary

(cherry picked from commit d39ebbfebc9da982cadfbe92f3fb6677e744622d)

HDFS-14838. RBF: Display RPC (instead of HTTP) Port Number in RBF web UI. Contributed by Xieming Li

(cherry picked from commit c255333e20c9af6166db5931d70151011d540359)

YARN-9824. Fall back to configured queue ordering policy class name

(cherry picked from commit f8f8598ea5e86330fa5b553963f5632da286409d)

(cherry picked from commit 1dbf87c9ff33b5e2f6cbb0ce8efd348c4314a0e2)

YARN-8541 (branch-3.1 addendum): RM startup failure on recovery after user deletion

Revert "HADOOP-16061. Upgrade Yetus to 0.10.0"

This reverts commit 565751e73901fb0e4017297480e8cc272d06f915.

YARN-9820. RM logs InvalidStateTransitionException when app is submitted. Contributed by Prabhu Joseph

YARN-9764. Print application submission context label in application summary. Contributed by Manoj Kumar

(cherry picked from commit 43e389b9801e09741fdf78fef067b8ac60f691c8)

(cherry picked from commit 45220d115797663b8749980b78a61bafcb2344f1)

YARN-9813. RM does not start on JDK11 when UIv2 is enabled. (Adam Antal/Eric Yang via wangda)

Change-Id: I18b8edc930b2efa0652f59c246931ad0d46827f3

(cherry picked from commit 34b82e6da0a471010cdae613ba39487889d79369)

YARN-8995. Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time(addendum). Contributed by Jonathan Hung.

YARN-9795. ClusterMetrics to include AM allocation delay. Contributed by Fengnan Li.

YARN-9817. Fix failing testcases due to not initialized AsyncDispatcher - ArithmeticException: / by zero. Contributed by Prabhu Joseph.

YARN-9763. Print application tags in application summary. Contributed by Manoj Kumar

YARN-9761. Allow overriding application submissions based on server side configs. Contributed by Pralabh Kumar

Revert "HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun."

This reverts commit 29e6a97faa81f6b143851b0a038706bccc223130.

YARN-9810. Add queue capacity/maxcapacity percentage metrics. Contributed by Shubham Gupta

(cherry picked from commit 0ccf4b0fe16a8c879a560f2a612a3185eb2df72b)

(cherry picked from commit cb806988d72bde1f9837c9e0fb82a3a6c032542c)

YARN-9718. Fixed yarn.service.am.java.opts shell injection. Contributed by Eric Yang

(cherry picked from commit 2e2e5401f297545181323b126a69eaa2239afb02)

YARN-8995. Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time. Contributed by zhuqi.

Preparing for 3.1.4 development

  1. … 82 more files in changeset.
YARN-9785. Fix DominantResourceCalculator when one resource is zero. Contributed by Bibin A Chundatt, Sunil Govindan, Bilwa S T.

YARN-9797. LeafQueue#activateApplications should use resourceCalculator#fitsIn. Contributed by Bilwa S T.

(cherry picked from commit 03489124ea1b8d5648ade5e3563e39b5bc323384)

Revert "HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell."

This reverts commit d42b48d4d0aa08f7570c0f3a80e7fbf58833a6b2.

HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 915cbc91c0a12cc7b4d3ef4ea951941defbbcb33)

(cherry picked from commit 2c7f49743fba587e32398c81412db9eac426cf98)

HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun.

(cherry picked from commit 62d71fbac3789c7d484bc76ced9ec7fa6ff94de1)

HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun.

(cherry picked from commit 62d71fbac3789c7d484bc76ced9ec7fa6ff94de1)

HDFS-8178. QJM doesn't move aside stale inprogress edits files. Contributed by Istvan Fajth.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-12212. Options.Rename.To_TRASH is considered even when Options.Rename.NONE is specified. Contributed by Vinayakumar B.

Make DataNodePeerMetrics#minOutlierDetectionSamples configurable (#1314). Contributed by Lisheng Sun.

Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>

(cherry picked from commit 915271245b9a3f682409db380eb311ffd465b041)

(cherry picked from commit b516d2ea7b2b96a1af350edd7964d3e082ee4fe7)

HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 7bebad61d9c3dbff81fdcf243585fd3e9ae59dde)

(cherry picked from commit 9c0d6e16573a055665318bce8f7d38a92c897393)

YARN-9756: Create metric that sums total memory/vcores preempted per round. Contributed by Manikandan R (manirajv06).

(cherry picked from commit d562050cec83a2bc2ffb6d109ed3d64b394b870d)