hadoop

Clone Tools
  • last updated 29 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
YARN-9761. Allow overriding application submissions based on server side configs. Contributed by Pralabh Kumar

YARN-9761. Allow overriding application submissions based on server side configs. Contributed by Pralabh Kumar

YARN-9761. Allow overriding application submissions based on server side configs. Contributed by Pralabh Kumar

HDFS-13913. LazyPersistFileScrubber.run() should log meaningful warn message. Contributed by Daniel Green.

HDFS-14826. dfs.ha.zkfc.port property duplicated in hdfs-default.xml. Contributed by Renukaprasad C.

HDDS-1561: Mark OPEN containers as QUASI_CLOSED as part of Ratis groupRemove (#1401)

HDFS-14784. Add more methods to WebHdfsTestUtil to support tests outside of package. Contributed by Chen Zhang.

Revert "HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun."

This reverts commit 12ec7c301ff19b004fd94e3f0af7238f8050bccc.

Revert "HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun."

This reverts commit a524608d1e0a276fd822e9574f0a4a6d51298b13.

Revert "HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun."

This reverts commit 5369a3bd94ee6b49d3aacdee1ca238be0c25e370.

Revert "HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun."

This reverts commit 29e6a97faa81f6b143851b0a038706bccc223130.

HDDS-1708. Add container scrubber metrics. Contributed by Hrishikesh Gadre.

YARN-9810. Add queue capacity/maxcapacity percentage metrics. Contributed by Shubham Gupta

(cherry picked from commit 0ccf4b0fe16a8c879a560f2a612a3185eb2df72b)

YARN-9810. Add queue capacity/maxcapacity percentage metrics. Contributed by Shubham Gupta

(cherry picked from commit 0ccf4b0fe16a8c879a560f2a612a3185eb2df72b)

(cherry picked from commit cb806988d72bde1f9837c9e0fb82a3a6c032542c)

(cherry picked from commit 37d1f8c81eeee79b1ef5ce6316afbcdbc76acd8e)

YARN-9810. Add queue capacity/maxcapacity percentage metrics. Contributed by Shubham Gupta

(cherry picked from commit 0ccf4b0fe16a8c879a560f2a612a3185eb2df72b)

(cherry picked from commit cb806988d72bde1f9837c9e0fb82a3a6c032542c)

YARN-9810. Add queue capacity/maxcapacity percentage metrics. Contributed by Shubham Gupta

YARN-9718. Fixed yarn.service.am.java.opts shell injection. Contributed by Eric Yang

(cherry picked from commit 2e2e5401f297545181323b126a69eaa2239afb02)

YARN-9718. Fixed yarn.service.am.java.opts shell injection. Contributed by Eric Yang

(cherry picked from commit 2e2e5401f297545181323b126a69eaa2239afb02)

YARN-9718. Fixed yarn.service.am.java.opts shell injection. Contributed by Eric Yang

HDFS-12904. Add DataTransferThrottler to the Datanode transfers. Contributed by Lisheng Sun.

HDFS-14276. [SBN read] Reduce tailing overhead. Contributed by Wei-Chiu Chuang

HADOOP-16430. S3AFilesystem.delete to incrementally update s3guard with deletions

Contributed by Steve Loughran.

This overlaps the scanning for directory entries with batched calls to S3 DELETE and updates of the S3Guard tables.

It also uses S3Guard to list the files to delete, so find newly created files even when S3 listings are not use consistent.

For path which the client considers S3Guard to be authoritative, we also do a recursive LIST of the store and delete files; this is to find unindexed files and do guarantee that the delete(path, true) call really does delete everything underneath.

Change-Id: Ice2f6e940c506e0b3a78fa534a99721b1698708e

  1. … 28 more files in changeset.
HDDS-1898. GrpcReplicationService#download cannot replicate the container. (#1326)

YARN-8995. Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time. Contributed by zhuqi.

YARN-8995. Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time. Contributed by zhuqi.

YARN-8995. Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time. Contributed by zhuqi.

HDDS-1577. Add default pipeline placement policy implementation. (#1366)

HDDS-1577. Add default pipeline placement policy implementation. (#1366)

(cherry picked from commit b640a5f6d53830aee4b9c2a7d17bf57c987962cd)

YARN-9804. Update ATSv2 document for latest feature supports.

YARN-9804. Update ATSv2 document for latest feature supports.