hadoop

Clone Tools
  • last updated 17 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
YARN-9763. Print application tags in application summary. Contributed by Manoj Kumar

HADOOP-16531. Log more timing information for slow RPCs. Contributed by Chen Zhang.

(cherry picked from commit a23417533e1ee052893baf207ec636c4993c5994)

HADOOP-16531. Log more timing information for slow RPCs. Contributed by Chen Zhang.

HADOOP-16531. Log more timing information for slow RPCs. Contributed by Chen Zhang.

(cherry picked from commit a23417533e1ee052893baf207ec636c4993c5994)

HDFS-14817. [Dynamometer] Fix start script options parsing which incorrectly interpret options starting with h as a help argument. Contributed by Soya Miyoshi.

HADOOP-15565. Add an inner FS cache to ViewFileSystem, separate from the global cache, to avoid file system leaks. Contributed by Jinglun.

HDFS-4819. [Dynamometer] Fix parsing of audit logs which contain = in path names. Contributed by Soya Miyoshi.

YARN-9761. Allow overriding application submissions based on server side configs. Contributed by Pralabh Kumar

YARN-9761. Allow overriding application submissions based on server side configs. Contributed by Pralabh Kumar

YARN-9761. Allow overriding application submissions based on server side configs. Contributed by Pralabh Kumar

YARN-9761. Allow overriding application submissions based on server side configs. Contributed by Pralabh Kumar

HDFS-13913. LazyPersistFileScrubber.run() should log meaningful warn message. Contributed by Daniel Green.

HDFS-14826. dfs.ha.zkfc.port property duplicated in hdfs-default.xml. Contributed by Renukaprasad C.

HDDS-1561: Mark OPEN containers as QUASI_CLOSED as part of Ratis groupRemove (#1401)

HDFS-14784. Add more methods to WebHdfsTestUtil to support tests outside of package. Contributed by Chen Zhang.

Revert "HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun."

This reverts commit 12ec7c301ff19b004fd94e3f0af7238f8050bccc.

Revert "HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun."

This reverts commit a524608d1e0a276fd822e9574f0a4a6d51298b13.

Revert "HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun."

This reverts commit 5369a3bd94ee6b49d3aacdee1ca238be0c25e370.

Revert "HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun."

This reverts commit 29e6a97faa81f6b143851b0a038706bccc223130.

HDDS-1708. Add container scrubber metrics. Contributed by Hrishikesh Gadre.

YARN-9810. Add queue capacity/maxcapacity percentage metrics. Contributed by Shubham Gupta

(cherry picked from commit 0ccf4b0fe16a8c879a560f2a612a3185eb2df72b)

YARN-9810. Add queue capacity/maxcapacity percentage metrics. Contributed by Shubham Gupta

(cherry picked from commit 0ccf4b0fe16a8c879a560f2a612a3185eb2df72b)

(cherry picked from commit cb806988d72bde1f9837c9e0fb82a3a6c032542c)

(cherry picked from commit 37d1f8c81eeee79b1ef5ce6316afbcdbc76acd8e)

YARN-9810. Add queue capacity/maxcapacity percentage metrics. Contributed by Shubham Gupta

(cherry picked from commit 0ccf4b0fe16a8c879a560f2a612a3185eb2df72b)

(cherry picked from commit cb806988d72bde1f9837c9e0fb82a3a6c032542c)

YARN-9810. Add queue capacity/maxcapacity percentage metrics. Contributed by Shubham Gupta

YARN-9718. Fixed yarn.service.am.java.opts shell injection. Contributed by Eric Yang

(cherry picked from commit 2e2e5401f297545181323b126a69eaa2239afb02)

YARN-9718. Fixed yarn.service.am.java.opts shell injection. Contributed by Eric Yang

(cherry picked from commit 2e2e5401f297545181323b126a69eaa2239afb02)

YARN-9718. Fixed yarn.service.am.java.opts shell injection. Contributed by Eric Yang

HDFS-12904. Add DataTransferThrottler to the Datanode transfers. Contributed by Lisheng Sun.

HDFS-14276. [SBN read] Reduce tailing overhead. Contributed by Wei-Chiu Chuang

HADOOP-16430. S3AFilesystem.delete to incrementally update s3guard with deletions

Contributed by Steve Loughran.

This overlaps the scanning for directory entries with batched calls to S3 DELETE and updates of the S3Guard tables.

It also uses S3Guard to list the files to delete, so find newly created files even when S3 listings are not use consistent.

For path which the client considers S3Guard to be authoritative, we also do a recursive LIST of the store and delete files; this is to find unindexed files and do guarantee that the delete(path, true) call really does delete everything underneath.

Change-Id: Ice2f6e940c506e0b3a78fa534a99721b1698708e

  1. … 28 more files in changeset.