hadoop

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HDDS-2019. Handle Set DtService of token in S3Gateway for OM HA. (#1489)

HDDS-2224. Fix loadup cache for cache cleanup policy NEVER. (#1567)

HDDS-2162. Make OM Generic related configuration support HA style config. (#1511)

HADOOP-16624. Upgrade hugo to the latest version in Dockerfile

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

HDDS-2200 : Recon does not handle the NULL snapshot from OM DB cleanly.

Signed-off-by: Anu Engineer <aengineer@apache.org>

HDDS-2227. GDPR key generation could benefit from secureRandom. (#1574)

HDDS-2073. Make SCMSecurityProtocol message based. Contributed by Elek, Marton.

YARN-9792. Document examples of SchedulerConf with Node Labels. Contributed by Prabhu Joseph

HDDS-2201. Rename VolumeList to UserVolumeInfo. (#1566)

  1. … 10 more files in changeset.
YARN-9870. Remove unused function from OpportunisticContainerAllocatorAMService. Contributed by Abhishek Modi.

HDDS-2187. ozone-mr test fails with No FileSystem for scheme "o3fs"

Closes #1537

HDDS-2210. ContainerStateMachine should not be marked unhealthy if applyTransaction fails with closed container exception(#1552).

HDFS-14885. UI: Fix a typo on WebUI of DataNode. Contributed by Xieming Li.

YARN-9862. Increase yarn-services-core test timeout value. Contributed by Prabhu Joseph

HADOOP-16578 : Avoid FileSystem API calls when FileSystem already exists

HADOOP-16578 : Avoid FileSystem API calls when FileSystem already exists

HADOOP-16578 : Avoid FileSystem API calls when FileSystem already exists

HADOOP-16619. Upgrade jackson and jackson-databind to 2.9.10 (#1554). Contributed by Siyao Meng.

HADOOP-16619. Upgrade jackson and jackson-databind to 2.9.10 (#1554). Contributed by Siyao Meng.

(cherry picked from commit d947ded05388c36f8ac688fc697cfafcbaaa58e7)

HADOOP-16458. LocatedFileStatusFetcher.getFileStatuses failing intermittently with S3

Contributed by Steve Loughran.

Includes

-S3A glob scans don't bother trying to resolve symlinks

-stack traces don't get lost in getFileStatuses() when exceptions are wrapped

-debug level logging of what is up in Globber

-Contains HADOOP-13373. Add S3A implementation of FSMainOperationsBaseTest.

-ITestRestrictedReadAccess tests incomplete read access to files.

This adds a builder API for constructing globbers which other stores can use

so that they too can skip symlink resolution when not needed.

Change-Id: I23bcdb2783d6bd77cf168fdc165b1b4b334d91c7

Revert "HDFS-14492. Snapshot memory leak. Contributed by Wei-Chiu Chuang. (#1370)"

This reverts commit 6ef6594c7ee09b561e42c16ce4e91c0479908ad8.

HDFS-14492. Snapshot memory leak. Contributed by Wei-Chiu Chuang. (#1370)

* HDFS-14492. Snapshot memory leak. Contributed by Wei-Chiu Chuang.

Change-Id: I9e5e450c07ad70aa1905973896c4f627042dbd37

* Fix checkstyle

Change-Id: I16d4bd4f03a971e1ed36cf57d89dc42357ef8fbf

(cherry picked from commit 6ef6594c7ee09b561e42c16ce4e91c0479908ad8)

(cherry picked from commit 570ffa1cd67990ef0e49c149abc04a92ed3670ac)

HDFS-14492. Snapshot memory leak. Contributed by Wei-Chiu Chuang. (#1370)

* HDFS-14492. Snapshot memory leak. Contributed by Wei-Chiu Chuang.

Change-Id: I9e5e450c07ad70aa1905973896c4f627042dbd37

* Fix checkstyle

Change-Id: I16d4bd4f03a971e1ed36cf57d89dc42357ef8fbf

HDFS-14492. Snapshot memory leak. Contributed by Wei-Chiu Chuang. (#1370)

* HDFS-14492. Snapshot memory leak. Contributed by Wei-Chiu Chuang.

Change-Id: I9e5e450c07ad70aa1905973896c4f627042dbd37

* Fix checkstyle

Change-Id: I16d4bd4f03a971e1ed36cf57d89dc42357ef8fbf

(cherry picked from commit 6ef6594c7ee09b561e42c16ce4e91c0479908ad8)

HDDS-2166. Some RPC metrics are missing from SCM prometheus endpoint

Closes #1505

YARN-9801. SchedConfCli does not work wiwith https mode. Contributed by Prabhu Joseph

YARN-9801. SchedConfCli does not work wiwith https mode. Contributed by Prabhu Joseph

(cherry picked from commit 99cd7572f113cbbb8f5ef89af60af3734fe8cfa7)

YARN-9801. SchedConfCli does not work wiwith https mode. Contributed by Prabhu Joseph

(cherry picked from commit 99cd7572f113cbbb8f5ef89af60af3734fe8cfa7)

YARN-9864. Format CS Configuration present in Configuration Store. Contributeed by Prabhu Joseph

  1. … 3 more files in changeset.
YARN-9858. Optimize RMContext getExclusiveEnforcedPartitions. Contributed by Jonathan Hung.