Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HADOOP-16531. Log more timing information for slow RPCs. Contributed by Chen Zhang.

(cherry picked from commit a23417533e1ee052893baf207ec636c4993c5994)

HADOOP-16531. Log more timing information for slow RPCs. Contributed by Chen Zhang.

HADOOP-16531. Log more timing information for slow RPCs. Contributed by Chen Zhang.

(cherry picked from commit a23417533e1ee052893baf207ec636c4993c5994)

HADOOP-15565. Add an inner FS cache to ViewFileSystem, separate from the global cache, to avoid file system leaks. Contributed by Jinglun.

    • -6
    • +16
    ./fs/viewfs/ChRootedFileSystem.java
  1. … 6 more files in changeset.
HADOOP-16430. S3AFilesystem.delete to incrementally update s3guard with deletions

Contributed by Steve Loughran.

This overlaps the scanning for directory entries with batched calls to S3 DELETE and updates of the S3Guard tables.

It also uses S3Guard to list the files to delete, so find newly created files even when S3 listings are not use consistent.

For path which the client considers S3Guard to be authoritative, we also do a recursive LIST of the store and delete files; this is to find unindexed files and do guarantee that the delete(path, true) call really does delete everything underneath.

Change-Id: Ice2f6e940c506e0b3a78fa534a99721b1698708e

  1. … 42 more files in changeset.
HADOOP-16268. Allow StandbyException to be thrown as CallQueueOverflowException when RPC call queue is filled. Contributed by CR Hota.

  1. … 2 more files in changeset.
HDFS-14611. Move handshake secret field from Token to BlockAccessToken. Contributed by Chen Liang

  1. … 11 more files in changeset.
HDFS-14630. Configuration.getTimeDurationHelper() should not log time unit warning in info log. Contributed by hemanthboyina.

  1. … 1 more file in changeset.
HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

  1. … 6 more files in changeset.
HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 915cbc91c0a12cc7b4d3ef4ea951941defbbcb33)

(cherry picked from commit 2c7f49743fba587e32398c81412db9eac426cf98)

  1. … 6 more files in changeset.
HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 915cbc91c0a12cc7b4d3ef4ea951941defbbcb33)

  1. … 6 more files in changeset.
HDFS-8631. WebHDFS : Support setQuota. Contributed by Chao Sun.

  1. … 13 more files in changeset.
HADOOP-16496. Apply HDDS-1870 (ConcurrentModification at PrometheusMetricsSink) to Hadoop common.

This closes #1317

Reviewed-by: Bharat Viswanadham <bharat@apache.org>

    • -8
    • +16
    ./metrics2/sink/PrometheusMetricsSink.java
HADOOP-15246. SpanReceiverInfo - Prefer ArrayList over LinkedList. Contributed by David Mollitor.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HADOOP-15246. SpanReceiverInfo - Prefer ArrayList over LinkedList. Contributed by David Mollitor.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 901652e26321832ac42ce54daa18ebc1813772b5)

HADOOP-15246. SpanReceiverInfo - Prefer ArrayList over LinkedList. Contributed by David Mollitor.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 901652e26321832ac42ce54daa18ebc1813772b5)

(cherry picked from commit 1b30b3fbe7b5e130778c79465ac7986772a83ab8)

HDFS-14523. Remove excess read lock for NetworkToplogy. Contributed by Wu Weiwei.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Reviewed-by: Chen Liang <cliang@apache.org>

HDFS-14523. Remove excess read lock for NetworkToplogy. Contributed by Wu Weiwei.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Reviewed-by: Chen Liang <cliang@apache.org>

(cherry picked from commit 971a4c8e8328a4bdea65de4a0e84c82b5b2de24b)

HDFS-14523. Remove excess read lock for NetworkToplogy. Contributed by Wu Weiwei.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Reviewed-by: Chen Liang <cliang@apache.org>

(cherry picked from commit 971a4c8e8328a4bdea65de4a0e84c82b5b2de24b)

HADOOP-16391 Add a prefix to the metric names for MutableRatesWithAggregation used for deferred RPC metrics to avoid collision with non-deferred metrics. Contributed by Bilwa S T.

    • -1
    • +8
    ./metrics2/lib/MutableRatesWithAggregation.java
  1. … 1 more file in changeset.
HADOOP-16504. Increase ipc.server.listen.queue.size default from 128 to 256. Contributed by Lisheng Sun.

    • -1
    • +1
    ./fs/CommonConfigurationKeysPublic.java
  1. … 1 more file in changeset.
HADOOP-16495. Fix invalid metric types in PrometheusMetricsSink (#1244)

    • -2
    • +3
    ./metrics2/sink/PrometheusMetricsSink.java
  1. … 1 more file in changeset.
HADOOP-16453. Update how exceptions are handled in NetUtils. Contributed by Lisheng Sun.

  1. … 2 more files in changeset.
HDFS-14423. Percent (%) and plus (+) characters no longer work in WebHDFS.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

(cherry picked from commit da0006fe0473e353ee2d489156248a01aa982dfd)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

(cherry picked from commit d7ca016d63d89e5c8377a035f93485a7c77c3430)

  1. … 5 more files in changeset.
HDFS-14423. Percent (%) and plus (+) characters no longer work in WebHDFS.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

  1. … 5 more files in changeset.
HDFS-14423. Percent (%) and plus (+) characters no longer work in WebHDFS.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

(cherry picked from commit da0006fe0473e353ee2d489156248a01aa982dfd)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

  1. … 5 more files in changeset.
HDFS-14423. Percent (%) and plus (+) characters no longer work in WebHDFS.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

(cherry picked from commit da0006fe0473e353ee2d489156248a01aa982dfd)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

(cherry picked from commit d7ca016d63d89e5c8377a035f93485a7c77c3430)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java

hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java

  1. … 5 more files in changeset.
[SBN read] Addendum: Misc fix of issues, javadoc, whitespace unused backported fields etc

  1. … 12 more files in changeset.
YARN-9727: Allowed Origin pattern is discouraged if regex contains *. Contributed by Zoltan Siegl

    • -1
    • +1
    ./security/http/CrossOriginFilter.java
HDFS-14313. Get hdfs used space from FsDatasetImpl#volumeMap#ReplicaInfo in memory instead of df/du. Contributed by Lisheng Sun.

    • -0
    • +19
    ./fs/CommonConfigurationKeysPublic.java
  1. … 9 more files in changeset.