Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HDFS-15383. RBF: Add support for router delegation token without watch (#2047)

Improving router's performance for delegation tokens related operations. It achieves the goal by removing watchers from router on tokens since based on our experience. The huge number of watches inside Zookeeper is degrading Zookeeper's performance pretty hard. The current limit is about 1.2-1.5 million.

    • -3
    • +3
    ./AbstractDelegationTokenSecretManager.java
    • -58
    • +83
    ./ZKDelegationTokenSecretManager.java
  1. … 3 more files in changeset.
HADOOP-17009: Embrace Immutability of Java Collections

    • -9
    • +5
    ./web/DelegationTokenAuthenticationHandler.java
  1. … 19 more files in changeset.
HADOOP-16828. Zookeeper Delegation Token Manager fetch sequence number by batch. Contributed by Fengnan Li.

    • -13
    • +41
    ./ZKDelegationTokenSecretManager.java
  1. … 1 more file in changeset.
HADOOP-16988. Remove source code from branch-2. (aajisaka via jhung)

This closes #1959

    • -241
    • +0
    ./AbstractDelegationTokenIdentifier.java
    • -718
    • +0
    ./AbstractDelegationTokenSecretManager.java
    • -61
    • +0
    ./AbstractDelegationTokenSelector.java
    • -950
    • +0
    ./ZKDelegationTokenSecretManager.java
    • -471
    • +0
    ./web/DelegationTokenAuthenticatedURL.java
    • -310
    • +0
    ./web/DelegationTokenAuthenticationFilter.java
    • -397
    • +0
    ./web/DelegationTokenAuthenticationHandler.java
    • -344
    • +0
    ./web/DelegationTokenAuthenticator.java
    • -64
    • +0
    ./web/DelegationTokenIdentifier.java
    • -233
    • +0
    ./web/DelegationTokenManager.java
    • -43
    • +0
    ./web/HttpUserGroupInformation.java
    • -54
    • +0
    ./web/KerberosDelegationTokenAuthenticationHandler.java
    • -46
    • +0
    ./web/KerberosDelegationTokenAuthenticator.java
  1. … 10832 more files in changeset.
HADOOP-16579. Upgrade to Curator 4.2.0 and ZooKeeper 3.5.5 (#1656). Contributed by Norbert Kalmár, Mate Szalay-Beko

* HADOOP-16579 - Upgrade to Apache Curator 4.2.0 and ZooKeeper 3.5.5

- Add a static initializer for the unit tests using ZooKeeper to enable

the four-letter-words diagnostic telnet commands. (this is an interface

that become disabled by default, so to keep the ZooKeeper 3.4.x behavior

we enabled it for the tests)

- Also fix ZKFailoverController to look for relevant fail-over ActiveAttempt

records. The new ZooKeeper seems to respond quicker during the fail-over

tests than the ZooKeeper, so we made sure to catch all the relevant records

by adding a new parameter to ZKFailoverontroller.waitForActiveAttempt().

Co-authored-by: Norbert Kalmár <nkalmar@cloudera.com>

  1. … 10 more files in changeset.
HADOOP-16069. Support configure ZK_DTSM_ZK_KERBEROS_PRINCIPAL in ZKDelegationTokenSecretManager using principal with Schema /_HOST. Contributed by luhuachao.

(cherry picked from commit 298f07abceb4bb854630c9058e1697d4ef3d2ae2)

HADOOP-16069. Support configure ZK_DTSM_ZK_KERBEROS_PRINCIPAL in ZKDelegationTokenSecretManager using principal with Schema /_HOST. Contributed by luhuachao.

(cherry picked from commit 298f07abceb4bb854630c9058e1697d4ef3d2ae2)

HADOOP-16069. Support configure ZK_DTSM_ZK_KERBEROS_PRINCIPAL in ZKDelegationTokenSecretManager using principal with Schema /_HOST. Contributed by luhuachao.

HDFS-14374. Expose total number of delegation tokens in AbstractDelegationTokenSecretManager. Contributed by CR Hota.

    • -1
    • +8
    ./AbstractDelegationTokenSecretManager.java
  1. … 1 more file in changeset.
HADOOP-15922. Fixed DelegationTokenAuthenticator URL decoding for doAs user. Contributed by He Xiaoqiao

(cherry picked from commit 0dd35e218fd4d6c660fd064e893be3112c546c9f)

    • -2
    • +1
    ./web/DelegationTokenAuthenticator.java
  1. … 1 more file in changeset.
HADOOP-15922. Fixed DelegationTokenAuthenticator URL decoding for doAs user. Contributed by He Xiaoqiao

(cherry picked from commit 0dd35e218fd4d6c660fd064e893be3112c546c9f)

    • -2
    • +1
    ./web/DelegationTokenAuthenticator.java
  1. … 1 more file in changeset.
HADOOP-15922. Fixed DelegationTokenAuthenticator URL decoding for doAs user. Contributed by He Xiaoqiao

    • -2
    • +1
    ./web/DelegationTokenAuthenticator.java
  1. … 1 more file in changeset.
HADOOP-16019. ZKDelegationTokenSecretManager won't log exception message occured in function setJaasConfiguration.

Contributed by luhuachao.

(cherry picked from commit ccc43621aba4f1fc9ca880e294a66862493805b0)

HADOOP-16019. ZKDelegationTokenSecretManager won't log exception message occured in function setJaasConfiguration.

Contributed by luhuachao.

(cherry picked from commit ccc43621aba4f1fc9ca880e294a66862493805b0)

HADOOP-16019. ZKDelegationTokenSecretManager won't log exception message occured in function setJaasConfiguration.

Contributed by luhuachao.

HADOOP-15922. Revert patch 004.

(cherry picked from commit 38ea3814bd0641d895e5d3b7415c6308e7f8491e)

    • -7
    • +1
    ./web/DelegationTokenAuthenticationFilter.java
  1. … 1 more file in changeset.
HADOOP-15922. Revert patch 004.

(cherry picked from commit 38ea3814bd0641d895e5d3b7415c6308e7f8491e)

    • -7
    • +1
    ./web/DelegationTokenAuthenticationFilter.java
  1. … 1 more file in changeset.
HADOOP-15922. Revert patch 004.

    • -7
    • +1
    ./web/DelegationTokenAuthenticationFilter.java
  1. … 1 more file in changeset.
HADOOP-15922. Fixed doAsUser decoding for DelegationTokenAuthenticationFilter. Contributed by He Xiaoqiao

(cherry picked from commit a9d96948ede11d4d8a8fb58b31b150af84e118d9)

    • -1
    • +7
    ./web/DelegationTokenAuthenticationFilter.java
  1. … 1 more file in changeset.
HADOOP-15922. Fixed doAsUser decoding for DelegationTokenAuthenticationFilter. Contributed by He Xiaoqiao

    • -1
    • +7
    ./web/DelegationTokenAuthenticationFilter.java
  1. … 1 more file in changeset.
HADOOP-15922. Fixed doAsUser decoding for DelegationTokenAuthenticationFilter. Contributed by He Xiaoqiao

(cherry picked from commit a9d96948ede11d4d8a8fb58b31b150af84e118d9)

    • -1
    • +7
    ./web/DelegationTokenAuthenticationFilter.java
  1. … 1 more file in changeset.
YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg

(cherry picked from commit ab6aa4c7265db5bcbb446c2f779289023d454b81)

    • -4
    • +8
    ./AbstractDelegationTokenSecretManager.java
  1. … 2 more files in changeset.
YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg

    • -4
    • +8
    ./AbstractDelegationTokenSecretManager.java
  1. … 2 more files in changeset.
YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg

(cherry picked from commit ab6aa4c7265db5bcbb446c2f779289023d454b81)

    • -4
    • +8
    ./AbstractDelegationTokenSecretManager.java
  1. … 2 more files in changeset.
YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg

(cherry picked from commit ab6aa4c7265db5bcbb446c2f779289023d454b81)

    • -4
    • +8
    ./AbstractDelegationTokenSecretManager.java
  1. … 2 more files in changeset.
HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances. Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.

    • -7
    • +18
    ./web/DelegationTokenAuthenticatedURL.java
  1. … 17 more files in changeset.
HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances. Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.

(cherry picked from commit 5ec86b445cc492f52c33639efb6a09a0d2f27475)

    • -7
    • +18
    ./web/DelegationTokenAuthenticatedURL.java
  1. … 17 more files in changeset.
HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances. Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.

(cherry picked from commit 5ec86b445cc492f52c33639efb6a09a0d2f27475)

(cherry picked from commit e93e401f492c7fc112da3d0c63b3b186c1b196ec)

Conflicts:

hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSClientProvider.java

    • -7
    • +18
    ./web/DelegationTokenAuthenticatedURL.java
  1. … 17 more files in changeset.
HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances. Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.

    • -7
    • +18
    ./web/DelegationTokenAuthenticatedURL.java
  1. … 17 more files in changeset.
HADOOP-15785. [JDK10] Javadoc build fails on JDK 10 in hadoop-common. Contributed by Dinesh Chitlangia.

    • -7
    • +7
    ./web/DelegationTokenAuthenticatedURL.java
    • -3
    • +3
    ./web/DelegationTokenAuthenticationFilter.java
    • -2
    • +2
    ./web/DelegationTokenAuthenticationHandler.java
    • -1
    • +1
    ./web/KerberosDelegationTokenAuthenticationHandler.java
    • -1
    • +1
    ./web/KerberosDelegationTokenAuthenticator.java
    • -1
    • +2
    ./web/MultiSchemeDelegationTokenAuthenticationHandler.java
    • -1
    • +1
    ./web/PseudoDelegationTokenAuthenticationHandler.java
    • -1
    • +1
    ./web/PseudoDelegationTokenAuthenticator.java
  1. … 137 more files in changeset.