Clone Tools
  • last updated 27 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HDFS-14564: Add libhdfs APIs for readFully; add readFully to ByteBufferPositionedReadable (#963) Contributed by Sahil Takiar.

Reviewed-by: Siyao Meng <smeng@cloudera.com>

    • -2
    • +41
    ./native/libhdfs-tests/test_libhdfs_ops.c
    • -1
    • +20
    ./native/libhdfs/include/hdfs/hdfs.h
  1. … 9 more files in changeset.
HDFS-14846: libhdfs tests are failing on trunk due to jni usage bugs

Signed-off-by: Anu Engineer <aengineer@apache.org>

    • -1
    • +1
    ./native/libhdfs-tests/native_mini_dfs.c
  1. … 1 more file in changeset.
HDFS-14425. Native build fails on macos due to jlong in hdfs.c (#741)

Revert "Backport HDFS-3246,HDFS-14111 ByteBuffer pread interface to branch-2.9"

This reverts commit 52004ce08195fd2b2d0994a9b3faf560bc42fc0d.

    • -108
    • +10
    ./native/libhdfs-tests/test_libhdfs_ops.c
  1. … 11 more files in changeset.
HDFS-14483 Backport HDFS-3246,HDFS-14111 ByteBuffer pread interface to branch-2.9""

This is a revert of a revert, i.e. a reapplication of the HDFS-14483

patch. Original commit was missing the JIRA number.

Revert "Revert "Backport HDFS-3246,HDFS-14111 ByteBuffer pread interface to branch-2.9""

This reverts commit b26ad8a4c38d27894bd42d3fba7abff80bd895f4.

    • -10
    • +108
    ./native/libhdfs-tests/test_libhdfs_ops.c
  1. … 11 more files in changeset.
HDFS-14483 Backport HDFS-3246,HDFS-14111 ByteBuffer pread interface to branch-2.9""

This is a revert of a revert, i.e. a reapplication of the HDFS-14483

patch. Original commit was missing the JIRA number.

Revert "Revert "Backport HDFS-3246,HDFS-14111 ByteBuffer pread interface to branch-2.9""

This reverts commit b26ad8a4c38d27894bd42d3fba7abff80bd895f4.

    • -10
    • +108
    ./native/libhdfs-tests/test_libhdfs_ops.c
  1. … 11 more files in changeset.
Revert "Backport HDFS-3246,HDFS-14111 ByteBuffer pread interface to branch-2.9"

This reverts commit 4f09a6bcfd685bbc9e139497adfeeeff8170e344.

    • -108
    • +10
    ./native/libhdfs-tests/test_libhdfs_ops.c
  1. … 11 more files in changeset.
Backport HDFS-3246,HDFS-14111 ByteBuffer pread interface to branch-2.9

Signed-off-by: stack <stack@apache.org>

    • -10
    • +108
    ./native/libhdfs-tests/test_libhdfs_ops.c
  1. … 11 more files in changeset.
Backport HDFS-3246,HDFS-14111 ByteBuffer pread interface to branch-2.9

Signed-off-by: stack <stack@apache.org>

    • -10
    • +108
    ./native/libhdfs-tests/test_libhdfs_ops.c
  1. … 11 more files in changeset.
HDFS-11950. Disable libhdfs zerocopy test on Mac. Contributed by Akira Ajisaka.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit a95e87d827381a7f87c01f0befc2475f9478e63b)

HDFS-11950. Disable libhdfs zerocopy test on Mac. Contributed by Akira Ajisaka.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit a95e87d827381a7f87c01f0befc2475f9478e63b)

(cherry picked from commit f68099aa1316f34591c757bcf4198a3a3c7f691a)

(cherry picked from commit 3d1d8623a11b72c7939d6500537be5fd6565d4d6)

(cherry picked from commit 010a99104b53a23826f8f1f73d0125cb26f2adca)

(cherry picked from commit 73a59b2c42e000e2e699133b774dc17240f62886)

HDFS-11950. Disable libhdfs zerocopy test on Mac. Contributed by Akira Ajisaka.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-11950. Disable libhdfs zerocopy test on Mac. Contributed by Akira Ajisaka.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit a95e87d827381a7f87c01f0befc2475f9478e63b)

(cherry picked from commit f68099aa1316f34591c757bcf4198a3a3c7f691a)

(cherry picked from commit 3d1d8623a11b72c7939d6500537be5fd6565d4d6)

(cherry picked from commit 010a99104b53a23826f8f1f73d0125cb26f2adca)

HDFS-11950. Disable libhdfs zerocopy test on Mac. Contributed by Akira Ajisaka.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit a95e87d827381a7f87c01f0befc2475f9478e63b)

(cherry picked from commit f68099aa1316f34591c757bcf4198a3a3c7f691a)

HDFS-11950. Disable libhdfs zerocopy test on Mac. Contributed by Akira Ajisaka.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit a95e87d827381a7f87c01f0befc2475f9478e63b)

(cherry picked from commit f68099aa1316f34591c757bcf4198a3a3c7f691a)

(cherry picked from commit 3d1d8623a11b72c7939d6500537be5fd6565d4d6)

(cherry picked from commit 010a99104b53a23826f8f1f73d0125cb26f2adca)

(cherry picked from commit 73a59b2c42e000e2e699133b774dc17240f62886)

(cherry picked from commit c9af5fb43039997474d900f95abe252f0ab6c140)

HDFS-11950. Disable libhdfs zerocopy test on Mac. Contributed by Akira Ajisaka.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit a95e87d827381a7f87c01f0befc2475f9478e63b)

(cherry picked from commit f68099aa1316f34591c757bcf4198a3a3c7f691a)

(cherry picked from commit 3d1d8623a11b72c7939d6500537be5fd6565d4d6)

HDFS-14482: Crash when using libhdfs with bad classpath

HDFS-3246: pRead equivalent for direct read path (#597)

HDFS-3246: pRead equivalent for direct read path

Contributed by Sahil Takiar

    • -11
    • +131
    ./native/libhdfs-tests/test_libhdfs_ops.c
  1. … 11 more files in changeset.
HDFS-14348: Fix JNI exception handling issues in libhdfs

This closes #600

Signed-off-by: Todd Lipcon <todd@apache.org>

    • -33
    • +61
    ./native/libhdfs/os/posix/thread_local_storage.c
HDFS-14304: High lock contention on hdfsHashMutex in libhdfs

This closes #595

Signed-off-by: Todd Lipcon <todd@apache.org>

    • -24
    • +18
    ./native/libhdfs-tests/native_mini_dfs.c
    • -100
    • +0
    ./native/libhdfs-tests/test_htable.c
    • -287
    • +0
    ./native/libhdfs/common/htable.c
    • -161
    • +0
    ./native/libhdfs/common/htable.h
    • -0
    • +136
    ./native/libhdfs/jclasses.c
    • -0
    • +112
    ./native/libhdfs/jclasses.h
    • -102
    • +121
    ./native/libhdfs/jni_helper.c
HDFS-14111. hdfsOpenFile on HDFS causes unnecessary IO from file offset 0. Contributed by Sahil Takiar.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

    • -1
    • +4
    ./native/libhdfspp/tests/hdfs_ext_test.cc
  1. … 3 more files in changeset.
Revert "HDFS-14111. hdfsOpenFile on HDFS causes unnecessary IO from file offset 0. Contributed by Sahil Takiar."

This reverts commit f5a4b43a4944e1fcbdc86fc91c3a5179218cefdc.

    • -4
    • +1
    ./native/libhdfspp/tests/hdfs_ext_test.cc
  1. … 6 more files in changeset.
HDFS-14111. hdfsOpenFile on HDFS causes unnecessary IO from file offset 0. Contributed by Sahil Takiar.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

    • -1
    • +4
    ./native/libhdfspp/tests/hdfs_ext_test.cc
  1. … 6 more files in changeset.
HDFS-14321. Fix -Xcheck:jni issues in libhdfs, run ctest with -Xcheck:jni enabled. Contributed by Sahil Takiar.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

  1. … 1 more file in changeset.
HDFS-14285. libhdfs hdfsRead copies entire array even if its only partially filled. Contributed by Sahil Takiar.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14267. Add test_libhdfs_ops to libhdfs tests, mark libhdfs_read/write.c as examples. Contributed by Sahil Takiar.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

    • -0
    • +34
    ./native/libhdfs-examples/CMakeLists.txt
    • -0
    • +24
    ./native/libhdfs-examples/README.md
    • -0
    • +77
    ./native/libhdfs-examples/libhdfs_read.c
    • -0
    • +104
    ./native/libhdfs-examples/libhdfs_write.c
    • -0
    • +152
    ./native/libhdfs-examples/test-libhdfs.sh
    • -36
    • +83
    ./native/libhdfs-tests/test_libhdfs_ops.c
    • -72
    • +0
    ./native/libhdfs-tests/test_libhdfs_read.c
  1. … 2 more files in changeset.
HDFS-14015. Improve error handling in hdfsThreadDestructor in native thread local storage

Change-Id: Ida1e888c9231b9e46081338e3a206d8f6faabd36

HDFS-14035. NN status discovery does not leverage delegation token. Contributed by Chen Liang.

    • -0
    • +1
    ./native/libhdfspp/lib/proto/CMakeLists.txt
  1. … 15 more files in changeset.
HDFS-14035. NN status discovery does not leverage delegation token. Contributed by Chen Liang.

    • -0
    • +1
    ./native/libhdfspp/lib/proto/CMakeLists.txt
  1. … 15 more files in changeset.
HDFS-14047. [libhdfs++] Fix hdfsGetLastExceptionRootCause bug in test_libhdfs_threaded.c (Contributed by Antoli Shein via Daniel Templeton)

Change-Id: Ia5546fd5f8270f285c373b9023a9bd9835059845