Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE][NET] Preemptively re-resolve INetSocketAddresses when replica connection is unhealthy

Change-Id: I64386b9a1e63d2b2ab792628dc4348a30590cc6f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/5043

Reviewed-by: Michael Blow <mblow@apache.org>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][NET] Re-resolve InetSocketAddresses on failure

Support IP address updates on replicas & CC by re-resolving the IP address

on connection failure

Change-Id: I2532a27c2abb8b891df668b0adc95cc33da99620

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4965

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 8 more files in changeset.
[NO ISSUE] Apply / enforce java import order

The process-sources target will now sort imports as well as

format source code; the source-format job will likewise verify

import order in addition to source code format

Change-Id: I55d976c4df10d9919c6a25683be2a3e3304e65d9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3288

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 624 more files in changeset.
[NO ISSUE][OTH] Refactor Healthy ISocketChannel Check

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Refactor common logic to check for healthy ISocketChannel.

- Fix SslReplicationExecutionTest test name.

Change-Id: I340d369b40d6f4200a4fc6c6f1c7c377e10fccb0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3096

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 2 more files in changeset.
[ASTERIXDB-2490][NET] Support Encrypted Replication Connections

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Use SocketChannelFactory in replication connections

to support both unencrypted and encrypted sockets.

- Add SSL replication test cases.

- Make SslSocketChannel close idempotent.

- Ensure FlushDatasetOperatorDescriptor waits for all

on-going dataset IO.

Change-Id: I9657624a5d54d4966357651efb671f3d8f0cb304

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3092

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 13 more files in changeset.
[NO ISSUE][OTH] Remove Unused Imports

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: Iafff39073d0fedaff74a26ef7e3260008a79ff0c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2893

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

  1. … 67 more files in changeset.
[NO ISSUE][REPL] Attempt to Close Replication Channel Quietly

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: I69af20aa76682b6d28f5c73f21be6db77117896d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2870

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Contrib: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

[NO ISSUE][REPL] Ignore LSNs of Partially Replicated Indexes

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- When determining low watermark, ignore LSN of replicated

indexes with no checkpoints.

- Guard logs in case of unexpected min LSN read failures.

- Ensure only one replica is synchronized at a time to prevent

possible merge operations from deleting files being synchronized

to another replica concurrently.

- Ensure index metadata files are replicated first to allow

replicas to find any existing files in case of re-synchronization.

- Ensure replication channel is closed on replication failures.

Change-Id: I9ca08da29bdd8fc4406f2df7e6eb32601caf9388

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2534

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 5 more files in changeset.
[NO ISSUE][NET] Networking Improvements

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Set keep alive and no TCP delay options

on socket channels.

- Cancel key and close IPC handle on failed

read/writes to avoid getting the same failures

with every NetworkThread loop.

Change-Id: I60c1f9cfe2ea577fca14cd2e98c6461c49df011a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2418

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 5 more files in changeset.
[NO ISSUE][OTR] Logging Cleanup

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- No pretty printing for replica status.

- Log ignored exception in debug level.

Change-Id: I7e4a37e9621ef5bdb27105b17e883800212e594b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2276

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 1 more file in changeset.
[ASTERIXDB-2195][REPL] Replace Static Replication

- user model changes: no

- storage format changes: no

- interface changes: yes

- Redesigned all replication interfaces

Details:

- Replace static replication and fault tolerance by

dynamic storage API.

- Remove static based fault tolerance strategies.

- Redesign replication APIs and classes to smaller

maintainable parts.

- Clean up replication properties.

- Unify logic for checkpoints when replication is

enabled.

- Remove static replication test cases.

- Add replication runtime test cases for:

- Bulkload component replication.

- Memory component recovery.

- Flushed component replication.

- Add replication integration test for:

- Resync failed replica.

Change-Id: Ic5c4b0ac199a4530c807e558c8aebb1eb1284048

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2252

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -0
    • +39
    ./IReplicationWorker.java
    • -0
    • +168
    ./PartitionReplica.java
    • -0
    • +128
    ./ReplicationDestination.java
  1. … 248 more files in changeset.
[ASTERIXDB-2198][REPL] Introduce Dynamic Replica Placement

- user model changes: no

- storage format changes: no

- interface changes: yes

- Add IReplicationMessage and IReplicaTask.

- Add notifyMetadataNodeChange to IFaultToleranceStrategy.

- Add register to IReplicationManager to allow registering

replicas at runtime.

Details:

- Add cluster APIs for:

- changing partition master node.

- changing metadata node.

- Add NC storage management API for promoting a partition replica

to master replica.

- Implement changing metadata node at runtime in

MetadataNodeFaultToleranceStrategy.

- Allow MetadataNodeFaultToleranceStrategy to have zero replica

at initialization.

- Add a flag to LangExecutionUtil to skip storage distribution

check at the end of each test.

- Add test case for metadata node failover as follows:

1- start with nc1 as metadata node.

2- add replica for metadata partition on nc2 at runtime.

3- performs metadata transactions on nc1.

4- promote metadata partition on nc2.

5- failover metadata node to nc2.

6- ensure the effects of the metadata transactions on (2) exists.

7- performs more metadata transactions on nc2.

8- ensure the effects of the metadata transactions on (7) exists.

Change-Id: I11f82efcad29d2c37324fe9d3c11d872b0348f49

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2215

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +40
    ./IReplicationMessage.java
  1. … 60 more files in changeset.