common

This change fixes the counter of number of active operations in primary

index opTracker. This is accomplished by sharing of counter between multiple

partitions. Each transaction will have that counter as part of its

context object

Change-Id: I0dc34b9a3aa69d39ac2eda11c17e7ad0ccc1a661

Reviewed-on: https://asterix-gerrit.ics.uci.edu/536

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Change-Id: I7d167b64bf9ec754182b5b2fe44dfc7e5908c686

Reviewed-on: https://asterix-gerrit.ics.uci.edu/325

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Change-Id: Idbfcd9c67f91d373c5f7269125778a5681021227

Reviewed-on: https://asterix-gerrit.ics.uci.edu/505

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Change-Id: I5610e903be3347893e676c915b98316b06073c25

Reviewed-on: https://asterix-gerrit.ics.uci.edu/265

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Change-Id: Ibb6c6949bdf2ed6c3e491fa66a23491ff34fc830

Reviewed-on: https://asterix-gerrit.ics.uci.edu/469

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Change-Id: I2de2d7c7fd816ddbd53a80c855f64923c02efe35

Reviewed-on: https://asterix-gerrit.ics.uci.edu/494

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

This change includes the following:

- Add data replication properties to cluster properties and Managix validate command.

- Introduce Data Replication components.

- Add data replication required fields to LogRecord.

- Specialized LogManager for data replication.

- Fix for invalid cluster state on nodes failure.

- ASTERIXDB-139: Fix for cleaning workspace files on startup/shutdown.

- Fix for temp datasets storage reclamation.

- Allow MetadataNode rebinding with CC.

- Add flag to checkpoint to identify sharp checkpoints.

- ASTERIXDB-1170: Fix shutdown sequence

Change-Id: I729fdd1144dbc9ff039b4bc414494860d7553810

Reviewed-on: https://asterix-gerrit.ics.uci.edu/338

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

- Adapt memory budget calculation to lazy LSM memory allocation.

- Add IDatasetLifecycleManager interface.

Change-Id: I4ea1eb129fe3043d43b077473dc29d17a97dfcc2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/408

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

This can mostly be seen during asterix-installer tests.

The fix basically lets managix wait and listens

through zookeeper for a signal from the cluster controller that

the cluster is up and ready.

Once the cluster controller sends the signal, Managix can proceed.

Change-Id: Ib730f50ab2fb492f3cf973d1cf2f03b34e24e5b3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/366

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Very simple API. Just do a GET against /admin/version and get all of the build-time git info in JSON.

Change-Id: Ie392eb0cdbd25f2f4679fba12aae4c7a496e9637

Reviewed-on: https://asterix-gerrit.ics.uci.edu/468

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

This patch is to change the encoding format that stores the length value

of

the variable length type (e.g. String, ByteArray) from fix-size encoding

(2bytes) to variable-size encoding ( 1 to 5bytes)

It will solve the issue 1102 to enable us to store a String that longer

than 64K. Also for the common case of storing the short string ( <=

127), it will save one byte per string.

Some important changes include:

1. The UTF8StringSerDer and ByteArraySerDer is not Singleton instance

any more. I need some state to speedup the serialization and avoid the

object creatation. Luckily, 99% percent of Serializer were used as

factory way. The other 1% has been fixed.

A separate Test support, the ExcutionTest now can produce the only.xml

which stores the previous failed runtime test.xml. It can speedup the

debug process.

Change-Id: I41fff780f5c071742ef10129d83c8f945d5886d7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/450

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Jianfeng Jia <jianfeng.jia@gmail.com>

Change-Id: Ide2b346c2ad498d7595e71bae890362c2143d301

Reviewed-on: https://asterix-gerrit.ics.uci.edu/458

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Change-Id: Ie3fca99e7019424f2b2a3ca43180cf6390feb761

Reviewed-on: https://asterix-gerrit.ics.uci.edu/448

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

-Avoid using exceptions for control flow in LogRecord

-Rename LogPage and ilk to LogBuffer

-Busywait on read() to fill entire buffer for fillLogBuffer rather than failing

-Distinguish between log truncation and checksum corruption

TODOs:

- Log IO and parsing still happen in lock-step.

- Busywaiting for read to return something other than 0 is unfortunate

Change-Id: I1658e938eb0f199f748407361ffee4833aac661c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/289

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Change-Id: I5a22b7a56e476b0cb4535ba4323419ef7eb69fb1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/446

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

- Allow indexes to be accessed by name.

- Allow lazy loading for persistent local resources.

- Caching for local resources.

Change-Id: I48b9260a3280750145f6ddb3783673a299055910

Reviewed-on: https://asterix-gerrit.ics.uci.edu/344

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Change-Id: I28ae228e4322c07128a40432378ecaace913ad80

Reviewed-on: https://asterix-gerrit.ics.uci.edu/411

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Also tweak the NOTICE file with some extras.

Change-Id:I09bc388089e515d7f51fd39c31bfbbc9f00cf84f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/388

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Change-Id: I2f01d2b5614e9e9c94fda4bf1294a8eba6a26c54

Reviewed-on: https://asterix-gerrit.ics.uci.edu/309

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>