asterixdb

Clone Tools
  • last updated 29 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Almost full support for clean JSON, plus some lossless JSON fixes

Clean JSON correctly supports all numeric and spatial types, plus hex and uuid.

Lossless JSON correctly supports uuid and hex, and "circle" is correct now.

Date/time types remain unfixed for both JSON formats.

Change-Id: I5c37d3b5aad7f286eba1cb8cb5f05ad456a6521d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/362

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -0
    • +25
    /asterix-app/data/nontagged/allData.adm
    • -17
    • +0
    /asterix-app/data/nontagged/allData.json
  1. … 33 more files in changeset.
Adding 'cleanjson' output format, along with implementation of lists.

Also includes test-framework update to allow testing of cleanjson.

Change-Id: I5c37d3b5aad7f286eba1cb8cb5f05ad456a6521c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/361

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Ian Maxon <imaxon@apache.org>

  1. … 168 more files in changeset.
Move ADM-specific printers and related classes into .adm packages.

Change-Id: I5c37d3b5aad7f286eba1cb8cb5f05ad456a6521b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/360

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 125 more files in changeset.
Change folder structure for Java repackage

Change only the folders, not the files, for our package name change.

This will break the build, and needs to be followed by a change to

the package name in all of the source files. However performing

the folder move and file change in two steps lets Git understand

that the files are the same, and lets us track revisions across

those files.

Change-Id: I08aff75e25ac7c6298c32cf3402febbc4a318c2a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/307

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

  1. … 3879 more files in changeset.
Fix missing JARs in YARN packaging

There were some missing JARs for the Asterix YARN client in the zip packaging.

This tells maven's packager to include those dependencies.

Change-Id: I3985f7c84f4a60733b99c696535dd8a4fb4b87e1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/358

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Changed metadata storage format for nullable field types. Moved field name generation to the client out of metadata node code. Changed naming scheme for autogenerated types. Moved GroupName, CompactionPolicy & CompactionPolicyProperties fields up from External\InternalDetails to Dataset record type definition

Change-Id: I223aded8aaf80f0688358899c0e8b0d6988fac93

Reviewed-on: https://asterix-gerrit.ics.uci.edu/323

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 192 more files in changeset.
whitespace fix for commit b361b06

Change-Id: I9b01a2cacb2a8efe0a4c0bb97436a9c59edb8e42

Reviewed-on: https://asterix-gerrit.ics.uci.edu/357

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -86
    • +86
    /asterix-doc/src/site/markdown/feeds/tutorial.md
Abstracting algebricks rules out of AsterixDB.

Change-Id: Id184cc1cdfa738964705007ac42027d90b84cf58

Reviewed-on: https://asterix-gerrit.ics.uci.edu/353

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Preston Carman <prestonc@apache.org>

Fixed ASTERIXDB-1072 issue - string-concat Change-Id: Id0dd46f983e0275c3f68329f7cfd52cc43363a76 Reviewed-on: https://asterix-gerrit.ics.uci.edu/356 Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Reviewed-by: Ian Maxon <imaxon@apache.org>

Fix for Issue 929

commit 58317b37a3a7b2546b4780f4427ae1ed21a4ece9

Author: Ubuntu <raman@ramangro.ramangro.d3.internal.cloudapp.net>

Date: Fri Aug 14 10:47:06 2015 +0000

Fix for Issue 929:

a) Added documenation for use of OAuth keys and tokens when using the built-in Twitter adaptor

b) Modified RSS feed adaptor and added documenation

Change-Id: I5521287a4fa1818c78a4f83b1a3cabeea8e6096d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/354

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -24
    • +183
    /asterix-doc/src/site/markdown/feeds/tutorial.md
Abstracting algebricks rules out of AsterixDB.

Change-Id: I80789e3827b4224b92b0b9d7247919f862f6f939

Reviewed-on: https://asterix-gerrit.ics.uci.edu/352

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

fixing minor issues in docs related to similarity queries Change-Id: Ide23cb7fb33a58bcb2eb4535cf89152518d35a86 Reviewed-on: https://asterix-gerrit.ics.uci.edu/351 Reviewed-by: Taewoo Kim <wangsaeu@gmail.com> Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -13
    • +16
    /asterix-doc/src/site/markdown/aql/functions.md
Optimized the binary tokenizer - get the total number of tokens Change-Id: Ifa9a18a43a097766da22633bb48371ffc78406ae Reviewed-on: https://asterix-gerrit.ics.uci.edu/348 Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Optimized the binary tokenizer - get the total number of tokens Change-Id: I83765b6cd7cb92648aa55b260b0044fa3ffdcd7d Reviewed-on: https://asterix-gerrit.ics.uci.edu/349 Reviewed-by: Young-Seok Kim <kisskys@gmail.com> Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Fix for issue 923

Change-Id: I87053315fc7650682fcbedd573b1155c17810073

Reviewed-on: https://asterix-gerrit.ics.uci.edu/347

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

This change includes: 1. avoid calling ByteBuffer.get() and ByteBuffer.put() for bloom filter set/get operations. ByteBuffer will check boundaries of the index for get/put. It's a very frequent operation. 2. let the hash table size in BufferCache be 3X of the buffer cache page count. This will even reduce conflicts.

Change-Id: Ifd47c410338ce557a494ab3605660bad1899e786

Reviewed-on: https://asterix-gerrit.ics.uci.edu/345

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Reviewed-by: Ian Maxon <imaxon@apache.org>

improve the buffer cache perf. with 1) a better hash function for fileid-pageid, 2) reduce synchronization in clock page replacement policy.

Change-Id: I296c589a556a9afa7f27c6f560fa07fc4e2c1861

Reviewed-on: https://asterix-gerrit.ics.uci.edu/342

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Performance fix for BufferCache. The dpid of a page of file is calculated by fileid<<32 + pageid. But BufferCache.hash(long dpid) returns the hash value dpid%pageMap.length. In many cases, the asterix configuration results in power-of-2 pageMap.length (buffer-cache-size/page-size), which makes fileid useless. That used to result in serious consequences: different partitions contend for the same cache bucket (which contains a link list of size #partitions) for most of the time and therefore the CPU couldn't be saturated.

Change-Id: I4afc406d612e569e23f65afdedc469459235ce7d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/341

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Reviewed-by: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>

Fix really bad typo in POM

- One change to a UUID result which doesn't correspond to its query

- Disable the one introspection test case that fails temporarily

Change-Id: I4e62a505754967c590f195bd997aba44ddb5a535

Reviewed-on: https://asterix-gerrit.ics.uci.edu/340

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Fix the temporary dataset life time threshold.

Change-Id: I076c085d4decfa23ab7413e85fe60458dd96d058

Reviewed-on: https://asterix-gerrit.ics.uci.edu/339

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

1. Fix the memory bloat issue introduced by https://github.com/apache/incubator-asterixdb/commit/c66d23a5ac65ec5218ee47134aea423fd62a32cc Recycle object pools in ADMDataParser before parsing each top-level ADM record.

2. Avoid using Strings as parameters of object pools because string comparison is slow and several comparisons done for parsing each ADM record.

Change-Id: I31848d8bd42a07f72035aefa2d671fdb2fce037d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/334

Reviewed-by: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Preston Carman <prestonc@apache.org>

Doc updates to HTTP API

-Rename "REST" API to HTTP API

-Minor documentation for /aql endpoint

Change-Id: I5c6520495752da312f4db7641fcfd14f7d63c829

Reviewed-on: https://asterix-gerrit.ics.uci.edu/331

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -1
    • +31
    /asterix-doc/src/site/markdown/api.md
Add missing documentation to sidebar, fix typos

Change-Id: Id957eb1321eb7539b951418178b989eb194ed625

Reviewed-on: https://asterix-gerrit.ics.uci.edu/330

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

NKC fix for int64

Change-Id: I60b3ec3f15921093b1fa11ac9fc157b7930f4e4d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/329

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Added the UUID constructor and changed the relevant documentation

Change-Id: I2276bf2b44975b13c99d56f448ae3e9e4a74b04e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/326

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -10
    • +10
    /asterix-app/data/pub-small/dblp-small-id-autogenerated-pk_including_uuid.adm
  1. … 19 more files in changeset.
Introducing data replication API to LSM indexes

Change-Id: I80565fc9d74e30440d2df5917911904ba8f33c25

Reviewed-on: https://asterix-gerrit.ics.uci.edu/322

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 25 more files in changeset.
This change includes the following: 1. allowing short-circuit reads to be used with external data. 2. enhancing behaviour of index access for Text data. 3. updating the external data documentation.

Rebased on current Master.

The following commits from your working branch will be included:

commit 3176d741b8ef187703c7346044c9531a99f2b716

Author: Abdullah Alamoudi <bamousaa@gmail.com>

Date: Wed Feb 4 18:32:24 2015 +0300

added changes from external experiments and reflected external data documentation to include external data indexing

Change-Id: I041c71391d8704cd800c4446a085beef197e7acf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/218

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Raman Grover <ramangrover29@gmail.com>

    • -51
    • +164
    /asterix-doc/src/site/markdown/aql/externaldata.md
Add record type and primary key in the response of connector servlet api.

Change-Id: Ieefe79557cfb3786a6b22371a2e64ac4161ff900

Reviewed-on: https://asterix-gerrit.ics.uci.edu/315

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

New feed fixes: Updated the ExternalFunctionProvider to improve handling "setResult"

Change-Id: I7c026e2f3b927bda2628835c15318d6c96f8b043

Reviewed-on: https://asterix-gerrit.ics.uci.edu/321

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reconcile ASF and Gerrit master branches

Both parents of this merge commit are the same content-wise, excepting the commit message.

We have to make this commit to get both repositories back to a common version of master.