Clone Tools
  • last updated 11 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
ASTERIXDB-1233: Fixed the bulk-loading with an inverted index on an open-type field

Change-Id: If58f594c0a7b6f4bca45b13ceaef07b605d2fe22

Reviewed-on: https://asterix-gerrit.ics.uci.edu/740

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

    • -0
    • +1
    ./load-with-index-open_02/load-with-index-open_02.1.adm
  1. … 5 more files in changeset.
Enabled Datasets to use Datatypes from foreign Dataverses

Removed broken Metadata Secondary Indexes

Added DatatypeDataverse field to Dataset

Cleaned up Metadata Tests

Added tests for dropping used Datatypes

User-facing changes are:

1) Allow qualified datatype when creating dataset

2) Metadata queries for datasets will now

include the type dataverse

Change-Id: I24dbc04dcb2a4126fc8361ebe3104877a0d1f2bb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/558

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -3
    • +0
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.adm
  1. … 139 more files in changeset.
Improve the Testing Framework

This change includes the following improvements to the test framework

1. Checking each expected failure against the failure exception.

2. Checking against multiple causes of failure in case of multiple

expected errors.

3. Check if a test that is expected to fail pass.

4. Make temp datasets use different storage path.

Change-Id: I957ecf19bf7209981e010e0e50fb882442a525dd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/537

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -1
    • +0
    ./insert-with-autogenerated-pk_adm_02/insert-with-autogenerated-pk_adm_02.1.adm
    • -1
    • +0
    ./load-with-autogenerated-pk_adm_02/load-with-autogenerated-pk_adm_02.1.adm
    • -1
    • +0
    ./load-with-autogenerated-pk_adm_03/load-with-autogenerated-pk_adm_02.1.adm
  1. … 26 more files in changeset.
ASTERIXDB-1145: verify the Hyracks fix doesn't break a duplicate key insert test case.

Change-Id: I8f770320423d76ba0429213b3376033c4b141fe2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/492

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +0
    ./insert-duplicated-keys-from-query/insert-duplicated-keys-from-query.1.adm
  1. … 4 more files in changeset.
ASTERIXDB-1148: Selectable array-wrapping of results

Introduce "wrapper-array" parameter to HTTP API which selects (for ADM and

JSON) whether to wrap the result sequence in a generated outer array. For

JSON this defaults to "true" as before. For ADM this defaults to false,

resulting in a large number of expected-results changes.

Also introduce ability to have AQL tests which provide HTTP parameters.

Change-Id: I3122f136ff9ca8a2c2268238c57bb5eddab7b27e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/473

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -168
    • +167
    ./compact-dataset-and-its-indexes/compact-dataset-and-its-indexes.1.adm
    • -2
    • +1
    ./create-drop-cltype/create-drop-cltype.1.adm
    • -2
    • +1
    ./create-drop-opntype/create-drop-opntype.1.adm
    • -168
    • +167
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.1.adm
    • -26
    • +25
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.1.adm
    • -151
    • +150
    ./delete-multi-statement/delete-multi-statement.1.adm
    • -26
    • +25
    ./delete-syntax-change/delete-syntax-change.1.adm
    • -4
    • +3
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.adm
    • -2
    • +1
    ./empty-load-with-index/empty-load-with-index.1.adm
    • -241
    • +240
    ./insert-and-scan-dataset-with-index/insert-and-scan-dataset-with-index.1.adm
    • -21
    • +20
    ./insert-and-scan-dataset/insert-and-scan-dataset.1.adm
    • -16
    • +15
    ./insert-and-scan-joined-datasets/insert-and-scan-joined-datasets.1.adm
    • -3
    • +2
    ./insert-into-empty-dataset-with-index/insert-into-empty-dataset-with-index.1.adm
  1. … 1426 more files in changeset.
Changed metadata storage format for nullable field types. Moved field name generation to the client out of metadata node code. Changed naming scheme for autogenerated types. Moved GroupName, CompactionPolicy & CompactionPolicyProperties fields up from External\InternalDetails to Dataset record type definition

Change-Id: I223aded8aaf80f0688358899c0e8b0d6988fac93

Reviewed-on: https://asterix-gerrit.ics.uci.edu/323

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -1
    • +1
    ./create-drop-cltype/create-drop-cltype.1.adm
    • -1
    • +1
    ./create-drop-opntype/create-drop-opntype.1.adm
    • -3
    • +3
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.adm
  1. … 204 more files in changeset.
Fix really bad typo in POM

- One change to a UUID result which doesn't correspond to its query

- Disable the one introspection test case that fails temporarily

Change-Id: I4e62a505754967c590f195bd997aba44ddb5a535

Reviewed-on: https://asterix-gerrit.ics.uci.edu/340

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -1
    • +1
    ./insert-with-autogenerated-pk_adm_03/insert-with-autogenerated-pk_adm_03.1.adm
  1. … 2 more files in changeset.
Added the UUID constructor and changed the relevant documentation

Change-Id: I2276bf2b44975b13c99d56f448ae3e9e4a74b04e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/326

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -0
    • +2
    ./insert-with-autogenerated-pk_adm_01/insert-with-autogenerated-pk_adm_01.1.adm
    • -0
    • +2
    ./insert-with-autogenerated-pk_adm_02/insert-with-autogenerated-pk_adm_02.1.adm
    • -0
    • +2
    ./insert-with-autogenerated-pk_adm_03/insert-with-autogenerated-pk_adm_03.1.adm
    • -0
    • +2
    ./load-with-autogenerated-pk_adm_03/load-with-autogenerated-pk_adm_02.1.adm
    • -0
    • +2
    ./load-with-autogenerated-pk_adm_04/load-with-autogenerated-pk_adm_04.1.adm
  1. … 29 more files in changeset.
fix multi-delete statement issue

Change-Id: I32c55e225fb8cc3f164da7029b4c31c26c6e574d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/271

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +151
    ./delete-multi-statement/delete-multi-statement.1.adm
  1. … 5 more files in changeset.
Added support of typed indexes over open fields & indexes over nested fields

Open indexes requires user to provide a type along with a indexed field name.

This type would be enforced for all the indexed records, i.e. index cannot be created if in some records a field with provided name has a different type.

Index-specific rewrite rules match provided type with the inferred types of other arguments in join\select statements and trigger index rewrite.

Nested indexes use the same semantics as the regular indexes, with exception that field could be located arbitrarily deep inside nested structure

Change-Id: I53d00aba243ccf7cf79cf7d775dd305813d24f98

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/97

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

    • -4
    • +4
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.adm
    • -0
    • +120
    ./insert-and-scan-dataset-with-index-on-open-field/insert-and-scan-dataset-with-index-on-open-field.1.adm
    • -0
    • +42
    ./load-with-index-open/load-with-index-open.1.adm
    • -0
    • +4
    ./load-with-ngram-index-open/load-with-ngram-index-open.1.adm
    • -0
    • +4
    ./load-with-rtree-index-open/load-with-rtree-index-open.1.adm
    • -0
    • +2
    ./load-with-word-index-open/load-with-word-index-open.1.adm
    • -0
    • +15
    ./scan-delete-btree-secondary-index-open/scan-delete-btree-secondary-index-open.1.adm
    • -0
    • +2
    ./scan-delete-inverted-index-ngram-secondary-index-open/scan-delete-inverted-index-ngram-secondary-index-open.1.adm
    • -0
    • +1
    ./scan-delete-inverted-index-word-secondary-index-open/scan-delete-inverted-index-word-secondary-index-open.1.adm
    • -0
    • +2
    ./scan-delete-rtree-secondary-index-open/scan-delete-rtree-secondary-index-open.1.adm
    • -0
    • +15
    ./scan-insert-btree-secondary-index-open/scan-insert-btree-secondary-index-open.1.adm
    • -0
    • +4
    ./scan-insert-inverted-index-ngram-secondary-index-open/scan-insert-inverted-index-ngram-secondary-index-open.1.adm
    • -0
    • +2
    ./scan-insert-inverted-index-word-secondary-index-open/scan-insert-inverted-index-word-secondary-index-open.1.adm
    • -0
    • +4
    ./scan-insert-rtree-secondary-index-open/scan-insert-rtree-secondary-index.1.adm
  1. … 1778 more files in changeset.
- Fixed Type Casting issue - Reorganized duplicated internal class in the DelimitedDataParser and DelimitedDataParserFactory - Prevented a user from creating an inverted index on a dataset with a variable-length PK - INT64 is now the default type - Issue 852 fixed

Change-Id: I2d71e8a21da4f709c3259a3d3f678c640f9e1160

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/192

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 847 more files in changeset.
Initial support for true ADM output (content type application/x-adm).

Elimiate the JSON "results" wrapper from API calls. Rename

DisplayFormat -> OutputFormat, TEXT -> ADM. Cleaned up some output and

added some useful comments. Fixed a few latent bugs in testdriver string

comparison routines. Refactored HTTP error handling in TestsUtils. Had

to update many expected test results.

Change-Id: I2d7ead038512455b2ab7844021cb62222400447b

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/137

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

    • -167
    • +168
    ./compact-dataset-and-its-indexes/compact-dataset-and-its-indexes.1.adm
    • -1
    • +2
    ./create-drop-cltype/create-drop-cltype.1.adm
    • -1
    • +2
    ./create-drop-opntype/create-drop-opntype.1.adm
    • -167
    • +168
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.1.adm
    • -25
    • +26
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.1.adm
    • -26
    • +26
    ./delete-syntax-change/delete-syntax-change.1.adm
    • -3
    • +4
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.adm
    • -1
    • +2
    ./empty-load-with-index/empty-load-with-index.1.adm
    • -240
    • +241
    ./insert-and-scan-dataset-with-index/insert-and-scan-dataset-with-index.1.adm
    • -20
    • +21
    ./insert-and-scan-dataset/insert-and-scan-dataset.1.adm
    • -15
    • +16
    ./insert-and-scan-joined-datasets/insert-and-scan-joined-datasets.1.adm
    • -2
    • +3
    ./insert-into-empty-dataset-with-index/insert-into-empty-dataset-with-index.1.adm
    • -2
    • +3
    ./insert-into-empty-dataset/insert-into-empty-dataset.1.adm
  1. … 1076 more files in changeset.
Implement TokenizeOperator in addition to the changes made by Zachary Heilbron. Now, the compiler builds the bulk-load plan. For other details, please refer to the corresponding Hyracks changes.

Change-Id: I646539d88ea2bdc6da4fbf2b6e9460a6189125ff

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/79

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

    • -0
    • +1
    ./load-with-autogenerated-pk_adm_01/load-with-autogenerated-pk_adm_01.1.adm
    • -0
    • +1
    ./load-with-autogenerated-pk_adm_02/load-with-autogenerated-pk_adm_02.1.adm
    • -0
    • +1
    ./load-with-autogenerated-pk_csv_01/load-with-autogenerated-pk_csv_01.1.adm
    • -0
    • +1
    ./load-with-autogenerated-pk_csv_02/load-with-autogenerated-pk_csv_02.1.adm
    • -0
    • +1
    ./load-with-autogenerated-pk_txt_01/load-with-autogenerated-pk_txt_01.1.adm
  1. … 112 more files in changeset.
Added a new merge policy, called correlated-prefix.

Change-Id: I8f961eb28b4ea460f6326c8b4acaea02b50819e9

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/108

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +167
    ./using-correlated-prefix-merge-policy/using-correlated-prefix-merge-policy.1.adm
    • -0
    • +167
    ./using-no-merge-policy/using-no-merge-policy.1.adm
  1. … 28 more files in changeset.
added test cases for comparator issues

    • -0
    • +3
    ./load-with-ngram-index/load-with-ngram-index.1.adm
    • -0
    • +3
    ./load-with-rtree-index/load-with-rtree-index.1.adm
    • -0
    • +1
    ./load-with-word-index/load-with-word-index.1.adm
  1. … 14 more files in changeset.
Allowed user to specify the merging policy

    • -0
    • +167
    ./using-constant-merge-policy/using-constant-merge-policy.1.adm
    • -0
    • +167
    ./using-prefix-merge-policy/using-prefix-merge-policy.1.adm
  1. … 58 more files in changeset.
Support for full compaction command.

    • -0
    • +167
    ./compact-dataset-and-its-indexes/compact-dataset-and-its-indexes.1.adm
  1. … 32 more files in changeset.
added materialization step before an insert and a scan/join of the same dataset.

    • -0
    • +240
    ./insert-and-scan-dataset-with-index/insert-and-scan-dataset-with-index.1.adm
    • -0
    • +20
    ./insert-and-scan-dataset/insert-and-scan-dataset.1.adm
    • -0
    • +15
    ./insert-and-scan-joined-datasets/insert-and-scan-joined-datasets.1.adm
  1. … 20 more files in changeset.
added fixes for issue 461 to support long count

  1. … 38 more files in changeset.
fix issue382

    • -0
    • +1
    ./query-issue382/query-issue382.1.adm
  1. … 5 more files in changeset.
fix issue433

    • -0
    • +2
    ./query-issue433/query-issue433.1.adm
  1. … 6 more files in changeset.
a fix for static type casting -- checks the funcExpr is record constructor or not.

    • -0
    • +2
    ./insert-record-function/insert-record-function.1.adm
  1. … 8 more files in changeset.
Merged asterix_lsm_stabilization upto r1547

git-svn-id: https://asterixdb.googlecode.com/svn/trunk/asterix@1622 eaa15691-b419-025a-1212-ee371bd00084

    • -0
    • +1
    ./create-drop-cltype/create-drop-cltype.1.adm
    • -0
    • +1
    ./create-drop-opntype/create-drop-opntype.1.adm
    • -0
    • +167
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.1.adm
    • -0
    • +25
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.1.adm
    • -0
    • +26
    ./delete-syntax-change/delete-syntax-change.1.adm
    • -0
    • +3
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.adm
    • -0
    • +1
    ./empty-load-with-index/empty-load-with-index.1.adm
    • -0
    • +2
    ./insert-into-empty-dataset-with-index/insert-into-empty-dataset-with-index.1.adm
    • -0
    • +2
    ./insert-into-empty-dataset/insert-into-empty-dataset.1.adm
    • -0
    • +1
    ./insert-into-loaded-dataset-with-index_01/insert-into-loaded-dataset-with-index_01.1.adm
    • -0
    • +9
    ./insert-into-loaded-dataset-with-index_02/insert-into-loaded-dataset-with-index_02.1.adm
  1. … 6206 more files in changeset.
Fixed the results of three failing test cases.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_api_cleanup@1503 eaa15691-b419-025a-1212-ee371bd00084

    • -0
    • +1
    ./scan-insert-rtree-secondary-index/scan-insert-rtree-secondary-index.1.adm
  1. … 2 more files in changeset.
merge back the fixes for issue285 and issue288: r1477:1478 and r1481:1482 from asterix_issue285

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_lsm_stabilization@1483 eaa15691-b419-025a-1212-ee371bd00084

    • -0
    • +1
    ./query-issue288/query-issue288.1.adm
  1. … 16 more files in changeset.
Enabled inverted index insert and delete operations. Added Tests cases for all the 4 index types.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_lsm_stabilization@1440 eaa15691-b419-025a-1212-ee371bd00084

    • -0
    • +1
    ./scan-delete-inverted-index-fuzzy-ngram-secondary-index-nullable/scan-delete-inverted-index-fuzzy-ngram-secondary-index-nullable.1.adm
    • -0
    • +1
    ./scan-delete-inverted-index-fuzzy-ngram-secondary-index/scan-delete-inverted-index-fuzzy-ngram-secondary-index.1.adm
    • -0
    • +0
    ./scan-delete-inverted-index-fuzzy-word-secondary-index-nullable/scan-delete-inverted-index-fuzzy-word-secondary-index-nullable.1.adm
    • -0
    • +0
    ./scan-delete-inverted-index-fuzzy-word-secondary-index/scan-delete-inverted-index-fuzzy-word-secondary-index.1.adm
    • -0
    • +1
    ./scan-delete-inverted-index-ngram-secondary-index-nullable/scan-delete-inverted-index-ngram-secondary-index-nullable.1.adm
    • -0
    • +1
    ./scan-delete-inverted-index-ngram-secondary-index/scan-delete-inverted-index-ngram-secondary-index.1.adm
    • -0
    • +0
    ./scan-delete-inverted-index-word-secondary-index-nullable/scan-delete-inverted-index-word-secondary-index-nullable.1.adm
    • -0
    • +0
    ./scan-delete-inverted-index-word-secondary-index/scan-delete-inverted-index-word-secondary-index.1.adm
    • -0
    • +3
    ./scan-insert-inverted-index-fuzzy-ngram-secondary-index-nullable/scan-insert-inverted-index-fuzzy-ngram-secondary-index-nullable.1.adm
    • -0
    • +3
    ./scan-insert-inverted-index-fuzzy-ngram-secondary-index/scan-insert-inverted-index-fuzzy-ngram-secondary-index.1.adm
    • -0
    • +1
    ./scan-insert-inverted-index-fuzzy-word-secondary-index-nullable/scan-insert-inverted-index-fuzzy-word-secondary-index-nullable.1.adm
    • -0
    • +1
    ./scan-insert-inverted-index-fuzzy-word-secondary-index/scan-insert-inverted-index-fuzzy-word-secondary-index.1.adm
    • -0
    • +3
    ./scan-insert-inverted-index-ngram-secondary-index-nullable/scan-insert-inverted-index-ngram-secondary-index-nullable.1.adm
    • -0
    • +3
    ./scan-insert-inverted-index-ngram-secondary-index/scan-insert-inverted-index-ngram-secondary-index.1.adm
    • -0
    • +1
    ./scan-insert-inverted-index-word-secondary-index-nullable/scan-insert-inverted-index-word-secondary-index-nullable.1.adm
  1. … 87 more files in changeset.
removed some left over result files

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_lsm_stabilization@1397 eaa15691-b419-025a-1212-ee371bd00084

    • -3
    • +0
    ./scan-insert-rtree-secondary-index.adm
  1. … 30 more files in changeset.
Merge asterix_stabilization into asterix_stabilization_result_distribution.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1358 eaa15691-b419-025a-1212-ee371bd00084

  1. … 106 more files in changeset.
Checkpoint #2 for fixing runtimets.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1352 eaa15691-b419-025a-1212-ee371bd00084

    • -0
    • +26
    ./delete-syntax-change/delete-syntax-change.1.adm
    • -0
    • +4
    ./insert-syntax/insert-syntax.1.adm
  1. … 252 more files in changeset.
Fixed issue 269. Any touch between two spatial objects are considered an intersection.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_lsm_stabilization@1331 eaa15691-b419-025a-1212-ee371bd00084

    • -0
    • +1
    ./scan-insert-rtree-secondary-index.adm
  1. … 18 more files in changeset.