memgraph/tests/qa
Matija Santl 1c2f599a93 Add kafka openCypher clauses
Summary:
Added basic functionality for kafka streams. The `CREATE STREAM` clause is a
simplified version from the one mentioned in D1415 so we can start testing
end-to-end sooner.

This diff also includes a bug fix in `lcp.list ` for operators that have no
members.

Reviewers: teon.banek, mtomic, buda

Reviewed By: mtomic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1434
2018-07-06 15:29:28 +02:00
..
tck_engine Add kafka openCypher clauses 2018-07-06 15:29:28 +02:00
.gitignore Make docker installation equivalent to regular install 2017-10-06 13:23:34 +02:00
apollo_runs.yaml Refactor Apollo build projects 2018-03-27 13:47:18 +02:00
continuous_integration POD serialization, rocksdb integration and Gleich's optimization 2018-06-12 13:54:41 +02:00
filter_failing_scenarios .gitignore wasn't updated. 2017-06-20 15:01:11 +02:00
plot_latency Change FILE COPY to configure_file COPYONLY 2017-07-10 16:26:30 +02:00
README.md Change FILE COPY to configure_file COPYONLY 2017-07-10 16:26:30 +02:00
requirements.txt Removed unnecessary dependencies from QA. 2017-08-02 12:06:42 +02:00
run Add initial version of properties on disk 2018-05-10 17:58:38 +02:00

Memgraph quality assurance

In order to test dressipi's queries agains memgraph the following commands have to be executed: 1. ./init [Dxyz] # downloads query implementations + memgraph # (the auth is manually for now) + optionally user can # define arcanist diff which will be applied on the # memgraph source code 2. ./run # compiles and runs database instance, also runs the # test queries

TODO: automate further

TCK Engine

Python script used to run tck tests against memgraph. To run script execute:

1. python3 tck_engine/test_executor.py

Script uses Behave to run Cucumber tests.

The following tck tests have been changed:

1. Tests where example injection did not work. Behave stores the first row
   in Cucumber tables as headings and the example injection is not working in
   headings. To correct this behavior, one row was added to tables where
   injection was used.

2. Tests where the results were not always in the same order. Query does not
   specify the result order, but tests specified it. It led to the test failure.
   To correct tests, tag "the result should be" was changed with a
   tag "the result should be (ignoring element order for lists)".

3. Behave can't escape character '|' and it throws parse error. Query was then
   changed and result was returned with different name.

Comparability.feature tests are failing because integers are compared to strings what is not allowed in openCypher.

TCK Engine problems:

1. Comparing tables with ordering.
     ORDER BY x DESC
     | x | y |    | x | y |
     | 3 | 2 |    | 3 | 1 |
     | 3 | 1 |    | 3 | 2 |
     | 1 | 4 |    | 1 | 4 |

2. Properties side effects
     | +properties | 1 |
     | -properties | 1 |

     Database is returning properties_set, not properties_created and properties_deleted.