ea615a13b4
Summary: tck engine first implementation Reviewers: dgleich, teon.banek, buda, mferencevic Reviewed By: buda, mferencevic Subscribers: buda Differential Revision: https://phabricator.memgraph.io/D95
36 lines
1.4 KiB
Markdown
36 lines
1.4 KiB
Markdown
# Memgraph quality assurance
|
|
|
|
In order to test dressipi's queries agains memgraph the following commands have
|
|
to be executed:
|
|
1. ./init [Dxyz] # downloads query implementations + memgraph
|
|
# (the auth is manually for now) + optionally user can
|
|
# define arcanist diff which will be applied on the
|
|
# memgraph source code
|
|
2. ./run # compiles and runs database instance, also runs the
|
|
# test queries
|
|
|
|
TODO: automate further
|
|
|
|
## TCK Engine
|
|
|
|
Python script used to run tck tests against memgraph. To run script execute:
|
|
|
|
1. python3 tck_engine/test_executor.py
|
|
|
|
Script uses Behave to run Cucumber tests.
|
|
|
|
The following tck tests have been changed:
|
|
|
|
1. Tests where example injection did not work. Behave stores the first row
|
|
in Cucumber tables as headings and the example injection is not working in
|
|
headings. To correct this behavior, one row was added to tables where
|
|
injection was used.
|
|
|
|
2. Tests where the results were not always in the same order. Query does not
|
|
specify the result order, but tests specified it. It led to the test failure.
|
|
To correct tests, tag "the result should be" was changed with a
|
|
tag "the result should be (ignoring element order for lists)".
|
|
|
|
Comparability.feature tests are failing because integers are compared to strings
|
|
what is not allowed in openCypher.
|