History

florijan 21550d3bb1 LDBC queries checked Summary: - checked existing queries and added new ones - minor changes to LDBC setup Reviewers: teon.banek, buda Reviewed By: buda Subscribers: pullbot Differential Revision: https://phabricator.memgraph.io/D737		2017-09-02 10:36:02 +02:00
..
memgraph_snapshots	LDBC	2017-08-28 09:34:22 +02:00
neo4j_config	LDBC	2017-08-28 09:34:22 +02:00
neo4j_home	LDBC	2017-08-28 09:34:22 +02:00
test_cases	LDBC queries checked	2017-09-02 10:36:02 +02:00
.gitignore	ldbc: Extract update queries	2017-09-01 14:13:04 +02:00
index_creation.py	LDBC queries checked	2017-09-02 10:36:02 +02:00
ldbc-snb-impls-allshorts.properties	LDBC	2017-08-28 09:34:22 +02:00
ldbc-snb-impls-infbug.properties	LDBC	2017-08-28 09:34:22 +02:00
ldbc-snb-impls-pom.xml	LDBC	2017-08-28 09:34:22 +02:00
mg	LDBC	2017-08-28 09:34:22 +02:00
neo	LDBC	2017-08-28 09:34:22 +02:00
README.md	Cleanup some errors in ldbc setup scripts	2017-09-01 14:13:34 +02:00
requirements_2.txt	LDBC	2017-08-28 09:34:22 +02:00
requirements_3.txt	LDBC	2017-08-28 09:34:22 +02:00
run_benchmark	LDBC	2017-08-28 09:34:22 +02:00
setup_dataset	Cleanup some errors in ldbc setup scripts	2017-09-01 14:13:34 +02:00
setup_dependencies	Cleanup some errors in ldbc setup scripts	2017-09-01 14:13:34 +02:00
setup_system	Cleanup some errors in ldbc setup scripts	2017-09-01 14:13:34 +02:00

README.md

LDBC benchmarks

How to run the benchmark against Neo4j OR Memgraph?

cd memgraph/tests/public_benchmark/ldbc
./setup_system
./setup_dependencies
./setup_dataset [--scale-factor 1]
./neo [--run] OR ./mg [--run]
./run_benchmark

How to run a specific test?

cd memgraph/tests/public_benchmark/ldbc/ldbc-snb-impls/snb-interactive-neo4j
mvn exec:java -Dexec.mainClass="net.ellitron.ldbcsnbimpls.interactive.neo4j.util.QueryTester" -Dexec.args="shortquery1 933 --repeat=10000 --timeUnits=MICROSECONDS"

Useful terminal commands

How to find out Default Query Limits?

cd memgraph/tests/public_benchmark/ldbc/ldbc_driver
ag "DEFAULT_LIMIT"

How to run test cases?

cd memgraph/tests/public_benchmark/ldbc
neo4j-client --insecure -u "" -p "" -o test_cases/results/short_query_2.oc.out -i test_cases/queries/short_query_2.oc localhost 7687

How to create indexes manually?

cd memgraph/tests/public_benchmark/ldbc
source ve3/bin/activate
./index_creation.py ldbc-snb-impls/snb-interactive-neo4j/scripts/indexCreation.neo4j

Where is and how to use LDBC plotting?

cd memgraph/tests/public_benchmark/ldbc
source ve2/bin/activate
cd memgraph/tests/public_benchmark/ldbc/ldbc_driver/plotting
python make_charts_all_queries_all_metrics.py /path/to/ldbc_driver/results/LDBC-results.json legend_location

TODOs

Run & validate all Short queries + optimize MemGraph performance.
Write the log parser.
Visualize the results.
Run & validate all Update queries + optimize MemGraph performance.
Run apacaci code an compare the results (Do We Need Specialized Graph Database?).
Optimize MemGraph performance.
Scale benchmarks (scale factors 1, 3, 10).
Test against Postgres and make comparison between Neo, Memgraph & Postgres. Latency + Throughput.
Run & validate all queries + optimize MemGraph performance.
Optimize MemGraph spinup time.