tursom/memgraph
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
3,143 Commits 247 Branches 35 Tags 62 MiB
b33d2c3940
Commit Graph

100 Commits

Author SHA1 Message Date
Matej Ferencevic
859641cb0c Changed macro benchmark summary format 
Reviewers: buda, mtomic, mislav.bradac

Reviewed By: mislav.bradac

Subscribers: florijan, pullbot

Differential Revision: https://phabricator.memgraph.io/D972
 2017-12-28 16:35:45 +01:00
Mislav Bradac
eb272f0b67 Assert on endpoint failures 
Summary: .

Reviewers: mferencevic, florijan

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1045
 2017-12-12 14:27:24 +01:00
Dominik Gleich
73c1206e81 Remove extension from Python executables 
Reviewers: mferencevic, buda

Reviewed By: buda

Subscribers: mislav.bradac, pullbot

Differential Revision: https://phabricator.memgraph.io/D988
 2017-11-27 14:39:51 +01:00
Mislav Bradac
15d0e74f97 Integrate pokec with harness 
Reviewers: buda, mferencevic

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D994
 2017-11-24 15:15:45 +01:00
florijan
8bbf1af525 Cleanup durability config, docs, CHANGELOG 
Reviewers: teon.banek, buda, mislav.bradac, dgleich

Reviewed By: teon.banek

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D992
 2017-11-21 10:17:13 +01:00
Dominik Gleich
f16246604f Add recovery speed measurement tool 
Reviewers: mferencevic, buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D985
 2017-11-16 13:29:06 +01:00
Mislav Bradac
6d78873ace Initialize seed in macro benchmark generators 
Reviewers: dgleich, buda, florijan

Reviewed By: dgleich

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D984
 2017-11-15 16:36:43 +01:00
Dominik Gleich
1d5245cb13 Add edge creation and bfs parallel tests 
Reviewers: buda, mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D953
 2017-11-10 16:03:06 +01:00
Matej Ferencevic
0ae88bc06b Added apollo data to harness. 
Reviewers: dgleich, teon.banek, buda

Reviewed By: teon.banek

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D963
 2017-11-07 22:10:27 +01:00
Matej Ferencevic
3fc1ef2770 Reduced database wait times in harness. 
Reviewers: dgleich

Reviewed By: dgleich

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D964
 2017-11-07 10:54:30 +01:00
Dominik Gleich
b3aa6bea17 Disable measurments output. 
Reviewers: mferencevic

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D957
 2017-11-06 09:58:33 +01:00
Dominik Gleich
7ab6da5f6a Update query suite. 
Summary: Add a perf flag.

Reviewers: mferencevic, mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot, mferencevic

Differential Revision: https://phabricator.memgraph.io/D937
 2017-10-30 09:55:23 +01:00
Matej Ferencevic
df4933ea0f Disable hyperthreading on Apollo for macro benchmark tests. 
Reviewers: mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D929
 2017-10-25 11:32:10 +02:00
Matej Ferencevic
cbf8dacc11 Add parallel macro benchmark suite 
Reviewers: mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D922
 2017-10-24 13:53:09 +02:00
Mislav Bradac
03c50bada9 Pass assigned cpus to harness by flags 
Summary:
Since we have different kind of workers in Apollo we should pass
assigned cpus to harness from apollo generate script and not define them
in harness or in benchmarks.

Reviewers: mferencevic

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D916
 2017-10-19 13:29:45 +02:00
Teon Banek
06b0111ddc Remove unused stuff from CMakeLists 
Summary: In the process, make experimental/distributed compilable.

Reviewers: mislav.bradac, buda, mferencevic

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D906
 2017-10-16 13:45:18 +02:00
Teon Banek
96d9846b25 Remove traces of custom assert 
Reviewers: mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D905
 2017-10-13 09:34:13 +02:00
Teon Banek
4c25123d83 Make docker installation equivalent to regular install 
Summary:
This puts the whole installation and packaging under a single point of
entry. (Docker, DEB, RPM, etc.)

Rename alpha.dockerfile to beta.dockerfile
Use Debian Stretch for docker
Remove building old hardcoded compiler
Rename build_interpreter to build_memgraph
Remove unused config-file

Reviewers: mferencevic, buda

Reviewed By: mferencevic, buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D857
 2017-10-06 13:23:34 +02:00
Mislav Bradac
3140f175fc Implement record lock deadlock breaker 
Reviewers: florijan, buda

Reviewed By: florijan

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D823
 2017-09-27 16:11:05 +02:00
florijan
a9381df09e Edges data structure now supports multiple edge filtering (implicit OR) 
Summary: - modified all utils/algorithm functions to be inline and in the utils namespace

Reviewers: teon.banek

Reviewed By: teon.banek

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D830
 2017-09-26 13:46:18 +02:00
Mislav Bradac
f91aa7b8fe Add medium sized pokec scenario 
Summary: Add window size to plot throughput

Reviewers: florijan

Reviewed By: florijan

Differential Revision: https://phabricator.memgraph.io/D828
 2017-09-25 13:20:08 +02:00
Mislav Bradac
4e4fdd8029 Unwrap exception from optional before throwing 
Reviewers: buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D815
 2017-09-22 15:46:19 +02:00
Mislav Bradac
cf7190ecc6 Refactor long running benchmark 
Reviewers: buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D801
 2017-09-20 10:36:51 +02:00
Mislav Bradac
7e5dddecae Move harness stuff to parent directory 
Reviewers: buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D799
 2017-09-15 14:05:26 +02:00
Mislav Bradac
d640ca3f1a Do preprocess in client 
Reviewers: buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D793
 2017-09-15 13:13:39 +02:00
Matej Ferencevic
84b0d03a5f Added max memory usage to harness 
Reviewers: buda, mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D790
 2017-09-13 22:13:22 +02:00
Mislav Bradac
3790fd252c Change MAX_RETRIES in query_client 
Reviewers: florijan

Reviewed By: florijan

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D785
 2017-09-13 14:19:03 +02:00
florijan
00723d34c3 Harness - match group setup fix 
Summary: I was mistaken in my calculations before and gave it +-3sigma tolerance (0.0027 probability of failure). Now I changed it to +-5sigma, which is good enough for CERN, and should be for us too.

Reviewers: mislav.bradac, mferencevic

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D780
 2017-09-13 10:11:30 +02:00
Mislav Bradac
7e99e93e47 Start work on parallel benchmark 
Summary: First version of our benchmark

Reviewers: florijan, buda

Reviewed By: florijan

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D740
 2017-09-12 16:58:21 +02:00
Matej Ferencevic
541a0dae24 Addded query error message to harness client. 
Reviewers: florijan

Reviewed By: florijan

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D766
 2017-09-08 15:30:58 +02:00
Matej Ferencevic
21782901c1 Added 3 iterations to macro benchmark. 
Reviewers: mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D759
 2017-09-08 11:23:25 +02:00
florijan
be16409da2 Harness MATCH tests refactored 
Summary:
1. Test setup rewritten to take cca 8 seconds. Note that edges are created by using:
`MATCH (a) WITH a MATCH (b) WITH b WHERE rand() < X CREATE (a)-[:ET]->(b)`
Where `X` is a threshold calculated so the desired edge count is the expectation. This seems the only feasable way of generating a large number of edges since query execution does not depend on edge count, but on vertex count.

2. Using the new `assert` function to verify graph state. I recommend doing that in all the harness tests (I don't think we currently have something better).

3. All tests rewritten to take around 200ms per iteration.

4. Test are using SKIP to avoid sending data to the client, but ensure that appropriate operations get executed. This currently seems like the best way of removing unwanted side-effects.

Harness will cost us our sanity. And it doesn't even provide good quality regression testing we really need :(

Reviewers: buda, mislav.bradac, mferencevic

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D752
 2017-09-07 12:05:05 +02:00
Matej Ferencevic
642c2f07bb Added PostgreSQL support to harness client. 
Reviewers: mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D753
 2017-09-06 15:22:25 +02:00
florijan
cd0d8eb543 Harness - dense expand group added, more tests on bench 
Summary: It turns out trivial if I use unwind for vertex creation, MATCH for edge creation and UNWIND for test duration. It took hours to converge to this :(

Reviewers: mislav.bradac, buda

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D747
 2017-09-06 14:58:50 +02:00
Matej Ferencevic
70d9f3f6f1 Refactored harness and added PostgreSQL support. 
Summary:
Moved Neo4j config to config dir.

Neo4j and PostgreSQL are now downloaded to libs.

Renamed metadata flags in memgraph.

Changed apollo generate for new harness.

Reviewers: mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D741
 2017-09-05 09:45:41 +02:00
Mislav Bradac
2111612fc8 Run Neo on ramdisk in harness 
Reviewers: mferencevic

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D734
 2017-09-01 12:04:42 +02:00
Mislav Bradac
bba5d134c0 Refactor harness 
Reviewers: mferencevic

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D732
 2017-08-31 11:23:11 +02:00
Mislav Bradac
e68f7ea536 Use median instead of avg in harness 
Reviewers: mferencevic

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D725
 2017-08-30 15:28:30 +02:00
Mislav Bradac
3e793fb8ac Add single_create group to harness 
Reviewers: mferencevic, buda

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D714
 2017-08-28 11:45:12 +02:00
Mislav Bradac
409c9200e2 Remove unnecessary requirements 
Reviewers: mferencevic, buda

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D717
 2017-08-28 10:19:14 +02:00
Mislav Bradac
7628084ccf Add no-strict option to harness 
Reviewers: mferencevic

Reviewed By: mferencevic

Differential Revision: https://phabricator.memgraph.io/D716
 2017-08-25 15:07:21 +02:00
Matej Ferencevic
0914c5a941 Migrate harness to use our bolt client 
Reviewers: mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D711
 2017-08-25 11:10:15 +02:00
Matej Ferencevic
5a2086b18f Libraries are now downloaded from our local cache server. 
Summary:
Improved libs cleanup script.

The root init script now downloads everything.

Removed obsolete init scripts.

Reviewers: buda, mislav.bradac

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D710
 2017-08-25 09:58:39 +02:00
Matej Ferencevic
9d1265f41f Initial version of macro benchmark summary script. 
Summary:
Changed harness output to be compatible with script.

Changed cppcheck message formatting.

Changed qa message formatting.

Changed macro benchmark summary icons.

Fixed newlines in status generators.

Added group name to harness summary.

Macro benchmark summary now handles different files.

Added more output options to summary script.

Diff builds now build parent for performance comparison.

Reviewers: buda, mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D706
 2017-08-24 15:11:36 +02:00
Mislav Bradac
5e3ff2438e Fix some benchmarks 
Summary: Fix bug in perf wrapper

Reviewers: mferencevic

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D611
 2017-07-30 20:12:25 +02:00
Mislav Bradac
0aa399bd91 Add cpu time to harness 
Reviewers: mferencevic

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D607
 2017-07-30 11:42:17 +02:00
Mislav Bradac
ddbb63a601 More apollo harness integration 
Reviewers: mferencevic

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D603
 2017-07-29 21:58:10 +02:00
Matej Ferencevic
0f562cd043 First version of apollo harness integration. 
Reviewers: mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D602
 2017-07-29 21:14:29 +02:00
Mislav Bradac
d9fbcfc1a2 Don't init perf if on apollo 
Reviewers: mferencevic

Reviewed By: mferencevic

Differential Revision: https://phabricator.memgraph.io/D601
 2017-07-29 19:21:50 +02:00
Mislav Bradac
b98c12ea89 Clean up of benchmark requirements file 
Reviewers: mferencevic

Reviewed By: mferencevic

Differential Revision: https://phabricator.memgraph.io/D600
 2017-07-29 18:26:18 +02:00