tursom/memgraph
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,806 Commits 247 Branches 35 Tags 62 MiB
1875be1e34
Commit Graph

69 Commits

Author SHA1 Message Date
Matej Ferencevic
cf648a8453 Optimize Apollo build process 
Reviewers: buda, teon.banek

Reviewed By: teon.banek

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1394
 2018-05-16 14:52:27 +02:00
Marin Tomic
91e38f6413 Distributed BFS 
Summary: depends on D1387

Reviewers: msantl, teon.banek, buda

Reviewed By: teon.banek

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1341
 2018-05-15 17:38:51 +02:00
Matej Ferencevic
2924746f20 Remove PostgreSQL 
Reviewers: buda, teon.banek

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1326
 2018-03-28 15:38:54 +02:00
Matej Ferencevic
c4a0da6054 Refactor network clients to use a single client implementation 
Summary: All network clients (Bolt & RPC) now use a wrapper.

Reviewers: buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1324
 2018-03-28 10:09:58 +02:00
florijan
0b2d0b0d61 Fix macro bench clients common rethrow 
Summary:
I think the rethrow as it was done in `.../clientes/common.hpp` is not
correct as it could have caught any exception type descending from
`BasicException`, copied it into `optional<BasicException>` and thus
losing exact type and members of the original exception. I think that
the proposed formulation of a rethrow in the `catch` does it properly.
I made a small test for this behavior, see P11.

Reviewers: teon.banek, mferencevic, mislav.bradac

Reviewed By: teon.banek

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1298
 2018-03-16 11:26:04 +01:00
Marin Tomic
2263a423b8 Add deletion, more stats to card fraud and RWLock 
Summary:
^^

this is a sample config to be used:
```
{
    "num_workers": 1,
    "cards_per_worker": 10001,
    "pos_per_worker": 10001,

    "fraud_probability": 0.01,
    "hop_probability": 0.05,

    "cleanup": {
        "check_interval_sec": 10,
        "tx_hi": 150000,
        "tx_lo": 100000
    },

    "analytic": {
        "query_interval_ms": 500,
        "pos_limit": 10
    }
}
```

I also added `RWLock` --- a wrapper around `pthread_rwlock`

Reviewers: mferencevic, mculinovic, florijan, teon.banek

Reviewed By: florijan

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1280
 2018-03-14 16:23:23 +01:00
Marin Tomic
5637703317 add strata v1 scenario 
Reviewers: mculinovic, mferencevic

Reviewed By: mferencevic

Subscribers: pullbot, buda

Differential Revision: https://phabricator.memgraph.io/D1266
 2018-03-06 11:20:39 +01:00
Matej Ferencevic
7e945c6667 Integrate distributed card fraud test with Apollo 
Reviewers: buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1247
 2018-02-28 11:09:18 +01:00
Matej Ferencevic
a826f41444 Temporarily disable parallel macro benchmarks 
Reviewers: buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1248
 2018-02-27 11:05:13 +01:00
Matej Ferencevic
2a68543f3e Change Apollo slave groups 
Reviewers: buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1238
 2018-02-25 23:02:31 +01:00
Marin Tomic
604ebf9d1e Add tx creation scenario 
Summary: ^^

Reviewers: buda, mculinovic

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1225
 2018-02-22 17:43:32 +01:00
Marin Tomic
f1cdae0617 Add teps and pointwise lookup scenarios 
Reviewers: mculinovic

Reviewed By: mculinovic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1211
 2018-02-21 11:44:57 +01:00
Marko Culinovic
61967f2e06 Fix statsd and benchmark client 
Summary:
Stats server wasn't connecting to the right service on statsd.
Also, benchmark client stats now have prefix `client` instead
of machine name to be consistent with memgraphs stats naming
which starts with `master` or `worker`.

Reviewers: mtomic, buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1209
 2018-02-17 17:06:25 +01:00
Marin Tomic
d15464e181 Add some metric types and basic RPC server stats 
Summary:
Get rid of client class

Fix cppcheck errors

Add documentation to metrics.hpp

Add documentation to stats.hpp

Remove stats from global namespace

Fix build failures

Refactor a bit

Refactor stopwatch into a function

Add rpc execution time stats

Fix segmentation fault

Reviewers: mferencevic

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1200
 2018-02-16 08:33:15 +01:00
Marko Budiselic
e2f5bcf96d Stats from card fraud benchmark 
Reviewers: mtomic

Reviewed By: mtomic

Subscribers: mferencevic, pullbot

Differential Revision: https://phabricator.memgraph.io/D1177
 2018-02-07 19:57:25 +01:00
Marin Tomic
5a162213e5 Refactor pokec, add card fraud 
Reviewers: buda, mculinovic, mferencevic

Reviewed By: mculinovic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1143
 2018-02-02 13:45:18 +01:00
Marko Budiselic
142b1f42b1 Add run_pokec script and minimum refactor 
Summary:
  * add run_pokec script because more than one step is required
  * refactor of plot_throughput script
  * move all plot scripts under tools/plot

Reviewers: mferencevic, teon.banek, mislav.bradac

Reviewed By: mferencevic

Subscribers: florijan, pullbot, buda

Differential Revision: https://phabricator.memgraph.io/D1106
 2018-01-23 16:17:09 +01:00
Dominik Gleich
5418dfb19e Rename NetworkEndpoint 
Summary:
Rename redunant port str

Add endpoint << operator

Migrate everything to endpoint

Reviewers: mferencevic, florijan

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1100
 2018-01-15 15:47:37 +01:00
Matej Ferencevic
499ad3ba15 Add initial version of Apollo config files 
Summary:
Improve Apollo config files

Add name to apollo_build

Remove old generate script from build

Add build_release symlink to release build

Rename 'args' to 'arguments'

Add run definition for cppcheck

Host doxygen documentation

Reviewers: teon.banek

Reviewed By: teon.banek

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1095
 2018-01-10 14:46:10 +01:00
Matej Ferencevic
859641cb0c Changed macro benchmark summary format 
Reviewers: buda, mtomic, mislav.bradac

Reviewed By: mislav.bradac

Subscribers: florijan, pullbot

Differential Revision: https://phabricator.memgraph.io/D972
 2017-12-28 16:35:45 +01:00
Mislav Bradac
eb272f0b67 Assert on endpoint failures 
Summary: .

Reviewers: mferencevic, florijan

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D1045
 2017-12-12 14:27:24 +01:00
Dominik Gleich
73c1206e81 Remove extension from Python executables 
Reviewers: mferencevic, buda

Reviewed By: buda

Subscribers: mislav.bradac, pullbot

Differential Revision: https://phabricator.memgraph.io/D988
 2017-11-27 14:39:51 +01:00
Mislav Bradac
15d0e74f97 Integrate pokec with harness 
Reviewers: buda, mferencevic

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D994
 2017-11-24 15:15:45 +01:00
florijan
8bbf1af525 Cleanup durability config, docs, CHANGELOG 
Reviewers: teon.banek, buda, mislav.bradac, dgleich

Reviewed By: teon.banek

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D992
 2017-11-21 10:17:13 +01:00
Dominik Gleich
f16246604f Add recovery speed measurement tool 
Reviewers: mferencevic, buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D985
 2017-11-16 13:29:06 +01:00
Mislav Bradac
6d78873ace Initialize seed in macro benchmark generators 
Reviewers: dgleich, buda, florijan

Reviewed By: dgleich

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D984
 2017-11-15 16:36:43 +01:00
Dominik Gleich
1d5245cb13 Add edge creation and bfs parallel tests 
Reviewers: buda, mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D953
 2017-11-10 16:03:06 +01:00
Matej Ferencevic
0ae88bc06b Added apollo data to harness. 
Reviewers: dgleich, teon.banek, buda

Reviewed By: teon.banek

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D963
 2017-11-07 22:10:27 +01:00
Matej Ferencevic
3fc1ef2770 Reduced database wait times in harness. 
Reviewers: dgleich

Reviewed By: dgleich

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D964
 2017-11-07 10:54:30 +01:00
Dominik Gleich
b3aa6bea17 Disable measurments output. 
Reviewers: mferencevic

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D957
 2017-11-06 09:58:33 +01:00
Dominik Gleich
7ab6da5f6a Update query suite. 
Summary: Add a perf flag.

Reviewers: mferencevic, mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot, mferencevic

Differential Revision: https://phabricator.memgraph.io/D937
 2017-10-30 09:55:23 +01:00
Matej Ferencevic
df4933ea0f Disable hyperthreading on Apollo for macro benchmark tests. 
Reviewers: mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D929
 2017-10-25 11:32:10 +02:00
Matej Ferencevic
cbf8dacc11 Add parallel macro benchmark suite 
Reviewers: mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D922
 2017-10-24 13:53:09 +02:00
Mislav Bradac
03c50bada9 Pass assigned cpus to harness by flags 
Summary:
Since we have different kind of workers in Apollo we should pass
assigned cpus to harness from apollo generate script and not define them
in harness or in benchmarks.

Reviewers: mferencevic

Reviewed By: mferencevic

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D916
 2017-10-19 13:29:45 +02:00
Teon Banek
06b0111ddc Remove unused stuff from CMakeLists 
Summary: In the process, make experimental/distributed compilable.

Reviewers: mislav.bradac, buda, mferencevic

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D906
 2017-10-16 13:45:18 +02:00
Teon Banek
96d9846b25 Remove traces of custom assert 
Reviewers: mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D905
 2017-10-13 09:34:13 +02:00
Teon Banek
4c25123d83 Make docker installation equivalent to regular install 
Summary:
This puts the whole installation and packaging under a single point of
entry. (Docker, DEB, RPM, etc.)

Rename alpha.dockerfile to beta.dockerfile
Use Debian Stretch for docker
Remove building old hardcoded compiler
Rename build_interpreter to build_memgraph
Remove unused config-file

Reviewers: mferencevic, buda

Reviewed By: mferencevic, buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D857
 2017-10-06 13:23:34 +02:00
Mislav Bradac
3140f175fc Implement record lock deadlock breaker 
Reviewers: florijan, buda

Reviewed By: florijan

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D823
 2017-09-27 16:11:05 +02:00
florijan
a9381df09e Edges data structure now supports multiple edge filtering (implicit OR) 
Summary: - modified all utils/algorithm functions to be inline and in the utils namespace

Reviewers: teon.banek

Reviewed By: teon.banek

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D830
 2017-09-26 13:46:18 +02:00
Mislav Bradac
f91aa7b8fe Add medium sized pokec scenario 
Summary: Add window size to plot throughput

Reviewers: florijan

Reviewed By: florijan

Differential Revision: https://phabricator.memgraph.io/D828
 2017-09-25 13:20:08 +02:00
Mislav Bradac
4e4fdd8029 Unwrap exception from optional before throwing 
Reviewers: buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D815
 2017-09-22 15:46:19 +02:00
Mislav Bradac
cf7190ecc6 Refactor long running benchmark 
Reviewers: buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D801
 2017-09-20 10:36:51 +02:00
Mislav Bradac
7e5dddecae Move harness stuff to parent directory 
Reviewers: buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D799
 2017-09-15 14:05:26 +02:00
Mislav Bradac
d640ca3f1a Do preprocess in client 
Reviewers: buda

Reviewed By: buda

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D793
 2017-09-15 13:13:39 +02:00
Matej Ferencevic
84b0d03a5f Added max memory usage to harness 
Reviewers: buda, mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D790
 2017-09-13 22:13:22 +02:00
Mislav Bradac
3790fd252c Change MAX_RETRIES in query_client 
Reviewers: florijan

Reviewed By: florijan

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D785
 2017-09-13 14:19:03 +02:00
florijan
00723d34c3 Harness - match group setup fix 
Summary: I was mistaken in my calculations before and gave it +-3sigma tolerance (0.0027 probability of failure). Now I changed it to +-5sigma, which is good enough for CERN, and should be for us too.

Reviewers: mislav.bradac, mferencevic

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D780
 2017-09-13 10:11:30 +02:00
Mislav Bradac
7e99e93e47 Start work on parallel benchmark 
Summary: First version of our benchmark

Reviewers: florijan, buda

Reviewed By: florijan

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D740
 2017-09-12 16:58:21 +02:00
Matej Ferencevic
541a0dae24 Addded query error message to harness client. 
Reviewers: florijan

Reviewed By: florijan

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D766
 2017-09-08 15:30:58 +02:00
Matej Ferencevic
21782901c1 Added 3 iterations to macro benchmark. 
Reviewers: mislav.bradac

Reviewed By: mislav.bradac

Subscribers: pullbot

Differential Revision: https://phabricator.memgraph.io/D759
 2017-09-08 11:23:25 +02:00