memgraph/experimental/distributed
Goran Zuzic a6b8d6b4cf Make Distributed Memgraph Stub
Summary:
* main file (copied distributed_test.cpp), start_main.py, config

Made a dedicated client and memgraph file (stubs) + code structure changes

Reviewers: sasa.stanko

Reviewed By: sasa.stanko

Subscribers: pullbot, lion, buda

Differential Revision: https://phabricator.memgraph.io/D709
2017-08-24 16:58:35 +02:00
..
src Make Distributed Memgraph Stub 2017-08-24 16:58:35 +02:00
tests Make Distributed Memgraph Stub 2017-08-24 16:58:35 +02:00
.clang-format Merged experimental repo. 2017-08-03 12:48:19 +02:00
.gitignore Merged experimental repo. 2017-08-03 12:48:19 +02:00
CMakeLists.txt Make Distributed Memgraph Stub 2017-08-24 16:58:35 +02:00
config Make Distributed Memgraph Stub 2017-08-24 16:58:35 +02:00
init Merged experimental repo. 2017-08-03 12:48:19 +02:00
main-client.cpp Make Distributed Memgraph Stub 2017-08-24 16:58:35 +02:00
main.cpp Make Distributed Memgraph Stub 2017-08-24 16:58:35 +02:00
README.md Distributed tests 2017-08-24 10:33:48 +02:00
start_main.py Make Distributed Memgraph Stub 2017-08-24 16:58:35 +02:00

distributed memgraph

This subdirectory structure implements distributed infrastructure of Memgraph.

Terminology

  • Memgraph Node Id (mnid): a machine (processs) that runs a (distributed) Memgraph program.
  • Node: a computer that performs (distributed) work.
  • Vertex: an abstract graph concept.
  • Reactor: a unit of concurrent execution, lives on its own thread.
  • Channel: a (one-way) communication abstraction between Reactors. The reactors can be on the same machine or on different processes.
  • Message: gets sent through channels. Must be serializable if sent via network layer (library: cereal).
  • Event: arrival of a (subclass of) Message. You can register callbacks. Register exact callbacks (not for derivated/subclasses).
  • EventStream: read-end of a channel, is owned by exactly one Reactor/thread.
  • ChannelWriter: write-end of a channel, can be owned (wrote into) by multiple threads.

Ownership:

  • System, Distributed are singletons. They should be always alive.
  • ChannelWriter (write-end) should be lightweight and can be copied arbitrarily.
  • EventStream (read-end) should never be written by anyone except the owner (the reactor that created it).

Code Conventions

  • Locked: A method having a Locked... prefix indicates that you have to lock the appropriate mutex before calling this function.
  • ALWAYS close channels. You will memory leak if you don't. Reactor::CloseChannel or Subscription::Close will do the trick.

Dependencies

  • cereal