Tyler Neely
6dd57426f8
Revert broken code suggestion
2022-11-01 15:51:37 +00:00
Tyler Neely
3c9f0c48e9
Merge branch 'project-pineapples' into tyler_1k_shard_unit_test
2022-11-01 16:31:29 +01:00
Tyler Neely
9a1258a708
Update tests/unit/1k_shards_1k_create_scanall.cpp
...
Co-authored-by: Kostas Kyrimis <kostaskyrim@gmail.com>
2022-11-01 16:31:14 +01:00
Tyler Neely
c55ca836a4
Update tests/unit/1k_shards_1k_create_scanall.cpp
...
Co-authored-by: Kostas Kyrimis <kostaskyrim@gmail.com>
2022-11-01 16:31:06 +01:00
Tyler Neely
5674ef4016
Update tests/unit/1k_shards_1k_create_scanall.cpp
...
Co-authored-by: Kostas Kyrimis <kostaskyrim@gmail.com>
2022-11-01 16:30:37 +01:00
Tyler Neely
77c2afc9e7
Add TODO about ID mapping improvements
2022-11-01 15:27:35 +00:00
Tyler Neely
27292dd921
Merge branch 'project-pineapples' into tyler_remove_shard_map_from_machine_manager
2022-11-01 16:20:54 +01:00
János Benjamin Antal
4608af9d00
Merge branch 'project-pineapples' into MG-improve-parameters
2022-11-01 15:56:16 +01:00
János Benjamin Antal
50e72a7c28
Merge branch 'project-pineapples' into T1138-MG-fix-edge-id-allocator
2022-11-01 15:56:12 +01:00
János Benjamin Antal
17a104677d
Merge pull request #617 from memgraph/T1105-MG-profile-query-in-distributed
2022-11-01 15:55:52 +01:00
Tyler Neely
a6add80fc9
Use static RSM partitioning function for achieving a smooth Shard->ShardWorker distribution
2022-11-01 14:52:38 +00:00
Tyler Neely
5d3eaf6a55
Rename 1k_shards_1k_create_scanall test to high_density_shard_create_scan
2022-11-01 14:02:07 +00:00
Tyler Neely
a13f260236
Parameterize shard worker threads in the MachineConfig and simplify test output
2022-11-01 13:57:57 +00:00
János Benjamin Antal
7b4b1ba8ed
Speed up Parameters::AtTokenPosition
2022-11-01 11:51:35 +01:00
Tyler Neely
bb1e8aa164
Improve histogram output by adding a pretty table printing function
2022-11-01 10:46:25 +00:00
Tyler Neely
27a1311966
Merge branch 'tyler_1k_shard_unit_test' of github.com:memgraph/memgraph into T1122-MG-ShardManager-ThreadPool
2022-11-01 09:49:15 +00:00
János Benjamin Antal
30ff6487f2
Merge remote-tracking branch 'origin/project-pineapples' into T1105-MG-profile-query-in-distributed
2022-11-01 10:32:44 +01:00
Tyler Neely
119da2d7a7
Update CMakeLists.txt
2022-11-01 09:51:43 +01:00
Tyler Neely
fa972813d2
Update src/coordinator/shard_map.cpp
...
Co-authored-by: Jure Bajic <jure.bajic@memgraph.com>
2022-10-31 19:05:19 +01:00
Tyler Neely
951b058116
Complete migration from single-threaded ShardManager to multi-threaded ShardWorker processing
2022-10-31 18:04:30 +00:00
Tyler Neely
d0cad6e6ba
Temporarily duplicate shard management logic from ShardManger in ShardWorker
2022-10-31 17:25:08 +00:00
Tyler Neely
6138277972
Merge branch 'tyler_remove_shard_map_from_machine_manager' of github.com:memgraph/memgraph into T1122-MG-ShardManager-ThreadPool
2022-10-31 17:14:01 +00:00
Tyler Neely
2f77eb96ff
Remove redundant ShardMap copy from MachineManager to avoid race conditions
2022-10-31 16:49:46 +00:00
Tyler Neely
d7bc93c55f
Fill Cron next time promise from each worker thread
2022-10-31 16:17:34 +00:00
Tyler Neely
039d5f51d3
Merge branch 'project-pineapples' into T1122-MG-ShardManager-ThreadPool
2022-10-31 17:06:36 +01:00
Tyler Neely
cebe6f62fa
Implement skeleton worker threadpool for the ShardManager
2022-10-31 16:03:47 +00:00
jbajic
6834ce01fe
Fix edge id allocator
2022-10-31 16:26:56 +01:00
János Benjamin Antal
f9e2a66961
Add const
qualifier to function parameters
2022-10-31 15:53:04 +01:00
János Benjamin Antal
d5700ab5ff
Use [[unlikely]]
attribute
2022-10-31 15:53:04 +01:00
Tyler Neely
b0aaba6765
Merge branch 'project-pineapples' into tyler_1k_shard_unit_test
2022-10-31 15:47:38 +01:00
Kostas Kyrimis
59c7d81ae8
[ 🍍 < T1086-MG] Test distributed operators e2e ( #607 )
...
* Fix Explain queries
* Add Vertex/Edge accessor support for properties
* Fix projections
* Fix expansions to fetch destination vertex properties
* Fix improper use of ShardMap on bolt and replaced it with the ShardRequestManager
* Add NameToId mappers on ShardRequestManager
* Add e2e tests for operators
* Fix OPTIONAL MATCH
2022-10-31 11:52:20 +02:00
János Benjamin Antal
d920d7c293
Merge branch 'project-pineapples' into T1105-MG-profile-query-in-distributed
2022-10-31 09:27:05 +01:00
Tyler Neely
6b0168cb3d
Add LocalTransport::ResponseLatencies
2022-10-28 08:51:12 +00:00
Tyler Neely
03cf264b76
Add test for 1k shards, 1k create vertices, and then a scan all
2022-10-28 08:29:27 +00:00
Tyler Neely
9448e23dc9
Check-in basic shard scheduler skeleton
2022-10-27 13:36:53 +00:00
Tyler Neely
eafccaea84
Add a logarithmically bucketing histogram and record response latencies per message type ( #616 )
2022-10-26 15:57:11 +02:00
János Benjamin Antal
0c4f591b3c
Merge branch 'project-pineapples' into T1105-MG-profile-query-in-distributed
2022-10-26 14:48:27 +02:00
János Benjamin Antal
534e365271
Suppress warning about exception escape for destructor
2022-10-26 11:22:27 +02:00
János Benjamin Antal
281ae158ec
Make ReadTSC
noexcept
2022-10-26 11:21:27 +02:00
János Benjamin Antal
39c9c215b1
Suppress clang-tidy warnings for
2022-10-26 11:14:24 +02:00
János Benjamin Antal
f6e78ce6da
Fix TODOs in storage engine ( #614 )
...
Fixed various TODOs that were easy to fix to improve the code quality of the
newly implemented storage.
2022-10-26 10:40:35 +02:00
János Benjamin Antal
6a31c49432
Flatten nested conditional statements
2022-10-25 20:30:29 +02:00
János Benjamin Antal
fea92f4829
Merge remote-tracking branch 'origin/project-pineapples' into T1105-MG-profile-query-in-distributed
2022-10-25 20:28:54 +02:00
János Benjamin Antal
1703cd039d
Populate custom data of profile query with request wait times
2022-10-25 20:15:06 +02:00
gvolfing
ca2351124b
Make primary labels act as label indices ( #605 )
...
Because of the lexicographical sharding, the primary labels themselves are
acting as indexes. If a primary label is specified in a MATCH query we can
safely narrow the range of shards we have to scan through based on that label.
This PR introduces the necessary changes in order to achieve that.
2022-10-25 19:48:17 +02:00
János Benjamin Antal
5784c0d473
Return the custom data for profile queries
2022-10-25 15:26:42 +02:00
János Benjamin Antal
8ebc704819
Fix profile queries with ScanAll
2022-10-25 14:37:18 +02:00
János Benjamin Antal
5939fb2b0c
Start transaction properly
2022-10-25 14:35:26 +02:00
János Benjamin Antal
ee64684b0b
Add ScopedCustomProfile
2022-10-25 13:37:57 +02:00
János Benjamin Antal
1e4c02f8a5
Make profile query work
2022-10-25 13:37:27 +02:00