Andi
7f5a55f1b2
Fix restarts when using init-file flag ( #1465 )
2023-11-24 13:11:47 +01:00
gvolfing
08acde3973
Merge branch 'master' into Implement-constant-time-label-and-edge-type-retrieval
2023-11-24 12:24:20 +01:00
andrejtonev
8b9e1fa08b
Replication refactor part 6 ( #1484 )
...
Single (instance level) connection to a replica (messages from all databases get multiplexed through it)
ReplicationClient split in two: ReplicationClient and ReplicationStorageClient
New ReplicationClient, moved under replication, handles the raw connection, owned by MainRoleData
ReplicationStorageClient handles the storage <-> replica state machine and holds to a stream
Removed epoch and storage from *Clients
rpc::Stream proactively aborts on error and sets itself to a defunct state
Removed HandleRpcFailure, instead we simply log the error and let the FrequentCheck handle re-connection
replica_state is now a synced variable
ReplicaStorageClient state machine bugfixes
Single FrequentCheck that goes through DBMS
Moved ReplicationState under DbmsHandler
Moved some replication startup logic under the DbmsHandler's constructor
Removed InMemoryReplicationClient
CreateReplicationClient has been removed from Storage
Simplified GetRecoverySteps and made safer
---------
Co-authored-by: Gareth Lloyd <gareth.lloyd@memgraph.io>
2023-11-23 11:02:35 +01:00
Gareth Andrew Lloyd
e4f94c15c6
Fixes for clang-tidy / sonar issues ( #1536 )
2023-11-22 13:05:02 +00:00
Andi
1d90b60f56
Add schema.assert ( #1485 )
2023-11-21 09:19:50 +01:00
Andi
d03fafcef6
Aggregations return empty result when used with group by ( #1531 )
2023-11-20 11:52:17 +01:00
imilinovic
6053a91ef8
Fix flaky GC test ( #1521 )
2023-11-17 17:06:46 -05:00
Antonio Filipovic
645568a75b
Remove default memory limit on procedures ( #1506 )
...
* remove default limit on procedures
* fix bug on GraphQL also
2023-11-16 15:01:44 +01:00
Antonio Filipovic
d3f4c35362
Add OOM enabler for MG procedure ( #1401 )
2023-11-15 12:42:04 +01:00
imilinovic
ced08fd7bc
Fix GC by adding periodic jemalloc purge ( #1471 )
2023-11-14 15:06:21 -05:00
gvolfing
a370b09d12
Merge branch 'master' into Implement-constant-time-label-and-edge-type-retrieval
2023-11-14 13:13:16 +01:00
gvolfing
1527bdf435
Make metadata collection setable with flag
...
There might be a performance impect of updating the metadata store on
bulk operations. Hence this flag which is disabling the collection by
default. If the queries to obtain the information are called with this
flag disabled, the database will throw an exception.
2023-11-14 13:10:08 +01:00
Andi
e5b2c19ea2
Empty Collect() returns nothing ( #1482 )
2023-11-13 11:45:09 +01:00
Josipmrden
e907817854
Fix for in list segmentation fault ( #1494 )
2023-11-13 05:17:10 +01:00
Josipmrden
0756cd6898
Add fix indexed join crash ( #1478 )
2023-11-12 22:12:25 -05:00
Josipmrden
3c413a7e50
Fix hash join expression matching ( #1496 )
2023-11-12 14:45:02 -05:00
DavIvek
c8fe9ee7d9
Fix accessing a variable bound to a list within BFS function ( #1380 )
2023-11-07 20:34:50 +01:00
Ante Javor
e4afddf518
Fix compare results in mgbench ( #1319 )
2023-11-07 17:04:37 +01:00
Antonio Filipovic
4d5ea03dfa
Use extent hooks for memory procedure limit ( #1443 )
2023-11-07 16:04:29 +01:00
DavIvek
ece4b0dba8
Fix cached plan not getting invalidated ( #1348 )
2023-11-07 13:34:03 +01:00
Andi
66487a6dce
Durability improvements ( #1385 )
2023-11-07 11:37:54 +01:00
Andi
f4b97fc03d
Fix missing statistics for SetPropertiesCursor ( #1460 )
2023-11-07 09:11:20 +01:00
Antonio Filipovic
1ab7f6ac78
Add notification for user on max map count ( #1408 )
2023-11-06 15:44:26 +01:00
andrejtonev
dbc6054689
Replication refactor (part 5) ( #1378 )
2023-11-06 11:50:49 +00:00
Aidar Samerkhanov
16b8c7b27c
Fix Kafka flaky unit test ( #1409 )
2023-11-05 20:51:56 +01:00
Antonio Filipovic
48631d1e37
Rename memory usage and memory allocated ( #1426 )
2023-11-03 14:40:45 +01:00
Andi
3e9f25b8e4
Support creating date and localtime from localdatetime ( #1381 )
2023-11-03 10:54:01 +01:00
Andi
c94201621a
Support deleting paths ( #1383 )
2023-11-02 14:07:48 +01:00
Andi
fdbc390d53
Throw when reduce inside exists ( #1392 )
2023-11-02 12:18:15 +01:00
Andi
4aacd45640
Throw when exists() combined with CASE ( #1382 )
2023-11-02 08:25:34 +01:00
Gareth Andrew Lloyd
157b36162b
Speedup socket unit test ( #1444 )
...
Was testing a setup that wasn't used in production, it would
unnecessarily thrash small buffers.
2023-11-01 17:24:24 +00:00
Josipmrden
5b9802bd7b
Extend property cache to the expression evaluator ( #1432 )
...
* Add support for property cache in the produce
* Fix the previous implementation in the map literal
2023-10-28 20:32:58 -07:00
Ante Pušić
b1c3168308
Fix PROFILE infinite loop ( #1431 )
2023-10-28 15:34:52 +02:00
gvolfing
c296dc67ce
Add index count to index info ( #1229 )
2023-10-27 18:13:05 +02:00
Ante Pušić
989bb97514
Extend Cypher queries with the index hinting feature ( #1345 )
2023-10-27 14:26:19 +02:00
Ante Pušić
3158a16ffd
Add filtering details to EXPLAIN and PROFILE ( #1265 )
2023-10-25 21:36:20 +02:00
Matija Pintarić
411f8c9d56
Move essential query modules from MAGE to Memgraph ( #1384 )
...
* schema.cpp
* mgps.py
* convert.py
2023-10-25 18:27:44 +02:00
Antonio Filipovic
a84f570c6d
Use extent hooks for per query memory limit ( #1340 )
2023-10-25 16:01:59 +02:00
Josipmrden
3d4d841753
Add constraint verification update only on necessary actions ( #1341 )
2023-10-25 16:01:02 +02:00
Antonio Filipovic
2426d7980d
Add OOM enabler in operator tree ( #1379 )
2023-10-25 12:16:11 +02:00
Josipmrden
7ef10dd82a
Fix gql behave dropping connection on Memgraph ( #1399 )
2023-10-25 10:59:02 +02:00
Gareth Andrew Lloyd
5b91f85161
Improve storage GC ( #1387 )
2023-10-24 23:41:21 +02:00
Josipmrden
e617ff9b59
Provide textual information for inefficient plans with notifications ( #1343 )
2023-10-24 22:20:05 +02:00
Josipmrden
be16ca7362
Add cartesian and hash join operators ( #1193 )
2023-10-24 21:54:42 +02:00
Josipmrden
fdf63436ab
Add cartesian and hash join mgbench ( #1393 )
2023-10-24 19:44:11 +02:00
Josipmrden
4e8148f7d9
Add retry logic possible when conflicting transactions ( #1361 )
2023-10-24 19:43:23 +02:00
imilinovic
1f118e7521
Add renaming of edge types ( #1364 )
2023-10-24 17:12:09 +02:00
Matija Pintarić
97ed912ab6
Implement map key exists in mgp ( #1336 )
2023-10-23 15:29:41 +02:00
Antonio Filipovic
7f7f3adfcb
Implement jemalloc extent hooks memory tracker ( #1250 )
...
Should improve/fix memory usage exceeds --memory-limit issues
2023-10-23 12:48:26 +02:00
andrejtonev
26e31ca06f
Fix SHOW CONFIG to show the run-time flag status ( #1278 )
2023-10-23 10:18:07 +02:00
DavIvek
3ff2c72db9
Fix crash caused by deleting non-existing edge in DETACH DELETE ( #1355 )
2023-10-23 08:36:28 +02:00
Andi
af56ab6ea8
Forbid changing isolation level for disk and analytical ( #1367 )
...
Co-authored-by: Marko Budiselić <marko.budiselic@memgraph.com>
2023-10-23 06:02:56 +02:00
andrejtonev
a100b900c5
Fix DB configuration error under expansion gbench ( #1368 )
2023-10-16 23:12:49 +02:00
Marko Budiselić
9524a51576
Add v5 toolchain ( #608 )
...
* clang 17.0.2
* gcc 13.2
* upgrade libs
* tmp disable gpg check, tmp disable fblibs
2023-10-16 19:01:39 +02:00
andrejtonev
22d8ef75e0
Updated telemetry client-side ( #1337 )
2023-10-16 14:16:00 +02:00
Andi
de9280b334
Refactor disk storage ( #1347 )
2023-10-16 09:11:07 +02:00
Andi
06868c8be7
Run separate GQL suits for different storage modes ( #1346 )
2023-10-11 11:42:41 +02:00
Andi
1a3c5af797
Improve expansions on disk ( #1335 )
...
* Improve disk expansions
2023-10-11 10:18:50 +02:00
Gareth Andrew Lloyd
d278a33f31
Decouple pure replication state from storage [part 1] ( #1325 )
...
A major refactor to decouple replication state from storage.
ATM it is still owned by storage but a following part should fix that.
2023-10-10 11:44:19 +01:00
Aidar Samerkhanov
7fbf5857f2
Add GQL behave tests for on-disk storage ( #1238 )
2023-10-10 09:27:11 +03:00
DavIvek
0d51a20a02
Fix a crash caused by declaring a path with only one node in OPTIONAL MATCH clause ( #1318 )
2023-10-09 15:25:25 +02:00
DavIvek
3143c986de
Fix crash caused by using exists() in a RETURN statement ( #1303 )
2023-10-09 11:31:49 +02:00
Andi
2fd34489af
Add mgbench support for disk storage and analytical mode ( #1286 )
...
* Add mgbench support for disk storage and analytical mode
2023-10-06 10:19:29 +02:00
Gareth Andrew Lloyd
3cc2bc2791
Refactor interpreter to support multiple distributed clocks (Part 1) ( #1281 )
...
* Interpreter transaction ID decoupled from storage transaction ID
* Transactional scope for indices, statistics and constraints
* Storage::Accessor now has 2 modes (unique and shared)
* Introduced ResourceLock to fix pthread mutex problems
* Split InfoQuery in two: non-transactional SystemInfoQuery and transactional DatabaseInfoQuery
* Replicable and durable statistics
* Bumped WAL/Snapshot versions
* Initial implementation of the Lamport clock
---------
Co-authored-by: Andreja Tonev <andreja.tonev@memgraph.io>
2023-10-05 16:58:39 +02:00
Gareth Andrew Lloyd
d71b6a5007
Refactor replication client/server ( #1311 )
2023-09-29 11:21:42 +01:00
Andi
61ac7e1b11
Add --storage-mode flag ( #1282 )
...
* Add --storage-mode flag
2023-09-26 14:47:30 +02:00
Andi
efdf7baea0
Refactor mgbench
2023-09-22 19:05:16 +02:00
Gareth Andrew Lloyd
eb4e2b019d
Fix distinct, now doesn't impacts other aggregates ( #1235 )
...
Before a distinct on one aggregate would impact distinct on another
aggregate. Fixed the logical error and at the same time did some memory
optimisations.
2023-09-20 16:45:55 +01:00
andrejtonev
bce48361ca
Decoupling Interpreter from Storage ( #1186 )
...
Unique/global InterpreterContext that is Storage agnostic (has a reference to the DbmsHandler instead)
* InterpreterContext is no longer the owner of Storage
* New Database structure that handles Storage, Triggers, Streams
* Renamed SessinContextHandler to DbmsHandler and simplified the multi-tenant logic
* Added Gatekeeper and updated handlers to use it
---------
Co-authored-by: Gareth Lloyd <gareth.lloyd@memgraph.io>
2023-09-20 13:13:54 +02:00
imilinovic
404cdf05d3
Add path pop to mgp API ( #1249 )
2023-09-19 12:37:55 +02:00
Josipmrden
440838c0e9
Add dependency check for e2e tests ( #1240 )
2023-09-12 11:34:08 -04:00
Josipmrden
bf03b38e39
Remove gqlalchemy from stress tests ( #1245 )
2023-09-12 11:32:16 -04:00
andrejtonev
5e5f4ffc5d
Add more runtime configurable settings ( #1183 )
...
server name, query timeout settings, log.level, log.to_stderr
2023-09-11 11:30:54 -04:00
Ante Pušić
060b9d1c16
[master < T1204] Add detailed operator info to PROFILE and EXPLAIN ( #1204 )
2023-09-11 14:34:27 +02:00
Ante Pušić
29a505cb38
Property lookup caching ( #1168 )
2023-09-11 13:03:54 +02:00
Ante Pušić
d4fcd745d2
Sort SHOW INDEX INFO ( #1178 )
2023-09-11 10:59:41 +02:00
Josipmrden
58546a9fe1
Add detach delete in bulk ( #1078 )
2023-09-10 18:53:03 +02:00
Ante Pušić
0403b67073
Fix returning NULL on map projection from a null value ( #1119 )
2023-09-09 06:43:25 -04:00
Antonio Filipovic
b094fdbadc
Fix API bug on accessing deleted object ( #1209 )
2023-09-08 13:52:21 -04:00
Josipmrden
07dea328d8
[master < T1110] Add merge optimization to expand dynamically during runtime ( #1110 )
2023-09-08 17:12:25 +02:00
Gareth Andrew Lloyd
bd1852f407
Reduce flake SnapshotFallback test ( #1237 )
...
Fixed the wait period, this should ensure at least one snapshot was
made. Also cleaned up the checking around this. And also better
corruption.
2023-09-08 14:21:35 +01:00
imilinovic
9c51dbbb01
Implement changing from and to vertices in relationships ( #1221 )
2023-09-08 12:52:40 +02:00
Matija Pintarić
d9464c6ffd
Add InDegree and OutDegree in O(1) ( #1217 )
2023-09-07 13:16:30 +02:00
Antonio Filipovic
b6b32bec03
Improve performance of delta creation ( #1129 )
2023-09-06 11:30:21 +02:00
Andi
b5413c6f82
Add edge import mode into the on-disk storage ( #1157 )
2023-09-05 19:00:53 +02:00
Josipmrden
09fd5939da
Remove double scan with expand from the planner ( #1085 )
2023-09-05 11:02:52 +02:00
Josipmrden
02eab6ab9c
Set properties C API extension ( #1131 )
...
Add SetProperties into the C++ query module API
2023-09-04 16:17:43 +02:00
Gareth Andrew Lloyd
e928eed028
Replication refactor (part 4) ( #1211 )
...
More refactoring to isolate generic replication behavior. Making the
InMemory* types even more decoupled from replication logic.
2023-08-31 16:06:44 +01:00
Josipmrden
eb5167dfef
Add high write set property workload ( #1172 )
2023-08-31 14:46:35 +02:00
Josipmrden
b952139973
Add supernode performance workload ( #1171 )
2023-08-30 15:19:52 +02:00
andrejtonev
28dbcd1545
Add disk storage to e2e tests ( #1202 )
...
* Add disk storage to e2e tests
---------
Co-authored-by: Andi Skrgat <andi8647@gmail.com>
2023-08-30 13:42:11 +02:00
Matija Pintarić
d516e40841
Add ToString on C++ API mgp types( #1140 )
2023-08-29 17:30:23 +02:00
Andi
a6ec81b179
Add deterministic disk vertex_count and edge_count ( #1146 )
...
* Add exact vertex_count and edge_count to disk storage
2023-08-29 13:07:23 +02:00
andrejtonev
c526ff2a8f
[master < ] Remove DbAccessor from non-transactional queries ( #1201 )
...
* Decouple non-transactional queries from DbAccessor
* Invalidate auth cache after AuthQuery
Co-authored-by: Gareth Lloyd <gareth.lloyd@memgraph.io>
2023-08-29 11:13:42 +02:00
Gareth Andrew Lloyd
4bc5d749b2
Refactor replication, part 3 ( #1177 )
...
Changes to make replication code agnostic of the storage kind being used.
Co-authored-by: Andreja Tonev <andreja.tonev@memgraph.io>
2023-08-25 10:52:07 +01:00
imilinovic
a426ef9cc3
Add Relationship::RemoveProperty to C++ query module API ( #1156 )
2023-08-24 12:14:00 +02:00
Ante Pušić
3f8befde79
Bump PyYAML version ( #1174 )
2023-08-23 12:48:17 +02:00
andrejtonev
9355e58e73
Decoupling replication logic from InMemoryStorage ( #1169 )
2023-08-22 13:29:25 +02:00
gvolfing
476968e2c8
Fix concurrent query module race condition ( #1158 )
...
Concurrent access to the same query module had a race condition on the
pointer that was used to handle the custom memory management. With this
commit, a mapping has been added to keep information about what
thread used the pointer to handle the memory resources. This should be
fine since the respected query executions are running on a dedicated
thread. Access to the mapping itself is threadsafe. A simple RAII
wrapper for the mapping container has also been added for simpler
client-side use.
2023-08-21 16:45:36 +02:00
Gareth Andrew Lloyd
97183fb9da
Fix FLAGS_delta_chain_cache_threshold typo ( #1181 )
2023-08-21 13:16:02 +02:00
