Ante Pušić
df82b05725
Add preliminary mock and PropertyStore modifications
2023-12-21 13:23:14 +01:00
Antonio Filipovic
cd37de481e
Add atomic memory block around unsafe code blocks ( #1589 )
2023-12-21 09:43:16 +01:00
Antonio Filipovic
4ef86efb6f
Fix memgraph crash on telemetry server and no file permissions ( #1566 )
2023-12-19 14:09:43 +01:00
Andi
04fb92dce8
Fix memory bug Alloc vs. Free ( #1570 )
2023-12-19 11:13:05 +01:00
gvolfing
7a9c4f5ec4
Fix logic in RelWithDebInfo mode ( #1397 )
...
In and only in RelWithDebInfo mode the access of the maybe_unused
variable results in segfaults, this change is making sure that does no
happen ever if the maybe_unused variable is nullopt without changing the
overall logic.
2023-12-06 22:52:28 +01:00
Antonio Filipovic
eceed274d9
Relax mg assert condition on dealloc ( #1492 )
2023-12-05 13:44:06 +01:00
Antonio Filipovic
74fa6d21f6
Implement parallel constraints recovery ( #1545 )
2023-12-04 21:56:05 +01:00
gvolfing
eeb9671bac
Merge branch 'master' into Implement-constant-time-label-and-edge-type-retrieval
2023-12-04 18:46:00 +01:00
andrejtonev
e716c90031
Fixed wrong handling of exceptions in SessionHL ( #1560 )
2023-12-04 18:13:55 +01:00
gvolfing
9690682bc2
Merge branch 'master' into Implement-constant-time-label-and-edge-type-retrieval
2023-12-04 16:18:00 +01:00
Ante Pušić
64e5428d94
Send Bolt success messages only after DB operations run successfully ( #1556 )
2023-12-04 10:52:00 +01:00
gvolfing
66e86c060f
Merge branch 'master' into Implement-constant-time-label-and-edge-type-retrieval
2023-12-04 09:02:51 +01:00
Aidar Samerkhanov
953a8f5340
Add handling of deleted return values for query procedures and functions ran in analytical mode ( #1395 )
...
Co-authored-by: Ante Pušić <ante.pusic@memgraph.io>
2023-12-04 08:32:59 +01:00
gvolfing
31efe28878
Merge branch 'master' into Implement-constant-time-label-and-edge-type-retrieval
2023-12-04 08:00:02 +01:00
Josipmrden
0fb3ae2d56
Fix three match cartesian sequential scanning ( #1555 )
2023-12-04 00:01:29 +01:00
Josipmrden
46bfeb0023
Fix counting when no matched nodes by property ( #1518 )
2023-12-03 22:28:26 +01:00
Josipmrden
d58a464141
Remove filter profile info ( #1481 )
2023-12-03 21:23:52 +01:00
Marko Budiselić
997779fe07
Merge branch 'master' into Implement-constant-time-label-and-edge-type-retrieval
2023-12-02 20:08:14 +01:00
Ante Pušić
3ccd78ac71
Add path and weight to variable expand filter ( #1434 )
...
Co-authored-by: Aidar Samerkhanov <aidar.samerkhanov@memgraph.io>
2023-12-02 20:03:40 +01:00
Gareth Andrew Lloyd
14f92b4a0f
Bugfix: correct replication handler ( #1540 )
...
Fixes root cause of a cascade of failures in replication code:
- Replica handling of deleting an edge is now corrected. Now tolerant of multiple edges of the same relationship type.
- Improved robustness: correct exception handling around failed stream of current WAL file. This now means a REPLICA failure will no longer prevent transactions on MAIN from performing WAL writes.
- Slightly better diagnostic messages, not user friendly but helps get developer to correct root cause quicker.
- Proactively remove vertex+edges during Abort rather than defer to GC to do that work, this included fixing constraints and indexes to be safe.
Co-authored-by: Andreja Tonev <andreja.tonev@memgraph.io>
2023-12-01 12:38:48 +00:00
gvolfing
ac0c4193b0
Remove comment
2023-11-28 11:46:32 +01:00
gvolfing
9868dee73b
Merge branch 'master' into Implement-constant-time-label-and-edge-type-retrieval
2023-11-28 10:21:59 +01:00
Antonio Filipovic
bb2a7b8f21
Fix frame change collector incomplete pmr type ( #1491 )
2023-11-28 10:00:34 +01:00
Antonio Filipovic
72d47fc3bf
Implement short circuiting of exists evaluation ( #1539 )
2023-11-27 16:44:12 +01:00
Andi
7f5a55f1b2
Fix restarts when using init-file flag ( #1465 )
2023-11-24 13:11:47 +01:00
gvolfing
08acde3973
Merge branch 'master' into Implement-constant-time-label-and-edge-type-retrieval
2023-11-24 12:24:20 +01:00
andrejtonev
8b9e1fa08b
Replication refactor part 6 ( #1484 )
...
Single (instance level) connection to a replica (messages from all databases get multiplexed through it)
ReplicationClient split in two: ReplicationClient and ReplicationStorageClient
New ReplicationClient, moved under replication, handles the raw connection, owned by MainRoleData
ReplicationStorageClient handles the storage <-> replica state machine and holds to a stream
Removed epoch and storage from *Clients
rpc::Stream proactively aborts on error and sets itself to a defunct state
Removed HandleRpcFailure, instead we simply log the error and let the FrequentCheck handle re-connection
replica_state is now a synced variable
ReplicaStorageClient state machine bugfixes
Single FrequentCheck that goes through DBMS
Moved ReplicationState under DbmsHandler
Moved some replication startup logic under the DbmsHandler's constructor
Removed InMemoryReplicationClient
CreateReplicationClient has been removed from Storage
Simplified GetRecoverySteps and made safer
---------
Co-authored-by: Gareth Lloyd <gareth.lloyd@memgraph.io>
2023-11-23 11:02:35 +01:00
Gareth Andrew Lloyd
e4f94c15c6
Fixes for clang-tidy / sonar issues ( #1536 )
2023-11-22 13:05:02 +00:00
Andi
1d90b60f56
Add schema.assert ( #1485 )
2023-11-21 09:19:50 +01:00
Andi
d03fafcef6
Aggregations return empty result when used with group by ( #1531 )
2023-11-20 11:52:17 +01:00
Antonio Filipovic
645568a75b
Remove default memory limit on procedures ( #1506 )
...
* remove default limit on procedures
* fix bug on GraphQL also
2023-11-16 15:01:44 +01:00
Antonio Filipovic
d3f4c35362
Add OOM enabler for MG procedure ( #1401 )
2023-11-15 12:42:04 +01:00
Josipmrden
c037cddb0e
Add granular index and constraint recovery info ( #1480 )
2023-11-14 17:23:06 -05:00
imilinovic
ced08fd7bc
Fix GC by adding periodic jemalloc purge ( #1471 )
2023-11-14 15:06:21 -05:00
gvolfing
a370b09d12
Merge branch 'master' into Implement-constant-time-label-and-edge-type-retrieval
2023-11-14 13:13:16 +01:00
gvolfing
1527bdf435
Make metadata collection setable with flag
...
There might be a performance impect of updating the metadata store on
bulk operations. Hence this flag which is disabling the collection by
default. If the queries to obtain the information are called with this
flag disabled, the database will throw an exception.
2023-11-14 13:10:08 +01:00
Andi
e5b2c19ea2
Empty Collect() returns nothing ( #1482 )
2023-11-13 11:45:09 +01:00
Josipmrden
e907817854
Fix for in list segmentation fault ( #1494 )
2023-11-13 05:17:10 +01:00
Josipmrden
0756cd6898
Add fix indexed join crash ( #1478 )
2023-11-12 22:12:25 -05:00
Josipmrden
38ad5e2146
Fix parallel index loading ( #1479 )
2023-11-12 23:51:00 +01:00
Josipmrden
3c413a7e50
Fix hash join expression matching ( #1496 )
2023-11-12 14:45:02 -05:00
Antonio Filipovic
17915578f8
Fix race condition and arena tracking bug ( #1468 )
2023-11-09 18:56:36 +01:00
gvolfing
df3274d78f
Make the metadata storing objects threadsafe
...
The objects stored_node_labels_ and stored_edge_types_ can be accesses
through separate threads but it was not safe to do so. This commit
replaces the standard containers with threadsafe ones.
2023-11-08 14:43:06 +01:00
gvolfing
2946d74fdd
Merge branch 'master' into Implement-constant-time-label-and-edge-type-retrieval
2023-11-08 07:48:15 +01:00
DavIvek
c8fe9ee7d9
Fix accessing a variable bound to a list within BFS function ( #1380 )
2023-11-07 20:34:50 +01:00
Antonio Filipovic
4d5ea03dfa
Use extent hooks for memory procedure limit ( #1443 )
2023-11-07 16:04:29 +01:00
DavIvek
ece4b0dba8
Fix cached plan not getting invalidated ( #1348 )
2023-11-07 13:34:03 +01:00
gvolfing
eb4ebab438
Merge branch 'master' into Implement-constant-time-label-and-edge-type-retrieval
2023-11-07 12:29:22 +01:00
gvolfing
260d60451d
Modify retrieval function signatures
...
Before the functions that are retrieving the data from the metadata
holding datastructures were returning a std::string, and that was
propagated outward all the way through. To keep this functions
consistent with the rest of the storage/dbaccessor functions the LabelId
and EdgeTypeId will be propagated respectively and the conversion into
string will only happen at the interpreter level.
2023-11-07 12:07:52 +01:00
Andi
66487a6dce
Durability improvements ( #1385 )
2023-11-07 11:37:54 +01:00
gvolfing
c4d9116c9c
Add queries to obtain the labels and edge types
...
Add two queries to be able to retrieve the labels and edge types this is
done through additions to the DatabaseInfoQuery query types.
2023-11-07 09:35:28 +01:00
Andi
f4b97fc03d
Fix missing statistics for SetPropertiesCursor ( #1460 )
2023-11-07 09:11:20 +01:00
Antonio Filipovic
58648d1a70
Revert license sender info ( #1461 )
2023-11-06 16:57:09 +01:00
Antonio Filipovic
1ab7f6ac78
Add notification for user on max map count ( #1408 )
2023-11-06 15:44:26 +01:00
andrejtonev
dbc6054689
Replication refactor (part 5) ( #1378 )
2023-11-06 11:50:49 +00:00
gvolfing
50c485fe40
Add storage side capabilites to retrieve metadata
...
In order to get the required metadata in constant time we need to keep
track of the node labels and edge types that were ever present in the
database. This is done by the two axuiliary datastructures that are
present in the storage instances. The ability to get this metadata is
propagated to the DBAccessor class, which the query modules can interact
with.
2023-11-06 12:37:48 +01:00
Aidar Samerkhanov
16b8c7b27c
Fix Kafka flaky unit test ( #1409 )
2023-11-05 20:51:56 +01:00
Antonio Filipovic
48631d1e37
Rename memory usage and memory allocated ( #1426 )
2023-11-03 14:40:45 +01:00
Antonio Filipovic
93e6d058d2
Remove all_shortest paths unnecessary logs ( #1425 )
2023-11-03 12:46:06 +01:00
Andi
3e9f25b8e4
Support creating date and localtime from localdatetime ( #1381 )
2023-11-03 10:54:01 +01:00
Andi
c94201621a
Support deleting paths ( #1383 )
2023-11-02 14:07:48 +01:00
Andi
fdbc390d53
Throw when reduce inside exists ( #1392 )
2023-11-02 12:18:15 +01:00
Andi
5e6c5618f5
Make FrameChangeCollector owning the memory resource ( #1398 )
2023-11-02 09:54:39 +01:00
Andi
4aacd45640
Throw when exists() combined with CASE ( #1382 )
2023-11-02 08:25:34 +01:00
Gareth Andrew Lloyd
157b36162b
Speedup socket unit test ( #1444 )
...
Was testing a setup that wasn't used in production, it would
unnecessarily thrash small buffers.
2023-11-01 17:24:24 +00:00
Josipmrden
5b9802bd7b
Extend property cache to the expression evaluator ( #1432 )
...
* Add support for property cache in the produce
* Fix the previous implementation in the map literal
2023-10-28 20:32:58 -07:00
Ante Pušić
b1c3168308
Fix PROFILE infinite loop ( #1431 )
2023-10-28 15:34:52 +02:00
gvolfing
c296dc67ce
Add index count to index info ( #1229 )
2023-10-27 18:13:05 +02:00
Ante Pušić
989bb97514
Extend Cypher queries with the index hinting feature ( #1345 )
2023-10-27 14:26:19 +02:00
Ante Pušić
3158a16ffd
Add filtering details to EXPLAIN and PROFILE ( #1265 )
2023-10-25 21:36:20 +02:00
Antonio Filipovic
a84f570c6d
Use extent hooks for per query memory limit ( #1340 )
2023-10-25 16:01:59 +02:00
Josipmrden
3d4d841753
Add constraint verification update only on necessary actions ( #1341 )
2023-10-25 16:01:02 +02:00
Antonio Filipovic
2426d7980d
Add OOM enabler in operator tree ( #1379 )
2023-10-25 12:16:11 +02:00
Josipmrden
7ef10dd82a
Fix gql behave dropping connection on Memgraph ( #1399 )
2023-10-25 10:59:02 +02:00
Gareth Andrew Lloyd
5b91f85161
Improve storage GC ( #1387 )
2023-10-24 23:41:21 +02:00
Antonio Filipovic
0d9bd5554c
Fix potential bug on memory pool ( #1299 )
2023-10-24 22:31:36 +02:00
Josipmrden
e617ff9b59
Provide textual information for inefficient plans with notifications ( #1343 )
2023-10-24 22:20:05 +02:00
Josipmrden
be16ca7362
Add cartesian and hash join operators ( #1193 )
2023-10-24 21:54:42 +02:00
Josipmrden
4e8148f7d9
Add retry logic possible when conflicting transactions ( #1361 )
2023-10-24 19:43:23 +02:00
imilinovic
1f118e7521
Add renaming of edge types ( #1364 )
2023-10-24 17:12:09 +02:00
DavIvek
98680b04c9
Add DNS support for cluster replica address ( #1323 )
2023-10-24 13:11:36 +02:00
Josipmrden
1d45016217
Add values and keys function to map ( #1246 )
2023-10-24 06:19:20 +02:00
Matija Pintarić
97ed912ab6
Implement map key exists in mgp ( #1336 )
2023-10-23 15:29:41 +02:00
gvolfing
aec4c3dd2b
Fix bug in alias mappings ( #1252 )
2023-10-23 13:07:46 +02:00
Antonio Filipovic
7f7f3adfcb
Implement jemalloc extent hooks memory tracker ( #1250 )
...
Should improve/fix memory usage exceeds --memory-limit issues
2023-10-23 12:48:26 +02:00
andrejtonev
26e31ca06f
Fix SHOW CONFIG to show the run-time flag status ( #1278 )
2023-10-23 10:18:07 +02:00
DavIvek
3ff2c72db9
Fix crash caused by deleting non-existing edge in DETACH DELETE ( #1355 )
2023-10-23 08:36:28 +02:00
Andi
af56ab6ea8
Forbid changing isolation level for disk and analytical ( #1367 )
...
Co-authored-by: Marko Budiselić <marko.budiselic@memgraph.com>
2023-10-23 06:02:56 +02:00
Gareth Andrew Lloyd
64bf75117b
Fix subtle replication bug ( #1370 )
...
When going from REPLICA to MAIN, need to ensure current WAL files are
finalised.
2023-10-16 22:56:56 +02:00
Marko Budiselić
9524a51576
Add v5 toolchain ( #608 )
...
* clang 17.0.2
* gcc 13.2
* upgrade libs
* tmp disable gpg check, tmp disable fblibs
2023-10-16 19:01:39 +02:00
Marko Budiselić
fd10d1c9f8
Fix CPU 100% usage by websocket error handling improvement ( #1327 )
2023-10-16 15:41:12 +02:00
andrejtonev
22d8ef75e0
Updated telemetry client-side ( #1337 )
2023-10-16 14:16:00 +02:00
Andi
7b0bafa21e
Add human readable memory allocations in show storage info ( #1366 )
2023-10-16 11:35:44 +02:00
Andi
de9280b334
Refactor disk storage ( #1347 )
2023-10-16 09:11:07 +02:00
Andi
1a3c5af797
Improve expansions on disk ( #1335 )
...
* Improve disk expansions
2023-10-11 10:18:50 +02:00
Gareth Andrew Lloyd
d278a33f31
Decouple pure replication state from storage [part 1] ( #1325 )
...
A major refactor to decouple replication state from storage.
ATM it is still owned by storage but a following part should fix that.
2023-10-10 11:44:19 +01:00
Aidar Samerkhanov
7fbf5857f2
Add GQL behave tests for on-disk storage ( #1238 )
2023-10-10 09:27:11 +03:00
DavIvek
0d51a20a02
Fix a crash caused by declaring a path with only one node in OPTIONAL MATCH clause ( #1318 )
2023-10-09 15:25:25 +02:00
DavIvek
3143c986de
Fix crash caused by using exists() in a RETURN statement ( #1303 )
2023-10-09 11:31:49 +02:00
Gareth Andrew Lloyd
3cc2bc2791
Refactor interpreter to support multiple distributed clocks (Part 1) ( #1281 )
...
* Interpreter transaction ID decoupled from storage transaction ID
* Transactional scope for indices, statistics and constraints
* Storage::Accessor now has 2 modes (unique and shared)
* Introduced ResourceLock to fix pthread mutex problems
* Split InfoQuery in two: non-transactional SystemInfoQuery and transactional DatabaseInfoQuery
* Replicable and durable statistics
* Bumped WAL/Snapshot versions
* Initial implementation of the Lamport clock
---------
Co-authored-by: Andreja Tonev <andreja.tonev@memgraph.io>
2023-10-05 16:58:39 +02:00
Gareth Andrew Lloyd
d71b6a5007
Refactor replication client/server ( #1311 )
2023-09-29 11:21:42 +01:00
Andi
61ac7e1b11
Add --storage-mode flag ( #1282 )
...
* Add --storage-mode flag
2023-09-26 14:47:30 +02:00
Gareth Andrew Lloyd
eb4e2b019d
Fix distinct, now doesn't impacts other aggregates ( #1235 )
...
Before a distinct on one aggregate would impact distinct on another
aggregate. Fixed the logical error and at the same time did some memory
optimisations.
2023-09-20 16:45:55 +01:00
Andi
1553fcb958
Improve deserialization performance
...
* Change std::stoull to std::from_chars
---------
Co-authored-by: Aidar Samerkhanov <aidar.samerkhanov@memgraph.io>
2023-09-20 14:25:17 +02:00
andrejtonev
bce48361ca
Decoupling Interpreter from Storage ( #1186 )
...
Unique/global InterpreterContext that is Storage agnostic (has a reference to the DbmsHandler instead)
* InterpreterContext is no longer the owner of Storage
* New Database structure that handles Storage, Triggers, Streams
* Renamed SessinContextHandler to DbmsHandler and simplified the multi-tenant logic
* Added Gatekeeper and updated handlers to use it
---------
Co-authored-by: Gareth Lloyd <gareth.lloyd@memgraph.io>
2023-09-20 13:13:54 +02:00
imilinovic
404cdf05d3
Add path pop to mgp API ( #1249 )
2023-09-19 12:37:55 +02:00
gvolfing
fd63944493
Add --query-callable-mappings-path package default ( #1203 )
2023-09-11 15:12:14 -04:00
Gareth Andrew Lloyd
6694de2dfa
Fix libkrb5 TRUE and FALSE macros leakage ( #1243 )
...
Co-authored-by: Marko Budiselić <marko.budiselic@memgraph.com>
2023-09-11 12:46:40 -04:00
andrejtonev
5e5f4ffc5d
Add more runtime configurable settings ( #1183 )
...
server name, query timeout settings, log.level, log.to_stderr
2023-09-11 11:30:54 -04:00
Ante Pušić
060b9d1c16
[master < T1204] Add detailed operator info to PROFILE and EXPLAIN ( #1204 )
2023-09-11 14:34:27 +02:00
Ante Pušić
29a505cb38
Property lookup caching ( #1168 )
2023-09-11 13:03:54 +02:00
Ante Pušić
d4fcd745d2
Sort SHOW INDEX INFO ( #1178 )
2023-09-11 10:59:41 +02:00
Josipmrden
58546a9fe1
Add detach delete in bulk ( #1078 )
2023-09-10 18:53:03 +02:00
Gareth Andrew Lloyd
ab56abf4ca
Optimize scanning vertices ( #1227 )
2023-09-09 10:09:25 -04:00
Gareth Andrew Lloyd
1bd47318cd
Improve PropertyStore ( #1142 )
...
Improve AnyVersionHasLabelProperty by doing less work in some instances.
Improve FindSpecificProperty.
2023-09-09 08:00:43 -04:00
Ante Pušić
0403b67073
Fix returning NULL on map projection from a null value ( #1119 )
2023-09-09 06:43:25 -04:00
DavIvek
9e4babcdbb
Fix segfault based on issue #874 ( #1175 )
2023-09-09 02:04:46 -04:00
Antonio Filipovic
b094fdbadc
Fix API bug on accessing deleted object ( #1209 )
2023-09-08 13:52:21 -04:00
Josipmrden
07dea328d8
[master < T1110] Add merge optimization to expand dynamically during runtime ( #1110 )
2023-09-08 17:12:25 +02:00
imilinovic
9c51dbbb01
Implement changing from and to vertices in relationships ( #1221 )
2023-09-08 12:52:40 +02:00
Matija Pintarić
d9464c6ffd
Add InDegree and OutDegree in O(1) ( #1217 )
2023-09-07 13:16:30 +02:00
Ante Javor
312d01bd0c
Remove repeated log lines from TRACE log level. ( #1054 )
2023-09-06 23:09:51 +02:00
Antonio Filipovic
b6b32bec03
Improve performance of delta creation ( #1129 )
2023-09-06 11:30:21 +02:00
Antonio Filipovic
93992a275b
Improve NameToId mapper on set properties ( #1147 )
2023-09-06 00:12:27 +02:00
Andi
b5413c6f82
Add edge import mode into the on-disk storage ( #1157 )
2023-09-05 19:00:53 +02:00
Josipmrden
09fd5939da
Remove double scan with expand from the planner ( #1085 )
2023-09-05 11:02:52 +02:00
Josipmrden
02eab6ab9c
Set properties C API extension ( #1131 )
...
Add SetProperties into the C++ query module API
2023-09-04 16:17:43 +02:00
Gareth Andrew Lloyd
9661c52179
Introduce a reader writer spin lock ( #1187 )
...
It is possible for multiple read only queries to be accessing the same
sequence of vertices/edges. The reader mode of the spin lock will ensure
multiple threads can make progress at the same time.
2023-09-01 14:21:15 +01:00
Gareth Andrew Lloyd
e928eed028
Replication refactor (part 4) ( #1211 )
...
More refactoring to isolate generic replication behavior. Making the
InMemory* types even more decoupled from replication logic.
2023-08-31 16:06:44 +01:00
Andi
a6ec81b179
Add deterministic disk vertex_count and edge_count ( #1146 )
...
* Add exact vertex_count and edge_count to disk storage
2023-08-29 13:07:23 +02:00
andrejtonev
c526ff2a8f
[master < ] Remove DbAccessor from non-transactional queries ( #1201 )
...
* Decouple non-transactional queries from DbAccessor
* Invalidate auth cache after AuthQuery
Co-authored-by: Gareth Lloyd <gareth.lloyd@memgraph.io>
2023-08-29 11:13:42 +02:00
Aidar Samerkhanov
5f509532f2
Add timestamp to DELETE_DESERIALIZED_OBJECT delta at which this object was created. ( #1179 )
...
Add timestamp to DELETE_DESERIALIZED_OBJECT delta at which this object was created.
RocksDB currently doesn't provide timestamp() functionality in iterators of TransationDB.
Because of that we are using constant "0" timestamp for DELETE_DESERIALIZED_OBJECT.
2023-08-28 10:56:17 +04:00
Andi
4b3ba908c7
Code improvements on disk storage ( #1153 )
...
* Improvements based on a code review
---------
Co-authored-by: Aidar Samerkhanov <aidar.samerkhanov@memgraph.io>
2023-08-26 14:16:12 +02:00
Andi
030b554ffd
Improve concurrency control for on-disk storage ( #1154 )
...
* Remove locking vertices and serialization checks
---------
Co-authored-by: Aidar Samerkhanov <aidar.samerkhanov@memgraph.io>
2023-08-25 14:42:52 +02:00
Gareth Andrew Lloyd
4bc5d749b2
Refactor replication, part 3 ( #1177 )
...
Changes to make replication code agnostic of the storage kind being used.
Co-authored-by: Andreja Tonev <andreja.tonev@memgraph.io>
2023-08-25 10:52:07 +01:00
Ante Pušić
60e167d676
Optimize index and constraint updates ( #1159 )
2023-08-23 14:52:44 +02:00
andrejtonev
9355e58e73
Decoupling replication logic from InMemoryStorage ( #1169 )
2023-08-22 13:29:25 +02:00
Gareth Andrew Lloyd
97183fb9da
Fix FLAGS_delta_chain_cache_threshold typo ( #1181 )
2023-08-21 13:16:02 +02:00
Gareth Andrew Lloyd
adb65b2fff
Refactor memgraph.cpp ( #1164 )
2023-08-18 18:23:15 +02:00
Aidar Samerkhanov
3bf2cf65ab
Optimize splitting keys inside the on-disk storage ( #1155 )
2023-08-17 18:09:21 +02:00
ind1xa
8f3f693f20
Fix duration overflow ( #1150 )
2023-08-16 13:30:26 +02:00
Gareth Andrew Lloyd
2e51e703c3
Add supernode vertex cache ( #1124 )
...
Add supernode vertex cache to account for long delta chains and modifications in the same module being independent of scanning of the nodes in the next iteration of the pulling mechanism.
2023-08-11 10:18:28 +02:00
Andi
adf7533751
Optimize import of edges on disk ( #1132 )
2023-08-10 11:53:07 +02:00
Antonio Filipovic
509183e985
Improve performance on set properties ( #1115 )
2023-08-10 09:06:44 +02:00
Aidar Samerkhanov
1fe2190747
Filter deleted edges during edge prefetch ( #1145 )
2023-08-09 13:56:34 +02:00
Andi
762fe6a65d
Improve disk indices ( #1139 )
2023-08-09 10:16:49 +02:00
Aidar Samerkhanov
271b1a5ddb
Fix bug with on-disk triggers ( #1134 )
...
* Fix TriggerContext adaptation for accessors.
* Fix edge deserialization in case of the deleted vertex.
2023-08-08 10:37:14 +02:00
gvolfing
260660f1dd
Fix sequential label-property index recovery ( #1135 )
...
The parallel_exec_info should have been passed to this function before,
otherwise, the recovery of label-property indices would never have been
parallelized.
2023-08-05 23:20:15 +02:00
andrejtonev
4a99625287
Fix throwing if user was created without a license ( #1067 )
2023-08-01 23:36:12 +02:00
andrejtonev
5bbed6ef9a
Implement user caching to speed up PullPlan ( #1109 )
2023-08-01 23:04:35 +02:00
Andi
f0bac53e7b
Improve restore replication role ( #1089 )
2023-08-01 21:51:52 +02:00
andrejtonev
e8850549d2
Add multi-tenancy v1 ( #952 )
...
* Decouple BoltSession and communication::bolt::Session
* Add CREATE/USE/DROP DATABASE
* Add SHOW DATABASES
* Cover WebSocket session
* Simple session safety implemented via RWLock
* Storage symlinks for backward. compatibility
* Extend the audit log with the DB info
* Add auth part
* Add tenant recovery
2023-08-01 18:49:11 +02:00
Andi
60f4ffc6a1
Improve logging if replica cannot recover using curr WAL file ( #1086 )
2023-08-01 10:33:46 +02:00
gvolfing
210bea83d4
Add GraphQL transpilation compatibility ( #1018 )
...
* Add callable mappings feature
* Implement mgps.validate (void procedure)
* Make '_' a valid variable name
2023-07-31 14:48:12 +02:00
Josh Soref
57fe3463f2
Fix a bunch of spelling mistakes (1/n) ( #1112 )
2023-07-30 14:05:05 +02:00
Antonio Filipovic
285b409927
Improve all shortest paths memory usage ( #981 )
...
* Change allocator to PoolResource
2023-07-30 12:58:07 +02:00
Gareth Andrew Lloyd
8ebab84324
Add handling of partial results on timeout ( #1046 )
2023-07-30 10:48:11 +02:00
imilinovic
3fd9ce4a33
Add mgp::map erase and update ( #1103 )
2023-07-30 08:36:50 +02:00
Andi
be4eb95a98
Fix Jepsen replication pause ( #1082 )
2023-07-30 02:36:11 +02:00
Andi
18bd02423a
Fix PropertyStore buffer serialization ( #1111 )
2023-07-29 19:14:27 +02:00
andrejtonev
58c0c4cebb
Add missing-field-initialization warning flag ( #1113 )
2023-07-29 17:59:11 +02:00
andrejtonev
110ca3968c
Fix path generation ignores edge's element_id ( #1108 )
2023-07-29 15:51:51 +02:00
Vlasta
fae039c215
Improve logging for the on-disk storage ( #1079 )
2023-07-19 22:54:42 +02:00
Marko Budiselić
3b9133fd5a
Improve e2e and replication testing setup ( #1061 )
...
* Add `--replication-restore-state-on-startup` with `false` as default
Co-authored-by: Aidar Samerkhanov <aidar.samerkhanov@memgraph.io>
Co-authored-by: Andi Skrgat <andi8647@gmail.com>
2023-07-19 21:18:43 +02:00
Marko Budiselić
9d056e7649
Add experimental/v1 of ON_DISK_TRANSACTIONAL storage ( #850 )
...
Co-authored-by: Andi Skrgat <andi8647@gmail.com>
Co-authored-by: Aidar Samerkhanov <aidar.samerkhanov@memgraph.io>
2023-06-29 11:44:55 +02:00
Antonio Filipovic
aa4f68a37d
Add error handling on py batched module init ( #1052 )
2023-06-28 17:23:42 +02:00
Josipmrden
84721f7e0a
Add vertex degree to index statistics ( #1026 )
...
Add graph analysis of vertex degrees when doing ANALYZE GRAPH.
2023-06-27 18:06:20 +02:00
Ante Javor
261aa4f49b
Improve replication logging ( #1030 )
2023-06-27 17:57:51 +02:00
Gareth Andrew Lloyd
3b781bf525
Add HTTP+GZIP support to LOAD CSV ( #1027 )
2023-06-26 19:10:48 +02:00
Antonio Filipovic
d573eda8bb
Add python & cpp batching option in procedures
...
* Add API for batching from the procedure
* Use PoolResource for batched procedures
2023-06-26 15:46:13 +02:00
Gareth Andrew Lloyd
5b1ba10183
Fix IN_MEMORY_ANALYTICAL storage GC ( #1025 )
2023-06-23 12:50:03 +02:00
Vlasta
b25e9968ee
Update links inside CSV import tool ( #834 )
2023-06-22 16:00:22 +02:00
Katarina Supe
68e5610566
Fix replica exception message ( #930 )
2023-06-22 14:41:59 +02:00
Ante Javor
0ea96663ba
Add check for opening snapshots ( #966 )
2023-06-22 13:29:49 +02:00
Marko Budiselić
e73eac77a9
Improve libstdc++ dependency on RPM systems ( #863 )
2023-06-22 10:14:59 +02:00
Josipmrden
b875649270
Add restoring of replication roles upon database startup ( #791 )
...
Fix replica node restoration on startup so it is restored as replica and not as main.
2023-06-21 19:08:58 +02:00
Josipmrden
05cc35bf93
Add command NULLIF for identifying nulls in LOAD CSV ( #914 )
...
Add NULLIF command which turns all row values corresponding to the string to the nullif character sequence.
2023-06-21 14:50:46 +02:00
Josipmrden
63f8298033
Fix MATCH + LOAD CSV to load CSV only once ( #916 )
...
* update profile query to use poolresource
* Optimize update of indexes
* Add ignore empty strings to load csv
* Add operator changes to support handling of nulls
* Store chunks in memory pools ordered
* Use same max block per chunks number
* Remove redundant return statement
* add hacky cached solution
* change map to set
* remove memory
* Add match load csv invalid behaviour commit
* Accept input on LOAD CSV
* Ommit changes not tied to the PR
* Add tests for match + load csv
* Add gqlalchemy installation for e2e tests
* Modify setup script to update packages
* Revert gqlalchemy to 1.3.3
* Revert gqlalchemy to 1.3.3
* Address PR review comments
* Ommit semicolon
---------
Co-authored-by: antoniofilipovic <filipovicantonio1998@gmail.com>
Co-authored-by: János Benjamin Antal <benjamin.antal@memgraph.io>
2023-06-21 11:13:40 +02:00
Josipmrden
df95775222
Fix init file startup in community edition ( #974 )
...
* Fix init file startup in community edition
* Add possibility to build binary without MG_ENTERPRISE
* Added trace spdlog for when init file is not present
* Add gqlalchemy and unit tests
* Add init data files which correspond to the right directory by the github actions
2023-06-20 17:54:50 +02:00
andrejtonev
30ec570bb9
Add Bolt v5 support ( #938 )
2023-06-12 18:55:15 +02:00
Antonio Filipovic
d917c3f0fd
Fix slow IN LIST evaluation ( #901 )
2023-05-29 17:52:20 +02:00
andrejtonev
d842adbed3
Handle user-defined metadata and expose it with SHOW TRANSACTIONS( #945 )
2023-05-29 11:40:14 +02:00
Josipmrden
651b6f3a5a
Expose system metrics over HTTP Endpoint ( #940 )
2023-05-18 05:10:57 +00:00
Ante Pušić
0d9bd74a8a
Add support for map projection ( #892 )
2023-05-16 20:05:35 +02:00
andrejtonev
802f8aceda
Add data directory status and (un)lock query ( #933 )
2023-05-16 18:36:04 +02:00
gvolfing
7ddce539fa
Add return build type command ( #894 )
2023-05-16 16:02:03 +02:00
gvolfing
c3e4f81026
Include additional info inside storage mode info query ( #883 )
2023-05-16 14:25:41 +02:00
Antonio Filipovic
208705f296
Reduce memory consumption on return from python procedures ( #932 )
2023-05-16 10:33:09 +02:00
János Benjamin Antal
3a5f140c2b
Order chunks in utils::Pool to speed up deallocation ( #898 )
2023-05-02 13:08:20 +02:00
Antonio Filipovic
91017b7f36
Update profile query to use PoolResource for LOAD CSV ( #885 )
2023-04-26 18:04:13 +02:00
gvolfing
00f8d54249
Parallelize index creation ( #882 )
2023-04-26 16:28:02 +02:00
János Benjamin Antal
4fcdd52f88
Use correct memory resource ( #900 )
2023-04-26 10:02:55 +02:00
János Benjamin Antal
6c947947eb
Parallelize recovery ( #868 )
...
* Parallelize edge recovery
* Load vertex labels and properties parallel
* Add parallel connectivity loading
* Add batches information to snapshot
* Introduce `items_per_batch` and `recovery_thread_count` flags
* Make possible to load snapshots with old version
* Add vertex batches to `RecoveryInfo`
* Extend durability integration tests with v15 test cases
* Add `std::vector` based `InitProperties`
* Use `InitProperties` in snapshot loading
2023-04-25 16:25:25 +02:00
János Benjamin Antal
97e250129e
Change AccumulateCursor to use utils::pmr::deque ( #888 )
...
* Increase performance by eliminating unnecessary `TypedValue` copies
2023-04-24 16:22:22 +02:00
Antonio Filipovic
2c6a55775d
Fix max block size bug on LOAD CSV( #877 )
2023-04-19 16:10:20 +02:00
Andi
26a0866938
Fix index optimization bug ( #860 )
2023-04-04 23:43:13 +02:00
Antonio Filipovic
64e837b355
Introduce analytics mode ( #772 )
2023-04-04 18:46:26 +02:00
Antonio Filipovic
a586f2f98d
Change EvalContext and QueryExecution to use PoolResource on LOAD CSV ( #825 )
...
* Change PullPlan to use specific PoolResource for LOAD CSV
2023-04-04 16:54:08 +02:00
Josipmrden
9fc51f74a0
Skip label based auth on user with global visibility on graph ( #837 )
2023-04-04 11:13:25 +02:00
Josipmrden
128771a6ec
Add SHA-256 password encryption ( #839 )
2023-04-03 16:29:21 +02:00
