tursom/memgraph
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
61e28bffd0
memgraph/tools/tests/CMakeLists.txt

38 lines
1.6 KiB
CMake
Raw Normal View History

Make csv_to_snapshot more user friendly Summary: Time csv_to_snapshot conversion and log it. Check if writing csv_to_snapshot failed. Extract LoadConfig from memgraph_bolt to config.hpp. Read memgraph config in csv_to_snapshot for snapshot_directory. Rename csv_to_snapshot to mg_import_csv. Add tests for tools. Run tools tests in apollo. Reviewers: mislav.bradac, florijan, mferencevic, buda Reviewed By: mferencevic Subscribers: pullbot Differential Revision: https://phabricator.memgraph.io/D931
2017-10-25 21:28:10 +08:00
include_directories(SYSTEM ${GTEST_INCLUDE_DIR})
add_executable(mg_recovery_check
mg_recovery_check.cpp
${memgraph_src_dir}/communication/bolt/v1/decoder/decoded_value.cpp
${memgraph_src_dir}/data_structures/concurrent/skiplist_gc.cpp
${memgraph_src_dir}/database/graph_db.cpp
Cleanup durability config, docs, CHANGELOG Reviewers: teon.banek, buda, mislav.bradac, dgleich Reviewed By: teon.banek Subscribers: pullbot Differential Revision: https://phabricator.memgraph.io/D992
2017-11-20 18:58:05 +08:00
${memgraph_src_dir}/database/graph_db_config.cpp
Make csv_to_snapshot more user friendly Summary: Time csv_to_snapshot conversion and log it. Check if writing csv_to_snapshot failed. Extract LoadConfig from memgraph_bolt to config.hpp. Read memgraph config in csv_to_snapshot for snapshot_directory. Rename csv_to_snapshot to mg_import_csv. Add tests for tools. Run tools tests in apollo. Reviewers: mislav.bradac, florijan, mferencevic, buda Reviewed By: mferencevic Subscribers: pullbot Differential Revision: https://phabricator.memgraph.io/D931
2017-10-25 21:28:10 +08:00
${memgraph_src_dir}/database/graph_db_accessor.cpp
${memgraph_src_dir}/durability/recovery.cpp
${memgraph_src_dir}/durability/snapshooter.cpp
Write-ahead log Summary: My dear fellow Memgraphians. It's friday afternoon, and I am as ready to pop as WAL is to get reviewed... What's done: - Vertices and Edges have global IDs, stored in `VersionList`. Main storage is now a concurrent map ID->vlist_ptr. - WriteAheadLog class added. It's based around buffering WAL::Op objects (elementraly DB changes) and periodically serializing and flusing them to disk. - Snapshot recovery refactored, WAL recovery added. Snapshot format changed again to include necessary info. - Durability testing completely reworked. What's not done (and should be when we decide how): - Old WAL file purging. - Config refactor (naming and organization). Will do when we discuss what we want. - Changelog and new feature documentation (both depending on the point above). - Better error handling and recovery feedback. Currently it's all returning bools, which is not fine-grained enough (neither for errors nor partial successes, also EOF is reported as a failure at the moment). - Moving the implementation of WAL stuff to .cpp where possible. - Not sure if there are transactions being created outside of `GraphDbAccessor` and it's `BuildIndex`. Need to look into. - True write-ahead logic (flag controlled): not committing a DB transaction if the WAL has not flushed it's data. We can discuss the gain/effort ratio for this feature. Reviewers: buda, mislav.bradac, teon.banek, dgleich Reviewed By: dgleich Subscribers: mtomic, pullbot Differential Revision: https://phabricator.memgraph.io/D958
2017-11-13 16:50:49 +08:00
${memgraph_src_dir}/durability/wal.cpp
Make csv_to_snapshot more user friendly Summary: Time csv_to_snapshot conversion and log it. Check if writing csv_to_snapshot failed. Extract LoadConfig from memgraph_bolt to config.hpp. Read memgraph config in csv_to_snapshot for snapshot_directory. Rename csv_to_snapshot to mg_import_csv. Add tests for tools. Run tools tests in apollo. Reviewers: mislav.bradac, florijan, mferencevic, buda Reviewed By: mferencevic Subscribers: pullbot Differential Revision: https://phabricator.memgraph.io/D931
2017-10-25 21:28:10 +08:00
${memgraph_src_dir}/query/typed_value.cpp
${memgraph_src_dir}/storage/edge_accessor.cpp
${memgraph_src_dir}/storage/locking/record_lock.cpp
${memgraph_src_dir}/storage/property_value.cpp
${memgraph_src_dir}/storage/record_accessor.cpp
${memgraph_src_dir}/storage/vertex_accessor.cpp
${memgraph_src_dir}/transactions/transaction.cpp
)
target_link_libraries(mg_recovery_check stdc++fs Threads::Threads fmt glog
gflags cppitertools)
target_link_libraries(mg_recovery_check gtest gtest_main)
# Copy CSV data to CMake build dir
configure_file(csv/comment_nodes.csv csv/comment_nodes.csv COPYONLY)
configure_file(csv/forum_nodes.csv csv/forum_nodes.csv COPYONLY)
Fix CSV multiple edge file import Summary: The CSV importer used to generate non-unique edge IDs when generating edges from multiple CSV files. This is incompatible with the unique ID requirements introduced by the WAL. Tested and fixed in this diff. Reviewers: teon.banek, mferencevic Reviewed By: teon.banek Subscribers: pullbot Differential Revision: https://phabricator.memgraph.io/D980
2017-11-14 21:06:19 +08:00
configure_file(csv/relationships_0.csv csv/relationships_0.csv COPYONLY)
configure_file(csv/relationships_1.csv csv/relationships_1.csv COPYONLY)
Make csv_to_snapshot more user friendly Summary: Time csv_to_snapshot conversion and log it. Check if writing csv_to_snapshot failed. Extract LoadConfig from memgraph_bolt to config.hpp. Read memgraph config in csv_to_snapshot for snapshot_directory. Rename csv_to_snapshot to mg_import_csv. Add tests for tools. Run tools tests in apollo. Reviewers: mislav.bradac, florijan, mferencevic, buda Reviewed By: mferencevic Subscribers: pullbot Differential Revision: https://phabricator.memgraph.io/D931
2017-10-25 21:28:10 +08:00
# Copy the actual runner to CMake build dir
configure_file(test_mg_import_csv test_mg_import_csv COPYONLY)
add_test(NAME test_mg_import_csv
COMMAND test_mg_import_csv
--mg-import-csv ../src/mg_import_csv
--mg-recovery-check ./mg_recovery_check)
Reference in New Issue Copy Permalink