Dan Helfman
255cc6ec23
When deep merging common configuration, merge colliding list values by appending them ( #531 ).
2022-05-20 15:28:28 -07:00
Dan Helfman
788281cfb9
When a configuration include is a relative path, load it from either the current working directory or from the directory containing the file doing the including ( #532 ).
2022-05-19 17:15:05 -07:00
Dan Helfman
525266ede6
Deep merging when including common configuration ( #381 ).
2022-04-25 21:18:37 -07:00
Dan Helfman
0e6b425ac5
Fix "borgmatic borg key ..." to pass parameters to Borg in correct order ( #515 ).
2022-04-23 14:03:15 -07:00
Dan Helfman
ed7fe5c6d0
Instead of executing "before" command hooks before all borgmatic actions run (and "after" hooks after), execute these hooks right before/after the corresponding action ( #473 ).
2022-04-21 22:08:25 -07:00
Dan Helfman
0c027a3050
Fix handling of TERM signal to exit borgmatic, not just forward the signal to Borg ( #516 ).
2022-04-03 13:12:48 -07:00
Dan Helfman
9f44bbad65
Fix borgmatic exit code (so it's zero) when initial Borg calls fail but later retries succeed ( #517 ).
2022-04-02 22:28:41 -07:00
Dan Helfman
976516d0e1
When loading a configuration file that is unreadable due to file permissions, warn instead of erroring ( #444 ).
2022-03-08 10:19:36 -08:00
Dan Helfman
574eb91921
Fix Borg usage error in the "compact" action when running "borgmatic --dry-run". Now, skip "compact" entirely during a dry run ( #507 ).
2022-03-07 21:46:12 -08:00
Dan Helfman
28fef3264b
Fix handling of "patterns_from" and "exclude_from" options to error instead of warning when referencing unreadable files and running "create" action ( #486 ).
2022-03-07 15:32:07 -08:00
Dan Helfman
9161dbcb7d
Removing unnecessary leading underscores from functions.
2022-03-07 11:58:29 -08:00
Dan Helfman
4b3027e4fc
Add test for new working_directory option ( #431 ).
2022-03-03 11:48:18 -08:00
Dan Helfman
0eb2634f9b
Working directory option to support source directories with relative paths ( #431 ).
...
Reviewed-on: https://projects.torsion.org/borgmatic-collective/borgmatic/pulls/477
2022-03-03 19:28:17 +00:00
Dan Helfman
9317cbaaf0
Code formatting.
2022-02-10 10:23:34 -08:00
Dan Helfman
1b5f04b79f
When using the "remote_rate_limit" option, tailor the flags passed to Borg depending on the Borg version ( #394 ).
2022-02-10 10:16:09 -08:00
Dan Helfman
948c86f62c
When using the "numeric_owner" option with the "extract" action, tailor the flags passed to Borg depending on the Borg version ( #394 ).
2022-02-10 10:09:18 -08:00
Dan Helfman
7e7209322a
When using the "numeric_owner" option, tailor the flags passed to Borg depending on the Borg version ( #394 ).
2022-02-10 09:51:13 -08:00
Dan Helfman
00a57fd947
Code formatting.
2022-02-09 21:20:28 -08:00
Dan Helfman
6bf6ac310b
When using the "bsd_flags" option, tailor the flags passed to Borg depending on the Borg version ( #394 ).
2022-02-09 21:11:00 -08:00
Dan Helfman
4b5af2770d
When the "atime" option is used, tailor the flags passed to Borg depending on version ( #394 ).
2022-02-09 16:54:35 -08:00
Dan Helfman
b525e70e1c
Run "compact" action by default when no actions are specified ( #394 ).
2022-02-09 14:33:12 -08:00
Dan Helfman
e3f4bf0293
Build fix for ruamel.yaml.clib error.
2022-02-08 12:52:45 -08:00
Dan Helfman
48f44d2f3d
Add tests for compact action ( #394 ).
2022-02-08 12:05:02 -08:00
Dan Helfman
bec73245e9
Fix traceback when a YAML validation error occurs ( #480 , #482 ).
2022-01-19 20:39:03 -08:00
fabianschilling
b39f08694d
Merge branch 'master' into pr-working-directory
2022-01-05 09:30:27 +00:00
Dan Helfman
2ee75546f5
Add MongoDB database hook documentation.
2022-01-04 16:26:38 -08:00
Andrea Ghensi
7c6ce9399c
fix integration tests and mongodb auth
2021-12-29 22:18:50 +01:00
Andrea Ghensi
6b7653484b
Add mongodb dump hook
2021-12-26 01:00:58 +01:00
Fabian Schilling
85e0334826
Add missing working_directory arg to pass tests
2021-12-10 18:24:41 +01:00
Dan Helfman
a1673d1fa1
Fix unicode error when restoring particular MySQL databases ( #476 ).
2021-12-08 16:40:25 -08:00
Dan Helfman
7a086d8430
Fix import ordering.
2021-11-29 14:00:14 -08:00
Dan Helfman
0e8e9ced64
When command-line configuration override produces a parse error, error cleanly ( #471 ).
2021-11-29 12:49:21 -08:00
nebulon42
c3e76585fc
move mysqldump options to the beginning of the command due to MySQL bug 30994.
2021-11-26 17:16:03 +01:00
nebulon42
3729ba5ca3
add list_options setting, fixes #306
2021-11-20 15:43:58 +01:00
Dan Helfman
38ebfd2969
Rename retry_timeout to retry_wait and standardize log formatting ( #28 ).
2021-11-15 11:51:17 -08:00
cadamswaite
976a877a25
Formatting
2021-11-14 22:37:42 +00:00
cadamswaite
b4117916b8
Add timeout and tests
2021-11-14 22:15:22 +00:00
cadamswaite
19cad89978
Add some tests for retry logic
2021-11-14 21:35:23 +00:00
Dan Helfman
449896f661
Fix error when configured source directories are not present on the filesystem at the time of backup ( #387 ).
2021-10-11 10:40:10 -07:00
Dan Helfman
acb2ca79d9
Fix traceback that can occur when dumping a database ( #440 ).
2021-08-06 08:58:11 -07:00
Dan Helfman
80b33fbf8a
Code style reformatting.
2021-07-27 09:39:48 -07:00
Marek Szuba
e8b8d86592
tests/integration/test_execute: use plain Python rather than xxd
...
Removes this test's dependencies on vim and /dev/urandom.
Signed-off-by: Marek Szuba <marek.szuba@cern.ch>
2021-07-27 13:50:16 +01:00
Dan Helfman
2a8692c64f
Fix integration test to hopefully work on Alpine ( #430 ).
2021-07-25 22:50:00 -07:00
Dan Helfman
1709f57ff0
Fix hang when restoring a PostgreSQL "tar" format database dump ( #430 ).
2021-07-25 22:30:15 -07:00
Dan Helfman
54d57e1349
Add test for #407 : Fix syslog logging on FreeBSD.
2021-06-23 10:21:45 -07:00
Dan Helfman
27d37b606b
Better error messages! Switch the library used for validating configuration files (from pykwalify to jsonschema).
2021-06-22 13:27:59 -07:00
Dan Helfman
cf8882f2bc
Run arbitrary Borg commands with new "borgmatic borg" action ( #425 ).
2021-06-17 20:41:44 -07:00
Dan Helfman
9fd28d2eed
Fix error handling to error loudly when Borg gets killed due to running out of memory ( #423 )!
2021-06-08 11:43:55 -07:00
Dan Helfman
d6e376d32d
Fix end-to-end test broken by change in source directory examples.
2021-04-18 17:54:54 -07:00
Dan Helfman
d543109ef4
"Fix" build failure with Alpine Edge by switching from Edge to Alpine 3.13.
2021-04-09 15:58:23 -07:00
Dan Helfman
4897a78fd3
Fix database tests broken by PostgreSQL upgrade in Alpine Edge.
2020-12-24 22:23:09 -08:00
Dan Helfman
ad7198ba66
Tweak to test failing on some machines.
2020-11-26 16:22:42 -08:00
Dan Helfman
c0ae01f5d5
Code formatting.
2020-11-25 17:46:57 -08:00
Dan Helfman
ccd1627175
Fix timing-related test error in Alpine Edge.
2020-11-25 15:48:33 -08:00
Dan Helfman
1f4f28b4dc
Drop support for Python 3.5. Only support black code formatter on Python 3.8+.
2020-11-22 17:27:21 -08:00
Dan Helfman
ea6cd53067
Update versions of test dependencies (test_requirements.txt and test containers).
2020-11-22 14:48:07 -08:00
Dan Helfman
9b819f32f8
Fix traceback when upgrading old INI-style configuration with upgrade-borgmatic-config ( #367 ).
2020-11-18 15:01:10 -08:00
Dan Helfman
b619bde037
Fix broken end-to-end test.
2020-11-18 14:20:07 -08:00
François Poulain
ebac02f118
Mention placeholders for repositories in documentation; fix #369
2020-11-18 20:22:41 +01:00
Dan Helfman
1ea04aedf0
Merge override values when specifying the "--override" flag multiple times ( #361 ).
2020-10-23 16:06:00 -07:00
Dan Helfman
0e978299cf
Fix traceback when a database hook value is null in a configuration file ( #355 ).
2020-10-07 15:41:45 -07:00
networkjanitor
3c723e8d99
Merge branch 'master' into master
2020-08-12 21:11:45 +00:00
Dan Helfman
72bd96c656
Fix traceback when a configuration directory is non-readable due to directory permissions ( #350 ).
2020-08-12 11:32:00 -07:00
networkjanitor
893fca2816
Add before_extract and after_extract hooks
2020-08-01 16:08:32 +02:00
Dan Helfman
b3fd1be5f6
Add "borgmatic export-tar" action to export an archive to a tar-formatted file or stream ( #300 ).
2020-07-22 21:53:55 -07:00
Dan Helfman
6f82c9979b
Add #339 to NEWS and add test.
2020-07-07 22:31:17 -07:00
Dan Helfman
37cc229749
Fix duplicate logging to Healthchecks and send "after_*" hooks output to Healthchecks ( #328 ).
2020-06-23 11:01:03 -07:00
Dan Helfman
17c2d109e5
Add tests for pass-through of BORG_* environment variables.
2020-06-21 14:41:22 -07:00
Dan Helfman
32e15dc905
Add a few more mocks to PostgreSQL SSL tests.
2020-06-20 14:39:16 -07:00
Dan Helfman
f5ebca4907
Add SSL support to PostgreSQL database configuration ( #331 ).
...
Reviewed-on: https://projects.torsion.org/witten/borgmatic/pulls/331
2020-06-20 21:24:14 +00:00
Edward Shornock
d2d92b1f1a
Add tests for the PostgreSQL SSL options
2020-06-20 23:32:24 +03:00
Dan Helfman
27cbe9dfc0
Fix for potential data loss (data not getting backed up) when borgmatic omitted configured source directories in certain situations ( #333 ).
2020-06-19 20:16:38 -07:00
Edward Shornock
abd47fc14e
Add SSL support to PostgreSQL hooks
2020-06-19 02:19:17 +03:00
Dan Helfman
7fb4061759
Improve configuration reference documentation readability via more aggressive word-wrapping in configuration schema descriptions.
2020-06-17 23:15:12 -07:00
Dan Helfman
aa14449857
Add "borgmatic extract --strip-components" flag to remove leading path components when extracting an archive ( #324 ).
2020-06-06 14:57:14 -07:00
Dan Helfman
a155eefa23
Fix for certain configuration options like ssh_command impacting Borg invocations for separate configuration files ( #323 ).
2020-06-06 14:30:04 -07:00
Dan Helfman
d7277893fb
Fix hang when a stale database dump named pipe from an aborted borgmatic run remains on disk ( #316 ).
2020-06-02 12:40:32 -07:00
Dan Helfman
097a09578a
Fix enabled database hooks to implicitly set one_file_system configuration option to true to prevent Borg hang. ( #315 ).
2020-05-26 09:20:14 -07:00
Dan Helfman
65472c8de2
Fix error message when there are no MySQL databases to dump for "all" databases ( #319 ).
2020-05-26 08:59:04 -07:00
Dan Helfman
96df52ec50
Fix hang when streaming a database dump to Borg with implicit duplicate source directories by deduplicating them first ( #316 ).
2020-05-20 13:33:53 -07:00
Dan Helfman
89cb5eb76d
Fix regression in support for PostgreSQL's "directory" dump format ( #314 ).
2020-05-18 11:31:29 -07:00
Dan Helfman
048a9ebb52
Add an additional end-to-end database test.
2020-05-15 10:12:49 -07:00
Dan Helfman
3e5a19d95a
Add missing test coverage.
2020-05-14 23:21:43 -07:00
Dan Helfman
d88f321cef
Fix legitimate database dump command errors (exit code 1) not being treated as errors by borgmatic ( #310 ).
2020-05-14 22:38:38 -07:00
Dan Helfman
15ea70a71b
Flesh out missing test coverage for execute.py.
2020-05-12 15:49:49 -07:00
Dan Helfman
8b91c01a4c
Add some missing test coverage.
2020-05-11 11:34:14 -07:00
Dan Helfman
3bcef72050
Add some missing test mocks that were masking lack of unit coverage.
2020-05-11 11:17:24 -07:00
Dan Helfman
695c764a01
Merge log output functions into one.
2020-05-11 10:55:50 -07:00
Dan Helfman
1ea047dd94
Remove "borgmatic restore --progress" flag, as it now conflicts with streaming database restores.
2020-05-09 21:53:16 -07:00
Dan Helfman
4b523f9e2c
Make database restore output only show at verbosity 2.
2020-05-08 19:38:33 -07:00
Dan Helfman
6a61070d85
Use shell redirection rather than the --file flag to sidestep synchronization issues when pg_dump/pg_dumpall tries to write to a named pipe.
2020-05-08 19:11:26 -07:00
Dan Helfman
f36082938e
Additional test coverage.
2020-05-08 09:48:04 -07:00
Dan Helfman
1ba996ad93
Additional test coverage.
2020-05-07 12:14:27 -07:00
Dan Helfman
a23fdf946d
Stream database dumps and restores directly to/from Borg without using any additional filesystem space ( #258 ).
2020-05-07 11:44:04 -07:00
Dan Helfman
12cf6913ef
Remove unused function parameter.
2020-05-03 14:07:34 -07:00
Dan Helfman
e4eff0e3dc
Bump version for release.
2020-04-24 15:56:56 -07:00
Dan Helfman
dce1928dc4
Fix PostgreSQL restore error on "all" database dump.
2020-04-24 15:50:33 -07:00
Nathan Beals
3c8dc4929f
Added test_restore_all_database_dump
unit test.
...
Updated the other unit tests, as I had to re-arrange argument order
Added an 'all' test for the postgres end-to-end test.
Ran black formatter on it all.
2020-04-24 18:32:53 -04:00
Dan Helfman
e511014a28
Fix MySQL restore error on "all" database dump by excluding system tables ( #301 ).
2020-04-22 12:17:22 -07:00
Dan Helfman
bae5f88824
Upgrade test database versions.
2020-04-21 10:01:26 -07:00