Dan Helfman
dce1928dc4
Fix PostgreSQL restore error on "all" database dump.
2020-04-24 15:50:33 -07:00
Nathan Beals
3c8dc4929f
Added test_restore_all_database_dump
unit test.
...
Updated the other unit tests, as I had to re-arrange argument order
Added an 'all' test for the postgres end-to-end test.
Ran black formatter on it all.
2020-04-24 18:32:53 -04:00
Dan Helfman
e511014a28
Fix MySQL restore error on "all" database dump by excluding system tables ( #301 ).
2020-04-22 12:17:22 -07:00
Dan Helfman
55141bda67
Specify "--archive latest" to all actions that accept an archive ( #289 ).
2020-01-29 16:59:02 -08:00
Dan Helfman
bc02c123e6
Monitor backups with PagerDuty hook integration ( #245 ).
2020-01-27 15:32:09 -08:00
Dan Helfman
e76d5ad988
Fix tests.
2020-01-27 12:56:12 -08:00
Dan Helfman
2405e97c38
Backup to a removable drive or intermittent server via "soft failure" feature ( #284 ).
2020-01-24 20:52:48 -08:00
Dan Helfman
fdbb2ee905
View consistency check progress via "--progress" flag for "check" action ( #287 ).
2020-01-24 11:27:16 -08:00
Dan Helfman
94b9ef56be
Change "exclude_if_present" option to support multiple filenames, rather than just a single filename ( #280 ).
2020-01-23 13:41:37 -08:00
Dan Helfman
53e6ff9524
No longer list files or show stats by default at verbosity 2.
2020-01-22 15:23:49 -08:00
Dan Helfman
f66fd1caaa
Customize Healthchecks log level via borgmatic "--monitoring-verbosity" flag ( #277 ).
2020-01-22 15:10:47 -08:00
Dan Helfman
d93fdbc5ad
Support "--files" and "--stats" flags at verbosity level 0.
2020-01-22 13:28:24 -08:00
palto42
75b5e7254e
changes as per comments in PR #283
2020-01-22 19:03:26 +01:00
palto42
5f0c084bee
Merge 'upstream/master' into list-files
2020-01-22 18:12:26 +01:00
Dan Helfman
7824a034ca
Add test for database dump directory removal.
2020-01-21 10:34:46 -08:00
palto42
e27ba0d08a
less detail at v1 + option "--files" for details
2020-01-11 16:38:07 +01:00
Dan Helfman
d0c533555e
In "borgmatic --help", don't expand $HOME in listing of default "--config" paths.
2020-01-02 10:37:31 -08:00
Dan Helfman
911668f0c8
Only trigger "on_error" hooks and monitoring failures for "prune", "create", and "check" actions, and not for other actions ( #270 ).
2019-12-20 13:58:02 -08:00
Dan Helfman
d64bcd5e83
When pruning with verbosity level 1, list pruned and kept archives.
2019-12-17 20:12:41 -08:00
Dan Helfman
f787dfe809
Override particular configuration options from the command-line via "--override" flag ( #268 ).
2019-12-17 11:46:27 -08:00
Dan Helfman
e009bfeaa2
Update Healthchecks/Cronitor/Cronhub monitoring integrations to fire for "check" and "prune" actions, not just "create" ( #249 ).
2019-12-12 22:54:45 -08:00
Dan Helfman
14e5cfc8f8
Support piping "borgmatic list" output to grep. Retain colored output when piping/redirecting ( #271 ).
2019-12-11 12:12:25 -08:00
Dan Helfman
8660af745e
Optionally change the internal database dump path via "borgmatic_source_directory" option in location configuration section ( #259 ).
2019-12-10 16:04:34 -08:00
Dan Helfman
826e4352d1
Filter listed paths via "borgmatic list --path" flag ( #269 ).
2019-12-08 14:07:02 -08:00
Dan Helfman
b94999bba4
Fix "borgmatic umount" so it only runs Borg once instead of once per repository / configuration file.
2019-12-07 21:36:51 -08:00
Dan Helfman
65cc4c9429
Fix "--repository" flag to accept relative paths.
2019-12-06 16:29:41 -08:00
Dan Helfman
2ab9daaa0f
Attempt to repair any inconsistencies found during a consistency check via "borgmatic check --repair" flag ( #266 ).
2019-12-04 16:07:00 -08:00
Dan Helfman
0c6c61a272
Pass extra options directly to particular Borg commands, handy for Borg options that borgmatic does not yet support natively ( #235 ).
2019-12-04 15:48:10 -08:00
Dan Helfman
00f62ca023
Fix for "before_backup" hook not triggering an error when the command contains "borg" and has an exit code of 1 ( #256 ).
2019-11-30 16:55:05 -08:00
Dan Helfman
9b2ca15de6
Fix for garbled Borg file listing when using "borgmatic create --progress" with verbosity level 1 or 2 ( #257 ).
2019-11-30 15:31:36 -08:00
Dan Helfman
c4aa34bf5c
Fix for missing Healthchecks monitoring payload or HTTP 500 due to incorrect unicode encoding ( #260 ).
2019-11-30 14:51:32 -08:00
Dan Helfman
d978a2d190
Fix for database dump removal incorrectly skipping some database dumps.
2019-11-25 15:27:59 -08:00
Dan Helfman
375036e409
Support for mounting an archive as a FUSE filesystem via "borgmatic mount" action, and unmounting via "borgmatic umount" ( #123 ).
2019-11-25 14:56:20 -08:00
Dan Helfman
f4a231420f
Show summary log errors regardless of verbosity. Log the "summary:" header with level based on the contained logs.
2019-11-25 10:31:09 -08:00
Dan Helfman
55ebfdda39
Show full error logs at "--verbosity 0" so you can see command output without upping the verbosity level.
2019-11-19 10:09:25 -08:00
Dan Helfman
2cc743cf47
With "borgmatic check", consider Borg warnings as errors ( #247 ).
2019-11-17 19:06:28 -08:00
Dan Helfman
d99e6d1994
Remove obnoxious log message when Healthchecks hook sends failure for check action.
2019-11-17 18:55:40 -08:00
Dan Helfman
50f62d73b7
When using the Healthchecks monitoring hook, include borgmatic logs in the payloads for completion and failure pings ( #241 ).
2019-11-17 16:54:27 -08:00
Dan Helfman
1f166a47e9
Fix failing test due to dictionary order (or the lack thereof..) in Python 3.5.
2019-11-13 16:42:58 -08:00
Dan Helfman
6cdc92bd0c
Fix for "borgmatic restore" showing success and incorrectly extracting archive files, even when no databases are configured to restore ( #246 ).
2019-11-13 10:41:57 -08:00
Dan Helfman
0a9f4e8708
Reopen the file given by "--log-file" flag if an external program rotates the log file while borgmatic is running.
2019-11-12 16:13:25 -08:00
Dan Helfman
781fac3266
Refactor ping monitors (Healthchecks, Cronitor, Cronhub) to share a common invocation and function signature.
2019-11-12 15:31:07 -08:00
Dan Helfman
04e5b42606
Fix repository does not exist error with "borgmatic extract" when repository is remote ( #243 ).
2019-11-12 11:47:24 -08:00
Dan Helfman
ebeb5efe05
More accurately detecting restore of unconfigured database ( #228 ).
2019-11-12 11:10:47 -08:00
Dan Helfman
a3e939f34b
Factor out filtering of database configuration to function with tests ( #228 ).
2019-11-12 10:39:36 -08:00
Dan Helfman
2a771161e7
Finish test coverage for MySQL restore ( #228 ).
2019-11-12 09:50:26 -08:00
Dan Helfman
ded042d8cc
First crack at MySQL/MariaDB database restore ( #228 ).
2019-11-11 21:59:30 -08:00
Dan Helfman
9d29ecf304
Remove MySQL/MariaDB database dumps after backing them up ( #228 ).
2019-11-08 11:53:27 -08:00
Dan Helfman
427b57e2a9
Database dump hooks for MySQL/MariaDB ( #228 ).
2019-11-08 11:17:52 -08:00
Dan Helfman
17fda7281a
Monitor backups with Cronhub hook integration. Fix Healthchecks/Cronitor hooks to respect dry run.
2019-11-07 10:08:44 -08:00
Dan Helfman
ac777965d0
Fix regression of generate-borgmatic-config working without --source flag ( #239 ).
2019-11-06 09:52:21 -08:00
Dan Helfman
2115eeb6a2
Upgrade your borgmatic configuration to get new options and comments via "generate-borgmatic-config --source" ( #239 ).
2019-11-06 09:31:00 -08:00
palto42
18d3542fbc
new verbosity level "-1" for errors
2019-11-03 09:55:19 +01:00
Dan Helfman
a9104ed090
Handle log file error more consistently with other error. Add --log-file-verbosity flag. Add docs.
2019-11-02 11:23:18 -07:00
Dan Helfman
06f134cc71
Log to file instead of syslog via command-line "--log-file" flag ( #233 ).
2019-11-02 17:43:39 +00:00
palto42
26a1a3d1e0
test cases for logfile option
2019-11-02 14:34:16 +01:00
Dan Helfman
f48f52079d
Support for Borg --keep-exclude-tags and --exclude-nodump options ( #234 ).
2019-11-01 15:50:59 -07:00
Dan Helfman
8fd46b8c70
Monitor backups with Cronitor hook integration.
2019-11-01 11:33:15 -07:00
Dan Helfman
e3dd545345
Extract files to a particular directory via "borgmatic extract --destination" flag. Also rename "--restore-path" to "--path" to reduce confusion.
2019-11-01 10:00:26 -07:00
Dan Helfman
939f4d4e3d
Add additional tests for database restores.
2019-10-31 14:11:19 -07:00
Dan Helfman
3006db0cae
Restore backed up PostgreSQL databases via "borgmatic restore" sub-command ( #229 ).
2019-10-31 12:57:36 -07:00
Dan Helfman
37dc94bc79
Add test for removal of database dumps.
2019-10-23 13:36:03 -07:00
Dan Helfman
fc274b43f0
Rename "borgmatic list --pattern-from" flag to "--patterns-from" to match Borg ( #230 ).
2019-10-22 22:42:36 -07:00
Dan Helfman
9ab12e4312
Tests for database dumping ( #225 ).
2019-10-22 21:39:30 -07:00
Dan Helfman
458e7776c5
Database dump hooks for PostgreSQL, so you can easily dump your databases before backups run ( #225 ).
2019-10-22 16:28:42 -07:00
Dan Helfman
fa5fa1c11b
Move hooks into directory, so there can be one source file per type of hook ( #225 ).
2019-10-21 15:52:14 -07:00
Dan Helfman
f8bc67be8d
Config generation support for sequences of maps, needed for database dump hooks ( #225 ).
2019-10-21 15:17:47 -07:00
Dan Helfman
128ebf04ce
Dead man's switch via healthchecks.io integration ( #223 ) + new monitoring documentation.
2019-10-15 10:49:14 -07:00
Dan Helfman
7b3b28616d
Add "borgmatic list --successful" flag to only list successful (non-checkpoint) archives ( #86 ).
2019-10-13 15:58:11 -07:00
Dan Helfman
1d37b14356
More detailed error alerting via runtime context available in "on_error" hook ( #174 ).
2019-10-01 12:23:16 -07:00
Dan Helfman
6c617eddd5
When backups to one of several repositories fails, keep backing up to the other repositories ( #144 ).
2019-09-30 22:19:31 -07:00
Dan Helfman
e14ebee4e0
User-defined hooks for global setup or cleanup that run before/after all actions. ( #192 ).
2019-09-28 16:18:10 -07:00
Dan Helfman
a897ffd514
Fix "borgmatic create --progress" output so that it updates on the console in real-time ( #221 ).
2019-09-25 12:03:10 -07:00
Dan Helfman
07222cd984
Fix visibility of "borgmatic prune --stats" output ( #219 ).
2019-09-23 13:07:51 -07:00
Dan Helfman
1a1bb71af1
Fix error with "borgmatic check --only" command-line flag with "extract" consistency check ( #217 ).
2019-09-20 11:43:27 -07:00
Dan Helfman
81739791e0
Override configured consistency checks via "borgmatic check --only" command-line flag ( #210 ).
2019-09-19 11:43:53 -07:00
Dan Helfman
4cdff74e9b
Support for Borg check --verify-data flag via borgmatic "data" consistency check ( #210 ).
2019-09-18 16:52:27 -07:00
Dan Helfman
f11a9bb4aa
Revert "Fix for spurious Borg traceback when initializing a repository in an empty directory ( #201 )."
...
This reverts commit 9585c8f908
.
2019-09-14 16:14:20 -07:00
Dan Helfman
9585c8f908
Fix for spurious Borg traceback when initializing a repository in an empty directory ( #201 ).
2019-09-13 13:08:23 -07:00
Dan Helfman
c085bacccf
Reorder arguments passed to Borg to fix duplicate directories when using Borg patterns ( #213 ).
2019-09-12 15:27:04 -07:00
Dan Helfman
896401088e
Fix for traceback when the "checks" option has an empty value ( #208 ).
2019-08-26 09:52:32 -07:00
Dan Helfman
ef3dda9213
Bypass Borg error about a moved repository ( #209 ).
2019-08-26 09:39:41 -07:00
Dan Helfman
ccbd0b608b
Do not treat Borg warnings (exit code 1) as failures ( #204 ).
2019-08-03 15:13:54 -07:00
Dan Helfman
7c890be76d
Black formatting.
2019-07-27 14:08:47 -07:00
Dan Helfman
39e5aac479
If a "prefix" option in borgmatic's configuration has an empty value (blank or ""), then disable default prefix.
2019-07-27 14:04:13 -07:00
Dan Helfman
90595e9c18
Only log to syslog when run from a non-interactive console (e.g. a cron job). Related to #197 .
2019-06-27 14:41:21 -07:00
Dan Helfman
4444219e17
Support for Borg --noatime, --noctime, and --nobirthtime flags (mentioned in #193 ).
2019-06-25 11:30:55 -07:00
Dan Helfman
56fd78089d
Sort generated flags before passing them to Borg.
2019-06-25 11:04:10 -07:00
Dan Helfman
86dbc00cbe
Support for several more borgmatic/borg info command-line flags ( #193 ).
2019-06-25 10:46:55 -07:00
Dan Helfman
c644270599
Pass through several "borg list" flags ( #193 ).
2019-06-25 10:18:30 -07:00
Dan Helfman
1676a98c51
Fix for Borg create error output not showing up at borgmatic verbosity level zero ( #198 ).
2019-06-24 09:55:41 -07:00
Dan Helfman
7185146481
A bunch of tests for parse_subparser_arguments().
2019-06-23 16:06:39 -07:00
Dan Helfman
0ca43ef67a
Get tests passing.
2019-06-22 21:23:48 -07:00
Dan Helfman
603e055a39
Fix borgmatic command unit tests for new parsed arguments.
2019-06-22 16:29:25 -07:00
Dan Helfman
74ac148747
Disable console color via "color" option in borgmatic configuration output section ( #191 ).
2019-06-19 20:48:54 -07:00
Dan Helfman
b3aa6af859
Don't color syslog output ( #197 ).
2019-06-17 11:53:08 -07:00
Dan Helfman
d6d66de251
Set umask used when executing hooks via "umask" option in borgmatic hooks section ( #189 ).
2019-06-13 17:05:26 -07:00
Dan Helfman
dc43c38e29
Complete test coverage for logging branch.
2019-06-13 11:11:42 -07:00
Dan Helfman
b43ef9d76d
Move test file to correspond to its code under test.
2019-06-13 10:27:00 -07:00
Dan Helfman
28cdd67743
Error hook test.
2019-06-13 10:14:16 -07:00