Commit graph

1421 commits

Author SHA1 Message Date
Andy Scherzinger
77f00ae812
Merge pull request #45681 from nextcloud/test-scanner-no-transactions-27
[27] feat: add option to disable scanner transactions
2024-06-13 18:33:33 +02:00
Robin Appelman
0396fe3816 fix: get child ids for folder in a separate query during move
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-06-13 09:44:20 +00:00
Arthur Schiwon
cb6325651a
Merge pull request #45838 from nextcloud/backport/45649/stable27
[stable27] fix(ObjectStore): Fix regression when hostname is empty
2024-06-13 11:34:26 +02:00
Josh
3fde98d71c fix(ObjectStore): handle empty S3 hostname
Fixes #45637

The support for s3-accelerate added in #44496 introduced a regression in AWS S3 environments when `hostname` is blank (which is a valid configuration w/ AWS since the hostname gets auto-generated).

Signed-off-by: Josh <josh.t.richards@gmail.com>
2024-06-12 20:57:49 +00:00
Louis Chemineau
3da39308cd fix(files): Use isRetryable to catch retryable exceptions
Signed-off-by: Louis Chemineau <louis@chmn.me>
2024-06-12 08:13:20 +00:00
John Molakvoæ
d457d9f29f
Merge pull request #45527 from nextcloud/backport/45014/stable27 2024-06-07 12:19:03 +02:00
Robin Appelman
6c4e74b6ec
feat: add option to disable scanner transactions
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-06-05 19:18:50 +02:00
Git'Fellow
7ae086b63f
Fix backport
Signed-off-by: Git'Fellow <12234510+solracsf@users.noreply.github.com>
2024-05-27 19:21:03 +02:00
Robin Appelman
7cb1ebacb9 fix: forbid moving a folder into a subfolder of itself
Signed-off-by: Robin Appelman <robin@icewind.nl>

[skip ci]
2024-05-27 12:30:39 +00:00
Christoph Wurst
b226039fe9 perf(db): Sort data for IN before chunking
Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>
2024-05-25 20:50:56 -04:00
Robin Appelman
a1db2021ee feat: add option to enable s3 acceleration
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-04-26 14:46:15 +00:00
Robin Appelman
eecd52628d fix: disable the internal s3sdk multi part copy logic
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-04-18 11:41:10 +02:00
Joas Schilling
7203ce22ac
fix(CI): Suppress psalm UndefinedClass
Signed-off-by: Joas Schilling <coding@schilljs.com>
2024-04-18 09:39:39 +02:00
Joas Schilling
2a33e94131 fix(files): Also skip cross storage move with access control
Signed-off-by: Joas Schilling <coding@schilljs.com>
2024-04-17 14:34:13 +00:00
Julius Härtl
fb08724486
perf: Avoid updating the folder size if we know the size difference
Signed-off-by: Julius Härtl <jus@bitgrid.net>
2024-04-09 15:45:05 +02:00
Robin Appelman
93cc59c5df
fix: use proper jailed patch in watcher
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-04-09 13:20:38 +02:00
Robin Appelman
f85ce2d803
Merge pull request #44508 from nextcloud/backport/39367/stable27
[stable27] handle more exceptions in AmazonS3::fopen
2024-04-03 13:33:32 +02:00
Louis Chemineau
ee14e2f965 feat(files)): Add retry logic to cover deadlock situations when moving many files
Signed-off-by: Louis Chemineau <louis@chmn.me>
2024-03-28 15:29:03 +01:00
Robin Appelman
e5f373c272
fix SeekableHttpStream::stream_stat errors on failed open
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-03-27 17:11:22 +01:00
Robin Appelman
680323216a fix: log error when default getWrapperStorage would return null
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-03-22 19:44:47 +00:00
Robin Appelman
406a59ccae
fix: add some recrusive detection/prevention
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-03-19 15:02:30 +01:00
Robin Appelman
1569469b70 fix: ensure nested mount points are handled in the correct order
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-03-18 18:01:53 +00:00
Benjamin Gaussorgues
63e5b6fb95 fix: avoid scanning a non existing directory
Signed-off-by: Benjamin Gaussorgues <benjamin.gaussorgues@nextcloud.com>
2024-03-14 18:45:53 +00:00
hopleus
deeca104f0 Refactoring getName function
Signed-off-by: hopleus <hopleus@gmail.com>
2024-03-14 14:53:43 +00:00
hopleus
591c2cb01a Fixes for getting the file name in the cases when the file name key is received, but it is empty
Signed-off-by: hopleus <hopleus@gmail.com>
2024-03-14 14:53:43 +00:00
Julius Härtl
d718a2adb1 fix: Throw instead of yielding nothing when listing local directories
Signed-off-by: Julius Härtl <jus@bitgrid.net>
2024-02-26 07:45:04 +00:00
Benjamin Gaussorgues
92df765457
Merge pull request #43246 from nextcloud/backport/41327/stable27 2024-02-09 10:31:11 +01:00
Git'Fellow
ef786616ec
Merge pull request #43390 from nextcloud/backport/43131/stable27
[stable27] fix(files): Don't attempt to format a partial cache entry
2024-02-09 10:25:03 +01:00
Robin Appelman
00b9002785 continue background scanning different storages if one fails
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-02-07 09:07:40 +00:00
Christoph Wurst
d4e01fb0a1 fix(files): Don't attempt to format a partial cache entry
Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>
2024-02-06 12:52:45 +00:00
Robin Appelman
7c8d71d0a0 also updated parent etags when a changed etag is detected during scanning
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-01-31 18:28:05 +00:00
Robin Appelman
90c57a6700 dont reuse etag for folders marked explicitly unscanned
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-01-31 18:28:05 +00:00
Git'Fellow
6b496ab164
fix: reduce memory consumption of scans
Signed-off-by: Git'Fellow <12234510+solracsf@users.noreply.github.com>

Fix lint

Signed-off-by: Git'Fellow <12234510+solracsf@users.noreply.github.com>
2024-01-16 09:29:09 +01:00
Julius Härtl
f5fe531665 fix(s3): Add config option to disable multipart copy for certain s3 providers
Signed-off-by: Julius Härtl <jus@bitgrid.net>
2023-12-29 10:48:40 +00:00
Robin Appelman
ad5be4f04b only do a multipart s3 copy when above the regular copy limit
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-12-29 10:48:40 +00:00
Robin Appelman
15bed77a22 setup filesystem wrappers before we mark the root as setup
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-12-05 09:47:03 +01:00
Robin Appelman
fbc0f65711 add more checks to ensure mounts aren't empty
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-12-05 09:47:03 +01:00
Marcel Klehr
76265de3f1 fix(TemplateManager): Bail early if templatedirectory is empty
fixes #39266

Signed-off-by: Marcel Klehr <mklehr@gmx.net>
2023-12-04 10:12:53 +00:00
Arthur Schiwon
52eddf8675
Merge pull request #41462 from nextcloud/backport/40996/stable27
[stable27] reuse sharing disabled state when listing folder content
2023-11-28 11:33:04 +01:00
Robin Appelman
43ef6da11e
optimize UserMountCache::registerStorage
Signed-off-by: Robin Appelman <robin@icewind.nl>
Signed-off-by: Benjamin Gaussorgues <benjamin.gaussorgues@nextcloud.com>
2023-11-16 16:40:57 +01:00
Benjamin Gaussorgues
902ba76d30
Merge pull request #41502 from nextcloud/backport/40935/stable27
[stable27] add some support for rename on case insensitive local filesystems
2023-11-16 16:34:12 +01:00
Benjamin Gaussorgues
1af4301997
Merge pull request #41363 from nextcloud/optmize-storage-wrappers-27
[27] optimize builtin storage wrappers
2023-11-16 14:21:56 +01:00
Robin Appelman
482deca354
add some support for rename on case insensitive local filesystems
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-11-15 15:21:14 +01:00
Tobias Zimmerer
8970f96e3b fix(s3): support SSE-C headers for the MultipartCopy call
Signed-off-by: Tobias Zimmerer <3228193+ir0nhide@users.noreply.github.com>
2023-11-15 07:37:09 +00:00
Robin Appelman
0c88d5b303 reuse sharing disabled state when listing folder content
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-11-14 14:28:16 +00:00
Robin Appelman
81d625d44d
optimize isShared and isMounted
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-11-09 15:42:41 +01:00
Robin Appelman
bdba3f1e2f
optimize builtin storage wrappers
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-11-09 15:41:01 +01:00
Robin Appelman
204aedc606 optimize cache jail creation
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-11-07 13:59:32 +00:00
Jonas
9ed1bbee5c enh(IMountManager): Add method to get MountPoint from CachedMountInfo
Signed-off-by: Jonas <jonas@freesources.org>
2023-10-26 22:21:08 +02:00
Arthur Schiwon
a722274c60
Merge pull request #40569 from nextcloud/backport/40499/stable27
[stable27] add wrapper for external storage to ensure we don't get an mtime that is lower than we know it is
2023-10-11 10:06:29 +02:00