Commit graph

1411 commits

Author SHA1 Message Date
Robin Appelman
a1db2021ee feat: add option to enable s3 acceleration
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-04-26 14:46:15 +00:00
Robin Appelman
eecd52628d fix: disable the internal s3sdk multi part copy logic
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-04-18 11:41:10 +02:00
Joas Schilling
7203ce22ac
fix(CI): Suppress psalm UndefinedClass
Signed-off-by: Joas Schilling <coding@schilljs.com>
2024-04-18 09:39:39 +02:00
Joas Schilling
2a33e94131 fix(files): Also skip cross storage move with access control
Signed-off-by: Joas Schilling <coding@schilljs.com>
2024-04-17 14:34:13 +00:00
Julius Härtl
fb08724486
perf: Avoid updating the folder size if we know the size difference
Signed-off-by: Julius Härtl <jus@bitgrid.net>
2024-04-09 15:45:05 +02:00
Robin Appelman
93cc59c5df
fix: use proper jailed patch in watcher
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-04-09 13:20:38 +02:00
Robin Appelman
f85ce2d803
Merge pull request #44508 from nextcloud/backport/39367/stable27
[stable27] handle more exceptions in AmazonS3::fopen
2024-04-03 13:33:32 +02:00
Louis Chemineau
ee14e2f965 feat(files)): Add retry logic to cover deadlock situations when moving many files
Signed-off-by: Louis Chemineau <louis@chmn.me>
2024-03-28 15:29:03 +01:00
Robin Appelman
e5f373c272
fix SeekableHttpStream::stream_stat errors on failed open
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-03-27 17:11:22 +01:00
Robin Appelman
680323216a fix: log error when default getWrapperStorage would return null
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-03-22 19:44:47 +00:00
Robin Appelman
406a59ccae
fix: add some recrusive detection/prevention
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-03-19 15:02:30 +01:00
Robin Appelman
1569469b70 fix: ensure nested mount points are handled in the correct order
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-03-18 18:01:53 +00:00
Benjamin Gaussorgues
63e5b6fb95 fix: avoid scanning a non existing directory
Signed-off-by: Benjamin Gaussorgues <benjamin.gaussorgues@nextcloud.com>
2024-03-14 18:45:53 +00:00
hopleus
deeca104f0 Refactoring getName function
Signed-off-by: hopleus <hopleus@gmail.com>
2024-03-14 14:53:43 +00:00
hopleus
591c2cb01a Fixes for getting the file name in the cases when the file name key is received, but it is empty
Signed-off-by: hopleus <hopleus@gmail.com>
2024-03-14 14:53:43 +00:00
Julius Härtl
d718a2adb1 fix: Throw instead of yielding nothing when listing local directories
Signed-off-by: Julius Härtl <jus@bitgrid.net>
2024-02-26 07:45:04 +00:00
Benjamin Gaussorgues
92df765457
Merge pull request #43246 from nextcloud/backport/41327/stable27 2024-02-09 10:31:11 +01:00
Git'Fellow
ef786616ec
Merge pull request #43390 from nextcloud/backport/43131/stable27
[stable27] fix(files): Don't attempt to format a partial cache entry
2024-02-09 10:25:03 +01:00
Robin Appelman
00b9002785 continue background scanning different storages if one fails
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-02-07 09:07:40 +00:00
Christoph Wurst
d4e01fb0a1 fix(files): Don't attempt to format a partial cache entry
Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>
2024-02-06 12:52:45 +00:00
Robin Appelman
7c8d71d0a0 also updated parent etags when a changed etag is detected during scanning
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-01-31 18:28:05 +00:00
Robin Appelman
90c57a6700 dont reuse etag for folders marked explicitly unscanned
Signed-off-by: Robin Appelman <robin@icewind.nl>
2024-01-31 18:28:05 +00:00
Git'Fellow
6b496ab164
fix: reduce memory consumption of scans
Signed-off-by: Git'Fellow <12234510+solracsf@users.noreply.github.com>

Fix lint

Signed-off-by: Git'Fellow <12234510+solracsf@users.noreply.github.com>
2024-01-16 09:29:09 +01:00
Julius Härtl
f5fe531665 fix(s3): Add config option to disable multipart copy for certain s3 providers
Signed-off-by: Julius Härtl <jus@bitgrid.net>
2023-12-29 10:48:40 +00:00
Robin Appelman
ad5be4f04b only do a multipart s3 copy when above the regular copy limit
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-12-29 10:48:40 +00:00
Robin Appelman
15bed77a22 setup filesystem wrappers before we mark the root as setup
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-12-05 09:47:03 +01:00
Robin Appelman
fbc0f65711 add more checks to ensure mounts aren't empty
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-12-05 09:47:03 +01:00
Marcel Klehr
76265de3f1 fix(TemplateManager): Bail early if templatedirectory is empty
fixes #39266

Signed-off-by: Marcel Klehr <mklehr@gmx.net>
2023-12-04 10:12:53 +00:00
Arthur Schiwon
52eddf8675
Merge pull request #41462 from nextcloud/backport/40996/stable27
[stable27] reuse sharing disabled state when listing folder content
2023-11-28 11:33:04 +01:00
Robin Appelman
43ef6da11e
optimize UserMountCache::registerStorage
Signed-off-by: Robin Appelman <robin@icewind.nl>
Signed-off-by: Benjamin Gaussorgues <benjamin.gaussorgues@nextcloud.com>
2023-11-16 16:40:57 +01:00
Benjamin Gaussorgues
902ba76d30
Merge pull request #41502 from nextcloud/backport/40935/stable27
[stable27] add some support for rename on case insensitive local filesystems
2023-11-16 16:34:12 +01:00
Benjamin Gaussorgues
1af4301997
Merge pull request #41363 from nextcloud/optmize-storage-wrappers-27
[27] optimize builtin storage wrappers
2023-11-16 14:21:56 +01:00
Robin Appelman
482deca354
add some support for rename on case insensitive local filesystems
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-11-15 15:21:14 +01:00
Tobias Zimmerer
8970f96e3b fix(s3): support SSE-C headers for the MultipartCopy call
Signed-off-by: Tobias Zimmerer <3228193+ir0nhide@users.noreply.github.com>
2023-11-15 07:37:09 +00:00
Robin Appelman
0c88d5b303 reuse sharing disabled state when listing folder content
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-11-14 14:28:16 +00:00
Robin Appelman
81d625d44d
optimize isShared and isMounted
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-11-09 15:42:41 +01:00
Robin Appelman
bdba3f1e2f
optimize builtin storage wrappers
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-11-09 15:41:01 +01:00
Robin Appelman
204aedc606 optimize cache jail creation
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-11-07 13:59:32 +00:00
Jonas
9ed1bbee5c enh(IMountManager): Add method to get MountPoint from CachedMountInfo
Signed-off-by: Jonas <jonas@freesources.org>
2023-10-26 22:21:08 +02:00
Arthur Schiwon
a722274c60
Merge pull request #40569 from nextcloud/backport/40499/stable27
[stable27] add wrapper for external storage to ensure we don't get an mtime that is lower than we know it is
2023-10-11 10:06:29 +02:00
Julius Härtl
1f4fffc258
Merge pull request #40577 from nextcloud/s3-multipart-copy-27 2023-10-10 19:22:53 +02:00
Robin Appelman
36eef0be67 add wrapper to ensure we don't get an mtime that is lower than we know it is
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-10-10 09:34:20 +02:00
Côme Chilliet
e0eb9a8ce9 Store size in int|float for 32bit support
Signed-off-by: Côme Chilliet <come.chilliet@nextcloud.com>
2023-09-25 15:14:31 +00:00
Robin Appelman
22556a67a8 use multipart copy for s3
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-09-22 10:42:07 +02:00
Arthur Schiwon
21f8cc8847
Merge pull request #40379 from nextcloud/backport/38808/stable27
[stable27] Fix issues where unencrypted_size was being falsely used for non-encrypted home folders
2023-09-21 10:55:43 +02:00
Lucas Azevedo
cfae699d6e Wrap mimetype insert and getLastInsertId in a transaction
Signed-off-by: Lucas Azevedo <lhs_azevedo@hotmail.com>
2023-09-16 19:31:27 +00:00
Lucas Azevedo
f0a1716bb5 fix(mimetype): Remove unnecessary transaction when storing a mime type
Fixes #40064.

This could be fixed by adding a rollback and starting a new transaction
before the SELECT query, but in this case that would have the same
effect as not using one.
See https://dev.mysql.com/doc/refman/8.0/en/innodb-autocommit-commit-rollback.html
and https://www.postgresql.org/docs/7.1/sql-begin.html#R1-SQL-BEGIN-1

Signed-off-by: Lucas Azevedo <lhs_azevedo@hotmail.com>
2023-09-16 19:31:26 +00:00
Julius Härtl
fd6990a33b
fix: Only read unencrypted_size when file is actually encrypted
Signed-off-by: Julius Härtl <jus@bitgrid.net>
2023-09-12 15:05:16 +02:00
Julius Härtl
b14967cb2c
fix: Only store unencrypted_size if path should be encrypted
Signed-off-by: Julius Härtl <jus@bitgrid.net>
2023-09-12 15:05:13 +02:00
Robin Appelman
ee8c1a5c60
only determine quota_include_external_storage once for quota wrapper
Signed-off-by: Robin Appelman <robin@icewind.nl>
2023-09-07 16:25:23 +02:00