nextcloud/lib/private
Christoph Fiehe 82be489f53 perf(ObjectStoreStorage): Improve (slow) move on same object bucket
This commit fixes the issue #47856. When you upload a file into a group folder and when you use a single S3 bucket as primary storage, the final move operation hangs for a long time. In the background, Nextcloud initiates a copy-delete sequence from the bucket into the bucket, with causes a lot unnecessary overhead. Nextcloud thinks that the file must be imported to another storage and does not recognize that everything is done on the same object bucket. In that case, the import step can be completely skipped, which saves time, network bandwidth and reduces the load on the object storage.

The behavior improves a lot with https://github.com/nextcloud/server/pull/46013. However, there are still some put messages that are being sent to the object storage when you use an object storage as primary storage and upload files into a group folder.

Co-authored-by: Kate <26026535+provokateurin@users.noreply.github.com>
Signed-off-by: Christoph Fiehe <c.fiehe@eurodata.de>
2024-09-19 18:53:36 +02:00
..
Accounts feat(ldap): sync additional properties to profile and SAB 2024-05-30 12:01:13 +02:00
Activity fix(activity): regroup Files and spltit sharing activity 2024-08-01 11:03:24 +02:00
App Merge pull request #47937 from nextcloud/backport/47854/stable30 2024-09-15 22:12:12 +02:00
AppFramework fix(BaseResponse): Cast XML element values to string 2024-09-15 17:18:33 +00:00
Archive chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Authentication feat(webauthn): Add user verification to webauthn challenges 2024-08-15 11:52:40 +02:00
Avatar fix: use different file name for generated dark avatars 2024-05-26 17:32:10 +02:00
BackgroundJob fix: Use sha256 to hash arguments of background jobs 2024-09-05 15:58:45 +00:00
Blurhash/Listener fix: don't persist previews used during blurhash generation 2024-07-30 09:09:26 +02:00
Broadcast/Events chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Cache Merge branch 'master' into refactor/OC-Server-getSecureRandom 2024-05-30 14:24:22 +02:00
Calendar feat(dav): Add an API for upcoming events 2024-08-13 20:03:31 +02:00
Collaboration feat(Reference): Add public API endpoints to get references 2024-07-17 12:56:41 +02:00
Command chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Comments fix(Comment): Initialize childrenCount as integer 2024-09-15 15:51:01 +00:00
Console chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Contacts/ContactsMenu chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Dashboard fix(dashboard): Document expected icon behaviour 2024-07-11 13:14:03 +00:00
DB fix: Adjust types of IQueryBuilder to properly allow joining with sub-query 2024-09-11 15:20:42 +02:00
Diagnostics feat(log): Allow to combine log.conditions to only log (app&user) 2024-07-30 13:18:09 +02:00
DirectEditing chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Encryption Merge branch 'master' into refactor/OC-Server-getEncryptionFilesHelper 2024-06-04 15:47:48 +02:00
EventDispatcher chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Federation fix(federation): Fix missing protocol on CloudID remote 2024-06-27 11:26:08 +02:00
Files perf(ObjectStoreStorage): Improve (slow) move on same object bucket 2024-09-19 18:53:36 +02:00
FilesMetadata chore: Add SPDX header 2024-05-24 13:11:22 +02:00
FullTextSearch chore: Add SPDX header 2024-05-24 13:11:22 +02:00
GlobalScale chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Group fix: Ensure database connection is setup when getting group details 2024-08-06 13:41:04 +02:00
Hooks chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Http chore: Add SPDX header 2024-05-24 13:11:22 +02:00
IntegrityCheck fix(IntegrityCheck): Ensure the check is run if no results are available 2024-07-03 11:37:49 +02:00
KnownUser chore: Add SPDX header 2024-05-24 13:11:22 +02:00
L10N feat: reduce available languages per config value "reduce_to_languages" 2024-07-01 09:34:11 +02:00
LDAP chore: Add SPDX header 2024-05-24 13:11:22 +02:00
legacy fix: Do not try to set HTTP response code on already closed connection 2024-09-14 19:22:52 +00:00
Lock chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Lockdown refactor(Token): introduce scope constants 2024-06-05 19:01:14 +02:00
Log chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Mail fix call to custom mail_template_class 2024-08-26 06:59:31 +00:00
Memcache fix: delay calculating global cache prefix untill a cache is created 2024-08-28 14:54:14 +02:00
Migration fix(migration-preview): display a message if no attributes set 2024-08-06 22:23:12 -01:00
Net chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Notification chore: Add SPDX header 2024-05-24 13:11:22 +02:00
OCM chore: Add SPDX header 2024-05-24 13:11:22 +02:00
OCS chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Preview fix(preview): gracefully handle file not being opened in ProviderV2 2024-09-10 11:27:40 +00:00
Profile chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Profiler chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Remote chore: fix some comments 2024-07-29 14:43:27 +08:00
Repair fix: implement sharding compatible cleanup for various bits 2024-08-28 14:54:14 +02:00
RichObjectStrings chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Route fix(Router): Load attribute routes of all apps when not app is specified 2024-08-27 10:51:52 +00:00
Search chore: Remove deprecated legacy search backend 2024-08-01 12:33:18 +02:00
Security feat: Provide CSP nonce as <meta> element 2024-08-13 10:32:44 +02:00
Session fix(setup): ignore long session login during installation 2024-08-27 19:14:03 +00:00
Settings chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Setup Merge branch 'master' into refactor/OC-Server-getSecureRandom 2024-05-30 14:24:22 +02:00
SetupCheck chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Share chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Share20 fix: fix share cleanup for deleted groups with sharding 2024-08-28 14:54:14 +02:00
SpeechToText fix(SpeechToTextManager): Throw TaskProcessing Task failed 2024-08-30 14:06:15 +02:00
Support chore: Add SPDX header 2024-05-24 13:11:22 +02:00
SystemTag fix: removed unused variable and check if tag ids are empty before starting the inserts 2024-06-19 12:52:46 +02:00
Tagging chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Talk chore: Add SPDX header 2024-05-24 13:11:22 +02:00
TaskProcessing fix(TaskProcessing): increase error_message column length 2024-09-06 13:26:24 +00:00
Teams fix: Avoid throwing errors for teams are unavailable 2024-06-24 12:29:43 +02:00
Template feat: Provide CSP nonce as <meta> element 2024-08-13 10:32:44 +02:00
TextProcessing fix(TextProcessing): Don't run taskProcessing if task type is not available 2024-08-30 14:06:15 +02:00
TextToImage chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Translation chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Updater feat(migration-attributes): tests 2024-07-29 12:44:52 -01:00
User fix(SetupCheck): Properly check public access to data directory 2024-08-08 22:08:42 +02:00
UserStatus chore: Add SPDX header 2024-05-24 13:11:22 +02:00
AllConfig.php fix(config): Throw PreconditionException always when it didn't match 2024-09-13 11:40:13 +00:00
AppConfig.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
AppScriptDependency.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
AppScriptSort.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
BinaryFinder.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
CapabilitiesManager.php perf(capabilities): Log capabilities providers that are slow 2024-06-21 11:41:22 +02:00
Color.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Config.php fix: switch from explode to substr (faster) 2024-09-16 15:06:03 +00:00
ContactsManager.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
DatabaseException.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
DatabaseSetupException.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
DateTimeFormatter.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
DateTimeZone.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
EmojiHelper.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
EventSource.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
EventSourceFactory.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
ForbiddenException.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
HintException.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
InitialStateService.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Installer.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
LargeFileHelper.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Log.php feat(log): Allow to combine log.conditions to only log (app&user) 2024-07-30 13:18:09 +02:00
MemoryInfo.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
NaturalSort.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
NaturalSort_DefaultCollator.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
NavigationManager.php fix(NavigationManager): Make entry order always an integer 2024-05-30 17:00:32 +02:00
NeedsUpdateException.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
NotSquareException.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
PhoneNumberUtil.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
PreviewManager.php feat(preview): move previews for imaginary pdf to own class ImaginaryPDF 2024-07-25 17:01:01 +02:00
PreviewNotAvailableException.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
RedisFactory.php feat: add config flag to toggle persistent redis connections 2024-07-22 14:25:20 +02:00
Repair.php fix(SetupCheck): Properly check public access to data directory 2024-08-08 22:08:42 +02:00
RepairException.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Server.php chore: Use IAppConfig instead of IConfig->getAppValue 2024-09-11 15:20:23 +02:00
ServerContainer.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
ServerNotAvailableException.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
ServiceUnavailableException.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Setup.php fix(a11y): Add OTF font loading check 2024-09-16 09:26:59 +00:00
Streamer.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
StreamImage.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
SubAdmin.php feat(users): Add support for admin delegation for users and groups management 2024-07-22 17:17:35 +02:00
SystemConfig.php fix: mark systemconfig value as not being tainted because they are implicitly trusted 2024-08-28 14:54:14 +02:00
TagManager.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Tags.php fix(Tags): Return boolean for userHasTags() 2024-09-15 15:52:40 +00:00
TemplateLayout.php fix: Support Safari mobile 2024-08-21 12:33:53 +00:00
TempManager.php chore: Add SPDX header 2024-05-24 13:11:22 +02:00
Updater.php fix(SetupCheck): Properly check public access to data directory 2024-08-08 22:08:42 +02:00
URLGenerator.php fix(setup-checks): Ensure URL with webroot works 2024-09-15 21:40:27 +02:00