Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extremely long-named nested folders corrupt filecache.path on move #5477

Closed
carboneater opened this issue Jun 20, 2017 · 10 comments
Closed

Extremely long-named nested folders corrupt filecache.path on move #5477

carboneater opened this issue Jun 20, 2017 · 10 comments
Labels
0. Needs triage Pending check for reproducibility or if it fits our roadmap bug

Comments

@carboneater
Copy link

Steps to reproduce

  1. (Works both on shared folders and personal folders. However, shared folders seem to make the bug easier to trigger.)
    0.1. (The easiest cue that the bug triggered (database file descriptors corrupted) is that the files shown on the web interface are now duplicated, and show their full path instead of filenames.)
  2. Create a new subdirectory with an extremely long name. (Having a space or internationalized character in its name also helps trigger that bug)
    1.1. Repeat step 1 until you have at least 3-4 nested directories
  3. Create a new nested directory named "target" and one named "subdir"
  4. In target, create a few dummy text files. Use Lorem/Bacon Ipsum for payload.
  5. Move folder target into subdir
    4.1. (Sometimes that is enough to trigger the bug. Have a look (on the web interface) at the contents of the target directory)
  6. Move folder target back one level (out of subdir)
    5.1. (This usually triggers the bug. Have a look (on the web interface) at the contents of the target directory)
  7. Add a nested directory (1) and repeat steps 4-5.
    6.1. Repeat until file descriptors break in database.

Expected behaviour

Moving folder moves with its contents unchanged. Mostly.
(Like we'd expect the mv command to do.)

Actual behaviour

Moving folders in a deeply-nested subfolder (as is common in an enterprise environment) can cause an error when updating the filecache.path field, which breaks the link between the database entry for a given file and the file on the filesystem. (File on filesystem is where we expect it to be.)
When browsing into the subfolder with the web interface, it looks like the system re-scans that folder on the filesystem and re-recreates an entry in the database to match the orphaned file on the filesystem. (Or something, the two database entries are identical but for fileid, path and path_hash)
On the web interface, these two entries for the same file will show a duplicated file, and will print the full filepath instead of the filename.

(It may also serve as root cause for #5449 )

Server configuration

Operating system:
Linux sleipnir 4.9.0-2-amd64 #1 SMP Debian 4.9.18-1 (2017-03-30) x86_64 GNU/Linux

Web server:
NGINX 1.10.3-1

Database:
mariadb 10.1.23-9+deb9u1

PHP version:
PHP7.0.19-1 FPM

Nextcloud version: (see Nextcloud admin page)
12.0.0.29

Updated from an older Nextcloud/ownCloud or fresh install:
Updated from NC 11 to NC12 on release date.

Where did you install Nextcloud from:
Updater Module in NC

Signing status:

Signing status No errors have been found.

List of activated apps:

App list Enabled: - activity: 2.5.2 - bruteforcesettings: 1.0.2 - comments: 1.2.0 - dav: 1.3.0 - federatedfilesharing: 1.2.0 - federation: 1.2.0 - files: 1.7.2 - files_markdown: 1.0.1 - files_pdfviewer: 1.1.1 - files_sharing: 1.4.0 - files_texteditor: 2.4.1 - files_trashbin: 1.2.0 - files_versions: 1.5.0 - files_videoplayer: 1.1.0 - firstrunwizard: 2.1 - gallery: 17.0.0 - logreader: 2.0.0 - lookup_server_connector: 1.0.0 - nextcloud_announcements: 1.1 - notifications: 2.0.0 - oauth2: 1.0.5 - password_policy: 1.2.2 - provisioning_api: 1.2.0 - serverinfo: 1.2.0 - sharebymail: 1.2.0 - survey_client: 1.0.0 - systemtags: 1.2.0 - theming: 1.3.0 - twofactor_backupcodes: 1.1.1 - updatenotification: 1.2.0 - user_ldap: 1.2.1 - workflowengine: 1.2.0 Disabled: - admin_audit - encryption - files_external - user_external

Nextcloud configuration:

Config report { "system": { "updatechecker": false, "instanceid": "oc6n6tqq77xl", "passwordsalt": "***REMOVED SENSITIVE VALUE***", "secret": "***REMOVED SENSITIVE VALUE***", "trusted_domains": [ "tsunami.ageg.ca", "nextcloud.ageg.ca" ], "datadirectory": "\/srv\/owncloud\/data", "overwrite.cli.url": "https:\/\/tsunami.ageg.ca", "dbhost": "localhost", "dbname": "nextcloud", "dbtype": "mysql", "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "dbtableprefix": "oc_", "version": "12.0.0.29", "logtimezone": "UTC", "installed": true, "theme": "", "forcessl": true, "forceSSLforSubdomains": true, "openssl": { "config": "\/etc\/ssl\/openssl.cnf" }, "memcache.local": "\\OC\\Memcache\\Redis", "memcache.locking": "\\OC\\Memcache\\Redis", "redis": { "host": "127.0.0.1", "port": 6379 }, "mail_smtpmode": "smtp", "mail_smtpsecure": "tls", "mail_from_address": "serveur", "mail_domain": "ageg.ca", "mail_smtpauthtype": "PLAIN", "mail_smtpauth": 1, "mail_smtphost": "sleipnir.ageg.ca", "mail_smtpport": "587", "mail_smtpname": "***REMOVED SENSITIVE VALUE***", "mail_smtppassword": "***REMOVED SENSITIVE VALUE***", "ldapIgnoreNamingRules": false, "loglevel": 0, "maintenance": false, "trashbin_retention_obligation": "auto", "htaccess.RewriteBase": "\/", "ldapProviderFactory": "\\OCA\\User_LDAP\\LDAPProviderFactory", "updater.release.channel": "stable" } }

Are you using external storage, if yes which one: local storage on filesystem (outside of \var\www\nextcloud folder)

Are you using encryption: not in nextcloud

Are you using an external user-backend, if yes which one: LDAP

LDAP configuration (delete this part if not used)

LDAP config +-------------------------------+------------------------------------------------------------+ | Configuration | s01 | +-------------------------------+------------------------------------------------------------+ | hasMemberOfFilterSupport | | | hasPagedResultSupport | | | homeFolderNamingRule | | | lastJpegPhotoLookup | 0 | | ldapAgentName | cn=nextcloud,ou=services,dc=ageg,dc=ca | | ldapAgentPassword | *** | | ldapAttributesForGroupSearch | | | ldapAttributesForUserSearch | | | ldapBackupHost | | | ldapBackupPort | | | ldapBase | dc=ageg,dc=ca | | ldapBaseGroups | dc=ageg,dc=ca | | ldapBaseUsers | dc=ageg,dc=ca | | ldapCacheTTL | 600 | | ldapConfigurationActive | 1 | | ldapDefaultPPolicyDN | | | ldapDynamicGroupMemberURL | | | ldapEmailAttribute | mail | | ldapExperiencedAdmin | 0 | | ldapExpertUUIDGroupAttr | | | ldapExpertUUIDUserAttr | | | ldapExpertUsernameAttr | | | ldapGidNumber | gidNumber | | ldapGroupDisplayName | cn | | ldapGroupFilter | | | ldapGroupFilterGroups | | | ldapGroupFilterMode | 0 | | ldapGroupFilterObjectclass | | | ldapGroupMemberAssocAttr | uniqueMember | | ldapHost | ldapi:/// | | ldapIgnoreNamingRules | | | ldapLoginFilter | (&(|(objectclass=inetOrgPerson))(|(uid=%uid)(|(cn=%uid)))) | | ldapLoginFilterAttributes | cn | | ldapLoginFilterEmail | 0 | | ldapLoginFilterMode | 0 | | ldapLoginFilterUsername | 1 | | ldapNestedGroups | 0 | | ldapOverrideMainServer | | | ldapPagingSize | 500 | | ldapPort | 389 | | ldapQuotaAttribute | | | ldapQuotaDefault | | | ldapTLS | 0 | | ldapUserDisplayName | displayname | | ldapUserDisplayName2 | | | ldapUserFilter | (|(objectclass=inetOrgPerson)) | | ldapUserFilterGroups | | | ldapUserFilterMode | 0 | | ldapUserFilterObjectclass | inetOrgPerson | | ldapUuidGroupAttribute | auto | | ldapUuidUserAttribute | auto | | turnOffCertCheck | 0 | | turnOnPasswordChange | 0 | | useMemberOfToDetectMembership | 1 | +-------------------------------+------------------------------------------------------------+

Client configuration

Browser:
Chromium 59.0.3071.86 (Developer Build) (64-bit)
Firefox 52.0.2 (64-bit)

Operating system:
Debian 4.9.30-2 (2017-06-12) x86_64 GNU/Linux

Logs

Web server error log

Web server error log 10.236.34.39 - - [19/Jun/2017:21:45:15 -0400] "MOVE /remote.php/webdav/SHARED/new HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:21:45:25 -0400] "MOVE /remote.php/webdav/SHARED/test HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:21:45:26 -0400] "MOVE /remote.php/webdav/SHARED/sha512.sig HTTP/2.0" 201 461 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:21:45:29 -0400] "MOVE /remote.php/webdav/SHARED/Int3rn%40tionalis%C3%A9/sha512.sig HTTP/2.0" 201 461 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - carboneater [19/Jun/2017:22:32:22 -0400] "MOVE /remote.php/dav/files/1249d780-705f-1036-960a-c1e8ddd96a57/SHARED/Int3rn@tionalis%C3%A9/test HTTP/1.1" 201 0 "-" "Mozilla/5.0 (Linux) mirall/2.3.1 (Nextcloud)" 10.236.34.39 - carboneater [19/Jun/2017:22:32:26 -0400] "MOVE /remote.php/dav/files/1249d780-705f-1036-960a-c1e8ddd96a57/SHARED/Int3rn@tionalis%C3%A9/new HTTP/1.1" 201 0 "-" "Mozilla/5.0 (Linux) mirall/2.3.1 (Nextcloud)" 10.236.34.39 - carboneater [19/Jun/2017:22:32:31 -0400] "MOVE /remote.php/dav/files/1249d780-705f-1036-960a-c1e8ddd96a57/SHARED/Int3rn@tionalis%C3%A9/test%20spaced/new HTTP/1.1" 201 0 "-" "Mozilla/5.0 (Linux) mirall/2.3.1 (Nextcloud)" 10.236.34.39 - - [19/Jun/2017:22:33:41 -0400] "MOVE /remote.php/webdav/SHARED/Int3rn%40tionalis%C3%A9/test%20spaced HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:38:35 -0400] "MOVE /remote.php/webdav/TESTFLDR HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:39:07 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGNAME/TESTFLDR2 HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:43:35 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAME/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGNAME HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:44:05 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAME/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGNAMEANDMOVED HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:45:01 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAME/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGNAMEANDMOVED%20WITH%20A%20SPACE%20IN%20ITS%20NAME/TEST HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:45:11 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAME/TEST HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:46:31 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGNAME HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:46:43 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGINTERNATION%40LIZEDNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAME/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGNAMEANDMOVED%20WITH%20A%20SPACE%20IN%20ITS%20NAME/TEST HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:46:48 -0400] "MOVE /remote.php/webdav/TEST HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:47:11 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGINTERNATION%40LIZEDNAME/TEST HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:47:26 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGINTERNATION%40LIZEDNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAME/TEST HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:47:54 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGINTERNATION%40LIZEDNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAME/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGNAMEANDMOVED%20WITH%20A%20SPACE%20IN%20ITS%20NAME HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:48:36 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGINTERNATION%40LIZEDNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAME HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:49:52 -0400] "MOVE /remote.php/webdav/SHARED/Int3rn%40tionalis%C3%A9/test%20Long%20Intern%40tionalized%20spaced%20Name/New%20folder%20in%20test%20scenario HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:49:55 -0400] "MOVE /remote.php/webdav/SHARED/Int3rn%40tionalis%C3%A9/New%20folder%20in%20test%20scenario HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:50:38 -0400] "MOVE /remote.php/webdav/SHARED/Int3rn%40tionalis%C3%A9/new HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:52:37 -0400] "MOVE /remote.php/webdav/SHARED/Int3rn%40tionalis%C3%A9/TESTEXTREMELELYLONGWINDEDALLCAPSFOLDERNAME/ALSOANOTHERUNUSUALLYLONGFOLDERNAME/LOREM%20IPSUM HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:52:45 -0400] "MOVE /remote.php/webdav/SHARED/Int3rn%40tionalis%C3%A9/TESTEXTREMELELYLONGWINDEDALLCAPSFOLDERNAME/LOREM%20IPSUM HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:54:09 -0400] "MOVE /remote.php/webdav/SHARED/Int3rn%40tionalis%C3%A9/TESTEXTREMELELYLONGWINDEDALLCAPSFOLDERNAME/ALSOANOTHERUNUSUALLYLONGFOLDERNAME/LIPSUM HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:58:00 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDER HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:58:06 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/TESTFOLDER HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:58:26 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDER HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:58:29 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDER%20WITH%20A%20SPACED%20NAME HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:58:36 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/TESTFOLDER%20WITH%20A%20SPACED%20NAME HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:59:04 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDER%20WITH%20A%20SPACED%20NAME HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:59:15 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDERWITHOUTASPACEDNAME/bacon.txt HTTP/2.0" 201 463 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:59:17 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDERWITHOUTASPACEDNAME/lipsum.txt HTTP/2.0" 201 461 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:59:28 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDERWITHOUTASPACEDNAME/SUBFOLDER HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:22:59:34 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/SUBFOLDER HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:23:01:16 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDERWITHOUTASPACEDNAME/INTERN%40TIONALIS%C3%89 HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:23:01:22 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDERWITHOUTASPACEDNAME/SUBFOLDER/INTERN%40TIONALIS%C3%89 HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:23:02:04 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDERWITHOUTASPACEDNAME/SUBFOLDER HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:23:02:10 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDERWITHOUTASPACEDNAME/SUBSUBFOLDER/SUBFOLDER HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:23:03:16 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDERWITHOUTASPACEDNAME/SUBSUBFOLDER HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:23:03:22 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDERWITHOUTASPACEDNAME/SUBFOLDER HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:23:03:29 -0400] "MOVE /remote.php/webdav/SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDERWITHOUTASPACEDNAME/SUB%20SUB%20FOLDER/SUBFOLDER HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:23:08:13 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGINTERNATION%40LIZEDNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAMEWITHAN%C3%89INITSNAME/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGINTERNATION%40LIZEDNAMEANDMOVED%20WITH%20A%20SPACE%20IN%20ITS%20NAME/TEST HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:23:08:20 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGINTERNATION%40LIZEDNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAMEWITHAN%C3%89INITSNAME/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGINTERNATION%40LIZEDNAMEANDMOVED%20WITH%20A%20SPACE%20IN%20ITS%20NAME/TEST%20Spaced HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:23:08:44 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGINTERNATION%40LIZEDNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAMEWITHAN%C3%89INITSNAME/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGINTERNATION%40LIZEDNAMEANDMOVED%20WITH%20A%20SPACE%20IN%20ITS%20NAME/SUB%20Folder HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 104.163.176.51 - - [19/Jun/2017:23:13:17 -0400] "MOVE /remote.php/webdav/Oktoberfest%20XVII%20(2017)/S%C3%A9curit%C3%A9/Intervension HTTP/2.0" 201 397 "-" "Mozilla/5.0 (Windows NT 10.0; WOW64; rv:53.0) Gecko/20100101 Firefox/53.0" 10.236.34.39 - - [19/Jun/2017:23:19:00 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGINTERNATION%40LIZEDNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAMEWITHAN%C3%89INITSNAME/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGINTERNATION%40LIZEDNAMEANDMOVED%20WITH%20A%20SPACE%20IN%20ITS%20NAME/Folder/New HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:23:19:05 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGINTERNATION%40LIZEDNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAMEWITHAN%C3%89INITSNAME/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGINTERNATION%40LIZEDNAMEANDMOVED%20WITH%20A%20SPACE%20IN%20ITS%20NAME/Folder/subfolder/New HTTP/2.0" 201 397 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" 10.236.34.39 - - [19/Jun/2017:23:55:56 -0400] "MOVE /remote.php/webdav/TESTFLDRWITHAVERYLONGINTERNATION%40LIZEDNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAMEWITHAN%C3%89INITSNAME/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGINTERNATION%40LIZEDNAMEANDMOVED%20WITH%20A%20SPACE%20IN%20ITS%20NAME/Folder/New HTTP/2.0" 500 1598 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.86 Safari/537.36" (No Internal NGINX or PHP Error Reported)

Nextcloud log (data/nextcloud.log)

Nextcloud log ==> /srv/owncloud/data/nextcloud.log <== {"reqId":"2esmg2t5lDQxo10UBm6J","level":0,"time":"2017-06-20T03:00:12+00:00","remoteAddr":"10.236.34.39","user":"1249d780-705f-1036-960a-c1e8ddd96a57","app":"core","method":"GET","url":"\/index.php\/core\/preview.png?file=%2FSHARED%2FFOLDERWITHALONGASCIIALLCAPSNAME%2FSUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME%2FTESTFOLDERWITHOUTASPACEDNAME%2FINTERN%40TIONALIS%C3%89%2Fbacon.txt&c=349699f6b10f87c1170260cdced60a29&x=32&y=32&forceIcon=0","message":"Scss is disabled for \/var\/www\/nextcloud\/core\/css\/server.scss, ignoring","userAgent":"Mozilla\/5.0 (X11; Linux x86_64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/59.0.3071.86 Safari\/537.36","version":"12.0.0.29"} {"reqId":"2esmg2t5lDQxo10UBm6J","level":0,"time":"2017-06-20T03:00:12+00:00","remoteAddr":"10.236.34.39","user":"1249d780-705f-1036-960a-c1e8ddd96a57","app":"core","method":"GET","url":"\/index.php\/core\/preview.png?file=%2FSHARED%2FFOLDERWITHALONGASCIIALLCAPSNAME%2FSUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME%2FTESTFOLDERWITHOUTASPACEDNAME%2FINTERN%40TIONALIS%C3%89%2Fbacon.txt&c=349699f6b10f87c1170260cdced60a29&x=32&y=32&forceIcon=0","message":"Scss is disabled for \/var\/www\/nextcloud\/core\/css\/share.scss, ignoring","userAgent":"Mozilla\/5.0 (X11; Linux x86_64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/59.0.3071.86 Safari\/537.36","version":"12.0.0.29"} {"reqId":"uCpl4jDcirsOLXeootHa","level":0,"time":"2017-06-20T03:00:28+00:00","remoteAddr":"10.236.34.39","user":"1249d780-705f-1036-960a-c1e8ddd96a57","app":"core","method":"GET","url":"\/index.php\/core\/preview.png?file=%2FSHARED%2FFOLDERWITHALONGASCIIALLCAPSNAME%2FSUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME%2FTESTFOLDERWITHOUTASPACEDNAME%2FINTERN%40TIONALIS%C3%89%2Fbacon.txt&c=1499003917&x=32&y=32&forceIcon=0","message":"OC_Image->loadFromBase64, could not load","userAgent":"Mozilla\/5.0 (X11; Linux x86_64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/59.0.3071.86 Safari\/537.36","version":"12.0.0.29"} {"reqId":"Bi6XksAlrM0ZGm5ebCrx","level":0,"time":"2017-06-20T03:00:44+00:00","remoteAddr":"10.236.34.39","user":"1249d780-705f-1036-960a-c1e8ddd96a57","app":"core","method":"GET","url":"\/index.php\/core\/preview.png?file=%2FSHARED%2FFOLDERWITHALONGASCIIALLCAPSNAME%2FSUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME%2FTESTFOLDERWITHOUTASPACEDNAME%2FINTERN%40TIONALIS%C3%89%2Flipsum.txt&c=4040e0e35d3545f6dc03d72b32f591c1&x=32&y=32&forceIcon=0","message":"Scss is disabled for \/var\/www\/nextcloud\/core\/css\/server.scss, ignoring","userAgent":"Mozilla\/5.0 (X11; Linux x86_64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/59.0.3071.86 Safari\/537.36","version":"12.0.0.29"} {"reqId":"Bi6XksAlrM0ZGm5ebCrx","level":0,"time":"2017-06-20T03:00:44+00:00","remoteAddr":"10.236.34.39","user":"1249d780-705f-1036-960a-c1e8ddd96a57","app":"core","method":"GET","url":"\/index.php\/core\/preview.png?file=%2FSHARED%2FFOLDERWITHALONGASCIIALLCAPSNAME%2FSUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME%2FTESTFOLDERWITHOUTASPACEDNAME%2FINTERN%40TIONALIS%C3%89%2Flipsum.txt&c=4040e0e35d3545f6dc03d72b32f591c1&x=32&y=32&forceIcon=0","message":"Scss is disabled for \/var\/www\/nextcloud\/core\/css\/share.scss, ignoring","userAgent":"Mozilla\/5.0 (X11; Linux x86_64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/59.0.3071.86 Safari\/537.36","version":"12.0.0.29"} {"reqId":"s0e3BhvYDETuRGKSKSbA","level":0,"time":"2017-06-20T03:00:59+00:00","remoteAddr":"10.236.34.39","user":"1249d780-705f-1036-960a-c1e8ddd96a57","app":"core","method":"GET","url":"\/index.php\/core\/preview.png?file=%2FSHARED%2FFOLDERWITHALONGASCIIALLCAPSNAME%2FSUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME%2FTESTFOLDERWITHOUTASPACEDNAME%2FINTERN%40TIONALIS%C3%89%2Flipsum.txt&c=1499003950&x=32&y=32&forceIcon=0","message":"OC_Image->loadFromBase64, could not load","userAgent":"Mozilla\/5.0 (X11; Linux x86_64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/59.0.3071.86 Safari\/537.36","version":"12.0.0.29"} {"reqId":"Pb73Dwz8XS9JaXQ3RxR0","level":0,"time":"2017-06-20T03:01:19+00:00","remoteAddr":"10.236.34.39","user":"1249d780-705f-1036-960a-c1e8ddd96a57","app":"core","method":"GET","url":"\/index.php\/core\/preview.png?file=%2FSHARED%2FFOLDERWITHALONGASCIIALLCAPSNAME%2FSUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME%2FTESTFOLDERWITHOUTASPACEDNAME%2FSUBFOLDER%2FINTERN%40TIONALIS%C3%89%2Flipsum.txt&c=f797609c0b54ce3a851fb2016928cd3d&x=32&y=32&forceIcon=0","message":"OC_Image->loadFromBase64, could not load","userAgent":"Mozilla\/5.0 (X11; Linux x86_64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/59.0.3071.86 Safari\/537.36","version":"12.0.0.29"} {"reqId":"zEdxgAv7HMeq2llXiYwh","level":0,"time":"2017-06-20T03:01:23+00:00","remoteAddr":"10.236.34.39","user":"1249d780-705f-1036-960a-c1e8ddd96a57","app":"core","method":"GET","url":"\/index.php\/core\/preview.png?file=%2FSHARED%2FFOLDERWITHALONGASCIIALLCAPSNAME%2FSUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME%2FTESTFOLDERWITHOUTASPACEDNAME%2FSUBFOLDER%2FINTERN%40TIONALIS%C3%89%2Fbacon.txt&c=8a4cef19f155d297e0d5ed91f48f56ef&x=32&y=32&forceIcon=0","message":"OC_Image->loadFromBase64, could not load","userAgent":"Mozilla\/5.0 (X11; Linux x86_64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/59.0.3071.86 Safari\/537.36","version":"12.0.0.29"} {"reqId":"TikB3blpu43lZOCLsaLk","level":0,"time":"2017-06-20T03:01:25+00:00","remoteAddr":"10.236.34.39","user":"1249d780-705f-1036-960a-c1e8ddd96a57","app":"core","method":"GET","url":"\/index.php\/core\/preview.png?file=%2FSHARED%2FFOLDERWITHALONGASCIIALLCAPSNAME%2FSUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME%2FTESTFOLDERWITHOUTASPACEDNAME%2FINTERN%40TIONALIS%C3%89%2Fbacon.txt&c=8a4cef19f155d297e0d5ed91f48f56ef&x=32&y=32&forceIcon=0","message":"OC_Image->loadFromBase64, could not load","userAgent":"Mozilla\/5.0 (X11; Linux x86_64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/59.0.3071.86 Safari\/537.36","version":"12.0.0.29"} {"reqId":"5VRtUv8hWBspwsw3JkY7","level":0,"time":"2017-06-20T03:01:29+00:00","remoteAddr":"10.236.34.39","user":"1249d780-705f-1036-960a-c1e8ddd96a57","app":"core","method":"GET","url":"\/index.php\/core\/preview.png?file=%2FSHARED%2FFOLDERWITHALONGASCIIALLCAPSNAME%2FSUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME%2FTESTFOLDERWITHOUTASPACEDNAME%2FINTERN%40TIONALIS%C3%89%2Flipsum.txt&c=f797609c0b54ce3a851fb2016928cd3d&x=32&y=32&forceIcon=0","message":"OC_Image->loadFromBase64, could not load","userAgent":"Mozilla\/5.0 (X11; Linux x86_64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/59.0.3071.86 Safari\/537.36","version":"12.0.0.29"} {"reqId":"mLjhGXNNikkqLmUQqUo0","level":0,"time":"2017-06-20T03:08:26+00:00","remoteAddr":"10.236.34.39","user":"1249d780-705f-1036-960a-c1e8ddd96a57","app":"core","method":"GET","url":"\/index.php\/core\/preview.png?file=%2FTESTFLDRWITHAVERYLONGINTERNATION%40LIZEDNAME%2FTESTFLDR2ALSOWITHANUTTERLYLONGNAMEWITHAN%C3%89INITSNAME%2FTESTFOLDER3WITHYETANOTHERUSELESSLYLONGINTERNATION%40LIZEDNAMEANDMOVED+WITH+A+SPACE+IN+ITS+NAME%2FSUB+Folder%2FTEST+Spaced%2Florem2.txt&c=7f0f3ff36cca1c8c99855707e861864e&x=32&y=32&forceIcon=0","message":"OC_Image->loadFromBase64, could not load","userAgent":"Mozilla\/5.0 (X11; Linux x86_64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/59.0.3071.86 Safari\/537.36","version":"12.0.0.29"}
nextcloud.log After trying to move a broken folder again {"reqId":"IRnJDqWlEswSXWMUvQjX","level":4,"time":"2017-06-20T03:55:56+00:00","remoteAddr":"10.236.34.39","user":"1249d780-705f-1036-960a-c1e8ddd96a57","app":"webdav","method":"MOVE","url":"\/remote.php\/webdav\/TESTFLDRWITHAVERYLONGINTERNATION%40LIZEDNAME\/TESTFLDR2ALSOWITHANUTTERLYLONGNAMEWITHAN%C3%89INITSNAME\/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGINTERNATION%40LIZEDNAMEANDMOVED%20WITH%20A%20SPACE%20IN%20ITS%20NAME\/Folder\/New","message":"Exception: {\"Message\":\"An exception occurred while executing 'UPDATE `oc_filecache` SET `storage` = ?, `path_hash` = MD5(CONCAT(?, SUBSTR(`path`, ?))), `path` = CONCAT(?, SUBSTR(`path`, ?)) WHERE (`storage` = ?) AND (`path` LIKE ?)' with params [281, \\\"files\\\\\\\/TESTFLDRWITHAVERYLONGINTERNATION@LIZEDNAME\\\\\\\/TESTFLDR2ALSOWITHANUTTERLYLONGNAMEWITHAN\\\\u00c9INITSNAME\\\\\\\/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGINTERNATION@LIZEDNAMEANDMOVED WITH A SPACE IN ITS NAME\\\\\\\/Folder\\\\\\\/subfolder\\\\\\\/New\\\", 205, \\\"files\\\\\\\/TESTFLDRWITHAVERYLONGINTERNATION@LIZEDNAME\\\\\\\/TESTFLDR2ALSOWITHANUTTERLYLONGNAMEWITHAN\\\\u00c9INITSNAME\\\\\\\/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGINTERNATION@LIZEDNAMEANDMOVED WITH A SPACE IN ITS NAME\\\\\\\/Folder\\\\\\\/subfolder\\\\\\\/New\\\", 205, 281, \\\"files\\\\\\\/TESTFLDRWITHAVERYLONGINTERNATION@LIZEDNAME\\\\\\\/TESTFLDR2ALSOWITHANUTTERLYLONGNAMEWITHAN\\\\u00c9INITSNAME\\\\\\\/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGINTERNATION@LIZEDNAMEANDMOVED WITH A SPACE IN ITS NAME\\\\\\\/Folder\\\\\\\/New\\\\\\\/%\\\"]:\\n\\nSQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry '281-8a4f965306e8dd44af5411975b55ef52' for key 'fs_storage_path_hash'\",\"Exception\":\"Doctrine\\\\DBAL\\\\Exception\\\\UniqueConstraintViolationException\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/DBALException.php(128): Doctrine\\\\DBAL\\\\Driver\\\\AbstractMySQLDriver->convertException('An exception oc...', Object(Doctrine\\\\DBAL\\\\Driver\\\\PDOException))\\n#1 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Connection.php(1015): Doctrine\\\\DBAL\\\\DBALException::driverExceptionDuringQuery(Object(Doctrine\\\\DBAL\\\\Driver\\\\PDOMySql\\\\Driver), Object(Doctrine\\\\DBAL\\\\Driver\\\\PDOException), 'UPDATE `oc_file...', Array)\\n#2 \\\/var\\\/www\\\/nextcloud\\\/lib\\\/private\\\/DB\\\/Connection.php(213): Doctrine\\\\DBAL\\\\Connection->executeUpdate('UPDATE `oc_file...', Array, Array)\\n#3 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Query\\\/QueryBuilder.php(208): OC\\\\DB\\\\Connection->executeUpdate('UPDATE `oc_file...', Array, Array)\\n#4 \\\/var\\\/www\\\/nextcloud\\\/lib\\\/private\\\/DB\\\/QueryBuilder\\\/QueryBuilder.php(213): Doctrine\\\\DBAL\\\\Query\\\\QueryBuilder->execute()\\n#5 \\\/var\\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Cache.php(545): OC\\\\DB\\\\QueryBuilder\\\\QueryBuilder->execute()\\n#6 \\\/var\\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Cache.php(484): OC\\\\Files\\\\Cache\\\\Cache->moveFromCache(Object(OC\\\\Files\\\\Cache\\\\HomeCache), 'files\\\/TESTFLDRW...', 'files\\\/TESTFLDRW...')\\n#7 \\\/var\\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Updater.php(196): OC\\\\Files\\\\Cache\\\\Cache->move('files\\\/TESTFLDRW...', 'files\\\/TESTFLDRW...')\\n#8 \\\/var\\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/View.php(333): OC\\\\Files\\\\Cache\\\\Updater->renameFromStorage(Object(OCA\\\\Files_Trashbin\\\\Storage), 'files\\\/TESTFLDRW...', 'files\\\/TESTFLDRW...')\\n#9 \\\/var\\\/www\\\/nextcloud\\\/lib\\\/private\\\/Files\\\/View.php(811): OC\\\\Files\\\\View->renameUpdate(Object(OCA\\\\Files_Trashbin\\\\Storage), Object(OCA\\\\Files_Trashbin\\\\Storage), 'files\\\/TESTFLDRW...', 'files\\\/TESTFLDRW...')\\n#10 \\\/var\\\/www\\\/nextcloud\\\/apps\\\/dav\\\/lib\\\/Connector\\\/Sabre\\\/Directory.php(431): OC\\\\Files\\\\View->rename('\\\/TESTFLDRWITHAV...', '\\\/TESTFLDRWITHAV...')\\n#11 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Tree.php(158): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->moveInto('New', 'TESTFLDRWITHAVE...', Object(OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory))\\n#12 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(642): Sabre\\\\DAV\\\\Tree->move('TESTFLDRWITHAVE...', 'TESTFLDRWITHAVE...')\\n#13 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpMove(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#14 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#15 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(479): Sabre\\\\Event\\\\EventEmitter->emit('method:MOVE', Array)\\n#16 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(254): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#17 \\\/var\\\/www\\\/nextcloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(71): Sabre\\\\DAV\\\\Server->exec()\\n#18 \\\/var\\\/www\\\/nextcloud\\\/remote.php(162): require_once('\\\/var\\\/www\\\/nextcl...')\\n#19 {main}\",\"File\":\"\\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/doctrine\\\/dbal\\\/lib\\\/Doctrine\\\/DBAL\\\/Driver\\\/AbstractMySQLDriver.php\",\"Line\":66,\"User\":\"1249d780-705f-1036-960a-c1e8ddd96a57\"}","userAgent":"Mozilla\/5.0 (X11; Linux x86_64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/59.0.3071.86 Safari\/537.36","version":"12.0.0.29"}
(No other errors were reported by NGINX, PHP, Redis or MariaDB)

Browser log

Browser log No error reported
@ghost
Copy link

ghost commented Jun 20, 2017

How long is "extremly long"?

@carboneater
Copy link
Author

I pushed it to the extreme to trigger the bug, so when I tried to replicate it in a shared folder, I used folder names like those:
(Shared is a shared folder)

  • SHARED/FOLDERWITHALONGASCIIALLCAPSNAME/SUBFOLDERWITHALONGASCIIALLCAPSUBFOLDERNAME/TESTFOLDERWITHOUTASPACEDNAME/INTERN@TIONALISÉ

(Moving this folder into another one broke it)

  • SHARED/Int3rn@tionalisé/test Long Intern@tionalized spaced Name
    (Applying steps 2-5 in that one also triggered it, badly: folders are being duplicated in that entry...)
  • TESTFLDRWITHAVERYLONGINTERNATION@LIZEDNAME/TESTFLDR2ALSOWITHANUTTERLYLONGNAMEWITHANÉINITSNAME/TESTFOLDER3WITHYETANOTHERUSELESSLYLONGINTERNATION@LIZEDNAMEANDMOVEDWITH A SPACE IN ITS NAME/Folder
    (Working in a non-shared environment, I had to push it a little more)

Other examples from my production environment (All are shared folders):

  • /Documents de Référence/Guide/Guide Utilisation Informatique/
  • /Documents de travail/Été 2017/CA/CA2/PREZ/
  • (A quick query in my database turned out about 200 files and folders with a bad file descriptor, I'll try to see if I can export some useful data from it today.)
    (Like I said, including spaces/internationalized characters seemed to make this bug more likely to occur.)

We've been using ownCloud/Nextcloud with internationalized characters (french) for years without issues.

@jospoortvliet
Copy link
Member

@icewind1991 how-to-break-the-file-cache ;-)

@carboneater
Copy link
Author

For more results, I ran the following queries on my oc_filecache table to get a list of all my duplicate filecache entries:

CREATE TEMPORARY TABLE IF NOT EXISTS DUPES AS (
    SELECT parent, etag, name, COUNT(*) AS dupes
    FROM oc_filecache AS FC
    WHERE FC.storage=1
    GROUP BY parent,etag,name
    HAVING dupes > 1
    ORDER BY dupes DESC
);
SELECT * 
FROM oc_filecache AS FC
INNER JOIN DUPES ON FC.parent=DUPES.parent AND FC.etag=DUPES.etag AND FC.name=DUPES.name
WHERE storage = 1
ORDER BY FC.name ASC, FC.etag ASC, FC.fileid DESC
LIMIT 100

Here are my results.
oc_filecache.xlsx
Looks like some concatenate functions are truncating the end of the path string and the beginning of the filename.

@MorrisJobke
Copy link
Member

@icewind1991 Ping

@jospoortvliet
Copy link
Member

@carboneater thanks for the debugging. Hope Icewind can figure this one out, he's working on filecache stuff atm anyhow, I'm sure he loves it 🥇

@MorrisJobke MorrisJobke added 0. Needs triage Pending check for reproducibility or if it fits our roadmap bug labels Jul 18, 2017
@metro2030
Copy link

@icewind1991 Any news?

@blizzz
Copy link
Member

blizzz commented Sep 8, 2017

@icewind1991 🏓

@nextcloud-bot nextcloud-bot added the stale Ticket or PR with no recent activity label Jun 20, 2018
@skjnldsv skjnldsv removed stale Ticket or PR with no recent activity labels Jun 12, 2019
@J0WI
Copy link
Contributor

J0WI commented Nov 26, 2019

Duplicate of #9907?

@skjnldsv
Copy link
Member

Looks like so yeas

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0. Needs triage Pending check for reproducibility or if it fits our roadmap bug
Projects
None yet
Development

No branches or pull requests

8 participants