8.2.11->stable10 update fails due to certificatemanager bootstrap issue

[PVince81]

Steps

1. git checkout v8.2.11
2. set it up
3. git checkout stable10
4. Clone the market app into "apps/market" with branch stable10
5. occ upgrade

Expected result

Success.

Actual result

ownCloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
Set log level to debug
Turned on maintenance mode
Repair warning: Doctrine\DBAL\Exception\InvalidFieldNameException
Repair warning: An exception occurred while executing 'SELECT `fileid`, `storage`, `path`, `parent`, `name`, `mimetype`, `mimepart`, `size`, `mtime`,



SQLSTATE[42S22]: Column not found: 1054 Unknown column 'checksum' in 'field list'                                                                                                            
Repair warning: Doctrine\DBAL\Exception\InvalidFieldNameException
Repair warning: An exception occurred while executing 'SELECT `fileid`, `storage`, `path`, `parent`, `name`, `mimetype`, `mimepart`, `size`, `mtime`,



SQLSTATE[42S22]: Column not found: 1054 Unknown column 'checksum' in 'field list'                                                                                                            
Repair warning: Doctrine\DBAL\Exception\InvalidFieldNameException
Repair warning: An exception occurred while executing 'INSERT INTO `oc_jobs` (`class`, `argument`, `last_run`, `last_checked`) VALUES(?, ?, ?, ?)' with params ["OCA\\Market\\CheckUpdateBackgroundJob", "null", 0, 1502711691]:                                                                                                                                                          

SQLSTATE[42S22]: Column not found: 1054 Unknown column 'last_checked' in 'field list'                                                                                                        
Updating database schema
Updated database
Updating <market> ...
Updated <market> to 0.1.1
Updating <files> ...
Updated <files> to 1.5.1
Updating <files_sharing> ...
Updated <files_sharing> to 0.10.1
Updating <files_trashbin> ...
Updated <files_trashbin> to 0.9.1
Updating <files_versions> ...
Updated <files_versions> to 1.3.0
Updating <provisioning_api> ...
Updated <provisioning_api> to 0.5.0
Drop old database tables

 Done
 28/28 [============================] 100%
Fix permissions so avatars can be stored again
 Done
 2/2 [============================] 100%
Move user avatars outside the homes to the new location
 Done
 1/1 [============================] 100%
Update successful
Turned off maintenance mode
Reset log level

Version

stable10 1f0a3b0

I put a breakpoint into that Doctrine exception to get more details and here is the stack:

0  Doctrine\DBAL\Exception\DriverException->__construct() /srv/www/htdocs/owncloud/lib/composer/doctrine/dbal/lib/Doctrine/DBAL/Exception/DriverException.php:48
1  Doctrine\DBAL\Driver\AbstractMySQLDriver->convertException() /srv/www/htdocs/owncloud/lib/composer/doctrine/dbal/lib/Doctrine/DBAL/Driver/AbstractMySQLDriver.php:71
2  Doctrine\DBAL\DBALException::driverExceptionDuringQuery() /srv/www/htdocs/owncloud/lib/composer/doctrine/dbal/lib/Doctrine/DBAL/DBALException.php:128
3  Doctrine\DBAL\Connection->executeQuery() /srv/www/htdocs/owncloud/lib/composer/doctrine/dbal/lib/Doctrine/DBAL/Connection.php:855
4  OC\DB\Connection->executeQuery() /srv/www/htdocs/owncloud/lib/private/DB/Connection.php:190
5  OC\Files\Cache\Cache->get() /srv/www/htdocs/owncloud/lib/private/Files/Cache/Cache.php:128
6  OC\Files\Storage\Wrapper\Encryption->getMetaData() /srv/www/htdocs/owncloud/lib/private/Files/Storage/Wrapper/Encryption.php:177
7  OC\Files\Storage\Wrapper\Checksum->getMetaData() /srv/www/htdocs/owncloud/lib/private/Files/Storage/Wrapper/Checksum.php:190
8  OC\Files\Cache\Scanner->getData() /srv/www/htdocs/owncloud/lib/private/Files/Cache/Scanner.php:113
9  OC\Files\Cache\Scanner->scanFile() /srv/www/htdocs/owncloud/lib/private/Files/Cache/Scanner.php:150
10 OC\Files\Cache\Scanner->scan() /srv/www/htdocs/owncloud/lib/private/Files/Cache/Scanner.php:314
11 OC\Files\Cache\Updater->update() /srv/www/htdocs/owncloud/lib/private/Files/Cache/Updater.php:124
12 OC\Files\View->writeUpdate() /srv/www/htdocs/owncloud/lib/private/Files/View.php:314
13 OC\Files\View->basicOperation() /srv/www/htdocs/owncloud/lib/private/Files/View.php:1138
14 OC\Files\View->mkdir() /srv/www/htdocs/owncloud/lib/private/Files/View.php:262
15 OC\Security\CertificateManager->createCertificateBundle() /srv/www/htdocs/owncloud/lib/private/Security/CertificateManager.php:104
16 OC\Security\CertificateManager->getAbsoluteBundlePath() /srv/www/htdocs/owncloud/lib/private/Security/CertificateManager.php:207
17 OC\Http\Client\Client->setDefaultOptions() /srv/www/htdocs/owncloud/lib/private/Http/Client/Client.php:73
18 OC\Http\Client\Client->get() /srv/www/htdocs/owncloud/lib/private/Http/Client/Client.php:135
19 OCA\Market\MarketService->httpGet() /srv/www/htdocs/owncloud/apps/market/lib/MarketService.php:458
20 OCA\Market\MarketService->queryData() /srv/www/htdocs/owncloud/apps/market/lib/MarketService.php:494
21 OCA\Market\MarketService->getApps() /srv/www/htdocs/owncloud/apps/market/lib/MarketService.php:390
22 OCA\Market\MarketService->getAppInfo() /srv/www/htdocs/owncloud/apps/market/lib/MarketService.php:221
23 OCA\Market\MarketService->getAvailableUpdateVersion() /srv/www/htdocs/owncloud/apps/market/lib/MarketService.php:201
24 OCA\Market\Listener->upgradeAppStoreApp() /srv/www/htdocs/owncloud/apps/market/lib/Listener.php:36
25 OCA\Market\Application->OCA\Market\{closure}() /srv/www/htdocs/owncloud/apps/market/lib/Application.php:46
26 call_user_func:{/srv/www/htdocs/owncloud/lib/composer/symfony/event-dispatcher/EventDispatcher.php:174}() /srv/www/htdocs/owncloud/lib/composer/symfony/event-dispatcher/EventDispatcher.php:174
27 Symfony\Component\EventDispatcher\EventDispatcher->doDispatch() /srv/www/htdocs/owncloud/lib/composer/symfony/event-dispatcher/EventDispatcher.php:174
28 Symfony\Component\EventDispatcher\EventDispatcher->dispatch() /srv/www/htdocs/owncloud/lib/composer/symfony/event-dispatcher/EventDispatcher.php:43
29 OC\Repair\Apps->getAppsFromMarket() /srv/www/htdocs/owncloud/lib/private/Repair/Apps.php:203
30 OC\Repair\Apps->run() /srv/www/htdocs/owncloud/lib/private/Repair/Apps.php:154
31 OC\Repair->run() /srv/www/htdocs/owncloud/lib/private/Repair.php:88
32 OC\Updater->doUpgrade() /srv/www/htdocs/owncloud/lib/private/Updater.php:221
33 OC\Updater->upgrade() /srv/www/htdocs/owncloud/lib/private/Updater.php:108
34 OC\Core\Command\Upgrade->execute() /srv/www/htdocs/owncloud/core/Command/Upgrade.php:249
35 Symfony\Component\Console\Command\Command->run() /srv/www/htdocs/owncloud/lib/composer/symfony/console/Command/Command.php:262
36 Symfony\Component\Console\Application->doRunCommand() /srv/www/htdocs/owncloud/lib/composer/symfony/console/Application.php:826
37 Symfony\Component\Console\Application->doRun() /srv/www/htdocs/owncloud/lib/composer/symfony/console/Application.php:189
38 Symfony\Component\Console\Application->run() /srv/www/htdocs/owncloud/lib/composer/symfony/console/Application.php:120
39 OC\Console\Application->run() /srv/www/htdocs/owncloud/lib/private/Console/Application.php:160
40 require_once()  /srv/www/htdocs/owncloud/console.php:106
41 {main}          /srv/www/htdocs/owncloud/occ:11

It looks like once again with have this "bootstrap paradox" where the certificate manager is trying to access files in the data folder before the update ran.

@phisch @DeepDiver1975

[PVince81]

Some env info:

• openSUSE Leap 42.2
• php7-7.0.15-40.3.x86_64
• apache2-2.4.23-8.9.1.x86_64
• openssl-1.0.2j-6.3.1.x86_64

[PVince81]

I also observed this when upgrading the EE tarball from 8.2.11 to stable10 daily CE tarball. So it also happens for tarball versions, not only git.

[PVince81]

PR here #28668

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.