Tests pass when individually run, but fail when the run as a suite

オープン

#37 2022年7月5日に作成コメント 1 件リアクション 0 件担当者 0 名 GitHub で見る

まだ誰も着手していません。

評価

難易度: 3/5
見積もり時間: 1〜2日
初心者へのやさしさ: 35/100

issue の種類: バグ
明瞭さ: おおむね明確
活発さ: 停滞
技術スタック: mysql, php
領域: database, testing-qa

調査の方向性

tests/test_database/NotePersistenceGetOneEntryTest.php から始め、特に326行目の testGetEntries を確認し、テストをスイートとして実行した場合と個別に実行した場合の両方で失敗を再現します。実行間での module-db populate、cleanup、reconnect、populator の動作を比較します。スイートがパスし、テストを単独で実行した場合にも引き続きパスすれば完了です。

索引モデルが issue の本文から書いたものです。

説明

I have a problem when running unit tests using module-db
My tests pass when the are run individually, when I run them as a suite only the first test passes, but other tests fail.
My configurations are as follow:

- Db:
            dsn: 'mysql:host=localhost;dbname=test'
            user: 'root'
            password: ''
            dump: 'tests/_data/database/empty_db.sql'
            populate: true # run populator before all tests
            cleanup: true # run populator before each test
            reconnect: true
            populator: 'mysql -u $user -h $host $dbname < $dump'
            skip_cleanup_if_failed: true,
            initial_queries:
              - 'CREATE DATABASE IF NOT EXISTS test;'
              - 'USE test;'

and the output that I see on the screen is just normal:

[Connecting To Db] {"config":{"populate":true,"cleanup":false,"reconnect":true,"waitlock":0,"dump":"tests/_data/database/empty_db.sql","populator":"mysql -u $user -h $host $dbname < $dump","skip_cleanup_if_failed":true,"dsn":"mysql:host=localhost;dbname=test","user":"root","password":""},"options":[]}
  [Db] Connected to default test
  [Db] Executing Populator: `mysql -u root -h localhost test < tests/_data/database/empty_db.sql`
  [Db] Populator Finished.
  [Db] Disconnected from default
  [Connecting To Db] {"config":{"populate":true,"cleanup":false,"reconnect":true,"waitlock":0,"dump":"tests/_data/database/empty_db.sql","populator":"mysql -u $user -h $host $dbname < $dump","skip_cleanup_if_failed":true,"dsn":"mysql:host=localhost;dbname=test","user":"root","password":""},"options":[]}
  [Db] Connected to default test
  [Query] INSERT INTO `logbook` (`USER_CODE`, `LOGTIME`, `LOGTEXT`, `LOC_CODE`) VALUES (?, ?, ?, ?)
  [Parameters] ["fsahli-notoken","2022-06-21 17:19:13","Test note asasas 2010","M009"]
  [Query] INSERT INTO `logbook` (`USER_CODE`, `LOGTIME`, `LOGTEXT`, `LOC_CODE`) VALUES (?, ?, ?, ?)
  [Parameters] ["fsahli-notoken","2022-06-21 17:08:38","Test note asasas 2001","M009"]
  [Query] INSERT INTO `logbook` (`USER_CODE`, `LOGTIME`, `LOGTEXT`, `LOC_CODE`) VALUES (?, ?, ?, ?)
  [Parameters] ["fsahli-notoken","2022-06-21 17:08:13","Test note asasas 2","M009"]
  [Query] INSERT INTO `logbook` (`USER_CODE`, `LOGTIME`, `LOGTEXT`, `LOC_CODE`) VALUES (?, ?, ?, ?)
  [Parameters] ["fsahli-notoken","2022-06-21 16:29:44","Test note asasas 1","M009"]
  [Query] INSERT INTO `users` (`id`, `USER_CODE`, `radiususer`, `active`, `deleted`, `LEVEL_CODE`, `user_password`, `USER_NAME`, `USER_EMAIL`) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?)
  [Parameters] ["109","fsahli-notoken","iavasco:fsahli@interact.nl",1,0,0,"pass","F. Sahli (Inter Act)","fsahli@interact.nl"]
  [Query] INSERT INTO `location` (`LOC_CODE`, `display_code`, `DEPT_CODE`, `LOC_ZONE`, `LOC_ADDRESS`, `LOC_POSTAL`, `LOC_CITY`, `LOC_COUNTRY`, `LOC_ACTIVE`, `LOC_DESC`, `LOC_TYPE`, `LOC_XPOS`, `LOC_YPOS`, `LAST_CHANGE`) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)
  [Parameters] ["M009","M009","M009","10","","","","",1,"Koning Stadhouderlaan","MK_1AN_GPRS",0,0,"2014-02-27 08:53:40"]
  [Query] INSERT INTO `location` (`LOC_CODE`, `display_code`, `DEPT_CODE`, `LOC_ZONE`, `LOC_POSTAL`, `LOC_ACTIVE`, `LOC_DESC`, `LOC_TYPE`, `LOC_XPOS`, `LOC_YPOS`, `LAST_CHANGE`) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)
  [Parameters] ["P644","P644","P633","6","7381BL",1,"Hooiland 32","POWERLINE_PM",199649.5785,465711.177,"2014-02-27 08:53:40"]
  [Query] INSERT INTO `location` (`LOC_CODE`, `display_code`, `DEPT_CODE`, `LOC_ZONE`, `LOC_POSTAL`, `LOC_ACTIVE`, `LOC_DESC`, `LOC_TYPE`, `LOC_XPOS`, `LOC_YPOS`, `LAST_CHANGE`) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)
  [Parameters] ["P643","P643","P633","6","7381BL",1,"Hooiland 29","POWERLINE_PM",199819.791,465691.7586,"2014-02-27 08:53:40"]
  [Query] INSERT INTO `department` (`DEPT_CODE`, `DEPT_DESC`, `LAST_CHANGE`) VALUES (?, ?, ?)
  [Parameters] ["M009","Koning Stadhouderlaan","2014-02-27 08:53:40"]
  [Query] INSERT INTO `department` (`DEPT_CODE`, `DEPT_DESC`) VALUES (?, ?)
  [Parameters] ["P644","Hooiland 32"]
  [Query] SELECT count(*) FROM `logbook`
  [Query] SELECT count(*) FROM `users`
  [Query] SELECT count(*) FROM `location`
  [Query] SELECT count(*) FROM `department`
  [Query] SELECT count(*) FROM `logbook` WHERE `USER_CODE` = ?
  [Parameters] ["fsahli-notoken"]
+ NotePersistenceGetOneEntryTest: Get one entry (14.28s)
+ NotePersistenceTest: Test__construct (0.00s)
  [Connecting To Db] {"config":{"populate":true,"cleanup":false,"reconnect":true,"waitlock":0,"dump":"tests/_data/database/empty_db.sql","populator":"mysql -u $user -h $host $dbname < $dump","skip_cleanup_if_failed":true,"dsn":"mysql:host=localhost;dbname=test","user":"root","password":""},"options":[]}
  [Db] Connected to default test
  [Db] Executing Populator: `mysql -u root -h localhost test < tests/_data/database/empty_db.sql`
  [Db] Populator Finished.
  [Db] Disconnected from default
  [Connecting To Db] {"config":{"populate":true,"cleanup":false,"reconnect":true,"waitlock":0,"dump":"tests/_data/database/empty_db.sql","populator":"mysql -u $user -h $host $dbname < $dump","skip_cleanup_if_failed":true,"dsn":"mysql:host=localhost;dbname=test","user":"root","password":""},"options":[]}
  [Db] Connected to default test
  [Query] INSERT INTO `logbook` (`USER_CODE`, `LOGTIME`, `LOGTEXT`, `LOC_CODE`) VALUES (?, ?, ?, ?)
  [Parameters] ["fsahli-notoken","2022-06-21 17:19:13","Test note asasas 2010","M009"]
  [Query] INSERT INTO `logbook` (`USER_CODE`, `LOGTIME`, `LOGTEXT`, `LOC_CODE`) VALUES (?, ?, ?, ?)
  [Parameters] ["fsahli-notoken","2022-06-21 17:08:38","Test note asasas 2001","M009"]
  [Query] INSERT INTO `logbook` (`USER_CODE`, `LOGTIME`, `LOGTEXT`, `LOC_CODE`) VALUES (?, ?, ?, ?)
  [Parameters] ["fsahli-notoken","2022-06-21 17:08:13","Test note asasas 2","M009"]
  [Query] INSERT INTO `logbook` (`USER_CODE`, `LOGTIME`, `LOGTEXT`, `LOC_CODE`) VALUES (?, ?, ?, ?)
  [Parameters] ["fsahli-notoken","2022-06-21 16:29:44","Test note asasas 1","M009"]
  [Query] INSERT INTO `users` (`id`, `USER_CODE`, `radiususer`, `active`, `deleted`, `LEVEL_CODE`, `user_password`, `USER_NAME`, `USER_EMAIL`) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?)
  [Parameters] ["109","fsahli-notoken","iavasco:fsahli@interact.nl",1,0,0,"pass","F. Sahli (Inter Act)","fsahli@interact.nl"]
  [Query] INSERT INTO `location` (`LOC_CODE`, `display_code`, `DEPT_CODE`, `LOC_ZONE`, `LOC_ADDRESS`, `LOC_POSTAL`, `LOC_CITY`, `LOC_COUNTRY`, `LOC_ACTIVE`, `LOC_DESC`, `LOC_TYPE`, `LOC_XPOS`, `LOC_YPOS`, `LAST_CHANGE`) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)
  [Parameters] ["M009","M009","M009","10","","","","",1,"Koning Stadhouderlaan","MK_1AN_GPRS",0,0,"2014-02-27 08:53:40"]
  [Query] INSERT INTO `location` (`LOC_CODE`, `display_code`, `DEPT_CODE`, `LOC_ZONE`, `LOC_POSTAL`, `LOC_ACTIVE`, `LOC_DESC`, `LOC_TYPE`, `LOC_XPOS`, `LOC_YPOS`, `LAST_CHANGE`) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)
  [Parameters] ["P644","P644","P633","6","7381BL",1,"Hooiland 32","POWERLINE_PM",199649.5785,465711.177,"2014-02-27 08:53:40"]
  [Query] INSERT INTO `location` (`LOC_CODE`, `display_code`, `DEPT_CODE`, `LOC_ZONE`, `LOC_POSTAL`, `LOC_ACTIVE`, `LOC_DESC`, `LOC_TYPE`, `LOC_XPOS`, `LOC_YPOS`, `LAST_CHANGE`) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)
  [Parameters] ["P643","P643","P633","6","7381BL",1,"Hooiland 29","POWERLINE_PM",199819.791,465691.7586,"2014-02-27 08:53:40"]
  [Query] INSERT INTO `department` (`DEPT_CODE`, `DEPT_DESC`, `LAST_CHANGE`) VALUES (?, ?, ?)
  [Parameters] ["M009","Koning Stadhouderlaan","2014-02-27 08:53:40"]
  [Query] INSERT INTO `department` (`DEPT_CODE`, `DEPT_DESC`) VALUES (?, ?)
  [Parameters] ["P644","Hooiland 32"]
  [Query] SELECT count(*) FROM `logbook`
  [Query] SELECT count(*) FROM `users`
  [Query] SELECT count(*) FROM `location`
  [Query] SELECT count(*) FROM `department`
x NotePersistenceGetOneEntryTest: Get entries (15.06s)
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------


Time: 00:29.374, Memory: 12.00 MB

There was 1 failure:

---------
1) NotePersistenceGetOneEntryTest: Get entries
 Test  tests\test_database\NotePersistenceGetOneEntryTest.php:testGetEntries
Failed asserting that actual size 0 matches expected size 4.
D:\laragon\www\tcn\vendor\phpunit\phpunit\src\Framework\Constraint\Constraint.php:121
D:\laragon\www\tcn\vendor\phpunit\phpunit\src\Framework\Constraint\Constraint.php:55
D:\laragon\www\tcn\vendor\phpunit\phpunit\src\Framework\Assert.php:2344
D:\laragon\www\tcn\vendor\phpunit\phpunit\src\Framework\Assert.php:286
D:\laragon\www\tcn\tests\test_database\NotePersistenceGetOneEntryTest.php:326
D:\laragon\www\tcn\vendor\phpunit\phpunit\src\Framework\TestCase.php:1526
D:\laragon\www\tcn\vendor\phpunit\phpunit\src\Framework\TestCase.php:1132
D:\laragon\www\tcn\vendor\phpunit\phpunit\src\Framework\TestResult.php:722
D:\laragon\www\tcn\vendor\phpunit\phpunit\src\Framework\TestCase.php:884
D:\laragon\www\tcn\vendor\phpunit\phpunit\src\Framework\TestSuite.php:677
D:\laragon\www\tcn\vendor\codeception\phpunit-wrapper\src\Runner.php:117
D:\laragon\www\tcn\vendor\codeception\codeception\src\Codeception\SuiteManager.php:161
D:\laragon\www\tcn\vendor\codeception\codeception\src\Codeception\Codecept.php:208
D:\laragon\www\tcn\vendor\codeception\codeception\src\Codeception\Codecept.php:162
D:\laragon\www\tcn\vendor\codeception\codeception\src\Codeception\Command\Run.php:609
D:\laragon\www\tcn\vendor\codeception\codeception\src\Codeception\Command\Run.php:442
D:\laragon\www\tcn\vendor\symfony\console\Command\Command.php:298
D:\laragon\www\tcn\vendor\symfony\console\Application.php:1024
D:\laragon\www\tcn\vendor\symfony\console\Application.php:299
D:\laragon\www\tcn\vendor\symfony\console\Application.php:171
D:\laragon\www\tcn\vendor\codeception\codeception\src\Codeception\Application.php:117
D:\laragon\www\tcn\vendor\codeception\codeception\app.php:46
D:\laragon\www\tcn\vendor\codeception\codeception\app.php:47
D:\laragon\www\tcn\vendor\codeception\codeception\codecept:6
D:\laragon\www\tcn\vendor\bin\codecept:112


FAILURES!
Tests: 3, Assertions: 23, Failures: 1.
  [Db] Disconnected from default
  [Db] Disconnected from default

can you please check and let me know

Best regards,
Firas

主要言語: PHP
スター: 23
フォーク: 31
PR マージ指標: 30日以内にマージされた PR はありません

コントリビューションガイド

このリポジトリのコントリビューションガイドは索引されていません

はじめの一歩

issue を最後まで読み、次にプロジェクトのコントリビューションガイドを読みます。
着手することを issue にコメントします — 二人が同じ作業をするのを防げます。
リポジトリをフォークし、ブランチを切って変更します。
issue 番号を参照したプルリクエストを送ります。

Codeception/module-db のほかの issue

haveInDatabase() is not usable inside a transaction on PostgreSQL オープン

難易度 3/5 1〜2日初心者へのやさしさ 42/100

Codeception/module-db#87 · 2025年6月9日に作成
Using DB module in testing with transactions オープン

難易度 4/5 3〜5日初心者へのやさしさ 25/100

Codeception/module-db#85 · 2025年2月25日に作成
Make optional the auto-erase of the records, added by `haveInDatabase()` オープン

難易度 4/5 3〜5日初心者へのやさしさ 35/100

Codeception/module-db#68 · コメント 1 件 · 2024年5月10日に作成
Fix a confusion between 'cleanup' and 'skip_cleanup_if_failed' configuration params オープン

難易度 4/5 3〜5日初心者へのやさしさ 35/100

Codeception/module-db#67 · 2024年5月9日に作成
inserting null on an autoincrement primary key prevents cleanup オープン

難易度 3/5 1〜2日初心者へのやさしさ 38/100

Codeception/module-db#58 · 2023年6月14日に作成

Codeception/module-db の issue をすべて見る

似ている issue

PHP warning in document.php after importing a saved header template in Elementor 4.3.0 オープン

status/awaiting_triage

難易度 2/5 1〜3時間初心者へのやさしさ 75/100

elementor/elementor#37396 · 2026年9月23日に作成
Recognize Blue Oak Model License 1.0.0 as GPL-compatible オープン

難易度 1/5 1時間未満初心者へのやさしさ 90/100

WordPress/plugin-check#1486 · 2026年9月23日に作成
Support the back-to-top button on Drupal Canvas page variants オープン

enhancement

難易度 2/5 1〜3時間初心者へのやさしさ 88/100

az-digital/az_quickstart#6019 · 2026年9月23日に作成
[Feature]: ABM adapter: validate the private key when settings are saved オープン

難易度 2/5 1〜3時間初心者へのやさしさ 75/100

grokability/snipe-it#19688 · 2026年9月23日に作成
Admin assets are being enqueued on front end オープン

難易度 2/5 1〜3時間初心者へのやさしさ 85/100

alleyinteractive/archiveless#88 · 2026年9月22日に作成

PHP の issue をもっと見る