Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

System test randomly failing (due to opcache bug?) #8057

Closed
mattab opened this issue Jun 8, 2015 · 1 comment
Closed

System test randomly failing (due to opcache bug?) #8057

mattab opened this issue Jun 8, 2015 · 1 comment
Labels
c: Tests & QA For issues related to automated tests or making it easier to QA & test issues. not-in-changelog For issues or pull requests that should not be included in our release changelog on matomo.org.
Milestone
2.14.0

Comments

@mattab
Copy link
Member

mattab commented Jun 8, 2015

The goal of this issue is to mitigate a random test failure, (so we can have green builds ASAP).
Then we will ideally figure out the root cause of this system test random failure.

Example failed CI build: https://travis-ci.org/piwik/piwik/jobs/65829754

Output:

1) Piwik\Tests\System\OneVisitorNoKeywordSpecifiedTest::testApi with data set #0 (array('Referrers.getKeywords', 'Live.getLastVisitsDetails'), array(1, '2010-03-06 11:22:33', 'fr'))

Piwik\Tests\System\OneVisitorNoKeywordSpecifiedTest: Differences with expected in '/home/travis/build/piwik/piwik/tests/PHPUnit/Framework/TestCase/../../System/processed/test_OneVisitor_NoKeywordSpecified__Live.getLastVisitsDetails_day.xml'

Failed asserting that two DOM documents are equal.

--- Expected
+++ Actual
@@ @@

     <idVisit>1</idVisit>
-    <visitIp>156.5.0.0</visitIp>
+    <visitIp>156.5.3.2</visitIp>
@mattab mattab added the c: Tests & QA For issues related to automated tests or making it easier to QA & test issues. label Jun 8, 2015
@mattab mattab added this to the 2.14.0 milestone Jun 8, 2015
diosmosis pushed a commit that referenced this issue Jun 8, 2015
Refs #8057, disable opcache in travis to avoid random system test fai…
9a6b376 
…lure.
diosmosis pushed a commit that referenced this issue Jun 8, 2015
Refs #8057, disable opcache in travis to avoid random system test fai…
3d0ca73 
…lure.
@mattab
Copy link
Member Author

mattab commented Jun 11, 2015

Looks fixed after opcache was disabled in travis CI 👍

@mattab mattab closed this as completed Jun 11, 2015
@mattab mattab added the not-in-changelog For issues or pull requests that should not be included in our release changelog on matomo.org. label Jun 11, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
c: Tests & QA For issues related to automated tests or making it easier to QA & test issues. not-in-changelog For issues or pull requests that should not be included in our release changelog on matomo.org.
Projects
None yet
Milestone
2.14.0
Development

No branches or pull requests
1 participant
@mattab