On 15/06/2014, at 3:36 AM, Pranith Kumar Karampuri wrote:
> On 06/13/2014 06:41 PM, Justin Clift wrote:
>> Hi Pranith,
>>
>> Do you want me to keep sending you spurious regression failure
>> notification?
>>
>> There's a fair few of them isn't there?
> I am doing one run on my VM. I will get back with the ones that fail on my VM. You can also do the same on your machine.
Cool, that should help. :)
These are the spurious failures found when running the rackspace-regression-2G
tests over friday and yesterday:
* bug-859581.t -- SPURIOUS
* 4846 - http://slave24.cloud.gluster.org/logs/glusterfs-logs-20140614:14:33:41.tgz
* 6009 - http://slave20.cloud.gluster.org/logs/glusterfs-logs-20140613:20:24:58.tgz
* 6652 - http://slave22.cloud.gluster.org/logs/glusterfs-logs-20140613:22:04:16.tgz
* 7796 - http://slave20.cloud.gluster.org/logs/glusterfs-logs-20140614:14:22:53.tgz
* 7987 - http://slave22.cloud.gluster.org/logs/glusterfs-logs-20140613:15:21:04.tgz
* 7992 - http://slave10.cloud.gluster.org/logs/glusterfs-logs-20140613:20:21:15.tgz
* 8014 - http://slave24.cloud.gluster.org/logs/glusterfs-logs-20140613:20:39:01.tgz
* 8054 - http://slave24.cloud.gluster.org/logs/glusterfs-logs-20140613:13:15:50.tgz
* 8062 - http://slave10.cloud.gluster.org/logs/glusterfs-logs-20140613:13:28:48.tgz
* mgmt_v3-locks.t -- SPURIOUS
* 6483 - build.gluster.org -> http://build.gluster.org/job/regression/4847/consoleFull
* 6630 - http://slave22.cloud.gluster.org/logs/glusterfs-logs-20140614:15:42:39.tgz
* 6946 - http://slave21.cloud.gluster.org/logs/glusterfs-logs-20140613:20:57:27.tgz
* 7392 - http://slave21.cloud.gluster.org/logs/glusterfs-logs-20140613:13:57:20.tgz
* 7852 - http://slave24.cloud.gluster.org/logs/glusterfs-logs-20140613:19:23:17.tgz
* 8014 - http://slave24.cloud.gluster.org/logs/glusterfs-logs-20140613:20:39:01.tgz
* 8015 - http://slave23.cloud.gluster.org/logs/glusterfs-logs-20140613:14:26:01.tgz
* 8048 - http://slave24.cloud.gluster.org/logs/glusterfs-logs-20140613:18:13:07.tgz
* bug-918437-sh-mtime.t -- SPURIOUS
* 6459 - http://slave21.cloud.gluster.org/logs/glusterfs-logs-20140614:18:28:43.tgz
* 7493 - http://slave22.cloud.gluster.org/logs/glusterfs-logs-20140613:10:30:16.tgz
* 7987 - http://slave10.cloud.gluster.org/logs/glusterfs-logs-20140613:14:23:02.tgz
* 7992 - http://slave10.cloud.gluster.org/logs/glusterfs-logs-20140613:20:21:15.tgz
* fops-sanity.t -- SPURIOUS
* 8014 - http://slave20.cloud.gluster.org/logs/glusterfs-logs-20140613:18:18:33.tgz
* 8066 - http://slave20.cloud.gluster.org/logs/glusterfs-logs-20140614:21:35:57.tgz
* bug-857330/xml.t - SPURIOUS
* 7523 - logs may (?) be hard to parse due to other failure data for this CR in them
* 8029 - http://slave23.cloud.gluster.org/logs/glusterfs-logs-20140613:16:46:03.tgz
If we resolve these five, our regression testing should be a *lot* more
predictable. :)
Text file (attached to this email) has the bulk test results. Manually
cut-n-pasted from browser to the text doc, so be wary of possible typos. ;)
> Give the output of "for i in `cat problematic-ones.txt`; do echo $i $(git log $i | grep Author| tail -1); done"
>>
>> Maybe we should make 1 BZ for the lot, and attach the logs
>> to that BZ for later analysis?
> I am already using 1092850 for this.
Good info. :)
+ Justin
Spurious failures
*****************
* bug-859581.t -- SPURIOUS
* 4846 - http://slave24.cloud.gluster.org/logs/glusterfs-logs-20140614:14:33:41.tgz
* 6009 - http://slave20.cloud.gluster.org/logs/glusterfs-logs-20140613:20:24:58.tgz
* 6652 - http://slave22.cloud.gluster.org/logs/glusterfs-logs-20140613:22:04:16.tgz
* 7796 - http://slave20.cloud.gluster.org/logs/glusterfs-logs-20140614:14:22:53.tgz
* 7987 - http://slave22.cloud.gluster.org/logs/glusterfs-logs-20140613:15:21:04.tgz
* 7992 - http://slave10.cloud.gluster.org/logs/glusterfs-logs-20140613:20:21:15.tgz
* 8014 - http://slave24.cloud.gluster.org/logs/glusterfs-logs-20140613:20:39:01.tgz
* 8054 - http://slave24.cloud.gluster.org/logs/glusterfs-logs-20140613:13:15:50.tgz
* 8062 - http://slave10.cloud.gluster.org/logs/glusterfs-logs-20140613:13:28:48.tgz
* mgmt_v3-locks.t -- SPURIOUS
* 6483 - build.gluster.org -> http://build.gluster.org/job/regression/4847/consoleFull
* 6630 - http://slave22.cloud.gluster.org/logs/glusterfs-logs-20140614:15:42:39.tgz
* 6946 - http://slave21.cloud.gluster.org/logs/glusterfs-logs-20140613:20:57:27.tgz
* 7392 - http://slave21.cloud.gluster.org/logs/glusterfs-logs-20140613:13:57:20.tgz
* 7852 - http://slave24.cloud.gluster.org/logs/glusterfs-logs-20140613:19:23:17.tgz
* 8014 - http://slave24.cloud.gluster.org/logs/glusterfs-logs-20140613:20:39:01.tgz
* 8015 - http://slave23.cloud.gluster.org/logs/glusterfs-logs-20140613:14:26:01.tgz
* 8048 - http://slave24.cloud.gluster.org/logs/glusterfs-logs-20140613:18:13:07.tgz
* bug-918437-sh-mtime.t -- SPURIOUS
* 6459 - http://slave21.cloud.gluster.org/logs/glusterfs-logs-20140614:18:28:43.tgz
* 7493 - http://slave22.cloud.gluster.org/logs/glusterfs-logs-20140613:10:30:16.tgz
* 7987 - http://slave10.cloud.gluster.org/logs/glusterfs-logs-20140613:14:23:02.tgz
* 7992 - http://slave10.cloud.gluster.org/logs/glusterfs-logs-20140613:20:21:15.tgz
* fops-sanity.t -- SPURIOUS
* 8014 - http://slave20.cloud.gluster.org/logs/glusterfs-logs-20140613:18:18:33.tgz
* 8066 - http://slave20.cloud.gluster.org/logs/glusterfs-logs-20140614:21:35:57.tgz
* bug-857330/xml.t - SPURIOUS
* 7523 - logs may (?) be hard to parse due to other failure data for this CR in them
* 8029 - http://slave23.cloud.gluster.org/logs/glusterfs-logs-20140613:16:46:03.tgz
Other failures
**************
* afr/afr_estale.t
* 5825 (x2) - seems real failure
* bug-857330/normal.t
* 7523
* bug-865825.t - SPURIOUS (but rare?)
* 7933
* bug-873367.t
* 3695 -- seems real failure
* bug-902610.t
* 4669 (x2) - seems real failure
* bug-974007.t
* 7523
* bug-1037790.t
* 6429 (x2) - seems real failure
* bug-1040355.t
* 6483 (x2) - seems real failure
* bug-1066798.t
* 7523
* bug-1099890.t
* 7942 (x2) - seems real failure
* pump.t - HOST WEIRDNESS?
* 7854
* quota.t
* 4846 (x2) - seems real failure
* 7662 -- seems real failure
* rpm.t -- NOT SPURIOUS. Mock rpm failure on host system, now fixed.
* 7852
* uss.t -- addressed by Vijay's patch
* 8015 (x3)
Bulk CR failure results
***********************
* 3910
* Many failures
* 3695:
* http://build.gluster.org/job/rackspace-regression-2GB/7/console
* bug-873367.t (Wstat: 0 Tests: 16 Failed: 2)
Failed tests: 13-14
* 4669
* http://build.gluster.org/job/rackspace-regression-2GB/171/console
* bug-902610.t (Wstat: 0 Tests: 8 Failed: 1)
Failed test: 8
* http://build.gluster.org/job/rackspace-regression-2GB/176/consoleFull
* bug-902610.t (Wstat: 0 Tests: 8 Failed: 1)
Failed test: 8
* 4846
* http://build.gluster.org/job/rackspace-regression-2GB/128/console
* quota.t (Wstat: 0 Tests: 72 Failed: 1)
Failed test: 65
bug-859581.t (Wstat: 0 Tests: 23 Failed: 1)
Failed test: 12
* http://build.gluster.org/job/rackspace-regression-2GB/133/consoleFull
* quota.t (Wstat: 0 Tests: 72 Failed: 1)
Failed test: 65
* 5825
* http://build.gluster.org/job/rackspace-regression-2GB/144/console
* afr/afr_estale.t (Wstat: 0 Tests: 14 Failed: 3)
Failed tests: 11, 13-14
* http://build.gluster.org/job/rackspace-regression-2GB/160/consoleFull
* afr/afr_estale.t (Wstat: 0 Tests: 14 Failed: 3)
Failed tests: 11, 13-14
* 6009
* http://build.gluster.org/job/rackspace-regression-2GB/89/console
* bug-859581.t (Wstat: 0 Tests: 23 Failed: 1)
Failed test: 12
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/108/consoleFull
* 6429
* http://build.gluster.org/job/rackspace-regression-2GB/141/console
* bug-1037790.t (Wstat: 0 Tests: 15 Failed: 1)
Failed test: 15
* http://build.gluster.org/job/rackspace-regression-2GB/164/consoleFull
* bug-1037790.t (Wstat: 0 Tests: 15 Failed: 1)
Failed test: 15
* 6459
* http://build.gluster.org/job/rackspace-regression-2GB/169/console
* bug-918437-sh-mtime.t (Wstat: 0 Tests: 31 Failed: 2)
Failed tests: 23, 26
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/175/consoleFull
* 6483
* http://build.gluster.org/job/rackspace-regression-2GB/39/console
* bug-1040355.t (Wstat: 0 Tests: 11 Failed: 5)
Failed tests: 7-11
* http://build.gluster.org/job/regression/4847/consoleFull
* mgmt_v3-locks.t (Wstat: 0 Tests: 14 Failed: 3)
Failed tests: 11-13
* http://build.gluster.org/job/rackspace-regression/133/consoleFull
* bug-1040355.t (Wstat: 0 Tests: 11 Failed: 5)
Failed tests: 7-11
* 6630
* http://build.gluster.org/job/rackspace-regression-2GB/140/console
* mgmt_v3-locks.t (Wstat: 0 Tests: 14 Failed: 3)
Failed tests: 11-13
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/163/consoleFull
* 6652
* http://build.gluster.org/job/rackspace-regression-2GB/102/console
* bug-859581.t (Wstat: 0 Tests: 23 Failed: 1)
Failed test: 12
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/123/consoleFull
* 6739
* Many failures
* 6946
* http://build.gluster.org/job/rackspace-regression-2GB/93/console
* mgmt_v3-locks.t (Wstat: 0 Tests: 14 Failed: 1)
Failed test: 14
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/121/consoleFull
* 7392
* http://build.gluster.org/job/rackspace-regression-2GB/31/console
* mgmt_v3-locks.t (Wstat: 0 Tests: 14 Failed: 3)
Failed tests: 11-13
bug-859581.t (Wstat: 0 Tests: 23 Failed: 1)
Failed test: 12
georep-rsync-changelog.t (Wstat: 256 Tests: 3 Failed: 0)
Non-zero exit status: 1
Parse errors: Bad plan. You planned 16 tests but ran 3.
georep-rsync-hybrid.t (Wstat: 256 Tests: 16 Failed: 12)
Failed tests: 4-9, 11-16
Non-zero exit status: 1
georep-setup.t (Wstat: 0 Tests: 13 Failed: 4)
Failed tests: 8-9, 12-13
georep-tarssh-changelog.t (Wstat: 256 Tests: 3 Failed: 0)
Non-zero exit status: 1
Parse errors: Bad plan. You planned 16 tests but ran 3.
georep-tarssh-hybrid.t (Wstat: 256 Tests: 16 Failed: 12)
Failed tests: 4-9, 11-16
* 7470
* Many failures
* 7493
* http://build.gluster.org/job/rackspace-regression-2GB/10/console
* bug-918437-sh-mtime.t (Wstat: 0 Tests: 31 Failed: 1)
Failed test: 23
* 7523
* http://build.gluster.org/job/rackspace-regression-2GB/130/console
* bug-1066798.t (Wstat: 0 Tests: 214 Failed: 63)
Failed tests: 62, 109, 111, 121, 129, 133, 135, 139, 141
147, 157, 163-214
bug-857330/normal.t (Wstat: 0 Tests: 24 Failed: 1)
Failed test: 20
bug-857330/xml.t (Wstat: 0 Tests: 27 Failed: 1)
Failed test: 23
bug-974007.t (Wstat: 0 Tests: 15 Failed: 1)
Failed test: 9
* 7662
* http://build.gluster.org/job/rackspace-regression-2GB/133/console
* quota.t (Wstat: 0 Tests: 72 Failed: 1)
Failed test: 65
* 7782
* Real failure
* http://build.gluster.org/job/rackspace-regression-2GB/74/consoleFull
* 7796
* http://build.gluster.org/job/rackspace-regression-2GB/126/console
bug-859581.t (Wstat: 0 Tests: 23 Failed: 1)
Failed test: 12
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/151/consoleFull
* 7852
* http://build.gluster.org/job/rackspace-regression-2GB/79/console
* mgmt_v3-locks.t (Wstat: 0 Tests: 14 Failed: 3)
Failed tests: 11-13
* http://build.gluster.org/job/rackspace-regression-2GB/96/consoleFull
* rpm.t (Wstat: 0 Tests: 8 Failed: 1)
Failed test: 8
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/111/consoleFull
* 7854
* http://build.gluster.org/job/rackspace-regression-2GB/166/console
* pump.t (Wstat: 0 Tests: 12 Failed: 2)
Failed tests: 11-12
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/173/consoleFull
* 7933
* http://build.gluster.org/job/rackspace-regression-2GB/107/console
* bug-865825.t (Wstat: 0 Tests: 21 Failed: 1)
Failed test: 16
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/122/consoleFull
* 7942
* http://build.gluster.org/job/rackspace-regression-2GB/114/console
* bug-1099890.t (Wstat: 0 Tests: 40 Failed: 10)
Failed tests: 22-23, 25-26, 29-30, 33-34, 39-40
* http://build.gluster.org/job/rackspace-regression-2GB/120/consoleFull
* bug-1099890.t (Wstat: 0 Tests: 40 Failed: 10)
Failed tests: 22-23, 25-26, 29-30, 33-34, 39-40
* 7964
* Real failure
* http://build.gluster.org/job/rackspace-regression-2GB/99/console
* 7987
* http://build.gluster.org/job/rackspace-regression-2GB/29/console
* bug-918437-sh-mtime.t (Wstat: 0 Tests: 31 Failed: 1)
Failed test: 23
* http://build.gluster.org/job/rackspace-regression-2GB/42/console
* bug-859581.t (Wstat: 0 Tests: 23 Failed: 1)
Failed test: 12
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/57/consoleFull
* 7992
* http://build.gluster.org/job/rackspace-regression-2GB/78/console
* bug-859581.t (Wstat: 0 Tests: 23 Failed: 1)
Failed test: 12
bug-918437-sh-mtime.t (Wstat: 0 Tests: 31 Failed: 2)
Failed tests: 23, 26
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/90/consoleFull
* 8014
* http://build.gluster.org/job/rackspace-regression-2GB/69/console
* fops-sanity.t (Wstat: 0 Tests: 11 Failed: 1)
Failed test: 10
* http://build.gluster.org/job/rackspace-regression-2GB/91/consoleFull
* mgmt_v3-locks.t (Wstat: 0 Tests: 14 Failed: 3)
Failed tests: 11-13
bug-859581.t (Wstat: 0 Tests: 23 Failed: 1)
Failed test: 12
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/110/consoleFull
* 8015
* http://build.gluster.org/job/rackspace-regression-2GB/6/console
* uss.t (Wstat: 0 Tests: 130 Failed: 26)
Failed tests: 17-24, 28, 31-32, 39-40, 76-83, 87, 90-91, 98-99
* http://build.gluster.org/job/rackspace-regression-2GB/35/console
* mgmt_v3-locks.t (Wstat: 0 Tests: 14 Failed: 3)
Failed tests: 11-13
uss.t (Wstat: 0 Tests: 130 Failed: 26)
Failed tests: 17-24, 28, 31-32, 39-40, 76-83, 87, 90-91, 98-99
* http://build.gluster.org/job/rackspace-regression-2GB/47/consoleFull
* uss.t (Wstat: 0 Tests: 130 Failed: 26)
Failed tests: 17-24, 28, 31-32, 39-40, 76-83, 87, 90-91, 98-99
* 8029
* http://build.gluster.org/job/rackspace-regression-2GB/54/console
* bug-857330/xml.t (Wstat: 0 Tests: 27 Failed: 1)
Failed test: 23
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/66/consoleFull
* 8048
* http://build.gluster.org/job/rackspace-regression-2GB/68/console
* mgmt_v3-locks.t (Wstat: 0 Tests: 14 Failed: 3)
Failed tests: 11-13
* 8054
* http://build.gluster.org/job/rackspace-regression-2GB/28/console
* bug-859581.t (Wstat: 0 Tests: 23 Failed: 1)
Failed test: 12
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/43/console
* 8062
* http://build.gluster.org/job/rackspace-regression-2GB/23/console
* bug-859581.t (Wstat: 0 Tests: 23 Failed: 1)
Failed test: 12
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/32/console
* 8066
* http://build.gluster.org/job/rackspace-regression-2GB/177/consoleFull
* fops-sanity.t (Wstat: 0 Tests: 11 Failed: 1)
Failed test: 10
** Subsequent pass
* http://build.gluster.org/job/rackspace-regression-2GB/179/consoleFull
--
GlusterFS - http://www.gluster.org
An open source, distributed file system scaling to several
petabytes, and handling thousands of clients.
My personal twitter: twitter.com/realjustinclift
_______________________________________________
Gluster-devel mailing list
Gluster-devel@xxxxxxxxxxx
http://supercolony.gluster.org/mailman/listinfo/gluster-devel
