Re: Build failed in Jenkins: regression-test-with-multiplex #60

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 

Ok,

I will check if this is catching the data corruption or not after modifying the code in EC.
Initially it was not doing so.


From: "Atin Mukherjee" <amukherj@xxxxxxxxxx>
To: "Ashish Pandey" <aspandey@xxxxxxxxxx>
Cc: "Gluster Devel" <gluster-devel@xxxxxxxxxxx>
Sent: Monday, June 12, 2017 3:21:29 PM
Subject: Re: Build failed in Jenkins: regression-test-with-multiplex #60



On Mon, Jun 12, 2017 at 11:37 AM, Atin Mukherjee <amukherj@xxxxxxxxxx> wrote:


On Mon, Jun 12, 2017 at 11:15 AM, Ashish Pandey <aspandey@xxxxxxxxxx> wrote:

Test is failing because of ENOTCONN.

-----------------------------------------------------------------------------+
[2017-06-11 21:26:04.650497] I [fuse-bridge.c:4210:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.24 kernel 7.14
[2017-06-11 21:26:04.650546] I [fuse-bridge.c:4840:fuse_graph_sync] 0-fuse: switched to graph 0
[2017-06-11 21:26:04.650890] E [fuse-bridge.c:4276:fuse_first_lookup] 0-fuse: first lookup on root failed (Transport endpoint is not connected)
[2017-06-11 21:26:04.651204] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected)
[2017-06-11 21:26:04.651231] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 2: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed
[2017-06-11 21:26:04.651379] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected)
[2017-06-11 21:26:04.651396] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 3: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed
[2017-06-11 21:26:05.654880] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected)
[2017-06-11 21:26:05.654921] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 4: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed
[2017-06-11 21:26:05.655105] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected)
[2017-06-11 21:26:05.655132] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 5: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed
[2017-06-11 21:26:06.658233] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected)
[2017-06-11 21:26:06.658294] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 6: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed
[2017-06-11 21:26:06.658445] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected)
[2017-06-11 21:26:06.658471] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 7: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed
[2017-06-11 21:26:07.661446] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected)
[2017-06-11 21:26:07.661487] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 8: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed
[2017-06-11 21:26:07.661625] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected)
[2017-06-11 21:26:07.661642] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 9: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed
[2017-06-11 21:26:08.664545] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected)
[2017-06-11 21:26:08.664598] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 10: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed



In this test, we are trying to kill a brick and starting it using command line.
I think that is what actually failing.
In multiplexing, can we do it?  Or  is there some other way of doing the same thing?

What's the reason of starting the brick from cmdline? Why can't we start the volume with force?

 


Ashish


From: "Atin Mukherjee" <amukherj@xxxxxxxxxx>
To: "Ashish Pandey" <aspandey@xxxxxxxxxx>
Cc: "Gluster Devel" <gluster-devel@xxxxxxxxxxx>
Sent: Monday, June 12, 2017 10:10:05 AM
Subject: Fwd: Build failed in Jenkins: regression-test-with-multiplex #60


https://review.gluster.org/#/c/16985/ has introduced a new test ec-data-heal.t which is now constantly failing with brick multiplexing. Can this be looked at?

---------- Forwarded message ----------
From: <jenkins@xxxxxxxxxxxxxxxxx>
Date: Mon, Jun 12, 2017 at 6:33 AM
Subject: Build failed in Jenkins: regression-test-with-multiplex #60
To: maintainers@xxxxxxxxxxx, jeff@xxxxxxxxxx, avishwan@xxxxxxxxxx, pkarampu@xxxxxxxxxx, amukherj@xxxxxxxxxx, xhernandez@xxxxxxxxxx, rgowdapp@xxxxxxxxxx, ndevos@xxxxxxxxxx


See <https://build.gluster.org/job/regression-test-with-multiplex/60/display/redirect>

------------------------------------------
[...truncated 747.65 KB...]
./tests/basic/glusterd/arbiter-volume-probe.t  -  14 second
./tests/basic/gfid-access.t  -  14 second
./tests/basic/ec/ec-root-heal.t  -  14 second
./tests/basic/afr/stale-file-lookup.t  -  14 second
./tests/bugs/replicate/bug-986905.t  -  13 second
./tests/bugs/replicate/bug-921231.t  -  13 second
./tests/bugs/replicate/bug-1325792.t  -  13 second
./tests/bugs/replicate/bug-1132102.t  -  13 second
./tests/bugs/quota/bug-1250582-volume-reset-should-not-remove-quota-quota-deem-statfs.t  -  13 second
./tests/bugs/quota/bug-1178130.t  -  13 second
./tests/bugs/protocol/bug-762989.t  -  13 second
./tests/bugs/posix/bug-1360679.t  -  13 second
./tests/bugs/glusterd/bug-955588.t  -  13 second
./tests/bugs/glusterd/bug-1242875-do-not-pass-volinfo-quota.t  -  13 second
./tests/bugs/fuse/bug-985074.t  -  13 second
./tests/bugs/bitrot/1207029-bitrot-daemon-should-start-on-valid-node.t  -  13 second
./tests/bitrot/bug-1207627-bitrot-scrub-status.t  -  13 second
./tests/basic/volume-status.t  -  13 second
./tests/basic/stats-dump.t  -  13 second
./tests/basic/inode-quota-enforcing.t  -  13 second
./tests/bugs/replicate/bug-1448804-check-quorum-type-values.t  -  12 second
./tests/bugs/nfs/bug-904065.t  -  12 second
./tests/bugs/nfs/bug-1157223-symlink-mounting.t  -  12 second
./tests/bugs/glusterfs/bug-902610.t  -  12 second
./tests/bugs/glusterfs/bug-872923.t  -  12 second
./tests/bugs/glusterd/bug-949930.t  -  12 second
./tests/bugs/glusterd/bug-889630.t  -  12 second
./tests/bugs/glusterd/bug-1121584-brick-existing-validation-for-remove-brick-status-stop.t  -  12 second
./tests/bugs/distribute/bug-961615.t  -  12 second
./tests/bugs/distribute/bug-1247563.t  -  12 second
./tests/bugs/distribute/bug-1088231.t  -  12 second
./tests/bugs/distribute/bug-1086228.t  -  12 second
./tests/bugs/cli/bug-1087487.t  -  12 second
./tests/bugs/cli/bug-1030580.t  -  12 second
./tests/bugs/cli/bug-1022905.t  -  12 second
./tests/bugs/bitrot/1209818-vol-info-show-scrub-process-properly.t  -  12 second
./tests/basic/quota-nfs.t  -  12 second
./tests/basic/pump.t  -  12 second
./tests/basic/md-cache/bug-1317785.t  -  12 second
./tests/basic/fop-sampling.t  -  12 second
./tests/performance/open-behind.t  -  11 second
./tests/features/ssl-authz.t  -  11 second
./tests/bugs/upcall/bug-1458127.t  -  11 second
./tests/bugs/upcall/bug-1227204.t  -  11 second
./tests/bugs/transport/bug-873367.t  -  11 second
./tests/bugs/snapshot/bug-1260848.t  -  11 second
./tests/bugs/replicate/bug-1250170-fsync.t  -  11 second
./tests/bugs/posix/bug-1122028.t  -  11 second
./tests/bugs/md-cache/bug-1211863.t  -  11 second
./tests/bugs/io-cache/bug-read-hang.t  -  11 second
./tests/bugs/glusterd/bug-948729/bug-948729.t  -  11 second
./tests/bugs/glusterd/bug-948729/bug-948729-mode-script.t  -  11 second
./tests/bugs/glusterd/bug-948729/bug-948729-force.t  -  11 second
./tests/bugs/glusterd/bug-1046308.t  -  11 second
./tests/bugs/ec/bug-1179050.t  -  11 second
./tests/bugs/distribute/bug-1122443.t  -  11 second
./tests/bugs/changelog/bug-1208470.t  -  11 second
./tests/bitrot/br-stub.t  -  11 second
./tests/basic/gfapi/gfapi-dup.t  -  11 second
./tests/basic/gfapi/bug-1241104.t  -  11 second
./tests/basic/ec/ec-read-policy.t  -  11 second
./tests/basic/ec/ec-anonymous-fd.t  -  11 second
./tests/features/readdir-ahead.t  -  10 second
./tests/bugs/tier/bug-1205545-CTR-and-trash-integration.t  -  10 second
./tests/bugs/snapshot/bug-1064768.t  -  10 second
./tests/bugs/replicate/bug-966018.t  -  10 second
./tests/bugs/replicate/bug-1365455.t  -  10 second
./tests/bugs/replicate/bug-1101647.t  -  10 second
./tests/bugs/quota/bug-1287996.t  -  10 second
./tests/bugs/quota/bug-1243798.t  -  10 second
./tests/bugs/quota/bug-1104692.t  -  10 second
./tests/bugs/posix/bug-990028.t  -  10 second
./tests/bugs/md-cache/afr-stale-read.t  -  10 second
./tests/bugs/glusterfs/bug-856455.t  -  10 second
./tests/bugs/glusterd/bug-888752.t  -  10 second
./tests/bugs/glusterd/bug-1179175-uss-option-validation.t  -  10 second
./tests/bugs/glusterd/bug-1102656.t  -  10 second
./tests/bugs/glusterd/bug-1091935-brick-order-check-from-cli-to-glusterd.t  -  10 second
./tests/bugs/glusterd/bug-1022055.t  -  10 second
./tests/bugs/ec/bug-1227869.t  -  10 second
./tests/bugs/core/bug-834465.t  -  10 second
./tests/bugs/bug-1258069.t  -  10 second
./tests/bugs/bitrot/bug-1229134-bitd-not-support-vol-set.t  -  10 second
./tests/basic/tier/ctr-rename-overwrite.t  -  10 second
./tests/basic/gfapi/upcall-cache-invalidate.t  -  10 second
./tests/basic/gfapi/libgfapi-fini-hang.t  -  10 second
./tests/basic/gfapi/glfs_xreaddirplus_r.t  -  10 second
./tests/basic/gfapi/anonymous_fd.t  -  10 second
./tests/basic/afr/gfid-heal.t  -  10 second
./tests/basic/afr/arbiter-remove-brick.t  -  10 second
./tests/bugs/upcall/bug-1369430.t  -  9 second
./tests/bugs/snapshot/bug-1178079.t  -  9 second
./tests/bugs/shard/bug-1342298.t  -  9 second
./tests/bugs/shard/bug-1260637.t  -  9 second
./tests/bugs/shard/bug-1258334.t  -  9 second
./tests/bugs/replicate/bug-767585-gfid.t  -  9 second
./tests/bugs/readdir-ahead/bug-1439640.t  -  9 second
./tests/bugs/posix/bug-1175711.t  -  9 second
./tests/bugs/nfs/bug-915280.t  -  9 second
./tests/bugs/nfs/bug-877885.t  -  9 second
./tests/bugs/nfs/bug-1143880-fix-gNFSd-auth-crash.t  -  9 second
./tests/bugs/nfs/bug-1116503.t  -  9 second
./tests/bugs/io-cache/bug-858242.t  -  9 second
./tests/bugs/glusterfs/bug-895235.t  -  9 second
./tests/bugs/glusterfs/bug-848251.t  -  9 second
./tests/bugs/glusterd/bug-1454418-seg-fault.t  -  9 second
./tests/bugs/glusterd/bug-1446172-brick-mux-reset-brick.t  -  9 second
./tests/bugs/glusterd/bug-1344407-volume-delete-on-node-down.t  -  9 second
./tests/bugs/glusterd/bug-1266818-shared-storage-disable.t  -  9 second
./tests/bugs/distribute/bug-884597.t  -  9 second
./tests/bugs/core/bug-986429.t  -  9 second
./tests/bugs/core/bug-908146.t  -  9 second
./tests/bugs/core/bug-1119582.t  -  9 second
./tests/bugs/bitrot/bug-1210684-scrub-pause-resume-error-handling.t  -  9 second
./tests/bitrot/bug-1221914.t  -  9 second
./tests/basic/ec/nfs.t  -  9 second
./tests/basic/ec/ec-internal-xattrs.t  -  9 second
./tests/basic/ec/ec-fallocate.t  -  9 second
./tests/basic/ec/dht-rename.t  -  9 second
./tests/basic/distribute/bug-1265677-use-readdirp.t  -  9 second
./tests/bugs/upcall/bug-upcall-stat.t  -  8 second
./tests/bugs/unclassified/bug-1034085.t  -  8 second
./tests/bugs/snapshot/bug-1111041.t  -  8 second
./tests/bugs/shard/bug-1259651.t  -  8 second
./tests/bugs/shard/bug-1256580.t  -  8 second
./tests/bugs/shard/bug-1245547.t  -  8 second
./tests/bugs/replicate/bug-976800.t  -  8 second
./tests/bugs/replicate/bug-880898.t  -  8 second
./tests/bugs/nfs/zero-atime.t  -  8 second
./tests/bugs/nfs/socket-as-fifo.t  -  8 second
./tests/bugs/nfs/bug-1166862.t  -  8 second
./tests/bugs/md-cache/bug-1211863_unlink.t  -  8 second
./tests/bugs/glusterfs-server/bug-873549.t  -  8 second
./tests/bugs/glusterfs-server/bug-864222.t  -  8 second
./tests/bugs/glusterfs/bug-893378.t  -  8 second
./tests/bugs/glusterd/bug-839595.t  -  8 second
./tests/bugs/glusterd/bug-1163108-min-free-disk-option-validation.t  -  8 second
./tests/bugs/distribute/bug-912564.t  -  8 second
./tests/bugs/distribute/bug-1368012.t  -  8 second
./tests/bugs/core/io-stats-1322825.t  -  8 second
./tests/bugs/core/bug-913544.t  -  8 second
./tests/bugs/cli/bug-961307.t  -  8 second
./tests/bugs/access-control/bug-1051896.t  -  8 second
./tests/basic/afr/heal-info.t  -  8 second
./tests/performance/quick-read.t  -  7 second
./tests/features/leases.t  -  7 second
./tests/bugs/upcall/bug-1422776.t  -  7 second
./tests/bugs/upcall/bug-1394131.t  -  7 second
./tests/bugs/trace/bug-797171.t  -  7 second
./tests/bugs/shard/bug-1272986.t  -  7 second
./tests/bugs/shard/bug-1250855.t  -  7 second
./tests/bugs/rpc/bug-954057.t  -  7 second
./tests/bugs/replicate/bug-886998.t  -  7 second
./tests/bugs/read-only/bug-1134822-read-only-default-in-graph.t  -  7 second
./tests/bugs/quick-read/bug-846240.t  -  7 second
./tests/bugs/posix/bug-765380.t  -  7 second
./tests/bugs/nl-cache/bug-1451588.t  -  7 second
./tests/bugs/nfs/subdir-trailing-slash.t  -  7 second
./tests/bugs/nfs/showmount-many-clients.t  -  7 second
./tests/bugs/nfs/bug-847622.t  -  7 second
./tests/bugs/nfs/bug-1210338.t  -  7 second
./tests/bugs/nfs/bug-1161092-nfs-acls.t  -  7 second
./tests/bugs/glusterfs-server/bug-861542.t  -  7 second
./tests/bugs/glusterd/bug-878004.t  -  7 second
./tests/bugs/glusterd/bug-1095097.t  -  7 second
./tests/bugs/glusterd/bug-1094119-remove-replace-brick-support-from-glusterd.t  -  7 second
./tests/bugs/glusterd/bug-1092841.t  -  7 second
./tests/bugs/glusterd/bug-1085330.t  -  7 second
./tests/bugs/geo-replication/bug-1296496.t  -  7 second
./tests/bugs/fuse/bug-1283103.t  -  7 second
./tests/bugs/fuse/bug-1126048.t  -  7 second
./tests/bugs/distribute/bug-907072.t  -  7 second
./tests/bugs/core/bug-1168803-snapd-option-validation-fix.t  -  7 second
./tests/bugs/core/949327.t  -  7 second
./tests/bugs/cli/bug-983317-volume-get.t  -  7 second
./tests/bugs/cli/bug-867252.t  -  7 second
./tests/bugs/cli/bug-1004218.t  -  7 second
./tests/bugs/access-control/bug-1387241.t  -  7 second
./tests/bitrot/bug-internal-xattrs-check-1243391.t  -  7 second
./tests/basic/nl-cache.t  -  7 second
./tests/basic/gfapi/glfs_sysrq.t  -  7 second
./tests/basic/gfapi/gfapi-trunc.t  -  7 second
./tests/basic/gfapi/gfapi-async-calls-test.t  -  7 second
./tests/features/ipc.t  -  6 second
./tests/bugs/shard/bug-1261773.t  -  6 second
./tests/bugs/readdir-ahead/bug-1446516.t  -  6 second
./tests/bugs/nfs/bug-970070.t  -  6 second
./tests/bugs/nfs/bug-1302948.t  -  6 second
./tests/bugs/glusterfs-server/bug-889996.t  -  6 second
./tests/bugs/glusterfs-server/bug-877992.t  -  6 second
./tests/bugs/glusterfs/bug-869724.t  -  6 second
./tests/bugs/glusterfs/bug-844688.t  -  6 second
./tests/bugs/glusterd/bug-958790.t  -  6 second
./tests/bugs/glusterd/bug-905307.t  -  6 second
./tests/bugs/glusterd/bug-862834.t  -  6 second
./tests/bugs/glusterd/bug-1314649-group-virt.t  -  6 second
./tests/bugs/glusterd/bug-1199451-op-version-retrieving-fix.t  -  6 second
./tests/bugs/fuse/bug-1336818.t  -  6 second
./tests/bugs/fuse/bug-1309462.t  -  6 second
./tests/bugs/distribute/bug-924265.t  -  6 second
./tests/bugs/distribute/bug-1204140.t  -  6 second
./tests/bugs/core/log-bug-1362520.t  -  6 second
./tests/bugs/core/bug-903336.t  -  6 second
./tests/bugs/core/bug-1421721-mpx-toggle.t  -  6 second
./tests/bugs/core/bug-1135514-allow-setxattr-with-null-value.t  -  6 second
./tests/bugs/cli/bug-1378842-volume-get-all.t  -  6 second
./tests/basic/quota-rename.t  -  6 second
./tests/basic/md-cache/bug-1418249.t  -  6 second
./tests/basic/gfapi/gfapi-load-volfile.t  -  6 second
./tests/basic/fops-sanity.t  -  6 second
./tests/bugs/unclassified/bug-991622.t  -  5 second
./tests/bugs/replicate/bug-884328.t  -  5 second
./tests/bugs/logging/bug-823081.t  -  5 second
./tests/bugs/glusterfs/bug-892730.t  -  5 second
./tests/bugs/glusterfs/bug-860297.t  -  5 second
./tests/bugs/glusterfs/bug-811493.t  -  5 second
./tests/bugs/glusterd/bug-916549.t  -  5 second
./tests/bugs/glusterd/bug-913487.t  -  5 second
./tests/bugs/glusterd/bug-1433578-invalid-peer-glusterd-crash.t  -  5 second
./tests/bugs/glusterd/bug-1321836-fix-opret-for-volume-info-xml-output.t  -  5 second
./tests/bugs/glusterd/bug-1315186-reject-lowering-down-op-version.t  -  5 second
./tests/bugs/glusterd/bug-1238135-lazy-daemon-initialization-on-demand.t  -  5 second
./tests/bugs/glusterd/bug-000000.t  -  5 second
./tests/bugs/core/bug-924075.t  -  5 second
./tests/bugs/core/bug-845213.t  -  5 second
./tests/bugs/core/bug-1117951.t  -  5 second
./tests/bugs/core/bug-1111557.t  -  5 second
./tests/bugs/cli/bug-977246.t  -  5 second
./tests/bugs/cli/bug-969193.t  -  5 second
./tests/bugs/cli/bug-949298.t  -  5 second
./tests/bugs/cli/bug-764638.t  -  5 second
./tests/bugs/cli/bug-1047378.t  -  5 second
./tests/basic/afr/arbiter-cli.t  -  5 second
./tests/bugs/glusterfs/bug-853690.t  -  4 second
./tests/bugs/cli/bug-921215.t  -  4 second
./tests/basic/gfapi/sink.t  -  2 second
./tests/features/glupy.t  -  1 second
./tests/bugs/shard/zero-flag.t  -  1 second
./tests/basic/posixonly.t  -  1 second
./tests/basic/netgroup_parsing.t  -  1 second
./tests/basic/exports_parsing.t  -  1 second
./tests/basic/first-test.t  -  0 second

Result is 1

tar: Removing leading `/' from member names
Logs archived in http://slave26.cloud.gluster.org/logs/glusterfs-logs-regression-test-with-multiplex-60.tgz
kernel.core_pattern = /%e-%p.core
Build step 'Execute shell' marked build as failure





_______________________________________________
Gluster-devel mailing list
Gluster-devel@xxxxxxxxxxx
http://lists.gluster.org/mailman/listinfo/gluster-devel
[Index of Archives]     [Gluster Users]     [Ceph Users]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Security]     [Bugtraq]     [Linux]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux