Re: Spice agent and LXC

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Despite my problem with building within my VM environment, I went ahead and attempted a Fedora LXC+Spice configuration. I'm happy to report it was successful as well. The only change that had to be made was adding the -f argument to the Xspice script to keep spice-vdagentd from attempting ioctl ops on the uinput pipe created by the QXL driver. I'm not sure why I didn't see this before, looks like I had mistakenly forgotten to use --prefix=/usr on the vdagent source, so I was using the distribution-provided version which doesn't have the -f option at all and apparently doesn't print the "improper ioctl for device" error. However, upon ensuring I was using the git versions of the vdagents and the -f flag was added in Xspice, I was again successful!

Hooray!

Well, if nothing else, I hope this discussion helps somebody else looking to accomplish the same task. And, even if it wasn't intended, props to the developers for having the foresight in making the QXL driver/Xspice and the agents flexible enough to use non-character devices and therefore eliminating the reliance on a virtualized environment. You guys rock!

Chuck R.

On 11/27/2014 11:27 PM, Charles Ricketts wrote:
Finally got it set up in an Ubuntu VM, but I get the same segfault error sans-LXC. Just a note, in order to actually get it compiled within Ubuntu I had to make a change to a Makefile:

spice/server/tests/Makefile: add -lm to LDFLAGS (looks like the LIBM line below doesn't get used?)

(hand typed diff, prone to error)

--- Makefile    2014-11-27 22:00:04.138824336 -0600
+++ Makefile.mod        2014-11-27 21:59:37.802824336 -0600
@@ -334,7 +334,7 @@
 INSTALL_STRIP_PROGRAM = $(install_sh) -c -s
 JPEG_LIBS = -ljpeg
 LD = /usr/bin/ld -m elf_x86_64
-LDFLAGS = 
+LDFLAGS = -lm
LIBM = -lm
LIBOBJS =
LIBRT = -lrt

But, even after getting it successfully built, I get the same segfault as in LXC (note, no X is currently running and again this is hand-typed):

$ sudo Xspice --vdagent --vdagent-exec $(which spice-vdagent) --vdagentd-exec $(which spice-vdagentd) --disable-ticketing :0
...
Loading extension GLX
resizing surface0 to 1677216
memory space from 0x7f10bfba0010 to 0x7f10c6b9d010
memory space from 0x7f10b6b9f010 to 0x7f10beb9f010
changing surface0 to 1677216
memory spice from 0x7f10bfba0010 to 0x7f10c6b9d010
memory space from 0x7f10b6b9f010 to 0x7f10beb9f010
(EE)
(EE) Backtrace:
(EE) 0: /usr/bin/Xorg (xorg_backtrace+0x48) [0x7f10ce389c78]
(EE) 1: /usr/bin/Xorg (0x7f10ce1e1000+0x1ac969) [0x7f10ce38d969]
(EE) 2: /lib/x86_64-linux-gnu/libpthread.so.0 (0x7f10cd2de000+0x10340) [0x7f10cd2ee340]
(EE) 3: /usr/lib/x86_64-linux-gnu/libspice-server.so.1 (0x7f10c7b5d000+0x20d3c) [0x7f10c7b7dd3c]
(EE) 4: /usr/lib/x86_64-linux-gnu/libspice-server.so.1 (0x7f10c7b5d000+0x210dc) [0x7f10c7b7e0dc]
(EE) 5: /usr/lib/xorg/modules/drivers/spiceqxl_drv.so (0x7f10c7e7a000+0x9885) [0x7f10c7e83885]
(EE) 6: /usr/lib/x86_64-linux-gnu/libspice-server.so.1 (0x7f10c7b5d000+0x22dde) [0x7f10c7b7fdde]
(EE) 7: /usr/lib/x86_64-linux-gnu/libspice-server.so.1 (spice_server_add_interface+0x3a6) [0x7f10c7ba6206]
(EE) 8: /usr/lib/xorg/modules/drivers/spiceqxl_drv.so (0x7f10c7e7a000+0xc2a3) [0x7f10c7e862a3]
(EE) 9: /usr/bin/Xorg (AddScreen+0x71) [0x7f10ce236d41]
(EE) 10: /usr/bin/Xorg (InitOutput+0x3c8) [0x7f10ce277ce8]
(EE) 11: /usr/bin/Xorg (0x7f10ce1e1000+0x5975b) [0x7f10ce23a75b]
(EE) 12: /lib/x86_64-linux-gnu/libc.so.6 (__libc_start_main+0xf5) [0x7f10cbd1dec5]
(EE) 13: /usr/bin/Xorg (0x7f10ce1e1000+0x44e7e) [0x7f10ce225e77e]
(EE)
(EE) Segmentation fault at address 0xd8
(EE)
Fatal server error:
(EE) Caught signal 11 (Segmentation fault). Server aborting
....

Kind of glad I hand typed this, because I may have found the error.... it's using the distribution-provided library from /usr/lib/x86_64-linux-gnu/libspice-server.so.1 instead of /usr/lib/libspice-server.so.1, that would cause some weird problems.. Reordering via ldconfig... success!

I actually got it fully working within Ubuntu. Using `Xspice --disable-ticketing --vdagent --vdagentd-exec $(which spice-vdagentd) --vdagent-exec $(which spice-vdagent)`. I had to make a modification to the Xspice script in order to get it working properly:

--- /usr/bin/Xspice     2014-11-27 22:58:26.114824336 -0600
+++ Xspice      2014-11-27 22:58:07.722824336 -0600
 else:
     if args.vdagent_enabled and args.vdagent_launch:
         # XXX use systemd --user for this?
-        vdagentd = launch(args=[args.vdagentd_exec, '-x', '-S', vdagentd_uds,
+        vdagentd = launch(args=[args.vdagentd_exec, '-f', '-x', '-S', vdagentd_uds,
                           '-s', args.vdagent_virtio_path, '-u', args.vdagent_uinput_path])
         time.sleep(1)
         # TODO wait for uinput pipe open for write

This simply adds the -f parameter to spice-vdagentd since /tmp/xspice-uinput is a pipe and not a character devices and, therefore, "fake." Without the parameter, spice-vdagend (pretty sure it was vdagentd) exits complaining about a bad ioctl. Using the modified Xspice allows me to copy/paste and automatic resolution switching.

Getting it working with Xspice is definitely an accomplishment and I now know the caveats I need to fix within my LXC container. But first, my LXC setup depends on X starting with the qxlspice settings -- moving spiceqxl.xorg.conf to xorg.conf. In order to accomplish this I added the undocumented xorg.conf options: "SpiceVdagentEnabled" "0", "SpiceVdagentVirtioPath" "/tmp/xspice-virtio", "SpiceVdagentUinputPath" "/tmp/xspice-uinput" (taken from xf86-video-qxl/src/qxl_driver.c). Now I simply need to figure out how to get spice-vdagent and spice-vdagentd to start up alongside it, but that's another problem for another day. Overall, a huge success.

But now, for Fedora. I'm unable to even get the QXL driver compiled for Fedora, unfortunately. I hit the following error when running `make`:

./configure: line 18133: syntax error near unexpected token `RANDR,'
./configure: line 18133: `XORG_DRIVER_CHECK_EXT(RANDR, randrproto)''

Keep in mind, this is my first experience with Fedora, but I've installed every x11 devel and xrandr devel package I can find. I even used advice I found on another forum to use `yum groupinstall "X11 Development Files"` (or some similar group name) to no avail. Oddly enough, I didn't have any issues with with compiling within my LXC container, but I'm not sure all the steps I took to set that up quite honestly. I even compared my installed packages with those from my LXC container, and they seem the same.

# yum list '*x11*devel*'
Installed Packages
xorg-x11-proto-devel.noarch
xorg-x11-server-devel.x86_64
xorg-x11-xkb-utils-devel.x86_64
xorg-x11-xtrans-devel.noarch
...

#yum list '*randr*devel*'
Installed Packages
libXrandr-devel.x86_64
...

If you guys could point me in the right direction here, it'd be greatly appreciated.

Chuck

On 11/27/2014 06:02 AM, Charles Ricketts wrote:
Well, I have Spice working perfectly fine in a Windows install. However,
seeing as that's not pertinent to the Linux side of things I went ahead
and installed Ubuntu 14.04 in Qemu and, as expected, everything worked.
I didn't bother with the git sources in this install, because I was 99%
sure it was going to work anyway. I don't have a Fedora ISO lying around
to test it with, but I imagine that the results would be the same.

However, I don't think that even this is pertinent to the problem. The
reason I think this is because Qemu acts as the Spice server if I am
correct. Qemu relays information from a network socket assigned on the
command line to the virtualized serial port and vice versa. Since an LXC
installation is sans-Qemu server then I must use Xspice in order to take
the place of Qemu and act as a Spice server in order to relay
information between the agents/QXL driver and the Spice client. So,
testing it within Qemu doesn't really reflect the problem at all. Beyond
Qemu, there's really no way to test it sans-LXC. Actually, now that I
think about it I may be able to run Xspice directly within a VM and then
attempt to connect to it... I'll try that out later on and let you know
how/if that works out. I may have to get that Fedora ISO after all just
to broaden the test cases.

I realize that I'm effectively attempting to use Spice outside of normal
circumstances. However, the way that Xspice behaves -- such as creating
its own versions of the virtio port (as a socket rather than a character
device) and uinput (as a pipe) and attempting to destroy any existing
versions of those files -- leads me to believe that Xspice was almost
built for the purpose even if not intentionally. And, as I had said
before, I got it mostly working in a Fedora LXC container (only lacking
client functionality, which is why I asked for input in the first place ;).

I would like to be able to provide a stack trace of the segfault I get
in the Ubuntu LXC, but I'm unsure how to compile the sources with
debugging symbols. Any help in that respect?

On 11/27/2014 03:50 AM, Christophe Fergeau wrote:
On Wed, Nov 26, 2014 at 05:16:52PM -0600, Charles Ricketts wrote:
Yes, I had seen those options. That was part of why I was asking about the
ucds socket. I found now that the ucds socket is used to talk to multiple
agents. I have tried both setting each argument to specify the paths of
each piece (ucds socket, uinput, and virtio port) and letting Xspice set
them up automatically. Xspice by default re-creates these devices as
sockets and pipes, so it seems that Xspice is actually ideal for this
purpose; there is no need to create the devices by hand. However, any way
it's done even with the newest sources results in the same thing. In the
Fedora LXC under Ubuntu 14.04, I get a display but no agent functionality
for some reason even though the same ucds port is used by both agentd and
agent. In an Ubuntu 14.04 LXC container I can't even get X to start via the
Xspice script or a direct call to X because it segfaults when using the
spiceqxl driver.

There also appears to be no difference between letting the Xspice script
start the agents or starting the agents by hand, which isn't unexpected.

Have you tried all of this without lxc to see how well/bad it works
without adding lxc to the mix?

Christophe

      


_______________________________________________
Spice-devel mailing list
Spice-devel@xxxxxxxxxxxxxxxxxxxxx
http://lists.freedesktop.org/mailman/listinfo/spice-devel

[Index of Archives]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Security]     [Bugtraq]     [Linux]     [Linux OMAP]     [Linux MIPS]     [ECOS]     [Asterisk Internet PBX]     [Linux API]     [Monitors]