Int10 causes guest's Xorg to crash

[lurker]

I'm running VirtualBox on a Gentoo amd64 host. Around christmas I stopped being able to run the Gentoo 2008 i686 LiveCD as a guest in, probably due to some package upgrade or similar. I've tried switching kernels, and I've tested ALL VirtualBox versions between 1.6 and 2.1.4, both Sun's binary dist and OSE. Nothing helps.

What happens is that the guest's X server crashes during startup with the following in the logs when using any video driver except fbdev (in the case below I tried vesa):

Code: Select all

(II) Loading sub module "int10"
(II) LoadModule: "int10"
(II) Loading /usr/lib/xorg/modules//libint10.so
(II) Module int10: vendor="X.Org Foundation"
        compiled for 1.3.0, module version = 1.0.0
        ABI class: X.Org Video Driver, version 1.2
(II) VESA(0): initializing int10

Backtrace:
0: X(xf86SigHandler+0x84) [0x80d92c4]
1: [0xb7f87420]
2: /usr/lib/xorg/modules//libint10.so(xf86ExtendedInitInt10+0x4e3) [0xb7be04f3]
3: /usr/lib/xorg/modules//libvbe.so(VBEExtendedInit+0x2f7) [0xb7f82a07]
4: /usr/lib/xorg/modules/drivers//vesa_drv.so [0xb7bf30f1]
5: X(InitOutput+0x9a1) [0x80a8971]
6: X(main+0x27b) [0x8076d0b]
7: /lib/libc.so.6(__libc_start_main+0xdc) [0xb7d04fdc]
8: X(FontFileCompleteXLFD+0x1ed) [0x8076241]

Fatal server error:
Caught signal 11.  Server aborting

Again, fbdev works fine, but I want to be able to use vesa, for various reasons. I've also made a custom LiveCD based on Gentoo which have the guest additions and vboxvideo (for mouse integration) installed, but vboxvideo fails just like vesa.

I'm quite certain this is unique to my system, so I'm merely looking for pointers for how I could troubleshoot this further. Any thoughts?

[Sasquatch]

Do you happen to have an ATi card on your Host? Are you running the latest stable build from Xserver? I'm not sure if it also affects Gentoo, or other distro's, but with Ubuntu, a recent update of Xserver broke all options for OpenGL/GLX use with ATi Cards. I've read the bug report on launchpad and one user noted that after turning off the fglrx driver and switching to the open source one, he was able to use direct rendering again. Might be the same issue?

[lurker]

Do you happen to have an ATi card on your Host?

No, Nvidia.

Are you running the latest stable build from Xserver?

No, 1.3.0.0, on both the host and guest.

[wayland]

Could be https://bugs.freedesktop.org/show_bug.cgi?id=18160

[lurker]

Could be https://bugs.freedesktop.org/show_bug.cgi?id=18160

I doubt it. After all, everything worked until I upgraded VirtualBox and/or some of its deps on my host. The guest system (i.e. the iso file) was the same before and after the error started appearing.