Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 166396 - vmware-esx-tools don't configure on 2.6.19-gentoo-r5
Summary: vmware-esx-tools don't configure on 2.6.19-gentoo-r5
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: New packages (show other bugs)
Hardware: x86 Linux
: High normal (vote)
Assignee: Gentoo VMWare Bug Squashers [disabled]
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2007-02-11 19:05 UTC by Serge
Modified: 2008-01-12 14:20 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
proposed patch (vmhgs.patch,3.66 KB, patch)
2007-02-11 19:20 UTC, Serge
Details | Diff
ebuild log file (config.log,36.09 KB, text/plain)
2007-10-02 21:46 UTC, Serge
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Serge 2007-02-11 19:05:19 UTC
the /opt/vmware/tools/bin/vmware-config-tools.pl give error in compiling vmhgfs

if have followed this thread (http://www.vmware.com/community/thread.jspa?messageID=564157)
and modified and apply only the vmhgfs.patch
(untar /usr/lib/vmware-tools/modules/source/vmhgfs.tar, apply patch, tar)



I'm testing a gentoo vm in a vmware server 1.01 on XP. This machine will be installed on a vmware-esx system.



Reproducible: Always

Steps to Reproduce:
1. install the vmware overlay (with layman)  (rev 147 at this time)
2. emerge vmware-esx-tools
3. run /opt/vmware/tools/bin/vmware-config-tools.pl




Result :
gentoo-vm-std ~ # /opt/vmware/tools/bin/vmware-config-tools.pl
It looks like you are trying to run this program in a remote session. This
program will temporarily shut down your network connection, so you should only
run it from a local console session. Are you SURE you want to continue?
[no] y


Stopping VMware Tools services in the virtual machine:
   Guest operating system daemon:                                      done
   Guest filesystem driver:                                            done
Trying to find a suitable vmhgfs module for your running kernel.

None of the pre-built vmhgfs modules for VMware Tools is suitable for your
running kernel.  Do you want this program to try to build the vmhgfs module for
your system (you need to have a C compiler installed on your system)? [yes]

Using compiler "/usr/bin/gcc". Use environment variable CC to override.

What is the location of the directory of C header files that match your running
kernel? [/lib/modules/2.6.19-gentoo-r5//build/include]

Extracting the sources of the vmhgfs module.

Building the vmhgfs module.

Using 2.6.x kernel build system.
make: entrant dans le répertoire « /tmp/vmware-config0/vmhgfs-only »
make -C /lib/modules/2.6.19-gentoo-r5//build/include/.. SUBDIRS=$PWD SRCROOT=$PWD/. modules
make[1]: entrant dans le répertoire « /usr/src/linux-2.6.19-gentoo-r5 »
  CC [M]  /tmp/vmware-config0/vmhgfs-only/cpName.o
  CC [M]  /tmp/vmware-config0/vmhgfs-only/cpNameLinux.o
  CC [M]  /tmp/vmware-config0/vmhgfs-only/dev.o
  CC [M]  /tmp/vmware-config0/vmhgfs-only/driver.o
/tmp/vmware-config0/vmhgfs-only/driver.c:4249: attention : initialization from incompatible pointer type
/tmp/vmware-config0/vmhgfs-only/driver.c: In function 'HgfsGetSb':
/tmp/vmware-config0/vmhgfs-only/driver.c:4452: attention : return makes pointer from integer without a cast
/tmp/vmware-config0/vmhgfs-only/driver.c: Hors de toute fonction :
/tmp/vmware-config0/vmhgfs-only/driver.c:4509: attention : initialization from incompatible pointer type
  CC [M]  /tmp/vmware-config0/vmhgfs-only/hgfsUtil.o
  CC [M]  /tmp/vmware-config0/vmhgfs-only/main.o
  CC [M]  /tmp/vmware-config0/vmhgfs-only/staticEscape.o
  LD [M]  /tmp/vmware-config0/vmhgfs-only/vmhgfs.o
  Building modules, stage 2.
  MODPOST 1 modules
  CC      /tmp/vmware-config0/vmhgfs-only/vmhgfs.mod.o
  LD [M]  /tmp/vmware-config0/vmhgfs-only/vmhgfs.ko
make[1]: quittant le répertoire « /usr/src/linux-2.6.19-gentoo-r5 »
cp -f vmhgfs.ko ./../vmhgfs.o
make: quittant le répertoire « /tmp/vmware-config0/vmhgfs-only »
The module loads perfectly in the running kernel.

pcnet32                32260  0
Unloading pcnet32 module

Unable to remove the pcnet32 module while installing new vmxnet.

The fast network device driver (vmxnet module) is used only for our fast
networking interface. The rest of the software provided by VMware Tools is
designed to work independently of this feature.
If you wish to have the fast network driver enabled, you can install the driver
by running vmware-config-tools.pl again after making sure that gcc, binutils,
make and the kernel sources for your running kernel are installed on your
machine. These packages are available on your distribution's installation CD.
[ Press Enter key to continue ]

No X install found.

Starting VMware Tools services in the virtual machine:
   Switching to guest configuration:                                   done
   Guest filesystem driver:                                            done
   DMA setup:                                                          done
   Guest operating system daemon:                                      done

The configuration of VMware Tools 3.0.1 build-32039 for Linux for this running
kernel completed successfully.

You must restart your X session before any mouse or graphics changes take
effect.

You can now run VMware Tools by invoking the following command:
"/opt/vmware/tools/bin/vmware-toolbox" during an X server session.

If you wish to configure any experimental features, please run the following
command: "vmware-config-tools.pl --experimental".

Enjoy,

--the VMware team


I'm not familiar with patchs, so I hope you could correct this for a future release.
Comment 1 Jakub Moc (RETIRED) gentoo-dev 2007-02-11 19:06:55 UTC
Please set your locales to C when reporting bugs so that we can read the messages in English.
Comment 2 Serge 2007-02-11 19:20:08 UTC
Created attachment 109880 [details, diff]
proposed patch
Comment 3 Serge 2007-02-11 19:21:15 UTC
sorry, this is with locale C :

gentoo-vm-std ~ # /opt/vmware/tools/bin/vmware-config-tools.pl
It looks like you are trying to run this program in a remote session. This
program will temporarily shut down your network connection, so you should only
run it from a local console session. Are you SURE you want to continue?
[no] y


Stopping VMware Tools services in the virtual machine:
   Guest operating system daemon:                                      done
   Guest filesystem driver:                                            done
Trying to find a suitable vmhgfs module for your running kernel.

None of the pre-built vmhgfs modules for VMware Tools is suitable for your
running kernel.  Do you want this program to try to build the vmhgfs module for
your system (you need to have a C compiler installed on your system)? [yes]

Using compiler "/usr/bin/gcc". Use environment variable CC to override.

What is the location of the directory of C header files that match your running
kernel? [/lib/modules/2.6.19-gentoo-r5//build/include]

Extracting the sources of the vmhgfs module.

Building the vmhgfs module.

Using 2.6.x kernel build system.
make: Entering directory `/tmp/vmware-config0/vmhgfs-only'
make -C /lib/modules/2.6.19-gentoo-r5//build/include/.. SUBDIRS=$PWD SRCROOT=$PWD/. modules
make[1]: Entering directory `/usr/src/linux-2.6.19-gentoo-r5'
  CC [M]  /tmp/vmware-config0/vmhgfs-only/cpName.o
  CC [M]  /tmp/vmware-config0/vmhgfs-only/cpNameLinux.o
  CC [M]  /tmp/vmware-config0/vmhgfs-only/dev.o
  CC [M]  /tmp/vmware-config0/vmhgfs-only/driver.o
/tmp/vmware-config0/vmhgfs-only/driver.c:4249: warning: initialization from incompatible pointer type
/tmp/vmware-config0/vmhgfs-only/driver.c: In function 'HgfsGetSb':
/tmp/vmware-config0/vmhgfs-only/driver.c:4452: warning: return makes pointer from integer without a cast
/tmp/vmware-config0/vmhgfs-only/driver.c: At top level:
/tmp/vmware-config0/vmhgfs-only/driver.c:4509: warning: initialization from incompatible pointer type
  CC [M]  /tmp/vmware-config0/vmhgfs-only/hgfsUtil.o
  CC [M]  /tmp/vmware-config0/vmhgfs-only/main.o
  CC [M]  /tmp/vmware-config0/vmhgfs-only/staticEscape.o
  LD [M]  /tmp/vmware-config0/vmhgfs-only/vmhgfs.o
  Building modules, stage 2.
  MODPOST 1 modules
  CC      /tmp/vmware-config0/vmhgfs-only/vmhgfs.mod.o
  LD [M]  /tmp/vmware-config0/vmhgfs-only/vmhgfs.ko
make[1]: Leaving directory `/usr/src/linux-2.6.19-gentoo-r5'
cp -f vmhgfs.ko ./../vmhgfs.o
make: Leaving directory `/tmp/vmware-config0/vmhgfs-only'
The module loads perfectly in the running kernel.

pcnet32                32260  0
Unloading pcnet32 module

Unable to remove the pcnet32 module while installing new vmxnet.

The fast network device driver (vmxnet module) is used only for our fast
networking interface. The rest of the software provided by VMware Tools is
designed to work independently of this feature.
If you wish to have the fast network driver enabled, you can install the driver
by running vmware-config-tools.pl again after making sure that gcc, binutils,
make and the kernel sources for your running kernel are installed on your
machine. These packages are available on your distribution's installation CD.
[ Press Enter key to continue ]

No X install found.

Starting VMware Tools services in the virtual machine:
   Switching to guest configuration:                                   done
   Guest filesystem driver:                                            done
   DMA setup:                                                          done
   Guest operating system daemon:                                      done

The configuration of VMware Tools 3.0.1 build-32039 for Linux for this running
kernel completed successfully.

You must restart your X session before any mouse or graphics changes take
effect.

You can now run VMware Tools by invoking the following command:
"/opt/vmware/tools/bin/vmware-toolbox" during an X server session.

If you wish to configure any experimental features, please run the following
command: "vmware-config-tools.pl --experimental".

Enjoy,

--the VMware team
Comment 4 Serge 2007-02-11 19:22:19 UTC
all this is after the proposed patch applied.
Comment 5 Mike Auty (RETIRED) gentoo-dev 2007-09-19 16:08:44 UTC
Serge, could you please try out the open-vm-tools from the vmware overlay?  You can get a copy of the overlay using the layman tool (which is in portage).  It is open source, and will hopefully cope with the changes to kernels more quickly than vmware themselves can.  Hopefully it will work on vmware ESX, and if you could report whether it does or not, it will help us a lot.  Thanks very much!  5:)
Comment 6 Serge 2007-10-02 21:44:43 UTC
Sorry, for the delay the result is :

 *
 * ERROR: app-emulation/open-vm-tools-0.0.20070904.56574 failed.
 * Call stack:
 *   ebuild.sh, line 1654:   Called dyn_compile
 *   ebuild.sh, line 990:   Called qa_call 'src_compile'
 *   ebuild.sh, line 44:   Called src_compile
 *   open-vm-tools-0.0.20070904.56574.ebuild, line 80:   Called econf '--without-x' '--disable-multimon'


emerge info is :
Portage 2.1.3.9 (default-linux/x86/2007.0/server, gcc-4.1.2, glibc-2.5-r4, 2.6.22-gentoo-r8 i686)
=================================================================
System uname: 2.6.22-gentoo-r8 i686 AMD Athlon(tm) 64 Processor 3200+
Timestamp of tree: Tue, 02 Oct 2007 21:20:01 +0000
app-shells/bash:     3.2_p17
dev-lang/python:     2.4.4-r5
dev-python/pycrypto: 2.0.1-r6
sys-apps/baselayout: 1.12.9-r2
sys-apps/sandbox:    1.2.17
sys-devel/autoconf:  2.61-r1
sys-devel/automake:  1.10
sys-devel/binutils:  2.17-r1
sys-devel/gcc-config: 1.3.16
sys-devel/libtool:   1.5.24
virtual/os-headers:  2.6.21
ACCEPT_KEYWORDS="x86"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-march=i686 -O2 -pipe -fomit-frame-pointer"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc"
CONFIG_PROTECT_MASK="/etc/env.d /etc/gconf /etc/revdep-rebuild /etc/terminfo"
CXXFLAGS="-march=i686 -O2 -pipe -fomit-frame-pointer"
DISTDIR="/usr/portage/distfiles"
FEATURES="distlocks metadata-transfer sandbox sfperms strict unmerge-orphans userfetch"
GENTOO_MIRRORS="http://mir1.ovh.net/gentoo-distfiles/ http://pandemonium.tiscali.de/pub/gentoo/ http://mirrors.sec.informatik.tu-darmstadt.de/gentoo/"
LANG="fr_FR.UTF-8"
LC_ALL="fr_FR.UTF-8"
LINGUAS="fr"
MAKEOPTS="-j2"
PKGDIR="/usr/portage/packages"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --delete-after --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --filter=H_**/files/digest-*"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/portage/local/layman/vmware"
SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage"
USE="berkdb bitmap-fonts cli cracklib crypt cups dri fortran gdbm gpm iconv isdnlog ldap logrotate mailwrapper midi mudflap mysql ncurses nls nptl nptlonly oci8-instant-client openmp pam pcre perl pppd python readline reflection session snmp spl ssl tcpd truetype truetype-fonts type1-fonts unicode vhosts x86 xml xorg zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1 emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mulaw multi null plug rate route share shm softvol" ELIBC="glibc" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="fr" USERLAND="GNU" VIDEO_CARDS="apm ark chips cirrus cyrix dummy fbdev glint i128 i740 i810 imstt mach64 mga neomagic nsc nv r128 radeon rendition s3 s3virge savage siliconmotion sis sisusb tdfx tga trident tseng v4l vesa vga via vmware voodoo"
Unset:  CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LDFLAGS, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 7 Serge 2007-10-02 21:46:17 UTC
Created attachment 132425 [details]
ebuild log file
Comment 8 Mike Auty (RETIRED) gentoo-dev 2007-10-03 06:53:59 UTC
Thanks Serge,

A little further up from that error you posted (and if you look in the logs) you should see:

configure:22017: result: no
configure:22023: error: libXrandr not found. Please install the libXrandr devel package(s).

I'm afraid there are currently issues compiling open-vm-tools without X.  I haven't ensured the dependencies are correct yet, so you may experience a couple of other issues like that, but if you're willing could you please install libXrandr and try again?

If not, let us know, we'll reopen this bug and give you a shout once upstream with their --without-X bug.  Thanks...  5:)
Comment 9 Serge 2007-10-03 11:30:16 UTC
Ok I'm trying but emerge -pvt libXrandr need 16 more packages....
[ebuild  N    ] x11-libs/libXrandr-1.2.1  USE="-debug" 216 kB
[ebuild  N    ]  x11-proto/randrproto-1.2.1  USE="-debug" 54 kB
[ebuild  N    ]  x11-libs/libXrender-0.9.2  USE="-debug" 241 kB
[ebuild  N    ]  x11-libs/libXext-1.0.3  USE="-debug" 256 kB
[ebuild  N    ]   x11-libs/libX11-1.1.2-r1  USE="-debug -ipv6 -xcb" 1,488 kB
[ebuild  N    ]    x11-proto/xcmiscproto-1.1.2  USE="-debug" 36 kB
[ebuild  N    ]    x11-libs/libXdmcp-1.0.2  USE="-debug" 216 kB
[ebuild  N    ]    x11-proto/bigreqsproto-1.0.2  USE="-debug" 36 kB
[ebuild  N    ]    x11-libs/xtrans-1.0.3  USE="-debug" 101 kB
[ebuild  N    ]    x11-libs/libXau-1.0.3  USE="-debug" 225 kB
[ebuild  N    ]    x11-proto/inputproto-1.4.2  USE="-debug" 45 kB
[ebuild  N    ]    x11-proto/xf86bigfontproto-1.1.2  USE="-debug" 37 kB
[ebuild  N    ]    x11-proto/kbproto-1.0.3  USE="-debug" 57 kB
[ebuild  N    ]  x11-proto/renderproto-0.9.2  USE="-debug" 40 kB
[nomerge      ] x11-libs/libXext-1.0.3  USE="-debug"
[ebuild  N    ]  x11-proto/xextproto-7.0.2  USE="-debug" 67 kB
[ebuild  N    ]  x11-proto/xproto-7.0.10  USE="-debug" 140 kB
[ebuild  N    ]   x11-misc/util-macros-1.1.5  USE="-debug" 47 kB


But after that It request libXtst :
[ebuild  N    ] x11-libs/libXtst-1.0.2  USE="-debug" 220 kB
[ebuild  N    ]  x11-proto/recordproto-1.13.2  USE="-debug" 39 kB

and after that it need libgtk !!!!
So that is not possible in our future production machinery !

So as I don't many time this day to do maore tests, I think the package need to respect the -X use flag.


If you could get upstream to correct I will be happyer.....

Regards



Comment 10 Mike Auty (RETIRED) gentoo-dev 2007-10-03 17:45:48 UTC
Ok, sorry that didn't work out Serge, I'll reopen this bug and keep an eye out for upstream to see when they update it.  Thanks for giving it a go...  5:)
Comment 11 Serge 2007-10-05 20:05:18 UTC
Hello,
I did find a little more time, and I got it to go to the end of the install. It's working on ESX 2.5, but :
1. vmmemctl is not loaded (work manualy and I don't know bout the utility of that on ESX...)
2. vmware-guestd is not needed without X

vmblock was not loading as expected (VM_DRAG_AND_DROP="no" in conf.d/vmware-tools)

It would be nice to insert a little more "intelligence" in the vmware-tools init script. So we would have a unique location to customize the tools without need to modify many startutp conf script (modprobe vmmemctl for an example).

But it's fine that it is working on my ESX2.5, Great work !!
I have the choice between vmware-server-tools ot open-vm-tools.

But for the later, upstream need to fix the script about "-X".

If you need more informations, ask about.

Regards
Serge
Comment 12 Serge 2007-10-12 20:14:57 UTC
see bug Bug#195655 about the latest upgrade to /open-vm-tools-0.0.20071008.99999
Comment 13 Serge 2007-11-12 20:27:22 UTC
I want only to report that it's working without X on vmware server 1.04 and vmware workstation 5.5.1. On the later shared folders work.

But my firsts remarks (see post #11) are present on open-vm-tools-0.0.20071008.99999

Could any of you explain to me the usage of vmmemctl ? what is its role ?

Great work !!

Comment 14 Mike Auty (RETIRED) gentoo-dev 2007-12-22 18:02:45 UTC
Hiya Serge, hopefully you'll find that open-vm-tools in the tree, and that it now works without problem on ESX server (unless you're trying to built it on a hardened profile, which is a separate bug).  Please let me know how it works out, and hopefully we can close this bug soon.  5:)
Comment 15 Serge 2008-01-12 14:17:37 UTC
Hello and happy New Year.
Sorry for the delay but we got our fist ESX3.5 (4 dual-core DELL server, 16GB RAM) yesterday.

I did build a gentoo guest on a vmware server1.04 host without X :
kernel 2.6.23-gentoo-r3
grub
latest open-vm-tools-0.0.20071121.64693-r1 from vmware overlay
buslogic and lsilogic (without patch)  driver in the kernel
pcnet32, e1000 and vmxnet network drivers as module (managed automatically by udev)
vmmemctl module loaded (needed ?)
vmware-tools init script in default run-level (needed ?)

To upload your vm to the ESX3.5 server you need to use the “colclone.iso” from VMware-converter-4.0.0-62386. The version 3.0.1-44840 didn’t work for me.

On the ESX 3.5 server, you have in this version many choices for the network adapter but from the UI you don’t have other choice that “Flexible”.
The drivers are:
 vlance: classic AMD card driver
 vmxnet: driver that need the vmware-tools (only the vmxnet driver part)
 Flexible: work as vmlance or vmxnet (present itself by default as vlance)
 e1000: classic Intel e1000 driver
 Enhanced vmxnet: new high performance driver.

So the results:
 The vm is booting with buslogic or lsilogic (so VMware corrected the bug)
 The network is working for :
   vlance: pcnet32 driver loaded by udev
   vmxnet: vmxnet driver loaded by udev
   e1000: e1000 driver loaded by udev
   flexible: pcnet32 driver loaded by udev (no “Ethernet0.virtualDev” line in vmx file)
   enhanced vmxnet: not tested

So it’s working very well.
Tell me if you need more information’s or others tests.
Thanks to all for your work

Comment 16 Mike Auty (RETIRED) gentoo-dev 2008-01-12 14:20:32 UTC
Glad to hear it's all working Serge, marking as FIXED.  5:)