net-print/hplip-3.20.3 does no longer decect the HP LaserJet 100 colorMFP M175nw. It has done so for many years and suddenly stopped. The problem is not with CUPS (the printer, once installed, still works). The problem is with the setup (hp-setup) tool. When it probes the network for printers with SLP, the printer replies with the model information: hp-setup[31364]: debug: Found device: {'num_devices': 1, 'num_ports': 1, 'product_id': 'CE866A', 'status_code': 0, 'device2': '0', 'device3': '0', 'note': '', 'device1': 'MFG:Hewlett-Packard;CMD:PJL,PML,PCLXL,URP,PCL,PDF,POSTSCRIPT;MDL:HP LaserJet 100 colorMFP M175nw;CLS:PRINTER;DES:Hewlett-Packard LaserJet 100 colorMFP M175nw;MEM:MEM=110MB;COMMENT:RES=600x8;LEDMDIS:USB#ff#04#01;', 'mac': 'AAAAAAAAAAAA', 'ip': '192.168.nnn.mmm', 'hn': 'nnnmmm'} From this, hp-setup seems to derive the model identifier "hp_laserjet_100_colormfp_m175nw", which it looks up in /usr/share/hplip/data/models/models.dat. For some reason, that string has either disappeared from that file (even though the model is listed there, under the identifier "hp_laserjet_100_colormfp_m175": ... model6=HP LaserJet 100 Color MFP M175nw hp-setup[31364]: debug: Cache miss: hp_laserjet_100_colormfp_m175nw hp-setup[31364]: debug: Reading file: /usr/share/hplip/data/models/models.dat hp-setup[31364]: debug: Searching for section [hp_laserjet_100_colormfp_m175nw] in file /usr/share/hplip/data/models/models.dat error: No devices found on bus: net error: HPLIP cannot detect printers in your network. This may be due to existing firewall settings blocking the required ports. When you are in a trusted network environment, you may open the ports for network services like mdns and slp in the firewall. For detailed steps follow the link. http://hplipopensource.com/node/374 The same happens when entering the IP or hostname of the printer directly. Reproducible: Always Steps to Reproduce: 1. Run hp-setup -ldebug 2. Use either SLP discovery or manually enter the printer's IP/hostname 3. Wait 5 sec Actual Results: An error appears both on the console and as a popup: error: HPLIP cannot detect printers in your network. This may be due to existing firewall settings blocking the required ports. When you are in a trusted network environment, you may open the ports for network services like mdns and slp in the firewall. For detailed steps follow the link. http://hplipopensource.com/node/374 Expected Results: The printer should be detected and selectable for continuing the installation Copying the entire section [hp_laserjet_100_colormfp_m175] to a new section [hp_laserjet_100_colormfp_m175nw] in /usr/share/hplip/data/models/models.dat solves the problem.
OK, for completeness' sake: > For some reason, that string has either disappeared from that file [...] ... or hp-setup is now deriving a different string from the printer response.
(In reply to Markus Wernig from comment #1) > OK, for completeness' sake: > > > For some reason, that string has either disappeared from that file [...] > > ... or hp-setup is now deriving a different string from the printer response. Interesting! I compared previous versions of models.dat and there are no changes to for that model. So probably the string is now derived differently. To find this out we need to know the output from the previous working version. I guess you were using 3.19.12 before. Can you provide the same output for the latest version working for you?
Also did you update the binary plug-in to the same version? According to the supported devices your model needs one!
I downgraded to 3.19.12-r1 and keep getting the same error. The model info that gets logged seems identical: hp-setup[14755]: debug: Found device: {'num_devices': 1, 'num_ports': 1, 'product_id': 'CE866A', 'status_code': 0, 'device2': '0', 'device3': '0', 'note': '', 'device1': 'MFG:Hewlett-Packard;CMD:PJL,PML,PCLXL,URP,PCL,PDF,POSTSCRIPT;MDL:HP LaserJet 100 colorMFP M175nw;CLS:PRINTER;DES:Hewlett-Packard LaserJet 100 colorMFP M175nw;MEM:MEM=110MB;COMMENT:RES=600x8;LEDMDIS:USB#ff#04#01;', 'mac': 'AAAAAAAAAAAA', 'ip': '192.168.nnn.mmm', 'hn': 'nnnmmm'} I just noticed that the HP device manager also no longer recognizes the printer (simply doesn't show it in the device list) as long as it's missing in models.dat. When I add the section with the "correct" string and refresh the device list, it shows up, both with 3.19 and 3.20. Maybe a red herring: When it worked, the system was using an earlier python version.
(In reply to Markus Wernig from comment #4) > I downgraded to 3.19.12-r1 and keep getting the same error. > > The model info that gets logged seems identical: > > hp-setup[14755]: debug: Found device: {'num_devices': 1, 'num_ports': 1, > 'product_id': 'CE866A', 'status_code': 0, 'device2': '0', 'device3': '0', > 'note': '', 'device1': > 'MFG:Hewlett-Packard;CMD:PJL,PML,PCLXL,URP,PCL,PDF,POSTSCRIPT;MDL:HP > LaserJet 100 colorMFP M175nw;CLS:PRINTER;DES:Hewlett-Packard LaserJet 100 > colorMFP M175nw;MEM:MEM=110MB;COMMENT:RES=600x8;LEDMDIS:USB#ff#04#01;', > 'mac': 'AAAAAAAAAAAA', 'ip': '192.168.nnn.mmm', 'hn': 'nnnmmm'} > > I just noticed that the HP device manager also no longer recognizes the > printer (simply doesn't show it in the device list) as long as it's missing > in models.dat. > When I add the section with the "correct" string and refresh the device > list, it shows up, both with 3.19 and 3.20. > > Maybe a red herring: When it worked, the system was using an earlier python > version. The only way to find this out is running hplip trying aain with the old python version. Do you know which version this was, I guess python-3.7? What is the output of "emerge --info net-print/hplip"?
I looked at the upstream bug tracker and there are a lot of issues regarding this and similar models: https://bugs.launchpad.net/hplip/+bug/1697958 https://bugs.launchpad.net/hplip/+bug/1724151 https://bugs.launchpad.net/hplip/+bug/1832751 https://bugs.launchpad.net/hplip/+bug/1843592 https://bugs.launchpad.net/hplip/+bug/1863375 https://bugs.launchpad.net/hplip/+bug/1876490 The last one sounds promising as it says this will be fixed in the next release!
Hello, I own an HP M177fw, and just last week I tried to upgrade hplip, discovered and investigated this bug, and decided to mask 3.20.x and downgrade to mitigate it until next hplip version comes around (>3.20.6). I noticed today that the 3.19 version was removed from the tree yesterday, and that leaves many users - according to the number of bug reports - without a working package in the tree. Can you please consider reverting the removal, and re-adding 3.19 until a version that solves this becomes available?
Sorry, I forgot about this bug! If I do not restore it immediately the removal of the ebuild should not affect existing installations. It is only a problem if you upgrade and there is no backup of the old version. I will add 3.19.12 back. Thanks for pointing me there. The only Problem is that Martin noted that a downgrade to this version for some reason did not fix the issue.
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=4fc746bdfd337275205f99b79e9eb0db8a7a8b9b commit 4fc746bdfd337275205f99b79e9eb0db8a7a8b9b Author: Daniel Pielmeier <billie@gentoo.org> AuthorDate: 2020-09-26 10:26:57 +0000 Commit: Daniel Pielmeier <billie@gentoo.org> CommitDate: 2020-09-26 10:27:43 +0000 net-print/hplip: Partial revert of commit '9d5803ed869'. Restore hplip-3.19.12-r1 to keep a working version for users affected by bug #727688. Bug: https://bugs.gentoo.org/727688 Package-Manager: Portage-3.0.4, Repoman-3.0.1 RepoMan-Options: --force Signed-off-by: Daniel Pielmeier <billie@gentoo.org> net-print/hplip/Manifest | 2 + net-print/hplip/hplip-3.19.12-r1.ebuild | 275 ++++++++++++++++++++++++++++++++ 2 files changed, 277 insertions(+)
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=9d0b50677352d435832143ba3f4bc797974e9837 commit 9d0b50677352d435832143ba3f4bc797974e9837 Author: Daniel Pielmeier <billie@gentoo.org> AuthorDate: 2020-09-26 10:34:50 +0000 Commit: Daniel Pielmeier <billie@gentoo.org> CommitDate: 2020-09-26 10:35:53 +0000 net-print/hplip-plugin: Partial revert of commit '0fe5854ccdd'. Restore hplip-plugin-3.19.12 to keep a working version for users affected by bug #727688. Bug: https://bugs.gentoo.org/727688 Package-Manager: Portage-3.0.4, Repoman-3.0.1 RepoMan-Options: --force Signed-off-by: Daniel Pielmeier <billie@gentoo.org> net-print/hplip-plugin/Manifest | 1 + net-print/hplip-plugin/hplip-plugin-3.19.12.ebuild | 63 ++++++++++++++++++++++ 2 files changed, 64 insertions(+)
Thanks for the prompt reply and action Daniel! I didn't notice that the downgrade did not fix it for Martin, sorry about that. It did fix it for me however, and it's crystal clear: 3.20.x -> not working, 3.19.x -> working, 100% reproducible. Something that may be relevant is the fact that a couple weeks ago I forced the upgrade of python to 3.7 via make.conf, set 3.7 via eselect, upgraded everything and finally removed any other python:3.x. I have to manage it myself because I use virtualenvs with system packages. ---- PYTHON_SINGLE_TARGET="python3_7" PYTHON_TARGETS="python3_7" Follows my "emerge --info net-print/hplip", for reference: ---- emerge --info net-print/hplip [13:15:18] Portage 3.0.8 (python 3.7.8-final-0, default/linux/amd64/17.1/desktop/plasma, gcc-9.3.0, glibc-2.32-r2, 5.8.10-gentoo-x86_64 x86_64) ================================================================= System Settings ================================================================= System uname: Linux-5.8.10-gentoo-x86_64-x86_64-AMD_Ryzen_7_3800X_8-Core_Processor-with-gentoo-2.7 KiB Mem: 65835576 total, 44793784 free KiB Swap: 16777212 total, 16777212 free Timestamp of repository gentoo: Sat, 26 Sep 2020 08:36:37 +0000 Head commit of repository gentoo: f290b66943f36520b1897d659aaeb561f9c5dffb Head commit of repository steam-overlay: 9b344386364381390a2418299779ba7fea9225c3 sh bash 5.0_p18 ld GNU ld (Gentoo 2.34 p6) 2.34.0 ccache version 3.7.11 [disabled] app-shells/bash: 5.0_p18::gentoo dev-java/java-config: 2.3.1::gentoo dev-lang/perl: 5.30.3::gentoo dev-lang/python: 2.7.18-r2::gentoo, 3.7.8-r2::gentoo dev-util/ccache: 3.7.11::gentoo dev-util/cmake: 3.16.5::gentoo dev-util/pkgconfig: 0.29.2::gentoo sys-apps/baselayout: 2.7::gentoo sys-apps/openrc: 0.42.1::gentoo sys-apps/sandbox: 2.18::gentoo sys-devel/autoconf: 2.13-r1::gentoo, 2.69-r5::gentoo sys-devel/automake: 1.13.4-r2::gentoo, 1.16.1-r1::gentoo sys-devel/binutils: 2.34-r2::gentoo sys-devel/gcc: 9.3.0-r1::gentoo sys-devel/gcc-config: 2.3.1::gentoo sys-devel/libtool: 2.4.6-r6::gentoo sys-devel/make: 4.2.1-r4::gentoo sys-kernel/linux-headers: 5.8::gentoo (virtual/os-headers) sys-libs/glibc: 2.32-r2::gentoo Repositories: gentoo location: /nr/repos/gentoo sync-type: git sync-uri: rsync://rsync.gentoo.org/gentoo-portage priority: 50 jorgicio location: /nr/repos/jorgicio sync-type: laymansync sync-uri: https://github.com/jorgicio/jorgicio-gentoo.git masters: gentoo priority: 50 pentoo location: /nr/repos/pentoo sync-type: laymansync sync-uri: https://github.com/pentoo/pentoo-overlay.git masters: gentoo priority: 50 cross-overlay location: /nr/repos/cross-overlay masters: gentoo priority: 100 local-overlay location: /nr/repos/local-overlay masters: gentoo priority: 100 steam-overlay location: /nr/repos/steam-overlay sync-type: git sync-uri: git://github.com/anyc/steam-overlay.git masters: gentoo priority: 100 ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="*" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O2 -march=native -pipe -ggdb" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-O2 -march=native -pipe -ggdb" DISTDIR="/nr/distfiles" EMERGE_DEFAULT_OPTS="--nospinner --with-bdeps=y" ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs buildpkg cgroup compressdebug config-protect-if-modified distlocks downgrade-backup ebuild-locks fail-clean fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch parallel-install pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfpermssplit-elog splitdebug strict unknown-features-warn unmerge-backup unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="http://mirrors.evowise.com/gentoo/ https://mirrors.evowise.com/gentoo/ http://mirror.netcologne.de/gentoo/" LANG="it_IT.utf8" LC_ALL="en_US.UTF-8" LDFLAGS="-Wl,-O1,-z,now,--as-needed" LINGUAS="de en en-US es it" MAKEOPTS="-j32" PKGDIR="/nr/packages" PORTAGE_BINHOST="/nr/packages" PORTAGE_BZIP2_COMMAND="pbzip2" PORTAGE_COMPRESS="pbzip2" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" USE="X a52 aac acl acpi activities adns alsa amd64 berkdb bluetooth branding bzip2 cairo caps cdda cdr clang cli crypt cups custom-cflags dbus declarative djvu dri dts dvd dvdr egl elogind emboss encode exif expat ffmpeg flac fontconfig fortran gdbm gif git gpg gphoto2 gpm gstreamer gtk gtk3 gui http2 iconv icu imagemagick ipv6 jpeg jpeg2k kipi kwallet lcms libass libglvnd libnotify libtirpc libzfs lm_sensors mad mng mp3 mp4 mpeg mpris multilib ncurses networkmanager nls nptl ogg openal opencl opengl openmp pam pango pcre pdf phonon plasma png policykit postgres ppds pulseaudio qml qt5 rar readline samba scanner sdl seccomp semantic-desktop socks5 spell split-usr ssh ssl startup-notification svg system-ffmpeg system-icu system-libvpx taglib tcpd theora threads tiff truetype udev udisks unicode upower usb v4l vaapi vorbis vulkan wayland webengine webp widgets x264 x265 xattr xcb xcomposite xml xscreensaver xv xvid zeroconf zfs zlib zstd" ABI_X86="64" ADA_TARGET="gnat_2018" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" CAMERAS="canon p2p" COLLECTD_PLUGINS="chrony conntrack contextswitch cpu cpufreq cpusleep df disk dns entropy ethstat fhcount fscache hugepages interface ipc irq load mbmon memory netlink sensors smart swap tcpconns thermal unixsock uptime virt vmem write_prometheus zfs_arc" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt sha sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="libinput" KERNEL="linux" L10N="de en en-US es it" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LLVM_TARGETS="AMDGPU BPF X86" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-2 php7-3 php7-4" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_7" PYTHON_TARGETS="python3_7" RUBY_TARGETS="ruby26" SANE_BACKENDS="hp" USERLAND="GNU" VIDEO_CARDS="amdgpu modesetting radeon radeonsi virgl" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS ================================================================= Package Settings ================================================================= net-print/hplip-3.19.12-r1::gentoo was built with the following: USE="X hpcups libnotify (policykit) qt5 scanner snmp -doc -fax -hpijs -kde -libressl -libusb0 -minimal -parport -static-ppds" ABI_X86="(64)" PYTHON_SINGLE_TARGET="python3_7 -python3_6"
If the downgrade "fixed" Fabio's problem, but not mine, we might not be having the same problem. On the other hand, with all that python version mess (I'm currently on 3.7), it's nearly impossible to tell which code is actually getting executed and to find out where the different output comes from. Since I can easily handle the workaround (manually manage models.dat), the ramifications of downgrading my system python to <3.5 in order to debug this are simply far too large, sorry. I'd wait for upstream to release a new version and then revisit this bug.
(In reply to Markus Wernig from comment #12) > If the downgrade "fixed" Fabio's problem, but not mine, we might not be > having the same problem. > On the other hand, with all that python version mess (I'm currently on 3.7), > it's nearly impossible to tell which code is actually getting executed and > to find out where the different output comes from. > > Since I can easily handle the workaround (manually manage models.dat), the > ramifications of downgrading my system python to <3.5 in order to debug this > are simply far too large, sorry. I'd wait for upstream to release a new > version and then revisit this bug. I guess Fabio was hit by bug #740740. I am working on fixing both issues as upstream as usually does not care much.
Created attachment 664420 [details, diff] Re-add support for HP LaserJet 100 Color MFP M175 models @Markus: Can you please test if the attached patch fixes your problem? Although it is for 3.20.9 it also applies for 3.20.6. @Fabio: I will add another patch to bug #740740 which should hopefully fix your issue!
Just added hplip-3.20.9. Please test if the new version fixes the issue.
Just tested with 3.20.9. With the newly generated models.dat the printer is detected correctly. Could not print a test page yet (out of paper ;-)), but scanning, reading toner status etc. all seem to work as before. Thank you for looking into this!
Sorry, not sure why but I got 0 notifications (guess I forgot to add myself to CC list). Can confirm that with 3.20.9 everything works (printer status, toner, scanning via network). Thanks a lot!
Thank you all for the feedback!
