systemd-nspawn; No such file or directory: /sys/fs/selinux, /sys/fs/cgroup

By: Mitch Maifeld user 14 Nov 2019 at 8:15 a.m. CST

13 Responses
Mitch Maifeld gravatar
followed: https://gluu.org/docs/ce/installation-guide/install-centos/ EXPECTED: `# /sbin/gluu-serverd start ` (without errors) ACTUAL: `# /sbin/gluu-serverd start` Job for systemd-nspawn@gluu_server.service failed because the control process exited with error code. See "systemctl status systemd-nspawn@gluu_server.service" and "journalctl -xe" for details.` `# systemctl status systemd-nspawn@gluu_server.service` ● systemd-nspawn@gluu_server.service - Container gluu_server Loaded: loaded (/usr/lib/systemd/system/systemd-nspawn@gluu_server.service; enabled; vendor preset: disabled) Active: failed (Result: exit-code) since Thu 2019-11-14 13:53:17 UTC; 1min 31s ago Docs: man:systemd-nspawn(1) Main PID: 8555 (code=exited, status=1/FAILURE) Status: "Terminating..." ` `Nov 14 13:53:17 euler systemd-nspawn[8555]: Failed to create directory /opt/gluu-server//sys/fs/selinux: No such file or directory Nov 14 13:53:17 euler systemd-nspawn[8555]: Failed to create directory /opt/gluu-server//sys/fs/selinux: No such file or directory Nov 14 13:53:17 euler systemd-nspawn[8555]: Failed to mount to /opt/gluu-server/sys/fs/cgroup/perf_event: Invalid argument REPRODUCE: `# uname -a` Linux euler 3.10.0-042stab138.1 #1 SMP Wed May 15 09:33:10 MSK 2019 x86_64 x86_64 x86_64 GNU/Linux `# cat /etc/selinux/config` SELINUX=permissive SELINUXTYPE=targeted `# getenforce` Disabled `# wget https://repo.gluu.org/centos/Gluu-centos7.repo -O /etc/yum.repos.d/Gluu.repo --2019-11-14 14:03:49-- https://repo.gluu.org/centos/Gluu-centos7.repo` Resolving repo.gluu.org (repo.gluu.org)... 165.227.82.89 Connecting to repo.gluu.org (repo.gluu.org)|165.227.82.89|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 159 Saving to: ‘/etc/yum.repos.d/Gluu.repo’ 100%[=============================================================================================================================>] 159 --.-K/s in 0s 2019-11-14 14:03:50 (8.91 MB/s) - ‘/etc/yum.repos.d/Gluu.repo’ saved [159/159]` `# wget https://repo.gluu.org/centos/RPM-GPG-KEY-GLUU -O /etc/pki/rpm-gpg/RPM-GPG-KEY-GLUU --2019-11-14 14:04:39-- https://repo.gluu.org/centos/RPM-GPG-KEY-GLUU` Resolving repo.gluu.org (repo.gluu.org)... 165.227.82.89 Connecting to repo.gluu.org (repo.gluu.org)|165.227.82.89|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 3112 (3.0K) Saving to: ‘/etc/pki/rpm-gpg/RPM-GPG-KEY-GLUU’ 100%[=============================================================================================================================>] 3,112 --.-K/s in 0s 2019-11-14 14:04:39 (147 MB/s) - ‘/etc/pki/rpm-gpg/RPM-GPG-KEY-GLUU’ saved [3112/3112] `# rpm --import /etc/pki/rpm-gpg/RPM-GPG-KEY-GLUU` `# yum clean all` Loaded plugins: fastestmirror, tsflags, universal-hooks Cleaning repos: EA4 cpanel-addons-production-feed cpanel-plugins Gluu-rpm-centos7-repo base docker-ce-stable extras imhbase mariadb updates Cleaning up list of fastest mirrors Other repos take up 1.2 M of disk space (use --verbose for details) `# yum install gluu-server` Loaded plugins: fastestmirror, tsflags, universal-hooks Determining fastest mirrors * EA4: 185.125.185.32 * cpanel-addons-production-feed: 185.125.185.32 * cpanel-plugins: 185.125.185.32 * base: mirror.scalabledns.com * extras: mirror.fileplanet.com * updates: mirror.scalabledns.com EA4 | 2.9 kB 00:00:00 cpanel-addons-production-feed | 2.9 kB 00:00:00 cpanel-plugins | 2.9 kB 00:00:00 Gluu-rpm-centos7-repo | 2.9 kB 00:00:00 base | 3.6 kB 00:00:00 docker-ce-stable | 3.5 kB 00:00:00 extras | 2.9 kB 00:00:00 imhbase | 2.5 kB 00:00:00 mariadb | 2.9 kB 00:00:00 updates | 2.9 kB 00:00:00 (1/12): cpanel-plugins/x86_64/primary_db | 29 kB 00:00:00 (2/12): cpanel-addons-production-feed/x86_64/primary_db | 30 kB 00:00:00 (3/12): EA4/7/x86_64/primary_db | 985 kB 00:00:00 (4/12): Gluu-rpm-centos7-repo/primary_db | 319 kB 00:00:00 (5/12): base/7/x86_64/group_gz | 165 kB 00:00:00 (6/12): docker-ce-stable/x86_64/updateinfo | 55 B 00:00:00 (7/12): docker-ce-stable/x86_64/primary_db | 37 kB 00:00:00 (8/12): mariadb/primary_db | 53 kB 00:00:00 (9/12): extras/7/x86_64/primary_db | 153 kB 00:00:00 (10/12): imhbase/7/x86_64/primary_db | 691 kB 00:00:00 (11/12): base/7/x86_64/primary_db | 6.0 MB 00:00:01 (12/12): updates/7/x86_64/primary_db | 2.8 MB 00:00:01 Package gluu-server-4.0-centos7.x86_64 already installed and latest version Nothing to do `# /sbin/gluu-serverd start` Job for systemd-nspawn@gluu_server.service failed because the control process exited with error code. See "systemctl status systemd-nspawn@gluu_server.service" and "journalctl -xe" for details. `# systemctl status systemd-nspawn@gluu_server.service` ● systemd-nspawn@gluu_server.service - Container gluu_server Loaded: loaded (/usr/lib/systemd/system/systemd-nspawn@gluu_server.service; enabled; vendor preset: disabled) Active: failed (Result: exit-code) since Thu 2019-11-14 14:08:30 UTC; 33s ago Docs: man:systemd-nspawn(1) Process: 9027 ExecStart=/usr/bin/systemd-nspawn --quiet --boot --link-journal=try-guest --machine=%I (code=exited, status=1/FAILURE) Main PID: 9027 (code=exited, status=1/FAILURE) Status: "Terminating..." Nov 14 14:08:30 euler systemd-nspawn[9027]: Failed to create directory /opt/gluu-server//sys/fs/selinux: No such file or directory Nov 14 14:08:30 euler systemd-nspawn[9027]: Failed to create directory /opt/gluu-server//sys/fs/selinux: No such file or directory Nov 14 14:08:30 euler systemd-nspawn[9027]: Failed to read link /sys/fs/cgroup/net_prio: No such file or directory
Gluu 4.0 CentOS 7.0
closed

Answers

By Mitch Maifeld user 14 Nov 2019 at 11:13 a.m. CST

Copy
Mitch Maifeld gravatar
Enable doesn't fail. It just sets up the symlinks for the next reboot. When start fails, I don't expect login would work either. Thanks for your thoughts. `# /sbin/gluu-serverd enable` (nothing) `# /sbin/gluu-serverd start` Job for systemd-nspawn@gluu_server.service failed because the control process exited with error code. See "systemctl status systemd-nspawn@gluu_server.service" and "journalctl -xe" for details. `# /sbin/gluu-serverd login` Gluu server is not started.

By Mitch Maifeld user 15 Nov 2019 at 6:09 a.m. CST

Copy
Mitch Maifeld gravatar
Yes, I recall Pratik in that post and the doubled 'grep' command. I appreciate your willingness to help. I agree that it doesn't seem like getting it running should be this challenging. My Google-fu failed me as I couldn't find anyone else having the exact same failure. Most seem able to 'start' without problems. 'Euler' is just my hostname, not a fork. The hostname is the second slot of uname -a. `# cat /etc/centos-release` CentOS Linux release 7.7.1908 (Core) In the reboot/reinstall script, I have already uninstalled 4.0, installed 3.1.1, reinstalled 4.0 again, and found this same issue each time. That leads me to believe it's this new VPS's configuration. I just don't know what to investigate next as far as the server. I even tried a bare nspawn and that failed as well. Thanks again for your time investment on my issue.

By Mohib Zico Account Admin 23 Nov 2019 at 2:42 a.m. CST

Copy
Mohib Zico gravatar
Disable SELinux and see how that goes please.

By Mitch Maifeld user 05 Dec 2019 at 6:30 a.m. CST

Copy
Mitch Maifeld gravatar
I agree it must have something to do with SE, but see my OP - it's already disabled. It seems like gluu choked on SE with "Failed to create..." "No such file..." and "Cannot read link..." in /opt/gluu-server. If having SE working is not a dependency, I wouldn't think that would make gluu error and give up.

By Mohib Zico Account Admin 05 Dec 2019 at 6:44 a.m. CST

Copy
Mohib Zico gravatar
Hi Mitch, What type of platform you are using? Is it cloud or personal computer or VMWare / VirtualBox software ?

By Mitch Maifeld user 05 Dec 2019 at 7:01 a.m. CST

Copy
Mitch Maifeld gravatar
CentOS6 VPS at a hosting service.

By Mohib Zico Account Admin 05 Dec 2019 at 7:03 a.m. CST

Copy
Mohib Zico gravatar
CentOS 6?? Which hosting service? Can I run my installation there ( of course without credit card. lol ) ?

By Mitch Maifeld user 05 Dec 2019 at 7:09 a.m. CST

Copy
Mitch Maifeld gravatar
https://totalchoicehosting.com/ I don't think they have a free trial, unfortunately. If I recall, I had the exact same error in CentOS7 on my VPS at InMotion Hosting. https://www.inmotionhosting.com It doesn't look like they have a free trial, but a money back. No, I don't expect anyone should have to use their CC, but thanks for the offer <wink>.

By Mohib Zico Account Admin 09 Dec 2019 at 7:39 a.m. CST

Copy
Mohib Zico gravatar
I'll check four Platforms with CentOS7 installation: VMWare in local machine, AWS, DigitalOcean and Google Cloud. Let's see if I can reproduce this issue there or not.

By Mohib Zico Account Admin 17 Dec 2019 at 9:36 a.m. CST

Copy
Mohib Zico gravatar
Sorry.. haven't managed time to test those. I'll start testing as soon as I can manage.

By Mohib Zico Account Admin 03 Jan 2020 at 4:16 a.m. CST

Copy
Mohib Zico gravatar
Ok, I tried multiple platforms and couldn't reproduce issue. ``` [root@ip-172-31-37-213 ~]# /sbin/gluu-serverd start [root@ip-172-31-37-213 ~]# /sbin/gluu-serverd login Welcome to the Gluu Server! [root@gluu_server ~]# cd /install/community-edition-setup/ [root@gluu_server community-edition-setup]# ls install.py output pylib requirements.txt setup.properties.sample static tests LICENSE post-setup-add-components.py README.md schema setup.py templates [root@gluu_server community-edition-setup]# exit logout [root@ip-172-31-37-213 ~]# cat /etc/selinux/config # This file controls the state of SELinux on the system. # SELINUX= can take one of these three values: # enforcing - SELinux security policy is enforced. # permissive - SELinux prints warnings instead of enforcing. # disabled - No SELinux policy is loaded. SELINUX=enforcing # SELINUXTYPE= can take one of three two values: # targeted - Targeted processes are protected, # minimum - Modification of targeted policy. Only selected processes are protected. # mls - Multi Level Security protection. SELINUXTYPE=targeted [root@ip-172-31-37-213 ~]# ```

Post an answer