By: Rohit Patil user 09 Mar 2019 at 5:03 a.m. CST

8 Responses
Rohit Patil gravatar
I had made some changes to the Name ID ( following some article) and restarted the gluu-3.1.4 server. After that i am getting 503 service unavilable when my SSO redirects for the authentication. to see the example please check on below link http://enwgrid.alpha.emisha.co/plugins/user/oneloginsaml/oneloginsaml.php?sso it then redirects to https://dev.sso.emisha.co/idp/profile/SAML2/Redirect/SSO?SAMLRequest= <blah blah=""> and i get the 503 service unaviable. I have logged into chroot, restarted identity, idp. Both are running. My gluu server config vCPU: 3 Memory: 4 GB If it helps, below is top output top - 11:01:03 up 20:33, 0 users, load average: 0.23, 0.16, 0.07 Tasks: 125 total, 1 running, 124 sleeping, 0 stopped, 0 zombie %Cpu(s): 0.2 us, 0.7 sy, 0.0 ni, 98.3 id, 0.0 wa, 0.0 hi, 0.7 si, 0.1 st KiB Mem : 4097704 total, 478620 free, 2461632 used, 1157452 buff/cache KiB Swap: 0 total, 0 free, 0 used. 1565644 avail Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 18576 root 20 0 36816 3352 2748 R 1.0 0.1 0:00.10 top 10178 jetty 20 0 3576788 523676 25720 S 0.7 12.8 1:26.34 java 11031 ldap 20 0 4072788 515444 18716 S 0.7 12.6 0:58.13 java 7 root 20 0 0 0 0 S 0.3 0.0 6:14.73 rcu_sched 519 _apt 20 0 44912 3148 2824 S 0.3 0.1 0:24.36 avahi-daemon 8410 jetty 20 0 3813112 571588 22812 S 0.3 13.9 1:26.03 java 8677 jetty 20 0 3549980 521680 21928 S 0.3 12.7 0:47.46 java 8784 jetty 20 0 3256160 306324 20500 S 0.3 7.5 0:36.59 java 18578 root 20 0 65508 5928 5220 S 0.3 0.1 0:00.01 sshd 1 root 20 0 37900 5984 4048 S 0.0 0.1 0:06.02 systemd</blah>

By Mohammad Abudayyeh staff 09 Mar 2019 at 5:22 a.m. CST

Mohammad Abudayyeh gravatar
Hi Roit, To assist you we would want to see your logs please ( `idp-process.log` , `oxauth`,`oxtrust` and `attribute-resolver.xml`. Thanks,

By Rohit Patil user 11 Mar 2019 at 12:01 a.m. CDT

Rohit Patil gravatar
Attched are the log files for last 3 days and the attribute-resolver.xml (all inside the zip file)

By Rohit Patil user 13 Mar 2019 at 1:19 a.m. CDT

Rohit Patil gravatar
May i know if you need any more info i can help you with. OR would you want me try out something on the server and get with those results please let me know. Thanks

By Mohammad Abudayyeh staff 13 Mar 2019 at 2:42 a.m. CDT

Mohammad Abudayyeh gravatar
Thanks for your logs. Can you please check the status of your services ? Do a `stop` and `start` because it looks like the service is down.

By Rohit Patil user 13 Mar 2019 at 3:06 a.m. CDT

Rohit Patil gravatar
I did , the service is running. please see the output of status cmd below. root@dev:~# /etc/init.d/gluu-server-3.1.4 status ● gluu-server-3.1.4.service - LSB: This shell script takes care of starting and stopping Loaded: loaded (/etc/init.d/gluu-server-3.1.4; bad; vendor preset: enabled) Active: active (running) since Sat 2019-03-09 15:29:21 IST; 3 days ago Docs: man:systemd-sysv-generator(8) Process: 7602 ExecStop=/etc/init.d/gluu-server-3.1.4 stop (code=exited, status=0/SUCCESS) Process: 8042 ExecStart=/etc/init.d/gluu-server-3.1.4 start (code=exited, status=0/SUCCESS) CGroup: /system.slice/gluu-server-3.1.4.service ├─ 1194 /usr/sbin/rsyslogd ├─ 1204 /usr/sbin/cron ├─ 1217 /usr/bin/dbus-daemon --system ├─ 8410 /opt/jre/bin/java -server -Xms256m -Xmx716m -XX:MaxMetaspaceSize=307m -XX:+DisableExplicitGC -Dgluu.base=/etc/gluu -Dserver.base=/opt/gluu/jetty/oxauth -Dlog.base=/opt/gluu/jetty/oxa... ├─ 8677 /opt/jre/bin/java -server -Xms256m -Xmx477m -XX:MaxMetaspaceSize=205m -XX:+DisableExplicitGC -XX:+UseG1GC -Dgluu.base=/etc/gluu -Dserver.base=/opt/gluu/jetty/idp -Djetty.home=/opt/je... ├─ 8784 /opt/jre/bin/java -server -Xms238m -Xmx238m -XX:MaxMetaspaceSize=103m -XX:+DisableExplicitGC -Dgluu.base=/etc/gluu -Dserver.base=/opt/gluu/jetty/oxauth-rp -Dlog.base=/opt/gluu/jetty/... ├─ 8884 /usr/sbin/apache2 -k start ├─21810 /usr/sbin/apache2 -k start └─21839 /usr/sbin/apache2 -k start Mar 09 15:27:35 e2e-56-88.e2enetworks.net.in systemd[1]: Starting LSB: This shell script takes care of starting and stopping... Mar 09 15:27:35 e2e-56-88.e2enetworks.net.in gluu-server-3.1.4[8042]: Starting Gluu server, please wait... Mar 09 15:29:21 dev.sso.emisha.co systemd[1]: Started LSB: This shell script takes care of starting and stopping.

By Mohammad Abudayyeh staff 13 Mar 2019 at 5:43 a.m. CDT

Mohammad Abudayyeh gravatar
Sorry if I was unclear. I meant you need to check the services status. Inside the container do `services --status-all`. You may have to restart these services `identity`, `idp`, `oxauth`,`oxauth-rp` . Also check opendj status `/opt/opendj/bin/status` you can `stop-ds` and `start-ds` from there as well.

By Rohit Patil user 23 Mar 2019 at 2:51 a.m. CDT

Rohit Patil gravatar
all services are running.. root@e2e-56-88:~# service identity status Jetty running pid=26742 JAVA = /opt/jre/bin/java JAVA_OPTIONS = -server -Xms256m -Xmx477m -XX:MaxMetaspaceSize=205m -XX:+DisableExplicitGC -Dgluu.base=/etc/gluu -Dserver.base=/opt/gluu/jetty/identity -Dlog.base=/opt/gluu/jetty/identity -Dpython.home=/opt/jython -Dorg.eclipse.jetty.server.Request.maxFormContentSize=50000000 -Djetty.home=/opt/jetty -Djetty.base=/opt/gluu/jetty/identity -Djava.io.tmpdir=/opt/jetty-9.4/temp JETTY_HOME = /opt/jetty JETTY_BASE = /opt/gluu/jetty/identity START_D = /opt/gluu/jetty/identity/start.d START_INI = /opt/gluu/jetty/identity/start.ini JETTY_START = /opt/jetty/start.jar JETTY_CONF = /opt/jetty/etc/jetty.conf JETTY_ARGS = jetty.http.host=localhost jetty.http.port=8082 jetty.state=/opt/gluu/jetty/identity/identity.state jetty-started.xml JETTY_RUN = /var/run/jetty JETTY_PID = /var/run/jetty/identity.pid JETTY_START_LOG = /var/run/jetty/identity-start.log JETTY_STATE = /opt/gluu/jetty/identity/identity.state JETTY_START_TIMEOUT = 60 RUN_CMD = /opt/jre/bin/java -server -Xms256m -Xmx477m -XX:MaxMetaspaceSize=205m -XX:+DisableExplicitGC -Dgluu.base=/etc/gluu -Dserver.base=/opt/gluu/jetty/identity -Dlog.base=/opt/gluu/jetty/identity -Dpython.home=/opt/jython -Dorg.eclipse.jetty.server.Request.maxFormContentSize=50000000 -Djetty.home=/opt/jetty -Djetty.base=/opt/gluu/jetty/identity -Djava.io.tmpdir=/opt/jetty-9.4/temp -jar /opt/jetty/start.jar jetty.http.host=localhost jetty.http.port=8082 jetty.state=/opt/gluu/jetty/identity/identity.state jetty-started.xml root@e2e-56-88:~# service idp status Jetty running pid=26925 JAVA = /opt/jre/bin/java JAVA_OPTIONS = -server -Xms256m -Xmx477m -XX:MaxMetaspaceSize=205m -XX:+DisableExplicitGC -XX:+UseG1GC -Dgluu.base=/etc/gluu -Dserver.base=/opt/gluu/jetty/idp -Djetty.home=/opt/jetty -Djetty.base=/opt/gluu/jetty/idp -Djava.io.tmpdir=/opt/jetty-9.4/temp JETTY_HOME = /opt/jetty JETTY_BASE = /opt/gluu/jetty/idp START_D = /opt/gluu/jetty/idp/start.d START_INI = /opt/gluu/jetty/idp/start.ini JETTY_START = /opt/jetty/start.jar JETTY_CONF = /opt/jetty/etc/jetty.conf JETTY_ARGS = jetty.http.host=localhost jetty.http.port=8086 jetty.state=/opt/gluu/jetty/idp/idp.state jetty-started.xml JETTY_RUN = /var/run/jetty JETTY_PID = /var/run/jetty/idp.pid JETTY_START_LOG = /var/run/jetty/idp-start.log JETTY_STATE = /opt/gluu/jetty/idp/idp.state JETTY_START_TIMEOUT = 60 RUN_CMD = /opt/jre/bin/java -server -Xms256m -Xmx477m -XX:MaxMetaspaceSize=205m -XX:+DisableExplicitGC -XX:+UseG1GC -Dgluu.base=/etc/gluu -Dserver.base=/opt/gluu/jetty/idp -Djetty.home=/opt/jetty -Djetty.base=/opt/gluu/jetty/idp -Djava.io.tmpdir=/opt/jetty-9.4/temp -jar /opt/jetty/start.jar jetty.http.host=localhost jetty.http.port=8086 jetty.state=/opt/gluu/jetty/idp/idp.state jetty-started.xml root@e2e-56-88:~# service oxauth status Jetty running pid=27100 JAVA = /opt/jre/bin/java JAVA_OPTIONS = -server -Xms256m -Xmx716m -XX:MaxMetaspaceSize=307m -XX:+DisableExplicitGC -Dgluu.base=/etc/gluu -Dserver.base=/opt/gluu/jetty/oxauth -Dlog.base=/opt/gluu/jetty/oxauth -Dpython.home=/opt/jython -Djetty.home=/opt/jetty -Djetty.base=/opt/gluu/jetty/oxauth -Djava.io.tmpdir=/opt/jetty-9.4/temp JETTY_HOME = /opt/jetty JETTY_BASE = /opt/gluu/jetty/oxauth START_D = /opt/gluu/jetty/oxauth/start.d START_INI = /opt/gluu/jetty/oxauth/start.ini JETTY_START = /opt/jetty/start.jar JETTY_CONF = /opt/jetty/etc/jetty.conf JETTY_ARGS = jetty.http.host=localhost jetty.http.port=8081 jetty.state=/opt/gluu/jetty/oxauth/oxauth.state jetty-started.xml JETTY_RUN = /var/run/jetty JETTY_PID = /var/run/jetty/oxauth.pid JETTY_START_LOG = /var/run/jetty/oxauth-start.log JETTY_STATE = /opt/gluu/jetty/oxauth/oxauth.state JETTY_START_TIMEOUT = 60 RUN_CMD = /opt/jre/bin/java -server -Xms256m -Xmx716m -XX:MaxMetaspaceSize=307m -XX:+DisableExplicitGC -Dgluu.base=/etc/gluu -Dserver.base=/opt/gluu/jetty/oxauth -Dlog.base=/opt/gluu/jetty/oxauth -Dpython.home=/opt/jython -Djetty.home=/opt/jetty -Djetty.base=/opt/gluu/jetty/oxauth -Djava.io.tmpdir=/opt/jetty-9.4/temp -jar /opt/jetty/start.jar jetty.http.host=localhost jetty.http.port=8081 jetty.state=/opt/gluu/jetty/oxauth/oxauth.state jetty-started.xml root@e2e-56-88:~# service oxauth-rp status Jetty running pid=27282 JAVA = /opt/jre/bin/java JAVA_OPTIONS = -server -Xms238m -Xmx238m -XX:MaxMetaspaceSize=103m -XX:+DisableExplicitGC -Dgluu.base=/etc/gluu -Dserver.base=/opt/gluu/jetty/oxauth-rp -Dlog.base=/opt/gluu/jetty/oxauth-rp -Djetty.home=/opt/jetty -Djetty.base=/opt/gluu/jetty/oxauth-rp -Djava.io.tmpdir=/opt/jetty-9.4/temp JETTY_HOME = /opt/jetty JETTY_BASE = /opt/gluu/jetty/oxauth-rp START_D = /opt/gluu/jetty/oxauth-rp/start.d START_INI = /opt/gluu/jetty/oxauth-rp/start.ini JETTY_START = /opt/jetty/start.jar JETTY_CONF = /opt/jetty/etc/jetty.conf JETTY_ARGS = jetty.http.host=localhost jetty.http.port=8085 jetty.state=/opt/gluu/jetty/oxauth-rp/oxauth-rp.state jetty-started.xml JETTY_RUN = /var/run/jetty JETTY_PID = /var/run/jetty/oxauth-rp.pid JETTY_START_LOG = /var/run/jetty/oxauth-rp-start.log JETTY_STATE = /opt/gluu/jetty/oxauth-rp/oxauth-rp.state JETTY_START_TIMEOUT = 60 RUN_CMD = /opt/jre/bin/java -server -Xms238m -Xmx238m -XX:MaxMetaspaceSize=103m -XX:+DisableExplicitGC -Dgluu.base=/etc/gluu -Dserver.base=/opt/gluu/jetty/oxauth-rp -Dlog.base=/opt/gluu/jetty/oxauth-rp -Djetty.home=/opt/jetty -Djetty.base=/opt/gluu/jetty/oxauth-rp -Djava.io.tmpdir=/opt/jetty-9.4/temp -jar /opt/jetty/start.jar jetty.http.host=localhost jetty.http.port=8085 jetty.state=/opt/gluu/jetty/oxauth-rp/oxauth-rp.state jetty-started.xml but do you think below could be the issue ? see the difference, if i give -h as localhost it works but if i give dev.sso.emisha.co it does not work. root@e2e-56-88:~# /opt/opendj/bin/ldapsearch -h localhost -p 1636 -Z -X -D 'cn=directory manager' -w ppaasswwoorrdd -b o=gluu -s sub "(uid=admin)" dn: inum=@!76FE.BCCB.5F09.B8AA!0001!068A.F3BA!0000!A8F2.DE1E.D7FB,ou=people,o=@! 76FE.BCCB.5F09.B8AA!0001!068A.F3BA,o=gluu objectClass: top objectClass: gluuPerson objectClass: gluuCustomPerson inum: @!76FE.BCCB.5F09.B8AA!0001!068A.F3BA!0000!A8F2.DE1E.D7FB oxLastLogonTime: 20190323064310.045Z updatedAt: 20181026080444.375Z locale: en zoneinfo: America/Los_Angeles phoneNumberVerified: true userPassword: {SSHA}fyX2jvx+YGywgggkf2B91AGxB76ATo7k mail: admin@dev.sso.emisha.co givenName: Admin telephoneNumber: 555-1212 emailVerified: true website: https://www.gluu.org/ birthdate: 20170907123010.485Z gender: male preferredUsername: admin memberOf: inum=@!76FE.BCCB.5F09.B8AA!0001!068A.F3BA!0003!60B7,ou=groups,o=@!76FE .BCCB.5F09.B8AA!0001!068A.F3BA,o=gluu picture: https://www.gluu.org/wp-content/themes/gluu/images/gl.png profile: https://www.facebook.com/gluufederation/ displayName: Default Admin User c: US gluuStatus: active sn: User nickname: Admin middleName: Admin uid: admin root@e2e-56-88:~# /opt/opendj/bin/ldapsearch -h dev.sso.emisha.co -p 1636 -Z -X -D 'cn=directory manager' -w ppaasswwoorrdd -b o=gluu -s sub "(uid=admin)" Connect Error Result Code: 91 (Connect Error)

By Rohit Patil user 23 Mar 2019 at 5:01 a.m. CDT

Rohit Patil gravatar
i even did a restart of all the services, still the same issue. Can you please help. i think i have hit a dead end. log files also show NO abnormality..