By: Vijayakumar Ramasamy user 29 Jul 2020 at 5:25 a.m. CDT

6 Responses
Vijayakumar Ramasamy gravatar
Hi, We are using the Gluu server 4.1 version, just restarted it but it coming to online after restarted it. we are getting the error message that "503" when we are click the main URL. Here, we used below commands for restart the Gluu server. To stop : /sbin/gluu-serverd stop To Start : /sbin/gluu-serverd start [root@gluu02 ~]# /sbin/gluu-serverd version Title: oxAuth Server Version: 4.2.0.Final Builddate: Mon Jul 13 19:41:43 UTC 2020 Build: f18b456eb688440c052a840f5b3ac88e445ed115 Title: Fido2 API Server Version: 4.2.0.Final Builddate: Mon Jul 13 19:43:02 UTC 2020 Build: c4cf3feff9a9d1652a80002105039d2faacbcfdc Title: oxTrust Server Version: 4.2.0.Final Builddate: Tue Jul 14 12:08:52 UTC 2020 Build: 52053a241e868448527dfd51470201977d57de87 Title: SCIM API Server Version: 4.2.0.Final Builddate: Mon Jul 13 19:47:27 UTC 2020 Build: 2a8a6970e67ec869d5f6deb242126c8ae4ebe4c4 Title: Gluu Shibboleth IDP Version: 4.2.0.Final Builddate: Build: 25605815c555d368a11c34649e2fb75dc5af8096 Title: oxAuth RP Version: 4.2.0.Final Builddate: Fri Jul 17 16:37:18 UTC 2020 Build: Title: casa Version: 4.2.0.Final Builddate: Mon Jul 13 19:49:28 UTC 2020 Build: fabb82d5feb52d676eb9ca2da1eeba0db287f397 Also i have attached the oxtrust , ldap and httpd logs file for your Investigation. Please find it and provide me the solution for bring it to online. also let me know if you needed any other details. Thanks in Advanced. Log file details: oxtrust.log file ****************************************************************************************** Caused by: com.unboundid.ldap.sdk.LDAPException: An error occurred while attempting to establish a connection to server localhost/127.0.0.1:1636: ConnectException(Connection refused (Connection refused)), ldapSDKVersion=4.0.14, revision=c0fb784eebf9d36a67c736d0428fb3577f2e25bb at com.unboundid.ldap.sdk.ConnectThread.getConnectedSocket(ConnectThread.java:269) ~[unboundid-ldapsdk-4.0.14.jar:4.0.14] at com.unboundid.ldap.sdk.LDAPConnectionInternals.<init>(LDAPConnectionInternals.java:166) ~[unboundid-ldapsdk-4.0.14.jar:4.0.14] at com.unboundid.ldap.sdk.LDAPConnection.connect(LDAPConnection.java:865) ~[unboundid-ldapsdk-4.0.14.jar:4.0.14] at com.unboundid.ldap.sdk.LDAPConnection.connect(LDAPConnection.java:764) ~[unboundid-ldapsdk-4.0.14.jar:4.0.14] at com.unboundid.ldap.sdk.LDAPConnection.connect(LDAPConnection.java:714) ~[unboundid-ldapsdk-4.0.14.jar:4.0.14] at com.unboundid.ldap.sdk.LDAPConnection.<init>(LDAPConnection.java:538) ~[unboundid-ldapsdk-4.0.14.jar:4.0.14] at com.unboundid.ldap.sdk.SingleServerSet.getConnection(SingleServerSet.java:307) ~[unboundid-ldapsdk-4.0.14.jar:4.0.14] at com.unboundid.ldap.sdk.FailoverServerSet.getConnection(FailoverServerSet.java:662) ~[unboundid-ldapsdk-4.0.14.jar:4.0.14] at com.unboundid.ldap.sdk.LDAPConnectionPool.createConnection(LDAPConnectionPool.java:1283) ~[unboundid-ldapsdk-4.0.14.jar:4.0.14] at com.unboundid.ldap.sdk.LDAPConnectionPool.createConnection(LDAPConnectionPool.java:1256) ~[unboundid-ldapsdk-4.0.14.jar:4.0.14] at com.unboundid.ldap.sdk.LDAPConnectionPool.getConnection(LDAPConnectionPool.java:1839) ~[unboundid-ldapsdk-4.0.14.jar:4.0.14] at com.unboundid.ldap.sdk.AbstractConnectionPool.getEntry(AbstractConnectionPool.java:611) ~[unboundid-ldapsdk-4.0.14.jar:4.0.14] at org.gluu.persist.ldap.operation.impl.LdapOperationServiceImpl.lookupImpl(LdapOperationServiceImpl.java:695) ~[oxcore-persistence-ldap-4.2.0.Final.jar:?] at org.gluu.persist.ldap.operation.impl.LdapOperationServiceImpl.lookup(LdapOperationServiceImpl.java:682) ~[oxcore-persistence-ldap-4.2.0.Final.jar:?] at org.gluu.persist.ldap.impl.LdapEntryManager.find(LdapEntryManager.java:403) ~[oxcore-persistence-ldap-4.2.0.Final.jar:?] ... 22 more Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:?] at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:399) ~[?:?] at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:242) ~[?:?] at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:224) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:403) ~[?:?] at java.net.Socket.connect(Socket.java:609) ~[?:?] at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:285) ~[?:?] at com.unboundid.util.ssl.SetEnabledProtocolsAndCipherSuitesSocket.connect(SetEnabledProtocolsAndCipherSuitesSocket.java:131) ~[unboundid-ldapsdk-4.0.14.jar:4.0.14] at com.unboundid.ldap.sdk.ConnectThread.run(ConnectThread.java:148) ~[unboundid-ldapsdk-4.0.14.jar:4.0.14] 2020-07-28 07:44:23,547 INFO [Thread-1] [org.gluu.oxtrust.service.AppInitializer] (AppInitializer.java:414) - Stopping services and closing DB connections at server shutdown... 2020-07-28 11:21:39,608 INFO [main] [org.gluu.oxauth.model.util.SecurityProviderUtility] (SecurityProviderUtility.java:24) - Adding Bouncy Castle Provider 2020-07-28 11:21:39,734 INFO [main] [org.gluu.oxtrust.util.BuildVersionService] (BuildVersionService.java:80) - Root element :beans 2020-07-28 11:21:39,737 INFO [main] [org.gluu.oxtrust.service.AppInitializer] (AppInitializer.java:253) - Build date 2020-07-14 12:06. Code revision 52053a241e868448527dfd51470201977d57de87 on 2020-07-13T17:46:46+0000. Build 2061 2020-07-28 11:21:39,743 INFO [main] [org.gluu.service.config.ConfigurationFactory] (ConfigurationFactory.java:127) - Creating oxTrustConfiguration 2020-07-28 11:21:39,809 INFO [main] [org.gluu.service.config.ConfigurationFactory] (ConfigurationFactory.java:289) - Loading configuration from 'ldap' DB... 2020-07-28 11:30:17,798 INFO [main] [org.gluu.oxauth.model.util.SecurityProviderUtility] (SecurityProviderUtility.java:24) - Adding Bouncy Castle Provider 2020-07-28 11:30:17,938 INFO [main] [org.gluu.oxtrust.util.BuildVersionService] (BuildVersionService.java:80) - Root element :beans 2020-07-28 11:30:17,941 INFO [main] [org.gluu.oxtrust.service.AppInitializer] (AppInitializer.java:253) - Build date 2020-07-14 12:06. Code revision 52053a241e868448527dfd51470201977d57de87 on 2020-07-13T17:46:46+0000. Build 2061 2020-07-28 11:30:17,946 INFO [main] [org.gluu.service.config.ConfigurationFactory] (ConfigurationFactory.java:127) - Creating oxTrustConfiguration 2020-07-28 11:30:18,013 INFO [main] [org.gluu.service.config.ConfigurationFactory] (ConfigurationFactory.java:289) - Loading configuration from 'ldap' DB... ***************************************************************************************** httpd error log file [Wed Jul 29 06:11:03.100114 2020] [proxy_http:error] [pid 2119] [client 192.168.1.98:37790] AH01114: HTTP: failed to make connection to backend: localhost [Wed Jul 29 06:12:03.155559 2020] [proxy:error] [pid 2117] (111)Connection refused: AH00957: HTTP: attempt to connect to 127.0.0.1:8082 (localhost) failed [Wed Jul 29 06:12:03.155616 2020] [proxy:error] [pid 2117] AH00959: ap_proxy_connect_backend disabling worker for (localhost) for 5s [Wed Jul 29 06:12:03.155624 2020] [proxy_http:error] [pid 2117] [client 192.168.1.98:37796] AH01114: HTTP: failed to make connection to backend: localhost [Wed Jul 29 06:13:03.212793 2020] [proxy:error] [pid 2160] (111)Connection refused: AH00957: HTTP: attempt to connect to 127.0.0.1:8082 (localhost) failed [Wed Jul 29 06:13:03.212848 2020] [proxy:error] [pid 2160] AH00959: ap_proxy_connect_backend disabling worker for (localhost) for 5s [Wed Jul 29 06:13:03.212857 2020] [proxy_http:error] [pid 2160] [client 192.168.1.98:37802] AH01114: HTTP: failed to make connection to backend: localhost [Wed Jul 29 06:14:03.254100 2020] [proxy:error] [pid 2115] (111)Connection refused: AH00957: HTTP: attempt to connect to 127.0.0.1:8082 (localhost) failed [Wed Jul 29 06:14:03.254162 2020] [proxy:error] [pid 2115] AH00959: ap_proxy_connect_backend disabling worker for (localhost) for 5s [Wed Jul 29 06:14:03.254171 2020] [proxy_http:error] [pid 2115] [client 192.168.1.98:37808] AH01114: HTTP: failed to make connection to backend: localhost [Wed Jul 29 06:15:03.313009 2020] [proxy:error] [pid 2116] (111)Connection refused: AH00957: HTTP: attempt to connect to 127.0.0.1:8082 (localhost) failed [Wed Jul 29 06:15:03.313072 2020] [proxy:error] [pid 2116] AH00959: ap_proxy_connect_backend disabling worker for (localhost) for 5s [Wed Jul 29 06:15:03.313080 2020] [proxy_http:error] [pid 2116] [client 192.168.1.98:37814] AH01114: HTTP: failed to make connection to backend: localhost [Wed Jul 29 06:16:03.371025 2020] [proxy:error] [pid 2118] (111)Connection refused: AH00957: HTTP: attempt to connect to 127.0.0.1:8082 (localhost) failed [Wed Jul 29 06:16:03.371073 2020] [proxy:error] [pid 2118] AH00959: ap_proxy_connect_backend disabling worker for (localhost) for 5s [Wed Jul 29 06:16:03.371081 2020] [proxy_http:error] [pid 2118] [client 192.168.1.98:37820] AH01114: HTTP: failed to make connection to backend: localhost [Wed Jul 29 06:17:03.424086 2020] [proxy:error] [pid 2119] (111)Connection refused: AH00957: HTTP: attempt to connect to 127.0.0.1:8082 (localhost) failed [Wed Jul 29 06:17:03.424136 2020] [proxy:error] [pid 2119] AH00959: ap_proxy_connect_backend disabling worker for (localhost) for 5s [Wed Jul 29 06:17:03.424145 2020] [proxy_http:error] [pid 2119] [client 192.168.1.98:37826] AH01114: HTTP: failed to make connection to backend: localhost [Wed Jul 29 06:17:12.047310 2020] [proxy:error] [pid 2117] (111)Connection refused: AH00957: HTTP: attempt to connect to 127.0.0.1:8082 (localhost) failed [Wed Jul 29 06:17:12.047357 2020] [proxy:error] [pid 2117] AH00959: ap_proxy_connect_backend disabling worker for (localhost) for 5s [Wed Jul 29 06:17:12.047365 2020] [proxy_http:error] [pid 2117] [client 192.168.1.10:64057] AH01114: HTTP: failed to make connection to backend: localhost [Wed Jul 29 06:18:03.479447 2020] [proxy:error] [pid 2160] (111)Connection refused: AH00957: HTTP: attempt to connect to 127.0.0.1:8082 (localhost) failed [Wed Jul 29 06:18:03.479502 2020] [proxy:error] [pid 2160] AH00959: ap_proxy_connect_backend disabling worker for (localhost) for 5s [Wed Jul 29 06:18:03.479510 2020] [proxy_http:error] [pid 2160] [client 192.168.1.98:37840] AH01114: HTTP: failed to make connection to backend: localhost [Wed Jul 29 06:19:03.538380 2020] [proxy:error] [pid 2115] (111)Connection refused: AH00957: HTTP: attempt to connect to 127.0.0.1:8082 (localhost) failed [Wed Jul 29 06:19:03.538432 2020] [proxy:error] [pid 2115] AH00959: ap_proxy_connect_backend disabling worker for (localhost) for 5s [Wed Jul 29 06:19:03.538441 2020] [proxy_http:error] [pid 2115] [client 192.168.1.98:37846] AH01114: HTTP: failed to make connection to backend: localhost [Wed Jul 29 06:20:03.599553 2020] [proxy:error] [pid 2116] (111)Connection refused: AH00957: HTTP: attempt to connect to 127.0.0.1:8082 (localhost) failed [Wed Jul 29 06:20:03.599627 2020] [proxy:error] [pid 2116] AH00959: ap_proxy_connect_backend disabling worker for (localhost) for 5s [Wed Jul 29 06:20:03.599638 2020] [proxy_http:error] [pid 2116] [client 192.168.1.98:37852] AH01114: HTTP: failed to make connection to backend: localhost [Wed Jul 29 06:21:03.645249 2020] [proxy:error] [pid 2118] (111)Connection refused: AH00957: HTTP: attempt to connect to 127.0.0.1:8082 (localhost) failed [Wed Jul 29 06:21:03.645321 2020] [proxy:error] [pid 2118] AH00959: ap_proxy_connect_backend disabling worker for (localhost) for 5s ***************************************************************************************** Open ldap log: 4444 [28/Jul/2020:11:25:29 -0400] category=PROTOCOL severity=NOTICE msgID=277 msg=Stopped listening for new connections on LDAP Connection Handler 0.0.0.0 port 1389 [28/Jul/2020:11:25:29 -0400] category=PROTOCOL severity=NOTICE msgID=277 msg=Stopped listening for new connections on LDAPS Connection Handler localhost port 1636 [28/Jul/2020:11:25:32 -0400] category=BACKEND severity=NOTICE msgID=370 msg=The backend userRoot is now taken offline [28/Jul/2020:11:25:32 -0400] category=BACKEND severity=NOTICE msgID=370 msg=The backend site is now taken offline [28/Jul/2020:11:25:32 -0400] category=BACKEND severity=NOTICE msgID=370 msg=The backend metric is now taken offline [28/Jul/2020:11:25:33 -0400] category=CORE severity=NOTICE msgID=203 msg=The Directory Server is now stopped [28/Jul/2020:11:29:35 -0400] category=JVM severity=NOTICE msgID=21 msg=Installation Directory: /opt/gluu-server/opt/opendj [28/Jul/2020:11:29:35 -0400] category=JVM severity=NOTICE msgID=23 msg=Instance Directory: /opt/gluu-server/opt/opendj [28/Jul/2020:11:29:35 -0400] category=JVM severity=NOTICE msgID=17 msg=JVM Information: 1.8.0_252-b09 by Oracle Corporation, 64-bit architecture, 921174016 bytes heap size [28/Jul/2020:11:29:55 -0400] category=JVM severity=NOTICE msgID=18 msg=JVM Host: gluu02.sennovate.com, running Linux 3.10.0-1127.el7.x86_64 amd64, 4142481408 bytes physical memory size, number of processors available 2 [28/Jul/2020:11:29:55 -0400] category=JVM severity=NOTICE msgID=19 msg=JVM Arguments: "-Dorg.opends.server.scriptName=start-ds" [28/Jul/2020:11:30:04 -0400] category=BACKEND severity=NOTICE msgID=513 msg=The database backend site containing 2 entries has started [28/Jul/2020:11:30:20 -0400] category=BACKEND severity=NOTICE msgID=513 msg=The database backend metric containing 5015 entries has started [28/Jul/2020:11:30:21 -0400] category=BACKEND severity=NOTICE msgID=513 msg=The database backend userRoot containing 302 entries has started [28/Jul/2020:11:30:21 -0400] category=EXTENSIONS severity=NOTICE msgID=221 msg=DIGEST-MD5 SASL mechanism using a server fully qualified domain name of: localhost [28/Jul/2020:11:30:37 -0400] category=CORE severity=NOTICE msgID=135 msg=The Directory Server has started successfully [28/Jul/2020:11:30:37 -0400] category=CORE severity=NOTICE msgID=139 msg=The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.core-135): The Directory Server has started successfully [28/Jul/2020:11:30:37 -0400] category=PROTOCOL severity=NOTICE msgID=276 msg=Started listening for new connections on Administration Connector localhost port 4444 [28/Jul/2020:11:30:37 -0400] category=PROTOCOL severity=NOTICE msgID=276 msg=Started listening for new connections on LDAP Connection Handler 0.0.0.0 port 1389 [28/Jul/2020:11:30:37 -0400] category=PROTOCOL severity=NOTICE msgID=276 msg=Started listening for new connections on LDAPS Connection Handler localhost port 1636 [28/Jul/2020:11:33:00 -0400] category=PROTOCOL severity=NOTICE msgID=277 msg=Stopped listening for new connections on LDAP Connection Handler 0.0.0.0 port 1389 [28/Jul/2020:11:37:10 -0400] category=JVM severity=NOTICE msgID=21 msg=Installation Directory: /opt/opendj [28/Jul/2020:11:37:10 -0400] category=JVM severity=NOTICE msgID=23 msg=Instance Directory: /opt/opendj [28/Jul/2020:11:37:10 -0400] category=JVM severity=NOTICE msgID=17 msg=JVM Information: 11.0.7+10-LTS by Amazon.com Inc., 64-bit architecture, 1035993088 bytes heap size [28/Jul/2020:11:37:10 -0400] category=JVM severity=NOTICE msgID=18 msg=JVM Host: gluu02.sennovate.com, running Linux 3.10.0-1127.el7.x86_64 amd64, 4142481408 bytes physical memory size, number of processors available 2 [28/Jul/2020:11:37:10 -0400] category=JVM severity=NOTICE msgID=19 msg=JVM Arguments: "-Dorg.opends.server.scriptName=start-ds" [28/Jul/2020:11:37:13 -0400] category=BACKEND severity=NOTICE msgID=513 msg=The database backend site containing 2 entries has started [28/Jul/2020:11:37:14 -0400] category=BACKEND severity=NOTICE msgID=513 msg=The database backend metric containing 5015 entries has started [28/Jul/2020:11:37:15 -0400] category=BACKEND severity=NOTICE msgID=513 msg=The database backend userRoot containing 302 entries has started [28/Jul/2020:11:37:15 -0400] category=EXTENSIONS severity=NOTICE msgID=221 msg=DIGEST-MD5 SASL mechanism using a server fully qualified domain name of: localhost [28/Jul/2020:11:37:16 -0400] category=CORE severity=NOTICE msgID=135 msg=The Directory Server has started successfully [28/Jul/2020:11:37:16 -0400] category=CORE severity=NOTICE msgID=139 msg=The Directory Server has sent an alert notification generated by class org.opends.server.core.DirectoryServer (alert type org.opends.server.DirectoryServerStarted, alert ID org.opends.messages.core-135): The Directory Server has started successfully [28/Jul/2020:11:37:17 -0400] category=PROTOCOL severity=NOTICE msgID=276 msg=Started listening for new connections on LDAPS Connection Handler localhost port 1636 [28/Jul/2020:11:37:17 -0400] category=PROTOCOL severity=NOTICE msgID=276 msg=Started listening for new connections on Administration Connector localhost port 4444 *****************************************************************************************

By Mohib Zico staff 29 Jul 2020 at 5:55 a.m. CDT

Mohib Zico gravatar
Couple of contradictory info in your ticket: - in subject, you said: 4.1 but tagged comment as 4.2 - why you are using openLDAP? - your ldap log showing message from 11:37 but oxtrust 11:30. LDAP should always run "before" any component of Gluu Server. - "just restarted it but it coming to online after restarted it" -- not sure what you tried to say. May be state clearly next time please. - " when we are click the main URL." -- what do you mean by "main url" ? Then, couple of other info required: - what Gluu server bits you are using? ( oxtrust, oxauth, shibboleth, casa etc ) - how much memory & resources you have?

By Vijayakumar Ramasamy user 29 Jul 2020 at 6:11 a.m. CDT

Vijayakumar Ramasamy gravatar
Hi, Please find my comments below, * in subject, you said: 4.1 but tagged comment as 4.2  it is a 4.2 version. * why you are using openLDAP?  we are using default ldap server. * "just restarted it but it coming to online after restarted it" after restart the gluu server, we unable to reach the url https://ipaddress/identity, getting “503. That's an error.The service you requested is not available at this time.Please try later again.” * what Gluu server bits you are using? ( oxtrust, oxauth, shibboleth, casa etc )  I’m not sure about it. * how much memory & resources you have?  Mem=4G CPU=2, HDD=70G Thanks, Vijay

By Mohib Zico staff 29 Jul 2020 at 7:42 a.m. CDT

Mohib Zico gravatar
Thanks. Increase memory to 8GB, test that. If anything doesn't look good, open a new ticket with proper info. Deployer must have to know which service they installed to troubleshoot any problem.

By Vijayakumar Ramasamy user 29 Jul 2020 at 7:58 a.m. CDT

Vijayakumar Ramasamy gravatar
Thank you so much. i will check.

By Vijayakumar Ramasamy user 29 Jul 2020 at 8:04 a.m. CDT

Vijayakumar Ramasamy gravatar
Can you please provide me the installation document or link,restart command basic and basic troubleshoot link. it will be much helpful for me to understand and fix this issue. Thanks, Vijay

By Mohib Zico staff 29 Jul 2020 at 8:14 a.m. CDT

Mohib Zico gravatar
https://www.gluu.org/docs