By: Dustin Landry user 11 Jan 2019 at 4:05 p.m. CST

6 Responses
Dustin Landry gravatar
Hello all, I am troubleshooting an issue with a server that has been in service for right at a year and has been working perfectly. All of a sudden the server hung up, and after a restart we get we are now getting a HTTP ERROR: 503 Problem accessing /identity/. Reason: Service Unavailable Powered by Jetty:// 9.3.15.v20161220 We did have a SSL cert expire on 1/4/19, in which I applied the new cert to apache, as well as cacert using keytool. All of the certs seem to verify just fine. I have tried stopping and starting the services in a specific order outlined in another thread with no luck. After further troubleshooting it, it appears ldap is not allowing connections although all ports are open. Here is a snipit of the logs that shows this error. Can someone please point me in the right direction? 2019-01-11 21:49:31,024 ERROR [main] [org.gluu.site.ldap.LDAPConnectionProvider] (LDAPConnectionProvider.java:76) - Failed to create connection pool with properties: {certsDir=/etc/certs, pythonModulesDir=/opt/gluu/python/libs, ssl.trustStoreFile=/etc/certs/openldap.pkcs12, bindPassword=REDACTED, oxpassport_ConfigurationEntryDN=ou=oxpassport,ou=configuration,inum=@!9566.09B1.EC8C.E57E!0002!5816.403A,ou=appliances,o=gluu, oxasimba_ConfigurationEntryDN=ou=oxasimba,ou=configuration,inum=@!9566.09B1.EC8C.E57E!0002!5816.403A,ou=appliances,o=gluu, oxtrust_ConfigurationEntryDN=ou=oxtrust,ou=configuration,inum=@!9566.09B1.EC8C.E57E!0002!5816.403A,ou=appliances,o=gluu, oxidp_ConfigurationEntryDN=ou=oxidp,ou=configuration,inum=@!9566.09B1.EC8C.E57E!0002!5816.403A,ou=appliances,o=gluu, oxauth_ConfigurationEntryDN=ou=oxauth,ou=configuration,inum=@!9566.09B1.EC8C.E57E!0002!5816.403A,ou=appliances,o=gluu, servers=localhost:1636, ssl.trustStorePin=, confDir=, ssl.trustStoreFormat=pkcs12, bindDN=cn=directory manager,o=gluu, useSSL=true, binaryAttributes=objectGUID, maxconnections=10, oxcas_ConfigurationEntryDN=ou=oxcas,ou=configuration,inum=@!9566.09B1.EC8C.E57E!0002!5816.403A,ou=appliances,o=gluu} **com.unboundid.ldap.sdk.LDAPBindException: An error occurred while attempting to send the LDAP message to server localhost:1636: SSLHandshakeException(message='Remote host closed connection during handshake',** trace='readRecord(SSLSocketImpl.java:992) / performInitialHandshake(SSLSocketImpl.java:1375) / readDataRecord(SSLSocketImpl.java:928) / read(AppInputStream.java:105) / fill(BufferedInputStream.java:246) / read(BufferedInputStream.java:265) / read(ASN1StreamReader.java:992) / readType(ASN1StreamReader.java:329) / beginSequence(ASN1StreamReader.java:912) / readLDAPResponseFrom(LDAPMessage.java:1146) / run(LDAPConnectionReader.java:251)', cause=EOFException(message='SSL peer shut down incorrectly', trace='read(InputRecord.java:505) / readRecord(SSLSocketImpl.java:973) / performInitialHandshake(SSLSocketImpl.java:1375) / readDataRecord(SSLSocketImpl.java:928) / read(AppInputStream.java:105) / fill(BufferedInputStream.java:246) / read(BufferedInputStream.java:265) / read(ASN1StreamReader.java:992) / readType(ASN1StreamReader.java:329) / beginSequence(ASN1StreamReader.java:912) / readLDAPResponseFrom(LDAPMessage.java:1146) / run(LDAPConnectionReader.java:251)', revision=24201), revision=24201) at com.unboundid.ldap.sdk.LDAPConnectionPool.createConnection(LDAPConnectionPool.java:1289) ~[unboundid-ldapsdk-3.2.0.jar:3.2.0] at com.unboundid.ldap.sdk.LDAPConnectionPool.createConnection(LDAPConnectionPool.java:1178) ~[unboundid-ldapsdk-3.2.0.jar:3.2.0] at com.unboundid.ldap.sdk.LDAPConnectionPool.<init>(LDAPConnectionPool.java:1115) ~[unboundid-ldapsdk-3.2.0.jar:3.2.0] at com.unboundid.ldap.sdk.LDAPConnectionPool.<init>(LDAPConnectionPool.java:997) ~[unboundid-ldapsdk-3.2.0.jar:3.2.0] at com.unboundid.ldap.sdk.LDAPConnectionPool.<init>(LDAPConnectionPool.java:934) ~[unboundid-ldapsdk-3.2.0.jar:3.2.0] at com.unboundid.ldap.sdk.LDAPConnectionPool.<init>(LDAPConnectionPool.java:877) ~[unboundid-ldapsdk-3.2.0.jar:3.2.0] at com.unboundid.ldap.sdk.LDAPConnectionPool.<init>(LDAPConnectionPool.java:792) ~[unboundid-ldapsdk-3.2.0.jar:3.2.0] at org.gluu.site.ldap.LDAPConnectionProvider.createConnectionPoolImpl(LDAPConnectionProvider.java:218) ~[oxcore-ldap-3.1.1.Final.jar:?] at org.gluu.site.ldap.LDAPConnectionProvider.createConnectionPoolWithWaitImpl(LDAPConnectionProvider.java:188) ~[oxcore-ldap-3.1.1.Final.jar:?] at org.gluu.site.ldap.LDAPConnectionProvider.init(LDAPConnectionProvider.java:143) ~[oxcore-ldap-3.1.1.Final.jar:?] at org.gluu.site.ldap.LDAPConnectionProvider.<init>(LDAPConnectionProvider.java:68) [oxcore-ldap-3.1.1.Final.jar:?] at org.xdi.service.ldap.LdapConnectionService.<init>(LdapConnectionService.java:19) [oxcore-service-3.1.1.Final.jar:?] at org.gluu.oxtrust.ldap.service.AppInitializer.createConnectionProvider(AppInitializer.java:302) [classes/:?] at org.gluu.oxtrust.ldap.service.AppInitializer.createConnectionProvider(AppInitializer.java:283) [classes/:?] at org.gluu.oxtrust.ldap.service.AppInitializer.applicationInitialized(AppInitializer.java:201) [classes/:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_112] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_112] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_112] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_112] at org.jboss.weld.injection.StaticMethodInjectionPoint.invoke(StaticMethodInjectionPoint.java:95) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.injection.StaticMethodInjectionPoint.invoke(StaticMethodInjectionPoint.java:85) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.injection.MethodInvocationStrategy$SimpleMethodInvocationStrategy.invoke(MethodInvocationStrategy.java:129) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.event.ObserverMethodImpl.sendEvent(ObserverMethodImpl.java:330) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.event.ObserverMethodImpl.sendEvent(ObserverMethodImpl.java:308) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.event.ObserverMethodImpl.notify(ObserverMethodImpl.java:286) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at javax.enterprise.inject.spi.ObserverMethod.notify(ObserverMethod.java:124) [cdi-api-2.0.jar:${parsedVersion.osgiVersion}] at org.jboss.weld.util.Observers.notify(Observers.java:166) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.event.ObserverNotifier.notifySyncObservers(ObserverNotifier.java:285) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.event.ObserverNotifier.notify(ObserverNotifier.java:273) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.event.ObserverNotifier.fireEvent(ObserverNotifier.java:177) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.bootstrap.BeanDeploymentModule.fireEvent(BeanDeploymentModule.java:93) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.module.web.servlet.HttpContextLifecycle.fireEventForApplicationScope(HttpContextLifecycle.java:161) [weld-web-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.module.web.servlet.HttpContextLifecycle.contextInitialized(HttpContextLifecycle.java:147) [weld-web-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.module.web.servlet.WeldInitialListener.contextInitialized(WeldInitialListener.java:105) [weld-web-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.servlet.api.helpers.ForwardingServletListener.contextInitialized(ForwardingServletListener.java:34) [weld-spi-3.0.Final.jar:3.0.Final] at org.jboss.weld.environment.servlet.EnhancedListener.onStartup(EnhancedListener.java:66) [weld-servlet-core-3.0.0.Final.jar:3.0.0.Final] at org.eclipse.jetty.plus.annotation.ContainerInitializer.callStartup(ContainerInitializer.java:140) [jetty-plus-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.annotations.ServletContainerInitializersStarter.doStart(ServletContainerInitializersStarter.java:63) [jetty-annotations-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:330) [jetty-servlet-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1404) [jetty-webapp-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1366) [jetty-webapp-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:778) [jetty-server-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:262) [jetty-servlet-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:520) [jetty-webapp-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.bindings.StandardStarter.processBinding(StandardStarter.java:41) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.AppLifeCycle.runBindings(AppLifeCycle.java:188) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.DeploymentManager.requestAppGoal(DeploymentManager.java:499) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.DeploymentManager.addApp(DeploymentManager.java:147) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.providers.ScanningAppProvider.fileAdded(ScanningAppProvider.java:180) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.providers.WebAppProvider.fileAdded(WebAppProvider.java:452) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.providers.ScanningAppProvider$1.fileAdded(ScanningAppProvider.java:64) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.Scanner.reportAddition(Scanner.java:610) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.Scanner.reportDifferences(Scanner.java:529) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.Scanner.scan(Scanner.java:392) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.Scanner.doStart(Scanner.java:313) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.providers.ScanningAppProvider.doStart(ScanningAppProvider.java:150) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.DeploymentManager.startAppProvider(DeploymentManager.java:561) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.DeploymentManager.doStart(DeploymentManager.java:236) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.server.Server.start(Server.java:422) [jetty-server-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61) [jetty-server-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.server.Server.doStart(Server.java:389) [jetty-server-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.xml.XmlConfiguration$1.run(XmlConfiguration.java:1516) [jetty-xml-9.3.15.v20161220.jar:9.3.15.v20161220] at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_112] at org.eclipse.jetty.xml.XmlConfiguration.main(XmlConfiguration.java:1441) [jetty-xml-9.3.15.v20161220.jar:9.3.15.v20161220] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_112] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_112] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_112] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_112] at org.eclipse.jetty.start.Main.invokeMain(Main.java:214) [start.jar:9.3.15.v20161220] at org.eclipse.jetty.start.Main.start(Main.java:457) [start.jar:9.3.15.v20161220] at org.eclipse.jetty.start.Main.main(Main.java:75) [start.jar:9.3.15.v20161220]

By Chris Blanton user 11 Jan 2019 at 4:19 p.m. CST

Chris Blanton gravatar
Dustin, Are you using OpenLDAP? the following should work for you: Here's the commands to update the OpenLDAP certs. You need to restart OpenLDAP, oxAuth and oxTrust/identity to make the changes: Change `$PASS` to a cryptographically strong(random) string below manually or run `export PASS=$YOUR_RANDOM_STRING`. Also don't lose it. ``` /usr/bin/openssl genrsa -des3 -out /etc/certs/openldap.key.orig -passout pass:$PASS 2048 /usr/bin/openssl rsa -in /etc/certs/openldap.key.orig -passin pass:$PASS -out /etc/certs/openldap.key /usr/bin/openssl req -new -key /etc/certs/openldap.key -out /etc/certs/openldap.csr -subj /C=US/ST=Texas/L=Austin/O=Gluu/CN=localhost/emailAddress=dc@gluu.org /usr/bin/openssl x509 -req -days 365 -in /etc/certs/openldap.csr -signkey /etc/certs/openldap.key -out /etc/certs/openldap.crt /bin/chown ldap:ldap /etc/certs/openldap.key /etc/certs/openldap.crt /bin/chmod 440 /etc/certs/openldap.key /etc/certs/openldap.crt ``` Change the alias here to match your environment. It should be `$hostname_openldap`. You need to delete the old cert and add this new one ``` /opt/jre/bin/keytool -delete -alias c5.gluu.org_openldap -keystore /opt/jre/jre/lib/security/cacerts -storepass changeit -noprompt /opt/jre/bin/keytool -import -trustcacerts -alias c5.gluu.org_openldap -file /etc/certs/openldap.crt -keystore /opt/jre/jre/lib/security/cacerts -storepass changeit -noprompt /usr/bin/openssl pkcs12 -export -inkey /etc/certs/openldap.key -in /etc/certs/openldap.crt -out /etc/certs/openldap.pkcs12 -name c5.gluu.org -passout pass:$PASS /bin/chown jetty:jetty /etc/certs/openldap.pkcs12 /bin/chmod 440 /etc/certs/openldap.pkcs12 cat /etc/certs/openldap.crt /etc/certs/openldap.key > openldap.pem /bin/chown ldap:ldap /etc/certs/openldap.pem /bin/chmod 440 /etc/certs/openldap.pem ``` You also need to encode the pass you used for $PASS like so: ``` /opt/gluu/bin/encode.py $PASS ``` And use that output to change the `ssl.trustStorePin:` value. For example: ``` root@c5:/etc/certs# export PASS=test ... root@c5:/etc/certs# /opt/gluu/bin/encode.py $PASS GiTR2gm2MPA= ``` Open `/etc/gluu/conf/ox-ldap.properties`: ``` bindDN: cn=directory manager,o=gluu bindPassword: 7Y/dJU06DkM= servers: localhost:1636 useSSL: true ssl.trustStoreFile: /etc/certs/openldap.pkcs12 ssl.trustStorePin: GiTR2gm2MPA= ssl.trustStoreFormat: pkcs12 ``` Then restart `openldap`, `oxauth` and `identity` ``` service solserver restart && service oxauth restart && service identity restart ```

By Dustin Landry user 11 Jan 2019 at 5:02 p.m. CST

Dustin Landry gravatar
Hi, Thank you for this, Yes it is openldap. Can you elaborate on this "Change $PASS to a cryptographically strong(random) string below manually or run export PASS=$YOUR_RANDOM_STRING. Also don't lose it." Should I just use a made up random password instead of "$PASS"? Then encode it in a later step using "/opt/gluu/bin/encode.py $PASS"

By Dustin Landry user 11 Jan 2019 at 6:27 p.m. CST

Dustin Landry gravatar
Ok, I ran the commands like you posted, changing out the few things you stated. I am still getting the 503 error. Here is the latest log: 2019-01-12 00:23:56,102 ERROR [main] [org.gluu.site.ldap.LDAPConnectionProvider] (LDAPConnectionProvider.java:76) - Failed to create connection pool with properties: {certsDir=/etc/certs, pythonModulesDir=/opt/gluu/python/libs, ssl.trustStoreFile=/etc/certs/openldap.pkcs12, bindPassword=REDACTED, oxpassport_ConfigurationEntryDN=ou=oxpassport,ou=configuration,inum=@!9566.09B1.EC8C.E57E!0002!5816.403A,ou=appliances,o=gluu, oxasimba_ConfigurationEntryDN=ou=oxasimba,ou=configuration,inum=@!9566.09B1.EC8C.E57E!0002!5816.403A,ou=appliances,o=gluu, oxtrust_ConfigurationEntryDN=ou=oxtrust,ou=configuration,inum=@!9566.09B1.EC8C.E57E!0002!5816.403A,ou=appliances,o=gluu, oxidp_ConfigurationEntryDN=ou=oxidp,ou=configuration,inum=@!9566.09B1.EC8C.E57E!0002!5816.403A,ou=appliances,o=gluu, oxauth_ConfigurationEntryDN=ou=oxauth,ou=configuration,inum=@!9566.09B1.EC8C.E57E!0002!5816.403A,ou=appliances,o=gluu, servers=localhost:1636, ssl.trustStorePin=yqd7tRXN, confDir=, ssl.trustStoreFormat=pkcs12, bindDN=cn=directory manager,o=gluu, useSSL=true, binaryAttributes=objectGUID, maxconnections=10, oxcas_ConfigurationEntryDN=ou=oxcas,ou=configuration,inum=@!9566.09B1.EC8C.E57E!0002!5816.403A,ou=appliances,o=gluu} com.unboundid.ldap.sdk.LDAPBindException: An error occurred while attempting to send the LDAP message to server localhost:1636: SSLHandshakeException(message='Remote host closed connection during handshake', trace='readRecord(SSLSocketImpl.java:992) / performInitialHandshake(SSLSocketImpl.java:1375) / readDataRecord(SSLSocketImpl.java:928) / read(AppInputStream.java:105) / fill(BufferedInputStream.java:246) / read(BufferedInputStream.java:265) / read(ASN1StreamReader.java:992) / readType(ASN1StreamReader.java:329) / beginSequence(ASN1StreamReader.java:912) / readLDAPResponseFrom(LDAPMessage.java:1146) / run(LDAPConnectionReader.java:251)', cause=EOFException(message='SSL peer shut down incorrectly', trace='read(InputRecord.java:505) / readRecord(SSLSocketImpl.java:973) / performInitialHandshake(SSLSocketImpl.java:1375) / readDataRecord(SSLSocketImpl.java:928) / read(AppInputStream.java:105) / fill(BufferedInputStream.java:246) / read(BufferedInputStream.java:265) / read(ASN1StreamReader.java:992) / readType(ASN1StreamReader.java:329) / beginSequence(ASN1StreamReader.java:912) / readLDAPResponseFrom(LDAPMessage.java:1146) / run(LDAPConnectionReader.java:251)', revision=24201), revision=24201) at com.unboundid.ldap.sdk.LDAPConnectionPool.createConnection(LDAPConnectionPool.java:1289) ~[unboundid-ldapsdk-3.2.0.jar:3.2.0] at com.unboundid.ldap.sdk.LDAPConnectionPool.createConnection(LDAPConnectionPool.java:1178) ~[unboundid-ldapsdk-3.2.0.jar:3.2.0] at com.unboundid.ldap.sdk.LDAPConnectionPool.<init>(LDAPConnectionPool.java:1115) ~[unboundid-ldapsdk-3.2.0.jar:3.2.0] at com.unboundid.ldap.sdk.LDAPConnectionPool.<init>(LDAPConnectionPool.java:997) ~[unboundid-ldapsdk-3.2.0.jar:3.2.0] at com.unboundid.ldap.sdk.LDAPConnectionPool.<init>(LDAPConnectionPool.java:934) ~[unboundid-ldapsdk-3.2.0.jar:3.2.0] at com.unboundid.ldap.sdk.LDAPConnectionPool.<init>(LDAPConnectionPool.java:877) ~[unboundid-ldapsdk-3.2.0.jar:3.2.0] at com.unboundid.ldap.sdk.LDAPConnectionPool.<init>(LDAPConnectionPool.java:792) ~[unboundid-ldapsdk-3.2.0.jar:3.2.0] at org.gluu.site.ldap.LDAPConnectionProvider.createConnectionPoolImpl(LDAPConnectionProvider.java:218) ~[oxcore-ldap-3.1.1.Final.jar:?] at org.gluu.site.ldap.LDAPConnectionProvider.createConnectionPoolWithWaitImpl(LDAPConnectionProvider.java:188) ~[oxcore-ldap-3.1.1.Final.jar:?] at org.gluu.site.ldap.LDAPConnectionProvider.init(LDAPConnectionProvider.java:143) ~[oxcore-ldap-3.1.1.Final.jar:?] at org.gluu.site.ldap.LDAPConnectionProvider.<init>(LDAPConnectionProvider.java:68) [oxcore-ldap-3.1.1.Final.jar:?] at org.xdi.service.ldap.LdapConnectionService.<init>(LdapConnectionService.java:19) [oxcore-service-3.1.1.Final.jar:?] at org.gluu.oxtrust.ldap.service.AppInitializer.createConnectionProvider(AppInitializer.java:302) [classes/:?] at org.gluu.oxtrust.ldap.service.AppInitializer.createConnectionProvider(AppInitializer.java:283) [classes/:?] at org.gluu.oxtrust.ldap.service.AppInitializer.applicationInitialized(AppInitializer.java:201) [classes/:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_112] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_112] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_112] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_112] at org.jboss.weld.injection.StaticMethodInjectionPoint.invoke(StaticMethodInjectionPoint.java:95) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.injection.StaticMethodInjectionPoint.invoke(StaticMethodInjectionPoint.java:85) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.injection.MethodInvocationStrategy$SimpleMethodInvocationStrategy.invoke(MethodInvocationStrategy.java:129) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.event.ObserverMethodImpl.sendEvent(ObserverMethodImpl.java:330) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.event.ObserverMethodImpl.sendEvent(ObserverMethodImpl.java:308) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.event.ObserverMethodImpl.notify(ObserverMethodImpl.java:286) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at javax.enterprise.inject.spi.ObserverMethod.notify(ObserverMethod.java:124) [cdi-api-2.0.jar:${parsedVersion.osgiVersion}] at org.jboss.weld.util.Observers.notify(Observers.java:166) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.event.ObserverNotifier.notifySyncObservers(ObserverNotifier.java:285) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.event.ObserverNotifier.notify(ObserverNotifier.java:273) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.event.ObserverNotifier.fireEvent(ObserverNotifier.java:177) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.bootstrap.BeanDeploymentModule.fireEvent(BeanDeploymentModule.java:93) [weld-core-impl-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.module.web.servlet.HttpContextLifecycle.fireEventForApplicationScope(HttpContextLifecycle.java:161) [weld-web-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.module.web.servlet.HttpContextLifecycle.contextInitialized(HttpContextLifecycle.java:147) [weld-web-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.module.web.servlet.WeldInitialListener.contextInitialized(WeldInitialListener.java:105) [weld-web-3.0.0.Final.jar:3.0.0.Final] at org.jboss.weld.servlet.api.helpers.ForwardingServletListener.contextInitialized(ForwardingServletListener.java:34) [weld-spi-3.0.Final.jar:3.0.Final] at org.jboss.weld.environment.servlet.EnhancedListener.onStartup(EnhancedListener.java:66) [weld-servlet-core-3.0.0.Final.jar:3.0.0.Final] at org.eclipse.jetty.plus.annotation.ContainerInitializer.callStartup(ContainerInitializer.java:140) [jetty-plus-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.annotations.ServletContainerInitializersStarter.doStart(ServletContainerInitializersStarter.java:63) [jetty-annotations-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:330) [jetty-servlet-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1404) [jetty-webapp-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1366) [jetty-webapp-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:778) [jetty-server-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:262) [jetty-servlet-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:520) [jetty-webapp-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.bindings.StandardStarter.processBinding(StandardStarter.java:41) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.AppLifeCycle.runBindings(AppLifeCycle.java:188) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.DeploymentManager.requestAppGoal(DeploymentManager.java:499) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.DeploymentManager.addApp(DeploymentManager.java:147) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.providers.ScanningAppProvider.fileAdded(ScanningAppProvider.java:180) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.providers.WebAppProvider.fileAdded(WebAppProvider.java:452) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.providers.ScanningAppProvider$1.fileAdded(ScanningAppProvider.java:64) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.Scanner.reportAddition(Scanner.java:610) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.Scanner.reportDifferences(Scanner.java:529) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.Scanner.scan(Scanner.java:392) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.Scanner.doStart(Scanner.java:313) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.providers.ScanningAppProvider.doStart(ScanningAppProvider.java:150) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.DeploymentManager.startAppProvider(DeploymentManager.java:561) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.deploy.DeploymentManager.doStart(DeploymentManager.java:236) [jetty-deploy-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.server.Server.start(Server.java:422) [jetty-server-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61) [jetty-server-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.server.Server.doStart(Server.java:389) [jetty-server-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) [jetty-util-9.3.15.v20161220.jar:9.3.15.v20161220] at org.eclipse.jetty.xml.XmlConfiguration$1.run(XmlConfiguration.java:1516) [jetty-xml-9.3.15.v20161220.jar:9.3.15.v20161220] at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_112] at org.eclipse.jetty.xml.XmlConfiguration.main(XmlConfiguration.java:1441) [jetty-xml-9.3.15.v20161220.jar:9.3.15.v20161220] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_112] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_112] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_112] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_112] at org.eclipse.jetty.start.Main.invokeMain(Main.java:214) [start.jar:9.3.15.v20161220] at org.eclipse.jetty.start.Main.start(Main.java:457) [start.jar:9.3.15.v20161220] at org.eclipse.jetty.start.Main.main(Main.java:75) [start.jar:9.3.15.v20161220]

By Michael Schwartz Account Admin 11 Jan 2019 at 11:48 p.m. CST

Michael Schwartz gravatar
IMHO, you should update the server. 3.1.5 is available in the repo now.

By Dustin Landry user 12 Jan 2019 at 8:12 a.m. CST

Dustin Landry gravatar
I actually tried to upgrade but it fails when trying to connect to ldap to apply schema changes.

By Michael Schwartz Account Admin 12 Jan 2019 at 12:49 p.m. CST

Michael Schwartz gravatar
Updating is tricky. It's one of the reasons you might want to consider getting a support contact.