By: Peter Karaganis user 18 Apr 2018 at 4:57 p.m. CDT

10 Responses
Peter Karaganis gravatar
I had the Gluu Server working fine, and then I rebooted it. After it came up I got an error in my browser: HTTP 503 Service Unavailable. I did some searching on the support channel here and found that it could be related to the order of starting the identity and oxauth services, so I did the following: ``` -bash-4.2# cd /etc/init.d/ -bash-4.2# ./identity stop Stopping Jetty: OK -bash-4.2# ./oxauth stop Stopping Jetty: OK -bash-4.2# ./oxauth start Starting Jetty: StartLog to /opt/gluu/jetty/oxauth/logs/start.log 2018-04-18 21:45:51.317:INFO::main: Logging initialized @1042ms 2018-04-18 21:45:51.689:INFO::main: Redirecting stderr/stdout to /opt/gluu/jetty/oxauth/logs/2018_04_18.stderrout.log . . . . . . . . . . . . OK Wed Apr 18 21:46:43 UTC 2018 -bash-4.2# ./identity start Starting Jetty: StartLog to /opt/gluu/jetty/identity/logs/start.log 2018-04-18 21:50:03.066:INFO::main: Logging initialized @1093ms 2018-04-18 21:50:03.435:INFO::main: Redirecting stderr/stdout to /opt/gluu/jetty/identity/logs/2018_04_18.stderrout.log . . . . . . . . . . . . . . FAILED Wed Apr 18 21:50:59 UTC 2018 -bash-4.2# ``` This didn't work, so I ended up having to restart the entire Gluu container and _*then*_ follow the steps above and it fixed the issue. Also, the .identity service appears to start even though it actually says it failed. Does that seem right? Just in case, I'm including the Identity service error log below: ``` 2018-04-18 21:50:03.958:INFO:oejs.Server:main: jetty-9.3.15.v20161220 2018-04-18 21:50:04.003:INFO:oejdp.ScanningAppProvider:main: Deployment monitor [file:///opt/gluu/jetty/identity/webapps/] at interval 1 2018-04-18 21:50:25.140:INFO:oeja.AnnotationConfiguration:main: Scanning elapsed time=18840ms 2018-04-18 21:50:25.300:WARN:oeja.WebServletAnnotation:main: org.jboss.resteasy.plugins.server.servlet.HttpServlet30Dispatcher defines neither @WebServlet.value nor @WebServlet.urlPatterns Apr 18, 2018 9:50:26 PM org.richfaces.webapp.ResourceServletContainerInitializer registerServlet INFO: Auto-registered servlet ResourceServlet with mapping '/org.richfaces.resources/*' 2018-04-18 21:50:40,208 INFO [main] [org.gluu.oxtrust.util.BuildVersion] (BuildVersion.java:82) - Root element :beans 2018-04-18 21:50:40,288 INFO [main] [org.xdi.oxauth.model.util.SecurityProviderUtility] (SecurityProviderUtility.java:23) - Adding Bouncy Castle Provider 2018-04-18 21:50:40,481 INFO [main] [org.gluu.oxtrust.ldap.service.AppInitializer] (AppInitializer.java:275) - Build date 2018-01-18 09:51. Code revision 9de781cd23764ec11b234af65cd055d159a83877 on ${git.commit.time}. Build 1492 2018-04-18 21:50:40,512 INFO [main] [org.gluu.oxtrust.config.ConfigurationFactory] (ConfigurationFactory.java:134) - Creating oxTrustConfiguration 2018-04-18 21:50:40,513 INFO [main] [org.gluu.oxtrust.config.ConfigurationFactory] (ConfigurationFactory.java:420) - ########## ldapFileName = /etc/gluu/conf/ox-ldap.properties 2018-04-18 21:50:41,562 INFO [main] [org.gluu.oxtrust.config.ConfigurationFactory] (ConfigurationFactory.java:357) - Loading configuration from LDAP... 2018-04-18 21:50:41,569 INFO [main] [org.gluu.oxtrust.ldap.service.AppInitializer] (AppInitializer.java:310) - Created ldapEntryManager: org.gluu.site.ldap.OperationsFacade@4d3d02c9 2018-04-18 21:50:42,088 INFO [main] [org.gluu.oxtrust.config.ConfigurationFactory] (ConfigurationFactory.java:156) - Configuration loaded successfully. 2018-04-18 21:50:42,096 INFO [main] [org.gluu.oxtrust.ldap.service.TemplateService] (TemplateService.java:104) - file.resource.loader.path = /opt/gluu/jetty/identity/conf/shibboleth3/idp, /opt/gluu/jetty/identity/conf/shibboleth3/sp, /opt/gluu/jetty/identity/conf/ldif, /opt/gluu/jetty/identity/conf/shibboleth3/idp/MetadataFilter, /opt/gluu/jetty/identity/conf/shibboleth3/idp/ProfileConfiguration, /opt/gluu/jetty/identity/conf/template/conf, /opt/gluu/jetty/identity/conf/template/shibboleth3 2018-04-18 21:50:42,329 WARN [main] [org.gluu.oxtrust.ldap.service.SubversionService] (SubversionService.java:191) - The service which commit configuration files into SVN was disabled 2018-04-18 21:50:50,922 INFO [main] [org.gluu.oxtrust.ldap.service.ShibbolethInitializer] (ShibbolethInitializer.java:41) - IDP config generation is set to false 2018-04-18 21:50:51,025 INFO [main] [org.quartz.impl.StdSchedulerFactory] (StdSchedulerFactory.java:1172) - Using default implementation for ThreadExecutor 2018-04-18 21:50:51,092 INFO [main] [org.quartz.core.SchedulerSignalerImpl] (SchedulerSignalerImpl.java:61) - Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl 2018-04-18 21:50:51,093 INFO [main] [org.quartz.core.QuartzScheduler] (QuartzScheduler.java:240) - Quartz Scheduler v.2.2.3 created. 2018-04-18 21:50:51,094 INFO [main] [org.quartz.simpl.RAMJobStore] (RAMJobStore.java:155) - RAMJobStore initialized. 2018-04-18 21:50:51,099 INFO [main] [org.quartz.core.QuartzScheduler] (QuartzScheduler.java:305) - Scheduler meta-data: Quartz Scheduler (v2.2.3) 'oxTrustScheduler' with instanceId 'NON_CLUSTERED' Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally. NOT STARTED. Currently in standby mode. Number of jobs executed: 0 Using thread pool 'org.quartz.simpl.SimpleThreadPool' - with 5 threads. Using job-store 'org.quartz.simpl.RAMJobStore' - which does not support persistence. and is not clustered. 2018-04-18 21:50:51,100 INFO [main] [org.quartz.impl.StdSchedulerFactory] (StdSchedulerFactory.java:1327) - Quartz scheduler 'oxTrustScheduler' initialized from the specified file : 'quartz.properties' from the class resource path. 2018-04-18 21:50:51,100 INFO [main] [org.quartz.impl.StdSchedulerFactory] (StdSchedulerFactory.java:1331) - Quartz scheduler version: 2.2.3 2018-04-18 21:50:51,102 INFO [main] [org.quartz.core.QuartzScheduler] (QuartzScheduler.java:2311) - JobFactory set to: org.xdi.service.timer.JobExecutionFactory@2e923046 2018-04-18 21:50:51,103 INFO [main] [org.xdi.service.timer.QuartzSchedulerManager] (QuartzSchedulerManager.java:62) - Quartz scheduler manager initialized 2018-04-18 21:50:51,103 INFO [main] [org.quartz.core.QuartzScheduler] (QuartzScheduler.java:575) - Scheduler oxTrustScheduler_$_NON_CLUSTERED started. 2018-04-18 21:50:51,104 INFO [main] [org.xdi.service.timer.QuartzSchedulerManager] (QuartzSchedulerManager.java:116) - Quartz scheduler started 2018-04-18 21:50:51,373 INFO [main] [org.gluu.oxtrust.ldap.service.StatusCheckerDaily] (StatusCheckerDaily.java:60) - Initializing Daily Status Cheker Timer 2018-04-18 21:50:51,381 INFO [main] [org.gluu.oxtrust.ldap.service.StatusCheckerTimer] (StatusCheckerTimer.java:104) - Initializing Daily Status Cheker Timer >>>>> Initializing ExternalScimService()... 2018-04-18 21:50:51,588 INFO [main] [org.gluu.oxtrust.ldap.service.LogFileSizeChecker] (LogFileSizeChecker.java:63) - Initializing Log File Size Checker Timer 2018-04-18 21:50:52,155 INFO [main] [org.omnifaces.ApplicationInitializer] (ApplicationInitializer.java:65) - Using OmniFaces version 2.6.6 2018-04-18 21:50:58,215 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - RewritePhaseListener starting up. 2018-04-18 21:51:00,604 INFO [main] [org.richfaces.log.JavaLogger] (JavaLogger.java:213) - Selected fallback cache factory 2018-04-18 21:51:00,611 INFO [main] [org.richfaces.log.JavaLogger] (JavaLogger.java:213) - Creating LRUMap cache instance using parameters: {resteasy.injector.factory=org.jboss.resteasy.cdi.CdiInjectorFactory, javax.faces.FACELETS_REFRESH_PERIOD=10, javax.faces.DEFAULT_SUFFIX=.xhtml, org.richfaces.CONTROL_SKINNING=disable, org.eclipse.jetty.servlet.Default.dirAllowed=false, org.jboss.weld.development=false, javax.faces.PROJECT_STAGE=Production, javax.faces.FACELETS_RESOURCE_RESOLVER=org.xdi.service.ExternalResourceHandler, javax.faces.STATE_SAVING_METHOD=server, org.richfaces.CONTROL_SKINNING_CLASSES=disable, org.richfaces.SKIN=glassX} 2018-04-18 21:51:00,613 INFO [main] [org.richfaces.log.JavaLogger] (JavaLogger.java:213) - Creating LRUMap cache instance of 512 items capacity 2018-04-18 21:51:00,640 INFO [main] [org.richfaces.log.JavaLogger] (JavaLogger.java:213) - RichFaces Core by JBoss by Red Hat, version 4.5.17.Final 2018-04-18 21:51:02,870 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - RewriteFilter starting up... 2018-04-18 21:51:02,988 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [4] org.ocpsoft.rewrite.servlet.spi.RewriteLifecycleListener [org.ocpsoft.rewrite.prettyfaces.PrettyFacesRewriteLifecycleListener<-100>, org.ocpsoft.rewrite.faces.FacesRewriteLifecycleListener<0>, org.ocpsoft.rewrite.servlet.config.lifecycle.JoinRewriteLifecycleListener<2147483647>, org.ocpsoft.rewrite.servlet.impl.DefaultRewriteLifecycleListener<2147483647>] 2018-04-18 21:51:02,989 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [1] org.ocpsoft.rewrite.servlet.spi.RequestCycleWrapper [org.ocpsoft.rewrite.servlet.impl.HttpRewriteRequestCycleWrapper<0>] 2018-04-18 21:51:02,989 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [1] org.ocpsoft.rewrite.spi.RewriteProvider [org.ocpsoft.rewrite.servlet.impl.DefaultHttpRewriteProvider<0>] 2018-04-18 21:51:02,989 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [1] org.ocpsoft.rewrite.servlet.spi.RewriteResultHandler [org.ocpsoft.rewrite.servlet.impl.HttpRewriteResultHandler<0>] 2018-04-18 21:51:02,990 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [1] org.ocpsoft.rewrite.servlet.spi.InboundRewriteProducer [org.ocpsoft.rewrite.servlet.impl.HttpInboundRewriteProducer<0>] 2018-04-18 21:51:02,990 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [1] org.ocpsoft.rewrite.servlet.spi.OutboundRewriteProducer [org.ocpsoft.rewrite.servlet.impl.HttpOutboundRewriteProducer<0>] 2018-04-18 21:51:02,998 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [1] org.ocpsoft.rewrite.servlet.spi.ContextListener [org.ocpsoft.rewrite.prettyfaces.PrettyConfigContextListener<0>] 2018-04-18 21:51:02,999 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [0] org.ocpsoft.rewrite.servlet.spi.RequestListener [] 2018-04-18 21:51:03,000 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [1] org.ocpsoft.rewrite.servlet.spi.RequestParameterProvider [org.ocpsoft.rewrite.prettyfaces.PrettyFacesRequestParameterProvider<0>] 2018-04-18 21:51:03,003 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [1] org.ocpsoft.rewrite.el.spi.ExpressionLanguageProvider [org.ocpsoft.rewrite.faces.FacesExpressionLanguageProvider<30>] 2018-04-18 21:51:03,020 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [1] org.ocpsoft.rewrite.spi.InvocationResultHandler [org.ocpsoft.rewrite.faces.NavigatingInvocationResultHandler<100>] 2018-04-18 21:51:03,028 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [0] org.ocpsoft.common.spi.ServiceEnricher [] 2018-04-18 21:51:03,031 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [1] org.ocpsoft.rewrite.spi.ConfigurationCacheProvider [org.ocpsoft.rewrite.servlet.impl.ServletContextConfigurationCacheProvider<0>] 2018-04-18 21:51:03,050 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [3] org.ocpsoft.rewrite.config.ConfigurationProvider [org.ocpsoft.rewrite.prettyfaces.PrettyFacesRewriteConfigurationProvider<1>, org.gluu.jsf2.customization.AccessRewriteConfiguration<10>, org.ocpsoft.rewrite.annotation.config.AnnotationConfigProvider<100>] 2018-04-18 21:51:03,069 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [0] org.ocpsoft.rewrite.spi.RuleCacheProvider [] 2018-04-18 21:51:03,198 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [1] org.ocpsoft.rewrite.spi.GlobalParameterProvider [org.ocpsoft.rewrite.instance.WildcardParameterProvider<0>] 2018-04-18 21:51:05,548 INFO [main] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Rewrite 3.4.1.Final initialized. 2018-04-18 21:51:06,044 INFO [main] [oxtrust.service.scim2.jackson.provider.CustomJacksonProviderScim2] (CustomJacksonProviderScim2.java:47) - CustomJacksonProviderScim2() 2018-04-18 21:51:06.461:INFO:oejsh.ContextHandler:main: Started o.e.j.w.WebAppContext@13deb50e{/identity,[file:///opt/jetty-9.3/temp/jetty-localhost-8082-identity.war-_identity-any-6696484417724153284.dir/webapp/, jar:file:///opt/jetty-9.3/temp/jetty-localhost-8082-identity.war-_identity-any-6696484417724153284.dir/webapp/WEB-INF/lib/jsf-impl-2.2.14.jar!/META-INF/resources, jar:file:///opt/jetty-9.3/temp/jetty-localhost-8082-identity.war-_identity-any-6696484417724153284.dir/webapp/WEB-INF/lib/oxtrust-static-3.1.2.Final.jar!/META-INF/resources, jar:file:///opt/jetty-9.3/temp/jetty-localhost-8082-identity.war-_identity-any-6696484417724153284.dir/webapp/WEB-INF/lib/richfaces-core-4.5.17.Final.jar!/META-INF/resources, jar:file:///opt/jetty-9.3/temp/jetty-localhost-8082-identity.war-_identity-any-6696484417724153284.dir/webapp/WEB-INF/lib/richfaces-4.5.17.Final.jar!/META-INF/resources, jar:file:///opt/jetty-9.3/temp/jetty-localhost-8082-identity.war-_identity-any-6696484417724153284.dir/webapp/WEB-INF/lib/omnifaces-2.6.6.jar!/META-INF/resources, jar:file:///opt/jetty-9.3/temp/jetty-localhost-8082-identity.war-_identity-any-6696484417724153284.dir/webapp/WEB-INF/lib/richfaces-a4j-4.5.17.Final.jar!/META-INF/resources],AVAILABLE}{/identity.war} 2018-04-18 21:51:06.568:INFO:oejs.AbstractConnector:main: Started ServerConnector@750a6ac3{HTTP/1.1,[http/1.1]}{localhost:8082} 2018-04-18 21:51:06.569:INFO:oejs.Server:main: Started @64597ms 2018-04-18 21:51:18,509 INFO [qtp985655350-18] [org.ocpsoft.logging.JDKLogAdapter] (JDKLogAdapter.java:29) - Loaded [1] org.ocpsoft.rewrite.spi.GlobalParameterProvider [org.ocpsoft.rewrite.instance.WildcardParameterProvider<0>] 2018-04-18 21:51:23,192 INFO [qtp985655350-11] [org.gluu.oxtrust.service.OpenIdService] (OpenIdService.java:61) - Successfully loaded oxAuth configuration ``` Is there something I can do to guard against this problem every time I reboot?

By Thomas Gasmyr Mougang staff 19 Apr 2018 at 4:03 a.m. CDT

Thomas Gasmyr Mougang gravatar
Hi **Peter**, Which ldap implementation have you choose during Gluu installation? I mean during the execution of the setup script. There are tow choices : 1. OpenDj 2. OpenLdap There is a know issue that show up in Gluu server 3.1.2 when the ldap implementation is OpenDj. Thanks, Gasmyr.

By Peter Karaganis user 19 Apr 2018 at 8:18 a.m. CDT

Peter Karaganis gravatar
I chose the default (which I believe was OpenDj). Is there a way to fix this?

By Mohib Zico staff 19 Apr 2018 at 8:21 a.m. CDT

Mohib Zico gravatar
Peter, A quick question.. how much memory you are using for your Gluu Server?

By Thomas Gasmyr Mougang staff 19 Apr 2018 at 8:23 a.m. CDT

Thomas Gasmyr Mougang gravatar
Check [this](https://gluu.org/docs/ce/operation/faq/#how-to-fix-idp-service-startup-issue-on-gluu-312-when-installed-with-opendj). Thanks, Gasmyr.

By Peter Karaganis user 19 Apr 2018 at 9:29 a.m. CDT

Peter Karaganis gravatar
I am running: Standard A2 v2 (2 vcpus, 4 GB memory). I will check the link you provided. Thanks.

By Mohib Zico staff 19 Apr 2018 at 9:44 a.m. CDT

Mohib Zico gravatar
Try with 8GB; there might be resource allocation issues among bits ( identity,oxauth,ldap etc. ) in a 4GB VM.

By Thomas Gasmyr Mougang staff 20 Apr 2018 at 12:59 a.m. CDT

Thomas Gasmyr Mougang gravatar
Hello **Peter**, Still need assistance?

By Peter Karaganis user 26 Apr 2018 at 10:17 a.m. CDT

Peter Karaganis gravatar
Hi, sorry for the delay. I actually rebuilt the server from the ground up and changed my LDAP provider. I also increased my RAM from 4GB to 8GB. I do still sometimes have the issue, but not every time I reboot it.

By Thomas Gasmyr Mougang staff 26 Apr 2018 at 10:24 a.m. CDT

Thomas Gasmyr Mougang gravatar
Hi, Just a suggestion: Make sure your Gluu server ip address is static. Depending on your server capacity, it may take up to five minutes or more for identity service to start completely. Thanks, Gasmyr.

By miguel galarza user 14 May 2018 at 2:11 p.m. CDT

miguel galarza gravatar
Re-install with option 2. OpenLdap