502 bad gateway error on adding user to group using SCIM

By: Aman Negi user 16 Feb 2023 at 12:17 p.m. CST

10 Responses
Aman Negi gravatar
## Here is the sample HTTP payload we are using to add user to group. ``` PATCH /identity/restv1/scim/v2/Groups/**{group-inum}**?excludedAttributes=members HTTP/1.1 Host: www.example.com Authorization: Bearer c30b61c2-3c1f-45df-84da-2e1bc40f1ac9 Content-Type: application/scim+json Group-Overhead-Bypass: test Content-Length: 271 { "schemas": [ "urn:ietf:params:scim:api:messages:2.0:PatchOp" ], "Operations": [ { "op": "add", "path": "members", "value": [ { "value": "fcfb4672-6882-4bba-9f71-7205a4c04868" } ] } ] } ``` ##Expected Behaviour: The above payload should give 200 OK code , and successfully add user to group. ##Actual Behaviour: The result we are getting is 502 Bad Gateway error, and sometime user get added and sometimes is not its quite unreliable. The current group count is 110,000+ and we already have added the Group-bypass-overhead header in the request we still are getting the 502 error. Is there any solution in the regarding this.
Gluu 4.3 Rhel 7.7
closed

Answers

By Aliaksandr Samuseu staff 16 Feb 2023 at 1:07 p.m. CST

Copy
Aliaksandr Samuseu gravatar
Hi, Aman. Any logs you could share? Check either `/opt/gluu/jetty/identity/logs` or `/opt/gluu/jetty/scim/logs` directory and see if there some errors in logs explaining why it's rejected. Btw, when you say that sometimes it adds an user and sometimes it doesn't - do you mean the same request you shared used in both cases? So it's kinda random?

By Aliaksandr Samuseu staff 16 Feb 2023 at 1:09 p.m. CST

Copy
Aliaksandr Samuseu gravatar
>The current group count is 110,000+ Do you mean the group has 110k users?

By Aman Negi user 17 Feb 2023 at 12:44 a.m. CST

Copy
Aman Negi gravatar
Hi Aliaksandr, here are logs from SCIM (Here is search for user called ajsmith got his inum and later tried to add him to group): ``` 17-02 06:03:49.915 INFO [qtp1422222071-20026] oxtrust.auth.oauth.BaseOAuthProtectionService BaseOAuthProtectionService.java:42- Authorization header found 17-02 06:03:49.924 INFO [qtp1422222071-20026] service.antlr.scimFilter.FilterListener FilterListener.java:149- LDAP filter expression computed was (mail=hopehdsny@gmail.com) 17-02 06:03:49.924 INFO [qtp1422222071-20026] oxtrust.service.scim2.Scim2UserService Scim2UserService.java:580- Executing search for users using: ldapfilter '(mail=hopehdsny@gmail.com)', sortBy 'null', sortOrder 'ascending', startIndex '1', count '200' 17-02 06:03:49.933 INFO [qtp1422222071-20026] oxtrust.service.scim2.Scim2UserService Scim2UserService.java:596- Found 1 matching entries - returning 1 17-02 06:03:49.933 INFO [qtp1422222071-20026] service.scim2.serialization.ScimResourceSerializer ScimResourceSerializer.java:105- buildIncludeSet. No attributes neither excludedAttributes query param were passed 17-02 06:31:28.592 DEBUG [qtp1422222071-20027] oxtrust.service.filter.AuthorizationProcessingFilter AuthorizationProcessingFilter.java:68- REST call to '/scim/v2/Users' intercepted 17-02 06:31:28.594 DEBUG [qtp1422222071-20027] oxtrust.service.filter.AuthorizationProcessingFilter AuthorizationProcessingFilter.java:84- Path is protected, proceeding with authorization processing... 17-02 06:31:28.594 INFO [qtp1422222071-20027] oxtrust.auth.oauth.BaseOAuthProtectionService BaseOAuthProtectionService.java:42- Authorization header found 17-02 06:31:28.594 DEBUG [qtp1422222071-20027] oxtrust.auth.oauth.BaseOAuthProtectionService BaseOAuthProtectionService.java:46- Validating token 71d3e0d0-f53e-48c8-885d-a096319bbf2b 17-02 06:31:28.604 DEBUG [qtp1422222071-20027] oxtrust.service.filter.AuthorizationProcessingFilter AuthorizationProcessingFilter.java:88- Authorization passed 17-02 06:31:28.604 DEBUG [qtp1422222071-20027] service.scim2.interceptor.ReferenceURIInterceptor ReferenceURIInterceptor.java:62- ReferenceURIInterceptor. manage exit 17-02 06:31:28.604 DEBUG [qtp1422222071-20027] ws.rs.scim2.UserWebService UserWebService.java:311- Executing web service method. searchUsers **17-02 06:31:28.605 DEBUG [qtp1422222071-20027] antlr.scimFilter.util.FilterUtil FilterUtil.java:112- Filter transformed to: userName eq "ajsmithtest"** 17-02 06:31:28.605 DEBUG [qtp1422222071-20027] service.antlr.scimFilter.SubFilterGenerator SubFilterGenerator.java:44- Preparing subfilter with attribute=uid, subAttribute=null, compValue="ajsmithtest", attrType=STRING, multiValued=false 17-02 06:31:28.605 INFO [qtp1422222071-20027] service.antlr.scimFilter.FilterListener FilterListener.java:149- LDAP filter expression computed was (uid=ajsmithtest) 17-02 06:31:28.605 INFO [qtp1422222071-20027] oxtrust.service.scim2.Scim2UserService Scim2UserService.java:580- Executing search for users using: ldapfilter '(uid=ajsmithtest)', sortBy 'null', sortOrder 'ascending', startIndex '1', count '200' 17-02 06:31:28.606 DEBUG [qtp1422222071-20027] oxtrust.service.scim2.Scim2UserService Scim2UserService.java:269- transferAttributesToUserResource 17-02 06:31:28.606 DEBUG [qtp1422222071-20027] oxtrust.service.scim2.Scim2UserService Scim2UserService.java:387- transferExtendedAttributesToResource of type User 17-02 06:31:28.627 DEBUG [qtp1422222071-20027] oxtrust.service.scim2.Scim2UserService Scim2UserService.java:401- transferExtendedAttributesToResource. Revising attributes of extension 'urn:ietf:params:scim:schemas:extension:gluu:2.0:User' 17-02 06:31:28.627 INFO [qtp1422222071-20027] oxtrust.service.scim2.Scim2UserService Scim2UserService.java:596- Found 1 matching entries - returning 1 17-02 06:31:28.628 INFO [qtp1422222071-20027] service.scim2.serialization.ScimResourceSerializer ScimResourceSerializer.java:105- buildIncludeSet. No attributes neither excludedAttributes query param were passed 17-02 06:31:35.284 DEBUG [qtp1422222071-20] oxtrust.service.filter.AuthorizationProcessingFilter AuthorizationProcessingFilter.java:68- REST call to '/scim/v2/Groups/74f91cc5-7c7a-4023-8c37-ab4dfa563961' intercepted 17-02 06:31:35.287 DEBUG [qtp1422222071-20] gluu.oxtrust.auth.ScimService ScimService.java:60- SCIM protection mode is: TEST 17-02 06:31:35.287 DEBUG [qtp1422222071-20] oxtrust.service.filter.AuthorizationProcessingFilter AuthorizationProcessingFilter.java:84- Path is protected, proceeding with authorization processing... 17-02 06:31:35.287 INFO [qtp1422222071-20] oxtrust.auth.oauth.BaseOAuthProtectionService BaseOAuthProtectionService.java:42- Authorization header found 17-02 06:31:35.287 DEBUG [qtp1422222071-20] oxtrust.auth.oauth.BaseOAuthProtectionService BaseOAuthProtectionService.java:46- Validating token 71d3e0d0-f53e-48c8-885d-a096319bbf2b 17-02 06:31:35.296 DEBUG [qtp1422222071-20] oxtrust.service.filter.AuthorizationProcessingFilter AuthorizationProcessingFilter.java:88- Authorization passed 17-02 06:31:35.296 DEBUG [qtp1422222071-20] service.scim2.interceptor.ReferenceURIInterceptor ReferenceURIInterceptor.java:62- ReferenceURIInterceptor. manage exit 17-02 06:31:35.296 DEBUG [qtp1422222071-20] ws.rs.scim2.GroupWebService GroupWebService.java:390- Executing web service method. patchGroup 17-02 06:31:35.296 INFO [qtp1422222071-20] ws.rs.scim2.BaseScimWebService BaseScimWebService.java:318- inspectPatchRequest. Preprocessing of patch request passed **17-02 06:31:35.988 INFO [qtp1422222071-20] ws.rs.scim2.GroupWebService GroupWebService.java:476- Group-Overhead-Bypass param found 17-02 06:31:35.988 INFO [qtp1422222071-20] ws.rs.scim2.GroupWebService GroupWebService.java:464- Members display will be ignored 17-02 06:31:37.319 DEBUG [qtp1422222071-20] oxtrust.service.scim2.Scim2PatchService Scim2PatchService.java:71- applyPatchOperation of type ADD** 17-02 06:31:37.319 DEBUG [qtp1422222071-20] oxtrust.service.scim2.Scim2PatchService Scim2PatchService.java:144- applyPatchOperation. Generating a ScimResource from generic map: {members=[{value=fcfb4672-6882-4bba-9f71-7205a4c04868}]} 17-02 06:31:37.321 DEBUG [qtp1422222071-20] model.scim2.util.ScimResourceUtil ScimResourceUtil.java:244- transferToResource. Processing add operation 17-02 06:31:37.410 DEBUG [qtp1422222071-20] model.scim2.util.ScimResourceUtil ScimResourceUtil.java:249- transferToResource. Recursive traversal of resource is taking place 17-02 06:31:37.414 DEBUG [qtp1422222071-20] model.scim2.util.ScimResourceUtil ScimResourceUtil.java:177- attachExtensionInfo 17-02 06:31:37.506 DEBUG [qtp1422222071-20] ws.rs.scim2.GroupWebService GroupWebService.java:417- patchGroup. Revising final resource representation still passes validations 17-02 06:31:37.506 DEBUG [qtp1422222071-20] model.scim2.util.ResourceValidator ResourceValidator.java:86- Validating existence of required attribute 'displayName' 17-02 06:31:37.506 DEBUG [qtp1422222071-20] model.scim2.util.ResourceValidator ResourceValidator.java:86- Validating existence of required attribute 'members.value' 17-02 06:31:37.517 DEBUG [qtp1422222071-20] model.scim2.util.ResourceValidator ResourceValidator.java:86- Validating existence of required attribute 'schemas' 17-02 06:31:39.187 DEBUG [qtp1422222071-20] oxtrust.service.scim2.Scim2GroupService Scim2GroupService.java:351- replaceGroupInfo. Updating group info in LDAP 17-02 06:31:42.187 DEBUG [qtp1422222071-20] oxtrust.service.scim2.Scim2GroupService Scim2GroupService.java:421- syncMemberAttributeInPerson. Updating memberOf attribute in user LDAP entries 17-02 06:31:42.234 INFO [qtp1422222071-20] service.scim2.serialization.ScimResourceSerializer ScimResourceSerializer.java:98- buildIncludeSet. Processing excludedAttributes query param ``` **As you can see i am not getting any error in the logs but receiving 502 bad gateway from server when making the request.** Here are also the logs from identity (can find much info here): ``` 2023-02-17 06:30:49,965 DEBUG [ForkJoinPool.commonPool-worker-7] [org.gluu.oxtrust.service.MetadataValidationTimer] (MetadataValidationTimer.java:114) - Starting metadata validation 2023-02-17 06:30:49,965 DEBUG [ForkJoinPool.commonPool-worker-7] [org.gluu.oxtrust.service.MetadataValidationTimer] (MetadataValidationTimer.java:117) - Metadata validation finished with result: 'false' 2023-02-17 06:30:50,026 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:30:50,028 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:31:04,964 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:31:04,964 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:31:19,960 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:31:19,960 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:31:19,964 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:31:19,964 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:31:19,964 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:31:19,964 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:31:19,988 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:31:19,988 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:31:19,998 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:31:19,998 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:31:20,026 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:31:20,028 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:31:34,964 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:31:34,964 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:31:49,960 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:31:49,960 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:31:49,964 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:31:49,964 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:31:49,964 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:31:49,964 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:31:49,964 DEBUG [ForkJoinPool.commonPool-worker-3] [org.gluu.oxtrust.service.MetadataValidationTimer] (MetadataValidationTimer.java:114) - Starting metadata validation 2023-02-17 06:31:49,965 DEBUG [ForkJoinPool.commonPool-worker-3] [org.gluu.oxtrust.service.MetadataValidationTimer] (MetadataValidationTimer.java:117) - Metadata validation finished with result: 'false' 2023-02-17 06:31:49,969 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:31:49,970 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:31:50,027 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:31:50,029 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:32:04,964 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:32:04,964 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:32:19,960 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:32:19,960 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:32:19,964 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:32:19,964 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:32:19,964 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:32:19,964 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:32:19,987 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:32:19,987 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:32:19,997 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:32:19,997 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:32:19,998 DEBUG [ForkJoinPool.commonPool-worker-5] [org.gluu.oxtrust.service.CleanerTimer] (CleanerTimer.java:135) - Start clean up for baseDn: class org.gluu.oxtrust.model.PasswordResetRequest, class: class org.gluu.oxtrust.model.PasswordResetRequest 2023-02-17 06:32:19,998 DEBUG [ForkJoinPool.commonPool-worker-5] [org.gluu.oxtrust.service.CleanerTimer] (CleanerTimer.java:140) - Finished clean up for baseDn: ou=resetPasswordRequests,o=gluu=class org.gluu.oxtrust.model.PasswordResetRequest, takes: 0ms, removed items: 0 2023-02-17 06:32:19,998 DEBUG [ForkJoinPool.commonPool-worker-5] [org.gluu.oxtrust.service.CleanerTimer] (CleanerTimer.java:135) - Start clean up for baseDn: class org.gluu.model.metric.ldap.MetricEntry, class: class org.gluu.model.metric.ldap.MetricEntry 2023-02-17 06:32:20,004 DEBUG [ForkJoinPool.commonPool-worker-5] [org.gluu.oxtrust.service.CleanerTimer] (CleanerTimer.java:140) - Finished clean up for baseDn: ou=oxtrust,ou=statistic,o=metric=class org.gluu.model.metric.ldap.MetricEntry, takes: 5ms, removed items: 0 2023-02-17 06:32:20,027 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:32:20,028 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:32:34,965 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:32:34,965 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:32:49,960 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:32:49,960 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:32:49,964 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:32:49,964 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:32:49,964 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:32:49,964 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:32:49,964 DEBUG [ForkJoinPool.commonPool-worker-3] [org.gluu.oxtrust.service.MetadataValidationTimer] (MetadataValidationTimer.java:114) - Starting metadata validation 2023-02-17 06:32:49,964 DEBUG [ForkJoinPool.commonPool-worker-3] [org.gluu.oxtrust.service.MetadataValidationTimer] (MetadataValidationTimer.java:117) - Metadata validation finished with result: 'false' 2023-02-17 06:32:50,026 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:32:50,028 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:33:04,964 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:33:04,964 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:33:19,960 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:33:19,961 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:33:19,965 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:33:19,965 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:33:19,965 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:33:19,965 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:33:19,987 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:33:19,987 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:33:19,997 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:33:19,997 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:33:20,026 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:33:20,028 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:33:34,964 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:33:34,964 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:33:49,960 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:33:49,961 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:33:49,964 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:33:49,964 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:33:49,965 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:33:49,965 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:33:49,965 DEBUG [ForkJoinPool.commonPool-worker-5] [org.gluu.oxtrust.service.MetadataValidationTimer] (MetadataValidationTimer.java:114) - Starting metadata validation 2023-02-17 06:33:49,965 DEBUG [ForkJoinPool.commonPool-worker-5] [org.gluu.oxtrust.service.MetadataValidationTimer] (MetadataValidationTimer.java:117) - Metadata validation finished with result: 'false' 2023-02-17 06:33:49,970 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:33:49,970 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:33:50,026 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:33:50,029 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:34:04,964 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:34:04,964 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:34:19,960 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:34:19,960 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:34:19,964 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:34:19,964 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:34:19,964 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:34:19,964 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:34:19,987 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:34:19,988 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:34:19,998 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:34:19,998 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:34:20,003 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:34:20,003 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:34:20,003 DEBUG [ForkJoinPool.commonPool-worker-3] [org.gluu.oxtrust.service.StatusCheckerTimer] (StatusCheckerTimer.java:129) - Starting update of configuration status 2023-02-17 06:34:20,004 DEBUG [ForkJoinPool.commonPool-worker-3] [org.gluu.oxtrust.service.StatusCheckerTimer] (StatusCheckerTimer.java:139) - Setting FactorAttributes 2023-02-17 06:34:20,004 DEBUG [ForkJoinPool.commonPool-worker-3] [org.gluu.util.process.ProcessHelper] (ProcessHelper.java:66) - Preparing to start process [facter, -j] 2023-02-17 06:34:20,004 DEBUG [ForkJoinPool.commonPool-worker-3] [org.gluu.util.process.ProcessHelper] (ProcessHelper.java:152) - Executing blocking process [facter, -j] 2023-02-17 06:34:20,026 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:34:20,026 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:34:20,027 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:34:20,028 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:34:20,065 DEBUG [ForkJoinPool.commonPool-worker-3] [org.gluu.util.process.ProcessHelper] (ProcessHelper.java:69) - Successfully start process [facter, -j] 2023-02-17 06:34:20,066 DEBUG [ForkJoinPool.commonPool-worker-3] [org.gluu.util.process.ProcessHelper] (ProcessHelper.java:77) - Waiting for the proces [facter, -j] finish 2023-02-17 06:34:20,066 DEBUG [ForkJoinPool.commonPool-worker-3] [org.gluu.util.process.ProcessHelper] (ProcessHelper.java:87) - Process [facter, -j] has finished 2023-02-17 06:34:20,067 DEBUG [ForkJoinPool.commonPool-worker-3] [org.gluu.oxtrust.service.StatusCheckerTimer] (StatusCheckerTimer.java:188) - Setting httpd attributes 2023-02-17 06:34:20,087 DEBUG [ForkJoinPool.commonPool-worker-3] [org.gluu.oxtrust.service.StatusCheckerTimer] (StatusCheckerTimer.java:165) - Configuration status update finished 2023-02-17 06:34:34,964 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:34:34,964 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:34:49,960 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:34:49,960 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:34:49,964 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:34:49,964 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:34:49,964 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:34:49,964 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:34:49,964 DEBUG [ForkJoinPool.commonPool-worker-5] [org.gluu.oxtrust.service.MetadataValidationTimer] (MetadataValidationTimer.java:114) - Starting metadata validation 2023-02-17 06:34:49,965 DEBUG [ForkJoinPool.commonPool-worker-5] [org.gluu.oxtrust.service.MetadataValidationTimer] (MetadataValidationTimer.java:117) - Metadata validation finished with result: 'false' 2023-02-17 06:34:50,027 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:34:50,029 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:35:04,965 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:35:04,965 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:35:19,960 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:35:19,960 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:35:19,964 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:35:19,964 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:35:19,964 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:35:19,964 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:35:19,987 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:35:19,987 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:35:19,997 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:35:19,997 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:35:20,026 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:35:20,029 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:35:34,965 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:35:34,965 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:35:49,961 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:35:49,961 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:35:49,964 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:35:49,964 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:35:49,964 DEBUG [oxTrustScheduler_Worker-1] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:35:49,964 DEBUG [oxTrustScheduler_Worker-2] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:35:49,964 DEBUG [ForkJoinPool.commonPool-worker-5] [org.gluu.oxtrust.service.MetadataValidationTimer] (MetadataValidationTimer.java:114) - Starting metadata validation 2023-02-17 06:35:49,964 DEBUG [ForkJoinPool.commonPool-worker-5] [org.gluu.oxtrust.service.MetadataValidationTimer] (MetadataValidationTimer.java:117) - Metadata validation finished with result: 'false' 2023-02-17 06:35:49,969 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:35:49,969 DEBUG [oxTrustScheduler_Worker-3] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:35:50,026 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:35:50,028 DEBUG [oxTrustScheduler_Worker-5] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended 2023-02-17 06:36:04,964 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:53) - Bound request started 2023-02-17 06:36:04,964 DEBUG [oxTrustScheduler_Worker-4] [org.gluu.service.timer.RequestJobListener] (RequestJobListener.java:63) - Bound request ended [root@localhost logs]# ``` **And yes you are correct we have 110k user in the group **

By Aman Negi user 17 Feb 2023 at 12:46 a.m. CST

Copy
Aman Negi gravatar
Yeah the same request always send 502 bad gateway error but when we check the group sometimes user get added to group and sometimes its not.

By Aliaksandr Samuseu staff 17 Feb 2023 at 10:05 a.m. CST

Copy
Aliaksandr Samuseu gravatar
Taking into account the size of the group, and the random nature of the issue, that could be caused by memory shortages (still strange that log records are not consistent with what actually happens, and that proper error (if it occurs) isn't logged). Have you tried to increase allocations for "identity" or "scim" JVM in the container? Please try to edit `/etc/default/scim` file; find "JAVA_OPTIONS=" line in it, and change -`Xms` and `-Xmx` parameters (try to double them). If at your version SCIM doesn't yet run as a separate service, then you'll need to modify `/etc/default/identity` file instead. Then restart corresponding service and see if this will bring a positive change.

By Aman Negi user 17 Feb 2023 at 10:23 a.m. CST

Copy
Aman Negi gravatar
Tried the above solution still resulting in the 502 bad gateway. Is there any other solution you guys recommends. ``` [root@localhost default]# cat scim JAVA_HOME=/opt/jre JAVA=$JAVA_HOME/bin/java JAVA_OPTIONS="-server -Xms256m -Xmx2228m -XX:+DisableExplicitGC -Dgluu.base=/etc /gluu -Dserver.base=/opt/gluu/jetty/scim -Dlog.base=/opt/gluu/jetty/scim -Dpytho n.home=/opt/jython" ```

By Aman Negi user 21 Feb 2023 at 3:50 p.m. CST

Copy
Aman Negi gravatar
hi Aliaksandr, Any update on the issue??

By Aman Negi user 28 Feb 2023 at 5:25 a.m. CST

Copy
Aman Negi gravatar
Hi Aliaksandr, Did by any chance you were able to look into this issue.

By Mohib Zico staff 28 Mar 2023 at 12:34 p.m. CDT

Copy
Mohib Zico gravatar
Assigning to myself.

By Aman Negi user 29 Mar 2023 at 7:11 a.m. CDT

Copy
Aman Negi gravatar
May i know what is the progress regarding it.

Post an answer