By: Moin Qidwai user 01 Jan 2021 at 4:14 a.m. CST

1 Response
Moin Qidwai gravatar
I was following the installation guide here: https://gluu.org/docs/gluu-server/4.2/installation-guide/install-kubernetes/ I expected it to be a simple install after answering the questions but it seems to be quite tricky to make it work. I am trying to install it on WSL2 on Windows 10. Initially I tried to install it on Docker for desktop + Kubernetes part of the Microsofts provided tools for WSL. I ran into 403 forbidden there with regards to the kubernetes API being called from the python scripts. I gave up on that and moved onto minikube installation on WSL. I first found out that the LDAP image version being created in the settings.json does not even exists causing the whole cluster to restart constantly. The specific version line is: ``` "LDAP_IMAGE_NAME": "gluufederation/opendj", "LDAP_IMAGE_TAG": "4.2.2_02", ``` This needs to be updated to: ``` "LDAP_IMAGE_NAME": "gluufederation/opendj", "LDAP_IMAGE_TAG": "4.2.2_01", ``` Once this was done I was able to get most services up and running but the jackrabbit pod was still failing to be created. I looked at the logs for that pod and found the below: Postgres is not ready; reason=could not translate host name "postgres.postgres.svc.cluster.local" to address: Name does not resolve This led me to the kubedb name space and specifically the Postgres pod being created there, which had the following in its logs: ``` E0101 08:11:02.228750 1 event.go:247] Could not construct reference to: '&v1alpha1.Postgres{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"postgres", GenerateName:"", Namespace:"postgres", SelfLink:"", UID:"df0ae230-9bf4-40c4-a5bc-71b3ed3d8d8b", ResourceVersion:"2131", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63745085462, loc:(*time.Location)(0x6c6e1c0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"postgres"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string{"kubedb.com"}, ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1alpha1.PostgresSpec{Version:"11.1", Replicas:(*int32)(0xc000c0c7e0), StandbyMode:(*v1alpha1.PostgresStandbyMode)(0xc0012ae3e0), StreamingMode:(*v1alpha1.PostgresStreamingMode)(nil), Archiver:(*v1alpha1.PostgresArchiverSpec)(nil), LeaderElection:(*v1alpha1.LeaderElectionConfig)(0xc000c0c780), DatabaseSecret:(*v1.SecretVolumeSource)(nil), StorageType:"Durable", Storage:(*v1.PersistentVolumeClaimSpec)(0xc0016715c0), Init:(*v1alpha1.InitSpec)(0xc000ee19e0), BackupSchedule:(*v1alpha1.BackupScheduleSpec)(nil), Monitor:(*v1.AgentSpec)(0xc001671560), ConfigSource:(*v1.VolumeSource)(nil), PodTemplate:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Annotations:map[string]string(nil)}, Controller:v1.ObjectMeta{Annotations:map[string]string(nil)}, Spec:v1.PodSpec{ServiceAccountName:"postgres", Args:[]string(nil), NodeSelector:map[string]string(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, Affinity:(*v1.Affinity)(nil), SchedulerName:"", Tolerations:[]v1.Toleration(nil), ImagePullSecrets:[]v1.LocalObjectReference(nil), Env:[]v1.EnvVar(nil), InitContainers:[]v1.Container(nil), PriorityClassName:"", Priority:(*int32)(nil), SecurityContext:(*v1.PodSecurityContext)(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil)}}, ServiceTemplate:v1.ServiceTemplateSpec{ObjectMeta:v1.ObjectMeta{Annotations:map[string]string(nil)}, Spec:v1.ServiceSpec{Ports:[]v1.ServicePort(nil), ClusterIP:"", Type:"", ExternalIPs:[]string(nil), LoadBalancerIP:"", LoadBalancerSourceRanges:[]string(nil), ExternalTrafficPolicy:"", HealthCheckNodePort:0}}, ReplicaServiceTemplate:v1.ServiceTemplateSpec{ObjectMeta:v1.ObjectMeta{Annotations:map[string]string(nil)}, Spec:v1.ServiceSpec{Ports:[]v1.ServicePort(nil), ClusterIP:"", Type:"", ExternalIPs:[]string(nil), LoadBalancerIP:"", LoadBalancerSourceRanges:[]string(nil), ExternalTrafficPolicy:"", HealthCheckNodePort:0}}, UpdateStrategy:v1.StatefulSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateStatefulSetStrategy)(nil)}, TerminationPolicy:"WipeOut"}, Status:v1alpha1.PostgresStatus{Phase:"Creating", Reason:"", ObservedGeneration:(*types.IntHash)(nil)}}' due to: 'selfLink was empty, can't make reference'. Will not report event: 'Warning' 'Failed' 'Fail to be ready Postgres: "postgres". Reason: selfLink was empty, can't make reference' E0101 08:11:02.287703 1 worker.go:76] Failed to process key postgres/postgres. Reason: selfLink was empty, can't make reference I0101 08:11:02.287738 1 worker.go:80] Error syncing key postgres/postgres: selfLink was empty, can't make reference ``` Now I do not see any particular resource files being generated specifically for this and so it seems to be part of the whole kubedb space (which I am not that familiar with if being honest). I do see that selflink is deprecated in kubcetl 1.20.1 but unfortunately since this is being generated through the kubedb api it seems we cannot control this from our side by changing settings in Gluu. At this point I am near enough to giving up on Gluu altogether **as I tried the same in Ubuntu 18 and faced the exact same issues.** If anyone knows how to resolve the above errors for Jackrabbit and kubedb resources, please help. The settings.json used for installation is below: ``` { "ACCEPT_GLUU_LICENSE": "Y", "GLUU_VERSION": "4.2", "TEST_ENVIRONMENT": "", "GLUU_UPGRADE_TARGET_VERSION": "", "GLUU_HELM_RELEASE_NAME": "", "NGINX_INGRESS_RELEASE_NAME": "", "NGINX_INGRESS_NAMESPACE": "", "INSTALL_GLUU_GATEWAY": "N", "POSTGRES_NAMESPACE": "postgres", "KONG_NAMESPACE": "", "GLUU_GATEWAY_UI_NAMESPACE": "", "KONG_PG_USER": "", "KONG_PG_PASSWORD": "", "GLUU_GATEWAY_UI_PG_USER": "", "GLUU_GATEWAY_UI_PG_PASSWORD": "", "KONG_DATABASE": "", "GLUU_GATEWAY_UI_DATABASE": "", "POSTGRES_REPLICAS": 3, "POSTGRES_URL": "postgres.postgres.svc.cluster.local", "KONG_HELM_RELEASE_NAME": "", "GLUU_GATEWAY_UI_HELM_RELEASE_NAME": "", "USE_ISTIO": "N", "USE_ISTIO_INGRESS": "", "ISTIO_SYSTEM_NAMESPACE": "", "NODES_IPS": [ "192.168.49.2" ], "NODES_ZONES": [], "NODES_NAMES": [], "NODE_SSH_KEY": "", "HOST_EXT_IP": "192.168.49.2", "VERIFY_EXT_IP": "", "AWS_LB_TYPE": "", "USE_ARN": "", "VPC_CIDR": "", "ARN_AWS_IAM": "", "LB_ADD": "", "REDIS_URL": "", "REDIS_TYPE": "", "REDIS_PW": "", "REDIS_USE_SSL": "false", "REDIS_SSL_TRUSTSTORE": "", "REDIS_SENTINEL_GROUP": "", "REDIS_MASTER_NODES": "", "REDIS_NODES_PER_MASTER": "", "REDIS_NAMESPACE": "", "INSTALL_REDIS": "", "INSTALL_JACKRABBIT": "Y", "JACKRABBIT_STORAGE_SIZE": "4Gi", "JACKRABBIT_URL": "http://jackrabbit:8080", "JACKRABBIT_ADMIN_ID": "admin", "JACKRABBIT_ADMIN_PASSWORD": "PASSWORd!76", "JACKRABBIT_CLUSTER": "Y", "JACKRABBIT_PG_USER": "jackrabbit", "JACKRABBIT_PG_PASSWORD": "PASSWORd!76", "JACKRABBIT_DATABASE": "jackrabbit", "DEPLOYMENT_ARCH": "minikube", "PERSISTENCE_BACKEND": "ldap", "INSTALL_COUCHBASE": "", "COUCHBASE_NAMESPACE": "", "COUCHBASE_VOLUME_TYPE": "", "COUCHBASE_CLUSTER_NAME": "", "COUCHBASE_URL": "", "COUCHBASE_USER": "", "COUCHBASE_BUCKET_PREFIX": "", "COUCHBASE_SUPERUSER": "", "COUCHBASE_PASSWORD": "", "COUCHBASE_SUPERUSER_PASSWORD": "", "COUCHBASE_CRT": "", "COUCHBASE_CN": "", "COUCHBASE_INDEX_NUM_REPLICA": "", "COUCHBASE_SUBJECT_ALT_NAME": "", "COUCHBASE_CLUSTER_FILE_OVERRIDE": "", "COUCHBASE_USE_LOW_RESOURCES": "", "COUCHBASE_DATA_NODES": "", "COUCHBASE_QUERY_NODES": "", "COUCHBASE_INDEX_NODES": "", "COUCHBASE_SEARCH_EVENTING_ANALYTICS_NODES": "", "COUCHBASE_GENERAL_STORAGE": "", "COUCHBASE_DATA_STORAGE": "", "COUCHBASE_INDEX_STORAGE": "", "COUCHBASE_QUERY_STORAGE": "", "COUCHBASE_ANALYTICS_STORAGE": "", "COUCHBASE_INCR_BACKUP_SCHEDULE": "", "COUCHBASE_FULL_BACKUP_SCHEDULE": "", "COUCHBASE_BACKUP_RETENTION_TIME": "", "COUCHBASE_BACKUP_STORAGE_SIZE": "", "LDAP_BACKUP_SCHEDULE": "", "NUMBER_OF_EXPECTED_USERS": "", "EXPECTED_TRANSACTIONS_PER_SEC": "", "USING_CODE_FLOW": "", "USING_SCIM_FLOW": "", "USING_RESOURCE_OWNER_PASSWORD_CRED_GRANT_FLOW": "", "DEPLOY_MULTI_CLUSTER": "", "HYBRID_LDAP_HELD_DATA": "", "LDAP_JACKRABBIT_VOLUME": "", "APP_VOLUME_TYPE": 2, "LDAP_STATIC_VOLUME_ID": "", "LDAP_STATIC_DISK_URI": "", "GLUU_CACHE_TYPE": "NATIVE_PERSISTENCE", "GLUU_NAMESPACE": "gluu", "GLUU_FQDN": "demoexample.gluu.org", "COUNTRY_CODE": "US", "STATE": "TX", "EMAIL": "qidwaimoin@yahoo.com", "CITY": "Austin", "ORG_NAME": "Gluu", "GMAIL_ACCOUNT": "", "GOOGLE_NODE_HOME_DIR": "", "IS_GLUU_FQDN_REGISTERED": "N", "LDAP_PW": "PASSWORd!76", "ADMIN_PW": "PASSWORd!76", "OXD_APPLICATION_KEYSTORE_CN": "", "OXD_ADMIN_KEYSTORE_CN": "", "LDAP_STORAGE_SIZE": "4Gi", "OXAUTH_REPLICAS": 1, "OXTRUST_REPLICAS": 1, "LDAP_REPLICAS": 1, "OXSHIBBOLETH_REPLICAS": "", "OXPASSPORT_REPLICAS": "", "OXD_SERVER_REPLICAS": "", "CASA_REPLICAS": "", "RADIUS_REPLICAS": "", "FIDO2_REPLICAS": "", "SCIM_REPLICAS": "", "ENABLE_OXTRUST_API": "N", "ENABLE_OXTRUST_TEST_MODE": "N", "ENABLE_CACHE_REFRESH": "N", "ENABLE_OXD": "N", "ENABLE_FIDO2": "N", "ENABLE_SCIM": "N", "ENABLE_RADIUS": "N", "ENABLE_OXPASSPORT": "N", "ENABLE_OXSHIBBOLETH": "N", "ENABLE_CASA": "N", "ENABLE_OXAUTH_KEY_ROTATE": "N", "ENABLE_OXTRUST_API_BOOLEAN": "true", "ENABLE_OXTRUST_TEST_MODE_BOOLEAN": "false", "ENABLE_RADIUS_BOOLEAN": "false", "ENABLE_OXPASSPORT_BOOLEAN": "false", "ENABLE_CASA_BOOLEAN": "false", "ENABLE_SAML_BOOLEAN": "false", "ENABLED_SERVICES_LIST": [ "update-lb-ip", "persistence", "oxtrust", "config", "ldap", "jackrabbit", "oxauth" ], "OXAUTH_KEYS_LIFE": "", "EDIT_IMAGE_NAMES_TAGS": "N", "CASA_IMAGE_NAME": "gluufederation/casa", "CASA_IMAGE_TAG": "4.2.2_02", "CONFIG_IMAGE_NAME": "gluufederation/config-init", "CONFIG_IMAGE_TAG": "4.2.2_02", "CACHE_REFRESH_ROTATE_IMAGE_NAME": "gluufederation/cr-rotate", "CACHE_REFRESH_ROTATE_IMAGE_TAG": "4.2.2_02", "CERT_MANAGER_IMAGE_NAME": "gluufederation/certmanager", "CERT_MANAGER_IMAGE_TAG": "4.2.2_02", "LDAP_IMAGE_NAME": "gluufederation/opendj", "LDAP_IMAGE_TAG": "4.2.2_01", "JACKRABBIT_IMAGE_NAME": "gluufederation/jackrabbit", "JACKRABBIT_IMAGE_TAG": "4.2.2_02", "OXAUTH_IMAGE_NAME": "gluufederation/oxauth", "OXAUTH_IMAGE_TAG": "4.2.2_03", "FIDO2_IMAGE_NAME": "gluufederation/fido2", "FIDO2_IMAGE_TAG": "4.2.2_02", "SCIM_IMAGE_NAME": "gluufederation/scim", "SCIM_IMAGE_TAG": "4.2.2_02", "OXD_IMAGE_NAME": "gluufederation/oxd-server", "OXD_IMAGE_TAG": "4.2.2_02", "OXPASSPORT_IMAGE_NAME": "gluufederation/oxpassport", "OXPASSPORT_IMAGE_TAG": "4.2.2_02", "OXSHIBBOLETH_IMAGE_NAME": "gluufederation/oxshibboleth", "OXSHIBBOLETH_IMAGE_TAG": "4.2.2_02", "OXTRUST_IMAGE_NAME": "gluufederation/oxtrust", "OXTRUST_IMAGE_TAG": "4.2.2_03", "PERSISTENCE_IMAGE_NAME": "gluufederation/persistence", "PERSISTENCE_IMAGE_TAG": "4.2.2_02", "RADIUS_IMAGE_NAME": "gluufederation/radius", "RADIUS_IMAGE_TAG": "4.2.2_02", "GLUU_GATEWAY_IMAGE_NAME": "gluufederation/gluu-gateway", "GLUU_GATEWAY_IMAGE_TAG": "4.2.2_01", "GLUU_GATEWAY_UI_IMAGE_NAME": "gluufederation/gluu-gateway-ui", "GLUU_GATEWAY_UI_IMAGE_TAG": "4.2.2_01", "UPGRADE_IMAGE_NAME": "gluufederation/upgrade", "UPGRADE_IMAGE_TAG": "4.2.2_02", "CONFIRM_PARAMS": "Y", "GLUU_LDAP_MULTI_CLUSTER": "", "GLUU_LDAP_SERF_PORT": "", "GLUU_LDAP_ADVERTISE_ADDRESS": "", "GLUU_LDAP_ADVERTISE_ADMIN_PORT": "", "GLUU_LDAP_ADVERTISE_LDAPS_PORT": "", "GLUU_LDAP_ADVERTISE_REPLICATION_PORT": "", "GLUU_LDAP_SECONDARY_CLUSTER": "", "GLUU_LDAP_SERF_PEERS": "" } ```

By Michael Schwartz Account Admin 01 Jan 2021 at 3:40 p.m. CST

Michael Schwartz gravatar
sorry, there is no community support for K8S