I don't want to leave this ticket open if it's not needed.
I removed and reinstalled Gluu 3.1.6, then I added in the localhost server 1636 to the Cache refresh and I also added in a few LDAP users to the Gluu Manager Group.
I can use both the internal Admin account as well as the external LDAP users as admins.
If need be I will open a new ticket asking how to create additional internal admin accounts for the exact reasons I referenced above, i.e. losing LDAP connectivity, issues with a user account etc.
Thanks