Use the correct configuration of Solr brokerpak

[nickumia-reisys]

Related to GSA/data.gov#2701 (comment)
Pull in release that uses persistent storage for solrcloud.

Overview:

• Terraform-driven EKS (with the correct configuration): Limit external-dns to exactly one zone GSA-TTS/datagov-brokerpak-eks#82
• Solr Brokerpak: Solr Optimizations for CKAN Integrations GSA-TTS/datagov-brokerpak-solr#32

A few issues that may inhibit deployment: https://gsa-tts.slack.com/archives/C2N85536E/p1646629525710879?thread_ts=1645114253.342779&cid=C2N85536E

• network: add cmd: failed to assign an IP address to container
• Managed node group size limit issue.

[github-actions]

Terraform plan for staging

Error: Get "http://localhost/api/v1/namespaces/kube-system/serviceaccounts/aws-load-balancer-controller": dial tcp 127.0.0.1:80: connect: connection refused

Error: Get "http://localhost/api/v1/namespaces/kube-system/serviceaccounts/aws-load-balancer-controller": dial tcp 127.0.0.1:80: connect: connection refused

  with module.brokerpak-eks-terraform.module.provision.module.aws_load_balancer_controller.kubernetes_service_account.this,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform.provision.aws_load_balancer_controller/main.tf line 313, in resource "kubernetes_service_account" "this":
 313: resource "kubernetes_service_account" "this" {


Error: Get "http://localhost/apis/rbac.authorization.k8s.io/v1/clusterroles/aws-load-balancer-controller": dial tcp 127.0.0.1:80: connect: connection refused

  with module.brokerpak-eks-terraform.module.provision.module.aws_load_balancer_controller.kubernetes_cluster_role.this,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform.provision.aws_load_balancer_controller/main.tf line 332, in resource "kubernetes_cluster_role" "this":
 332: resource "kubernetes_cluster_role" "this" {


Error: Get "http://localhost/api/v1/namespaces/kube-system/serviceaccounts/admin-c327ebb43b24b66e": dial tcp 127.0.0.1:80: connect: connection refused

  with module.brokerpak-eks-terraform.module.provision.kubernetes_service_account.admin,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform/terraform/modules/provision/admin-account.tf line 7, in resource "kubernetes_service_account" "admin":
   7: resource "kubernetes_service_account" "admin" {


Error: Kubernetes cluster unreachable: invalid configuration: no configuration has been provided, try setting KUBERNETES_MASTER environment variable

  with module.brokerpak-eks-terraform.module.provision.helm_release.zookeeper-operator,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform/terraform/modules/provision/crds.tf line 9, in resource "helm_release" "zookeeper-operator":
   9: resource "helm_release" "zookeeper-operator" {


Error: Kubernetes cluster unreachable: invalid configuration: no configuration has been provided, try setting KUBERNETES_MASTER environment variable

  with module.brokerpak-eks-terraform.module.provision.helm_release.solr-operator,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform/terraform/modules/provision/crds.tf line 29, in resource "helm_release" "solr-operator":
  29: resource "helm_release" "solr-operator" {


Error: Get "http://localhost/api/v1/namespaces/kube-system/serviceaccounts/external-dns": dial tcp 127.0.0.1:80: connect: connection refused

  with module.brokerpak-eks-terraform.module.provision.kubernetes_service_account.external_dns,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform/terraform/modules/provision/external-dns.tf line 61, in resource "kubernetes_service_account" "external_dns":
  61: resource "kubernetes_service_account" "external_dns" {


Error: Get "http://localhost/apis/rbac.authorization.k8s.io/v1/clusterroles/external-dns": dial tcp 127.0.0.1:80: connect: connection refused

  with module.brokerpak-eks-terraform.module.provision.kubernetes_cluster_role.external_dns,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform/terraform/modules/provision/external-dns.tf line 72, in resource "kubernetes_cluster_role" "external_dns":
  72: resource "kubernetes_cluster_role" "external_dns" {


Error: Get "http://localhost/api/v1/namespaces/aws-observability": dial tcp 127.0.0.1:80: connect: connection refused

  with module.brokerpak-eks-terraform.module.provision.kubernetes_namespace.logging,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform/terraform/modules/provision/logging.tf line 28, in resource "kubernetes_namespace" "logging":
  28: resource "kubernetes_namespace" "logging" {


Error: Get "http://localhost/apis/storage.k8s.io/v1/storageclasses/ebs-sc": dial tcp 127.0.0.1:80: connect: connection refused

  with module.brokerpak-eks-terraform.module.provision.kubernetes_storage_class.ebs-sc,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform/terraform/modules/provision/persistent-storage.tf line 208, in resource "kubernetes_storage_class" "ebs-sc":
 208: resource "kubernetes_storage_class" "ebs-sc" {


Error: Get "http://localhost/apis/rbac.authorization.k8s.io/v1/namespaces/default/roles/namespace-admin": dial tcp 127.0.0.1:80: connect: connection refused

  with module.brokerpak-eks-terraform.module.provision.kubernetes_role.namespace_admin,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform/terraform/modules/provision/rbac.tf line 3, in resource "kubernetes_role" "namespace_admin":
   3: resource "kubernetes_role" "namespace_admin" {

❌ Failed to generate plan in plan #203

[github-actions]

Terraform plan for production

Error: Get "http://localhost/api/v1/namespaces/kube-system/serviceaccounts/aws-load-balancer-controller": dial tcp 127.0.0.1:80: connect: connection refused

Error: Get "http://localhost/api/v1/namespaces/kube-system/serviceaccounts/aws-load-balancer-controller": dial tcp 127.0.0.1:80: connect: connection refused

  with module.brokerpak-eks-terraform.module.provision.module.aws_load_balancer_controller.kubernetes_service_account.this,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform.provision.aws_load_balancer_controller/main.tf line 313, in resource "kubernetes_service_account" "this":
 313: resource "kubernetes_service_account" "this" {


Error: Get "http://localhost/apis/rbac.authorization.k8s.io/v1/clusterroles/aws-load-balancer-controller": dial tcp 127.0.0.1:80: connect: connection refused

  with module.brokerpak-eks-terraform.module.provision.module.aws_load_balancer_controller.kubernetes_cluster_role.this,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform.provision.aws_load_balancer_controller/main.tf line 332, in resource "kubernetes_cluster_role" "this":
 332: resource "kubernetes_cluster_role" "this" {


Error: Get "http://localhost/api/v1/namespaces/kube-system/serviceaccounts/admin-94ae17f666c6887b": dial tcp 127.0.0.1:80: connect: connection refused

  with module.brokerpak-eks-terraform.module.provision.kubernetes_service_account.admin,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform/terraform/modules/provision/admin-account.tf line 7, in resource "kubernetes_service_account" "admin":
   7: resource "kubernetes_service_account" "admin" {


Error: Kubernetes cluster unreachable: invalid configuration: no configuration has been provided, try setting KUBERNETES_MASTER environment variable

  with module.brokerpak-eks-terraform.module.provision.helm_release.zookeeper-operator,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform/terraform/modules/provision/crds.tf line 9, in resource "helm_release" "zookeeper-operator":
   9: resource "helm_release" "zookeeper-operator" {


Error: Kubernetes cluster unreachable: invalid configuration: no configuration has been provided, try setting KUBERNETES_MASTER environment variable

  with module.brokerpak-eks-terraform.module.provision.helm_release.solr-operator,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform/terraform/modules/provision/crds.tf line 29, in resource "helm_release" "solr-operator":
  29: resource "helm_release" "solr-operator" {


Error: Get "http://localhost/api/v1/namespaces/kube-system/serviceaccounts/external-dns": dial tcp 127.0.0.1:80: connect: connection refused

  with module.brokerpak-eks-terraform.module.provision.kubernetes_service_account.external_dns,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform/terraform/modules/provision/external-dns.tf line 61, in resource "kubernetes_service_account" "external_dns":
  61: resource "kubernetes_service_account" "external_dns" {


Error: Get "http://localhost/apis/rbac.authorization.k8s.io/v1/clusterroles/external-dns": dial tcp 127.0.0.1:80: connect: connection refused

  with module.brokerpak-eks-terraform.module.provision.kubernetes_cluster_role.external_dns,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform/terraform/modules/provision/external-dns.tf line 72, in resource "kubernetes_cluster_role" "external_dns":
  72: resource "kubernetes_cluster_role" "external_dns" {


Error: Get "http://localhost/api/v1/namespaces/aws-observability/configmaps/aws-logging": dial tcp 127.0.0.1:80: connect: connection refused

  with module.brokerpak-eks-terraform.module.provision.kubernetes_config_map.logging,
  on /tmp/terraform-data-dir/modules/brokerpak-eks-terraform/terraform/modules/provision/logging.tf line 36, in resource "kubernetes_config_map" "logging":
  36: resource "kubernetes_config_map" "logging" {

❌ Failed to generate plan in plan #203

[nickumia-reisys]

Verified that the solr can be deployed with persistent storage