echoing-smartphone-60420
04/12/2022, 1:10 PM.release
apivalues.yml
that will build in about 3 mins running with helm install/upgrade
but running as part of Pulumi it freezes for about 5 minutes then timesout--atomic
flag at the end of ithelm dependencies update
pulumi logs
and pulumi up v=9
doesn't yield anything usefullskipAwait
and timeout 6000
const temporal = new k8s.helm.v3.Release("temp", {
chart: "./temporal",
version: "1.0.0",
atomic: true,
skipAwait: true,
timeout: 6000,
values: {
server: {
replicaCount:1
},
cassandra: {
config: {
cluster_size: 1,
}
},
prometheus: {
enabled: true
},
grafana: { enabled: true},
elasticearch: { enabled: false},
}
});
great-queen-39697
04/13/2022, 3:21 PMTF_LOG=TRACE pulumi up -v=11 --logflow --logtostderr 2>&1 | tee -a pulumi_log.txt
The environment variable asks the classic provider to bubble up data. The --logflow
flag bubbles up data from providers that aren't on the Terraform bridge.echoing-smartphone-60420
04/13/2022, 4:33 PMgreat-queen-39697
04/13/2022, 4:35 PMechoing-smartphone-60420
04/13/2022, 4:38 PMbillowy-army-68599
04/14/2022, 11:30 PMgreat-queen-39697
04/14/2022, 11:32 PMechoing-smartphone-60420
04/15/2022, 1:33 AMbillowy-army-68599
04/15/2022, 1:38 AMechoing-smartphone-60420
04/15/2022, 5:38 PMbillowy-army-68599
04/15/2022, 5:41 PMechoing-smartphone-60420
04/15/2022, 5:53 PMDo you want to perform this update? details
pulumi:pulumi:Stack: (same)
[urn=urn:pulumi:main::grand-infra::pulumi:pulumi:Stack::grand-infra-main]
+ kubernetes:<http://helm.sh/v3:Release|helm.sh/v3:Release>: (create)
[urn=urn:pulumi:main::grand-infra::kubernetes:<http://helm.sh/v3:Release::temp|helm.sh/v3:Release::temp>]
[provider=urn:pulumi:main::grand-infra::pulumi:providers:kubernetes::default_3_18_2::04da6b54-80e4-46f7-96ec-b56ff0331ba9]
atomic : true
chart : "./temporal"
cleanupOnFail : false
createNamespace : false
dependencyUpdate : false
devel : false
disableCRDHooks : false
disableOpenapiValidation: false
disableWebhooks : false
forceUpdate : false
lint : false
name : "temp-b1f36b40"
namespace : "default"
recreatePods : false
renderSubchartNotes : false
replace : false
resetValues : false
resourceNames : {
<http://ClusterRole.rbac.authorization.k8s.io/rbac.authorization.k8s.io/v1|ClusterRole.rbac.authorization.k8s.io/rbac.authorization.k8s.io/v1> : [
[0]: "temp-b1f36b40-kube-state-metrics"
[1]: "temp-b1f36b40-prometheus-alertmanager"
[2]: "temp-b1f36b40-prometheus-pushgateway"
[3]: "temp-b1f36b40-prometheus-server"
]
<http://ClusterRoleBinding.rbac.authorization.k8s.io/rbac.authorization.k8s.io/v1|ClusterRoleBinding.rbac.authorization.k8s.io/rbac.authorization.k8s.io/v1>: [
[0]: "temp-b1f36b40-kube-state-metrics"
[1]: "temp-b1f36b40-prometheus-alertmanager"
[2]: "temp-b1f36b40-prometheus-pushgateway"
[3]: "temp-b1f36b40-prometheus-server"
]
ConfigMap/v1 : [
[0]: "default/temp-b1f36b40-grafana"
[1]: "default/temp-b1f36b40-grafana-dashboards-default"
[2]: "default/temp-b1f36b40-prometheus-alertmanager"
[3]: "default/temp-b1f36b40-prometheus-server"
[4]: "temp-b1f36b40-temporal-dynamic-config"
[5]: "temp-b1f36b40-temporal-frontend-config"
[6]: "temp-b1f36b40-temporal-history-config"
[7]: "temp-b1f36b40-temporal-matching-config"
[8]: "temp-b1f36b40-temporal-web-config"
[9]: "temp-b1f36b40-temporal-worker-config"
]
Deployment.apps/apps/v1 : [
[0]: "default/temp-b1f36b40-grafana"
[1]: "default/temp-b1f36b40-kube-state-metrics"
[2]: "default/temp-b1f36b40-prometheus-alertmanager"
[3]: "default/temp-b1f36b40-prometheus-pushgateway"
[4]: "default/temp-b1f36b40-prometheus-server"
[5]: "temp-b1f36b40-temporal-admintools"
[6]: "temp-b1f36b40-temporal-frontend"
[7]: "temp-b1f36b40-temporal-history"
[8]: "temp-b1f36b40-temporal-matching"
[9]: "temp-b1f36b40-temporal-web"
[10]: "temp-b1f36b40-temporal-worker"
]
Job.batch/batch/v1 : [
[0]: "temp-b1f36b40-temporal-es-index-setup"
[1]: "temp-b1f36b40-temporal-schema-setup"
[2]: "temp-b1f36b40-temporal-schema-update"
]
PersistentVolumeClaim/v1 : [
[0]: "default/temp-b1f36b40-prometheus-alertmanager"
[1]: "default/temp-b1f36b40-prometheus-server"
]
Pod/v1 : [
[0]: "temp-b1f36b40-wismc-test"
]
PodDisruptionBudget.policy/policy/v1beta1 : [
[0]: "elasticsearch-master-pdb"
]
Secret/v1 : [
[0]: "default/temp-b1f36b40-grafana"
[1]: "temp-b1f36b40-temporal-default-store"
[2]: "temp-b1f36b40-temporal-visibility-store"
]
Service/v1 : [
[0]: "default/temp-b1f36b40-grafana"
[1]: "default/temp-b1f36b40-kube-state-metrics"
[2]: "default/temp-b1f36b40-prometheus-alertmanager"
[3]: "default/temp-b1f36b40-prometheus-pushgateway"
[4]: "default/temp-b1f36b40-prometheus-server"
[5]: "elasticsearch-master"
[6]: "elasticsearch-master-headless"
[7]: "temp-b1f36b40-cassandra"
[8]: "temp-b1f36b40-temporal-admintools"
[9]: "temp-b1f36b40-temporal-frontend"
[10]: "temp-b1f36b40-temporal-frontend-headless"
[11]: "temp-b1f36b40-temporal-history-headless"
[12]: "temp-b1f36b40-temporal-matching-headless"
[13]: "temp-b1f36b40-temporal-web"
[14]: "temp-b1f36b40-temporal-worker-headless"
]
ServiceAccount/v1 : [
[0]: "default/temp-b1f36b40-grafana"
[1]: "default/temp-b1f36b40-kube-state-metrics"
[2]: "default/temp-b1f36b40-prometheus-alertmanager"
[3]: "default/temp-b1f36b40-prometheus-pushgateway"
[4]: "default/temp-b1f36b40-prometheus-server"
[5]: "temporaladmin"
]
StatefulSet.apps/apps/v1 : [
[0]: "elasticsearch-master"
[1]: "temp-b1f36b40-cassandra"
]
}
reuseValues : false
skipAwait : true
skipCrds : false
timeout : 6000
values : {
cassandra : {
config: {
cluster_size: 1
}
}
elasticearch: {
enabled: false
}
grafana : {
enabled: true
}
prometheus : {
enabled: true
}
server : {
replicaCount: 1
}
}
verify : false
version : "1.0.0"
waitForJobs : false
~ pulumi:providers:kubernetes: (update)
[id=b62bfb25-6546-424a-92b1-384e58dfcc80]
[urn=urn:pulumi:main::grand-infra::eks:index:Cluster$pulumi:providers:kubernetes::grand-eks-eks-k8s]
~ version: "3.17.0" => "3.18.2"
~ pulumi:providers:kubernetes: (update)
[id=b69eea56-b079-4318-8853-c6f2cbd7e146]
[urn=urn:pulumi:main::grand-infra::eks:index:Cluster$pulumi:providers:kubernetes::grand-eks-provider]
~ version: "3.17.0" => "3.18.2"
.Values
its a super vanila deploybillowy-army-68599
04/18/2022, 4:08 PMalright I got the infra up@echoing-smartphone-60420 does this mean you got it running? anything else you need help debugging with here?
echoing-smartphone-60420
04/18/2022, 6:02 PMbillowy-army-68599
04/18/2022, 6:25 PMechoing-smartphone-60420
04/18/2022, 6:45 PMbillowy-army-68599
04/18/2022, 6:46 PMhelm dependency update
and it pulled themechoing-smartphone-60420
04/18/2022, 6:53 PMbillowy-army-68599
04/18/2022, 6:53 PMechoing-smartphone-60420
04/18/2022, 6:53 PMbillowy-army-68599
04/18/2022, 6:53 PMechoing-smartphone-60420
04/18/2022, 6:59 PM@Zach Gates one thing I noticed:
you aren't passing a provider to the helm template at all, so where is the helm chart going?
aws eks update-kubeconfig --name <name of cluster>
after completing the cluster creation earlier in scriptbillowy-army-68599
04/18/2022, 7:00 PMechoing-smartphone-60420
04/18/2022, 7:01 PMaws-vault
to wrap the pulumi call with aws-environment variablesbillowy-army-68599
04/18/2022, 7:57 PMdependsOn
for the helm chart to the node group, what I found was that the pods were stuck pending
NAME READY STATUS RESTARTS AGE
elasticsearch-master-0 0/1 Pending 0 38m
elasticsearch-master-1 0/1 Pending 0 38m
elasticsearch-master-2 0/1 Pending 0 38m
temp-dd4cb578-cassandra-0 0/1 Pending 0 38m
temp-dd4cb578-grafana-dd58f468d-d2pg5 0/1 Pending 0 38m
temp-dd4cb578-kube-state-metrics-548559c9cd-c6m9s 0/1 Pending 0 38m
temp-dd4cb578-prometheus-alertmanager-6b4b6cb5b7-m5vv8 0/2 Pending 0 38m
temp-dd4cb578-prometheus-pushgateway-b7d4f96d6-tvm7z 0/1 Pending 0 38m
temp-dd4cb578-prometheus-server-5d9674bd4c-qs4vg 0/2 Pending 0 38m
temp-dd4cb578-temporal-admintools-6b8bf64cb5-7zhbs 0/1 Pending 0 38m
temp-dd4cb578-temporal-frontend-5db9b4d79-6ld72 0/1 Pending 0 38m
temp-dd4cb578-temporal-history-666dc56744-jgqnn 0/1 Pending 0 38m
temp-dd4cb578-temporal-matching-5d468745c6-s8t9l 0/1 Pending 0 38m
temp-dd4cb578-temporal-web-7b77d477c8-gllhf 0/1 Pending 0 38m
temp-dd4cb578-temporal-worker-758b668454-tl6pp 0/1 Pending 0 38m
the nodegroups takes a little while to provision because of the fargate/spot bid, which then the helm release times outechoing-smartphone-60420
04/18/2022, 8:46 PM