https://pulumi.com logo
Powered by
Title
b

billowy-horse-79629

12/04/2022, 4:27 PM
Hey all, This is not the first time i’m encountering this annoying 
transport is closing
error while upgrading Helm Releases. Actually, i’m not changing anything in my pulumi stack, but the helm release doesn’t know how to keep the ServiceAccount list in order, so Pulumi is trying to upgrade it anyway, you can see here the changes that found (nothing really change, just the order of the list) - Anyway, applying this change (pulumi up) is broken and i’m getting 
transport is closing
, which happened to me a while a go and the only solution that I found was to fully destroy the k8s cluster and re-create it (Which is the worst solution I could imagine to use). I don’t want to destroy this cluster, especially by the fact that it’s a new one that I created it a week ago so nothing changed there. The full log is in the thread. I’m completely lost by this error, so any help I can get would be super appreciated.
Updating (permitio/dev)

View Live: <https://app.pulumi.com/permitio/permit-main/dev/updates/461>

     Type                              Name                            Status       Info
     Type                              Name                            Status                  Info
     pulumi:pulumi:Stack               permit-main-dev                 **failed**              1 error; 1 warning; 25 messages
     ├─ eks:index:Cluster              permit-main-eks-dev                                     
     │  └─ aws:eks:Cluster             permit-main-eks-dev-eksCluster                          
 ~   ├─ kubernetes:<http://helm.sh/v3:Release|helm.sh/v3:Release>  alb-controller-release          **updating failed**     [diff: ~resourceNames]; 1 error
 ~   ├─ kubernetes:<http://helm.sh/v3:Release|helm.sh/v3:Release>  cluster-autoscaler-release      **updating failed**     1 error
 ~   └─ kubernetes:<http://helm.sh/v3:Release|helm.sh/v3:Release>  eks-bootstrap                   **updating failed**     [diff: ~resourceNames]; 1 error
 
Diagnostics:
  kubernetes:<http://helm.sh/v3:Release|helm.sh/v3:Release> (cluster-autoscaler-release):
    error: transport is closing
 
  kubernetes:<http://helm.sh/v3:Release|helm.sh/v3:Release> (eks-bootstrap):
    error: transport is closing
 
  pulumi:pulumi:Stack (permit-main-dev):
    panic: runtime error: invalid memory address or nil pointer dereference
    [signal SIGSEGV: segmentation violation code=0x2 addr=0x20 pc=0x106038848]
    goroutine 226 [running]:
    <http://github.com/pulumi/pulumi-kubernetes/provider/v3/pkg/provider.setReleaseAttributes(0x140027f61e0|github.com/pulumi/pulumi-kubernetes/provider/v3/pkg/provider.setReleaseAttributes(0x140027f61e0>, 0x0, 0x0)
        /home/runner/work/pulumi-kubernetes/pulumi-kubernetes/provider/pkg/provider/helm_release.go:1149 +0x178
    <http://github.com/pulumi/pulumi-kubernetes/provider/v3/pkg/provider.(*helmReleaseProvider).helmUpdate(0x14000b71500|github.com/pulumi/pulumi-kubernetes/provider/v3/pkg/provider.(*helmReleaseProvider).helmUpdate(0x14000b71500>, 0x140027f61e0, 0x140027f62d0)
        /home/runner/work/pulumi-kubernetes/pulumi-kubernetes/provider/pkg/provider/helm_release.go:588 +0x51c
    <http://github.com/pulumi/pulumi-kubernetes/provider/v3/pkg/provider.(*helmReleaseProvider).Update(0x14000b71500|github.com/pulumi/pulumi-kubernetes/provider/v3/pkg/provider.(*helmReleaseProvider).Update(0x14000b71500>, {0x10695efe8, 0x140029ca000}, 0x14002777b00)
        /home/runner/work/pulumi-kubernetes/pulumi-kubernetes/provider/pkg/provider/helm_release.go:979 +0x45c
    <http://github.com/pulumi/pulumi-kubernetes/provider/v3/pkg/provider.(*kubeProvider).Update(0x14000177380|github.com/pulumi/pulumi-kubernetes/provider/v3/pkg/provider.(*kubeProvider).Update(0x14000177380>, {0x10695efe8, 0x140029ca000}, 0x14002777b00)
        /home/runner/work/pulumi-kubernetes/pulumi-kubernetes/provider/pkg/provider/provider.go:2124 +0x1434
    <http://github.com/pulumi/pulumi/sdk/v3/proto/go._ResourceProvider_Update_Handler.func1({0x10695efe8|github.com/pulumi/pulumi/sdk/v3/proto/go._ResourceProvider_Update_Handler.func1({0x10695efe8>, 0x140029ca000}, {0x10681a820, 0x14002777b00})
        /home/runner/go/pkg/mod/github.com/pulumi/pulumi/sdk/v3@v3.26.1/proto/go/provider.pb.go:2665 +0x7c
    <http://github.com/grpc-ecosystem/grpc-opentracing/go/otgrpc.OpenTracingServerInterceptor.func1({0x10695efe8|github.com/grpc-ecosystem/grpc-opentracing/go/otgrpc.OpenTracingServerInterceptor.func1({0x10695efe8>, 0x140029955f0}, {0x10681a820, 0x14002777b00}, 0x14002998520, 0x1400297b3f8)
        /home/runner/go/pkg/mod/github.com/grpc-ecosystem/grpc-opentracing@v0.0.0-20180507213350-8e809c8a8645/go/otgrpc/server.go:57 +0x3bc
    <http://github.com/pulumi/pulumi/sdk/v3/proto/go._ResourceProvider_Update_Handler({0x10689c5e0|github.com/pulumi/pulumi/sdk/v3/proto/go._ResourceProvider_Update_Handler({0x10689c5e0>, 0x14000177380}, {0x10695efe8, 0x140029955f0}, 0x140029b0240, 0x140001349a0)
        /home/runner/go/pkg/mod/github.com/pulumi/pulumi/sdk/v3@v3.26.1/proto/go/provider.pb.go:2667 +0x150
    <http://google.golang.org/grpc.(*Server).processUnaryRPC(0x140009fc540|google.golang.org/grpc.(*Server).processUnaryRPC(0x140009fc540>, {0x10699c6b8, 0x140004db040}, 0x140029858c0, 0x140008c5aa0, 0x107ced850, 0x0)
        /home/runner/go/pkg/mod/google.golang.org/grpc@v1.45.0/server.go:1282 +0xc5c
    <http://google.golang.org/grpc.(*Server).handleStream(0x140009fc540|google.golang.org/grpc.(*Server).handleStream(0x140009fc540>, {0x10699c6b8, 0x140004db040}, 0x140029858c0, 0x0)
        /home/runner/go/pkg/mod/google.golang.org/grpc@v1.45.0/server.go:1619 +0xa34
    <http://google.golang.org/grpc.(*Server).serveStreams.func1.2(0x140007801d0|google.golang.org/grpc.(*Server).serveStreams.func1.2(0x140007801d0>, 0x140009fc540, {0x10699c6b8, 0x140004db040}, 0x140029858c0)
        /home/runner/go/pkg/mod/google.golang.org/grpc@v1.45.0/server.go:921 +0x94
    created by <http://google.golang.org/grpc.(*Server).serveStreams.func1|google.golang.org/grpc.(*Server).serveStreams.func1>
        /home/runner/go/pkg/mod/google.golang.org/grpc@v1.45.0/server.go:919 +0x1f0
 
    warning: aws:ec2/getSubnetIds:getSubnetIds verification warning: The aws_subnet_ids data source has been deprecated and will be removed in a future version. Use the aws_subnets data source instead.
    error: update failed
 
  kubernetes:<http://helm.sh/v3:Release|helm.sh/v3:Release> (alb-controller-release):
    error: transport is closing
 
Outputs:
    kubeconfig: {}
m

many-telephone-49025

12/04/2022, 7:58 PM
Hi Raz, can you run 
pulumi about
and post the output here
A GitHub gist of the code would be nice too
b

brash-gigabyte-81569

12/05/2022, 2:41 PM
Just a thought, is the cluster set to private endpoints and you aren’t connected to the VPN?
g

gorgeous-egg-16927

12/05/2022, 4:04 PM
Hi @billowy-horse-79629, could you please open an issue for that? We treat panics as a high-priority issue to fix, so we can take a look shortly.
b

billowy-horse-79629

12/05/2022, 7:08 PM
CLI          
Version      3.48.0
Go Version   go1.19.3
Go Compiler  gc

Host     
OS       darwin
Version  12.6.1
Arch     arm64

Backend        
Name           <http://pulumi.com|pulumi.com>

Pulumi locates its logs in /var/folders/hg/tk92cycn45ndkzmjzpx5l1tc0000gn/T/ by default
warning: Failed to read project: no Pulumi.yaml project file found (searching upwards from /Users/razco). If you have not created a project yet, use `pulumi new` to do so: no project file found
warning: Failed to get information about the current stack: no Pulumi.yaml project file found (searching upwards from /Users/razco). If you have not created a project yet, use `pulumi new` to do so: no project file found
I didn’t attach the Org and User fields, tell me if it’s important
Will attach gist of the code later, thanks so much for the support !
m

many-telephone-49025

12/05/2022, 7:19 PM
Thanks Raz, @gorgeous-egg-16927 answered too and as he wrote opening an issue so they can have a look into this quicker!
7 Views
#kubernetesJoin Slack
Powered by