https://pulumi.com logo
Join Slack
Powered by
so starting last thursday or so when I try to bri...
# aws
a
so starting last thursday or so when I try to bring up my EKS stack I get: (First pulumi up): Warning: apiextensions.k8s.io/v1beta1 CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use apiextensions.k8s.io/v1 CustomResourceDefinition (if I pulumi up again I instead get): error: an unhandled error occurred: Program exited with non-zero exit code: -1 any ideas? I've since version-locked my cluster to 1.20, and rolled back to pulumi 3.19 to no avail.
ok, so it's 2 seperate isues... the unhandled error is I0110 155845.075148 6411 step_executor.go:327] StepExecutor worker(138): step same on urnpulumiASC-PRD-adamw-189--aws-stack:jxecustomresource:VPC$awsec2/vpcVpc$customresourceEFS$awsefs/fileSystemFileSystem$awsbackup/vaultVault$awsbackup/planPlan::ASC-PRD-adamw-189--aws-stack--BUPl pulumipulumiStack jxe-ASC-PRD-adamw-189--aws-stack running... error: an unhandled error occurred: Program exited with non-zero exit code: -1 so ideas on either of these issues is appreciated
b
the first one is easy to fix with a transformation, the second one, you may need to open an issue
a
I've never used transformations before, and I dont reference apiextensions.k8s.io/v1beta1 in any of my code, so I'm not sure what resources to apply a transform to =/
b
is it a helm chart?
a
no, this is while launching the EKS cluster itself
b
ah yes, I'll file a bug for that
a
can you thnk of a workaround for me in the shortterm?
b
that shouldn't result in your cluster failing, just a warning
what's your code?
a
I got about 3k lines of code, lemme grab the cluster stuff
Copy code
import pulumi_eks as eks
import pulumi

class EKSCluster(pulumi.ComponentResource):
    """ builds EKS cluster """

    def __init__(self,
            config=None,
            stack_artifacts=None,
            ):
        super().__init__(
                'custom:resource:EKS',
                __name__,
                {},
                opts=pulumi.ResourceOptions(parent=stack_artifacts['network'].get('private_subnets')[0])
                )
        if config is None:
            self._config = {}
        else:
            self._config = config
        self._stack_artifacts = stack_artifacts

        self._artifacts = {}
        self._artifacts['cluster'] = self.__get_cluster()
        self._artifacts['node_sg'] = self._artifacts['cluster'].node_security_group
        #self._stack_artifacts['sec_grps'].add_orch_and_vpns_on_port(
        #        sec_grp=self._artifacts['node_sg'],
        #        port=22,
        #        sec_grp_name='eks_node_sg',
        #        parent=self._artifacts['cluster'],
        #        )

    def get(self, key = None):
        """ expose artifacts """
        if key is None:
            return self._artifacts
        return self._artifacts[key]

    def __get_cluster_name(self):
        return f'{self._config["stackname"]}--EKSC'

    def __get_cluster(self):
        cluster_conf = {}
        cluster_conf['name'] = self.__get_cluster_name()
        cluster_conf['eks_sg'] = self._stack_artifacts['sec_grps'].get_eks()

        private_subnet_objs=self._stack_artifacts['network'].get('private_subnets')
        cluster_conf['private_subnet_ids']=[]
        for private_subnet_obj in private_subnet_objs:
            cluster_conf['private_subnet_ids'].append(private_subnet_obj.id)

        cluster_conf['nodes_conf'] = self.__build_node_conf(name=cluster_conf['name'])
        cluster_conf['cluster_role'] = self._stack_artifacts['roles'].get_eks_cluster_role()
        cluster_conf['node_role'] = self._stack_artifacts['roles'].get_eks_node_role()

        cluster = self.__build_cluster(cluster_conf=cluster_conf)
        return cluster

    def __build_node_conf(self, name):
        with open('./user-data/node-user-data') as file:
            node_user_data = file.read()
        nodes_conf = eks.ClusterNodeGroupOptionsArgs(
                auto_scaling_group_tags={
                    "Name": name,
                    "JX_ENV": self._config["stackname"]
                    },
                desired_capacity=self._config['location']['EKS_Nodes_Desired'],
                max_size=self._config['location']['EKS_Nodes_Max'],
                min_size=self._config['location']['EKS_Nodes_Min'],
                encrypt_root_block_device=True,
                instance_type=self._config['location']['EKS_Nodes_Type'],
                node_associate_public_ip_address=False,
                node_public_key=self._config['location']['sshpubkey'],
                node_root_volume_size=self._config['location']['EKS_Nodes_HDD'],
                node_user_data=node_user_data,
                version='1.20', #FIXME Warning: <http://apiextensions.k8s.io/v1beta1|apiextensions.k8s.io/v1beta1> CustomResourceDefinition is deprecated in v1.16+, unavailable in v1.22+; use <http://apiextensions.k8s.io/v1|apiextensions.k8s.io/v1> CustomResourceDefinition
                )
        return nodes_conf

    def __build_cluster(self, cluster_conf):
        cluster = eks.Cluster(resource_name=cluster_conf['name'],
            name=cluster_conf['name'],
            cluster_security_group=cluster_conf['eks_sg'],
            create_oidc_provider=True,
            encryption_config_key_arn=self._config['location']['KMSKey'],
            endpoint_private_access=True,
            endpoint_public_access=False,
            instance_role=cluster_conf['node_role'],
            kubernetes_service_ip_address_range=self._config['location']['EKS_Nodes_CIDR'],
            node_group_options=cluster_conf['nodes_conf'],
            private_subnet_ids=cluster_conf['private_subnet_ids'],
            public_subnet_ids=self._stack_artifacts['network'].get('public_subnets'),
            service_role=cluster_conf['cluster_role'],
            tags={
                "Name": cluster_conf['name'],
                "JX_ENV": self._config["stackname"]
                },
            vpc_id=self._stack_artifacts['network'].get('vpc').id,
            opts=pulumi.ResourceOptions(parent=self),
            )
        return cluster
most of the specific config is read from conf files and loaded into dicts
b
and this used to work?
a
yeah, for a few months now, started giving me grief last weds/thurs
b
did you upgrade versions of pulumi eks
?
a
I dont think so, not intentionally at least, where's that located? requirements.txt?
pulumi-eks==0.31.0
you still around Jaxx? This mean anything to you?
Copy code
I0110 19:34:07.109512   26332 eventsink.go:59] Invoking function: tok=aws:ssm/getParameter:getParameter asynchronously
I0110 19:34:07.110324   26332 eventsink.go:59] , obj={"name":"/aws/service/eks/optimized-ami/1.20/amazon-linux-2/recommended/image_id"}
I0110 19:34:07.111176   26332 eventsink.go:59] RegisterResource RPC prepared: t=eks:index:Cluster, name=ASC-PRD-adamw-189--stack--EKSC
    pulumi:pulumi:Stack jxe-ASC-PRD-adamw-189--stack running error: an unhandled error occurred: Program exited with non-zero exit code: -1
I0110 19:34:17.311108   26332 eventsink.go:59] Reading SSM Parameter: {
I0110 19:34:17.311358   26332 eventsink.go:59]   Name: "/aws/service/eks/optimized-ami/1.20/amazon-linux-2/recommended/image_id",
I0110 19:34:17.311592   26332 eventsink.go:59]   WithDecryption: true
I0110 19:34:17.311767   26332 eventsink.go:59] }
Copy code
aws ssm get-parameter --name /aws/service/eks/optimized-ami/1.20/amazon-linux-2/recommended/image_id --region us-east-1 --query "Parameter.Value" --output text
ami-03c45fa21d6d9e641
ok @billowy-army-68599 just fyi: I've upgraded pulumi-eks to .36, upgraded pulumi lib, and upgraded the cli to latest, modified my code to fit with the changes in .36, version locked the k8s to 1.18, and its working now.
🎉 1
Open in Slack
PreviousNext
Powered by