FYI

Question

FYI <https pulumi community slack com archives CB36DSVSA p1631645316033200>

worried-city-86458 · Answer

I ll have a play with this soon Does this mean pulumi k8s will call `helm uninstall` for the chart resource delete operation That would help dependency ordering issues where a chart creates resources outside of k8s like in aws via a controller and the rest of the non k8s stack can t be torn down unless these resources are also deleted

sparse-park-68967 · Answer

To be clear the chart resource is not encapsulated by the helm release resource and nothing changes there If you use the helm release resource the `create` will do the equivalent of `helm install` though this directly calls into Helm as a library and delete will do an equivalent of `helm uninstall` This resource explicitly models a `release` while chart is a component resource that doesn t materialize a release in any way on the cluster The blog post goes into some detail

worried-city-86458 · Answer

First attempt to move everything from helm chart to helm release was easy at the source level but it blows up at runtime

worried-city-86458 · Answer

For example installing cert manager before using dotnet c ``` cert manager Logger LogDebug Installing cert manager var certManagerCrds = new ConfigGroup cert manager crds new ConfigGroupArgs Yaml = ReadResource CertManagerCrds yaml new ComponentResourceOptions Protect = true Provider = k8sProvider var certManagerNs = new Namespace cert manager new NamespaceArgs Metadata = new ObjectMetaArgs Name = cert manager new CustomResourceOptions Provider = k8sProvider var certManagerValues = new Dictionary lt string object gt prometheus = new enabled = true servicemonitor = new enabled = true var certManagerChart = new Chart cert manager new ChartArgs Namespace = cert manager FetchOptions = new ChartFetchArgs Repo = Chart = cert manager Version = K8sConfig CertManagerChartVersion Values = certManagerValues SkipCRDRendering = true new ComponentResourceOptions DependsOn = certManagerCrds certManagerNs kubePrometheusStackCrds Provider = k8sProvider ``` After showing just diff from chart to release ```var certManagerRelease = new Release cert manager new ReleaseArgs Namespace = cert manager RepositoryOpts = new RepositoryOptsArgs Repo = Chart = cert manager Version = K8sConfig CertManagerChartVersion Values = certManagerValues SkipCrds = true new CustomResourceOptions DependsOn = certManagerCrds certManagerNs kubePrometheusStackCrds Provider = k8sProvider ```

worried-city-86458 · Answer

However helm release values is not compatible with helm chart values as it doesn t like my use of anonymous types in the values ```Diagnostics pharos k8s alpha pulumi pulumi Stack error Running program D Devel Mps devops gemini pulumi Cli bin Debug gemini dll failed with an unhandled exception System InvalidOperationException lt gt f AnonymousType15`2 System Boolean System Private CoreLib Version=5 0 0 0 Culture=neutral PublicKeyToken=7cec85d7bea7798e lt gt f AnonymousType7`1 System Boolean System Private CoreLib Version=5 0 0 0 Culture=neutral PublicKeyToken=7cec85d7bea7798e K8s Version=1 0 0 0 Culture=neutral PublicKeyToken=null is not a supported argument type resource cert manager kubernetes <http helm sh v3 Release|helm sh v3 Release> values id prometheus at async Task lt object gt Pulumi Serialization Serializer SerializeAsync string ctx object prop bool keepResources in sdk dotnet Pulumi Serialization Serializer cs line 242 at async Task lt ImmutableDictionary lt string object gt gt Pulumi Serialization Serializer SerializeDictionaryAsync string ctx IDictionary dictionary bool keepResources in sdk dotnet Pulumi Serialization Serializer cs line 362 at async Task lt object gt Pulumi Serialization Serializer SerializeAsync string ctx object prop bool keepResources in sdk dotnet Pulumi Serialization Serializer cs line 221 at async Task lt object gt Pulumi Serialization Serializer SerializeAsync string ctx object prop bool keepResources in sdk dotnet Pulumi Serialization Serializer cs line 150 at async Task lt object gt Pulumi Serialization Serializer SerializeAsync string ctx object prop bool keepResources in sdk dotnet Pulumi Serialization Serializer cs line 108 at async Task lt SerializationResult gt Pulumi Deployment SerializeFilteredPropertiesAsync string label IDictionary lt string object gt args Predicate lt string gt acceptKey bool keepResources in sdk dotnet Pulumi Deployment Deployment Serialization cs line 53 at async Task lt PrepareResult gt Pulumi Deployment PrepareResourceAsync string label Resource res bool custom bool remote ResourceArgs args ResourceOptions options in sdk dotnet Pulumi Deployment Deployment Prepare cs line 32 at async Task lt string urn string id Struct data ImmutableDictionary lt string ImmutableHashSet lt Resource gt gt dependencies gt Pulumi Deployment RegisterResourceAsync Resource resource bool remote Func lt string Resource gt newDependency ResourceArgs args ResourceOptions options in sdk dotnet Pulumi Deployment Deployment RegisterResource cs line 27 at async Task lt string urn string id Struct data ImmutableDictionary lt string ImmutableHashSet lt Resource gt gt dependencies gt Pulumi Deployment ReadOrRegisterResourceAsync Resource resource bool remote Func lt string Resource gt newDependency ResourceArgs args ResourceOptions options in sdk dotnet Pulumi Deployment Deployment ReadOrRegisterResource cs line 73 at async Task Pulumi Deployment CompleteResourceAsync Resource resource bool remote Func lt string Resource gt newDependency ResourceArgs args ResourceOptions options ImmutableDictionary lt string IOutputCompletionSource gt completionSources in sdk dotnet Pulumi Deployment Deployment ReadOrRegisterResource cs line 89 at async Task lt T gt Pulumi Output lt T gt GetValueAsync T whenUnknown in sdk dotnet Pulumi Core Output cs line 153 at async Task lt HashSet lt string gt gt Pulumi Deployment GetAllTransitivelyReferencedResourceUrnsAsync HashSet lt Resource gt resources in sdk dotnet Pulumi Deployment Deployment Prepare cs line 163 at async Task lt PrepareResult gt Pulumi Deployment PrepareResourceAsync string label Resource res bool custom bool remote ResourceArgs args ResourceOptions options in sdk dotnet Pulumi Deployment Deployment Prepare cs line 80 at async Task lt string urn string id Struct data ImmutableDictionary lt string ImmutableHashSet lt Resource gt gt dependencies gt Pulumi Deployment RegisterResourceAsync Resource resource bool remote Func lt string Resource gt newDependency ResourceArgs args ResourceOptions options in sdk dotnet Pulumi Deployment Deployment RegisterResource cs line 27 at async Task lt string urn string id Struct data ImmutableDictionary lt string ImmutableHashSet lt Resource gt gt dependencies gt Pulumi Deployment ReadOrRegisterResourceAsync Resource resource bool remote Func lt string Resource gt newDependency ResourceArgs args ResourceOptions options in sdk dotnet Pulumi Deployment Deployment ReadOrRegisterResource cs line 73 at async Task Pulumi Deployment CompleteResourceAsync Resource resource bool remote Func lt string Resource gt newDependency ResourceArgs args ResourceOptions options ImmutableDictionary lt string IOutputCompletionSource gt completionSources in sdk dotnet Pulumi Deployment Deployment ReadOrRegisterResource cs line 89 at async Task lt T gt Pulumi Output lt T gt GetValueAsync T whenUnknown in sdk dotnet Pulumi Core Output cs line 153 at async Task lt HashSet lt string gt gt Pulumi Deployment GetAllTransitivelyReferencedResourceUrnsAsync HashSet lt Resource gt resources in sdk dotnet Pulumi Deployment Deployment Prepare cs line 163 at async Task lt PrepareResult gt Pulumi Deployment PrepareResourceAsync string label Resource res bool custom bool remote ResourceArgs args ResourceOptions options in sdk dotnet Pulumi Deployment Deployment Prepare cs line 80 at async Task lt string urn string id Struct data ImmutableDictionary lt string ImmutableHashSet lt Resource gt gt dependencies gt Pulumi Deployment RegisterResourceAsync Resource resource bool remote Func lt string Resource gt newDependency ResourceArgs args ResourceOptions options in sdk dotnet Pulumi Deployment Deployment RegisterResource cs line 27 at async Task lt string urn string id Struct data ImmutableDictionary lt string ImmutableHashSet lt Resource gt gt dependencies gt Pulumi Deployment ReadOrRegisterResourceAsync Resource resource bool remote Func lt string Resource gt newDependency ResourceArgs args ResourceOptions options in sdk dotnet Pulumi Deployment Deployment ReadOrRegisterResource cs line 73 at async Task Pulumi Deployment CompleteResourceAsync Resource resource bool remote Func lt string Resource gt newDependency ResourceArgs args ResourceOptions options ImmutableDictionary lt string IOutputCompletionSource gt completionSources in sdk dotnet Pulumi Deployment Deployment ReadOrRegisterResource cs line 89 at async Task lt T gt Pulumi Output lt T gt GetValueAsync T whenUnknown in sdk dotnet Pulumi Core Output cs line 153 at async Task lt OutputData lt U gt gt Pulumi Output lt T gt ApplyHelperAsync lt U gt Task lt OutputData lt T gt gt dataTask Func lt T Output lt U gt gt func in sdk dotnet Pulumi Core Output cs line 254 at async Task lt T gt Pulumi Output lt T gt GetValueAsync T whenUnknown in sdk dotnet Pulumi Core Output cs line 153 at async Task lt PrepareResult gt Pulumi Deployment PrepareResourceAsync string label Resource res bool custom bool remote ResourceArgs args ResourceOptions options in sdk dotnet Pulumi Deployment Deployment Prepare cs line 42 at async Task lt OutputData lt object gt gt Pulumi Output lt T gt Pulumi IOutput GetDataAsync in sdk dotnet Pulumi Core Output cs line 164 at async Task lt string urn string id Struct data ImmutableDictionary lt string ImmutableHashSet lt Resource gt gt dependencies gt Pulumi Deployment RegisterResourceAsync Resource resource bool remote Func lt string Resource gt newDependency ResourceArgs args ResourceOptions options in sdk dotnet Pulumi Deployment Deployment RegisterResource cs line 27 at async Task lt OutputData lt ImmutableArray lt T gt gt gt Pulumi Output lt T gt AllHelperAsync ImmutableArray lt Input lt T gt gt inputs in sdk dotnet Pulumi Core Output cs line 288 at async Task lt string urn string id Struct data ImmutableDictionary lt string ImmutableHashSet lt Resource gt gt dependencies gt Pulumi Deployment ReadOrRegisterResourceAsync Resource resource bool remote Func lt string Resource gt newDependency ResourceArgs args ResourceOptions options in sdk dotnet Pulumi Deployment Deployment ReadOrRegisterResource cs line 73 at async Task lt OutputData lt U gt gt Pulumi Output lt T gt ApplyHelperAsync lt U gt Task lt OutputData lt T gt gt dataTask Func lt T Output lt U gt gt func in sdk dotnet Pulumi Core Output cs line 254 at async Task Pulumi Deployment CompleteResourceAsync Resource resource bool remote Func lt string Resource gt newDependency ResourceArgs args ResourceOptions options ImmutableDictionary lt string IOutputCompletionSource gt completionSources in sdk dotnet Pulumi Deployment Deployment ReadOrRegisterResource cs line 89 at async Task lt T gt Pulumi Output lt T gt GetValueAsync T whenUnknown in sdk dotnet Pulumi Core Output cs line 153 at async Task lt string gt Pulumi Deployment+EngineLogger TryGetResourceUrnAsync Resource resource in sdk dotnet Pulumi Deployment Deployment EnginerLogger cs line 144```

worried-city-86458 · Answer

Looks like I d have to change all nested values to use `Dictionary lt string object gt ` which is not desirable ```var certManagerValues = new Dictionary lt string object gt prometheus = new Dictionary lt string object gt enabled = true servicemonitor = new Dictionary lt string object gt enabled = true ```

worried-city-86458 · Answer

I ve got heaps of nested values in other charts so this is not really practical either

worried-city-86458 · Answer

This then failed with a different error ```Diagnostics cert manager kubernetes helm sh Release error unable to build kubernetes objects from release manifest unable to recognize no matches for kind ServiceMonitor in version <http monitoring coreos com v1|monitoring coreos com v1> ```

worried-city-86458 · Answer

Note I install the CRDs separately and depend on the config group This works with helm chart

worried-city-86458 · Answer

I think this is due to a race condition where the crds have not been created yet I think the helm chart resources would retry and eventually succeed Not sure if the helm release does the same

sparse-park-68967 · Answer

< worried city 86458> sorry missed this Can you open an issue for this

worried-city-86458 · Answer

Will do

worried-city-86458 · Answer

sparse-park-68967 · Answer

thanks