Hi, I'm generating a temporary file (line 45) whic...
# typescripti
important-lion-7565
12/21/2023, 5:48 PMHi, I'm generating a temporary file (line 45) which I want to use then to copy to the remote (line 58). Problem is I get the following error. Also the pulumi.log.info logs the folder path properly.
important-lion-7565
12/21/2023, 5:49 PMimage.png
l
little-cartoon-10569
12/21/2023, 6:16 PMgenerateTmpFile()apply()CopyFilegenerateTmpFile()little-cartoon-10569
12/21/2023, 6:17 PMBTW most of that code isn't related to the problem; shorter posts are easier to read and help others find the problem faster.
i
important-lion-7565
12/21/2023, 6:20 PMSo what would be a proper way of doing this?
l
little-cartoon-10569
12/21/2023, 6:22 PMYou could copy the file inside the apply. You probably wouldn't use pulumi.command for that though.
Or you could use another Pulumi resource (maybe a pulumi.local.Command) to create the temp file, so that the CopyFile can depend on it. That way Pulumi can manage the order of events.
little-cartoon-10569
12/21/2023, 6:23 PMStrictly speaking, you could chain another apply onto the file-generating one, but you shouldn't create a resource in there. So CopyFile shouldn't go in there.
i
important-lion-7565
12/21/2023, 6:24 PMHow would I clean up the temp file created by local.Command, just another Command removing the file after it has been copied?
important-lion-7565
12/21/2023, 6:26 PMOr well could also run remote.command that creates the file
l
little-cartoon-10569
12/21/2023, 6:26 PMYou could rely on the system to do it (which generally happens each time there's a reboot). Or you could create the temp file using tmp outside the apply, so that it is created in advance, and just pass a reference to it to where it's needed.
little-cartoon-10569
12/21/2023, 6:26 PMThe apply is guaranteed to run after the non-applied code (I think). It's safe to rely on that (I always do and have never been caught out.)
i
important-lion-7565
12/21/2023, 6:33 PMHow could I create the tmp outside the apply when I need a value from the config for the content of the tmp? Sorry just trying to understand everything.
l
little-cartoon-10569
12/21/2023, 6:37 PMYou can create the file before writing to it.
i
important-lion-7565
12/21/2023, 6:38 PMAnd then I write to it through the command resource?
important-lion-7565
12/21/2023, 6:38 PMAnd make the container depend on command resource?
l
little-cartoon-10569
12/21/2023, 6:39 PMThat's an option, sounds good. There may be all sorts of other solutions, of course 🙂
little-cartoon-10569
12/21/2023, 6:39 PMI've just noticed that the value you're creating the content from is a configuration value.
little-cartoon-10569
12/21/2023, 6:39 PMIt's not from another resource.
i
important-lion-7565
12/21/2023, 6:39 PMDoes that change things? 😅
l
little-cartoon-10569
12/21/2023, 6:41 PMWell, it should, since it's technically available before the program starts. But
requireSecret()little-cartoon-10569
12/21/2023, 6:41 PMDoes CopyFile (which I've never used) accept an Output as the source? If it does, you could create the file in there.
i
important-lion-7565
12/21/2023, 6:42 PMIt sucks it can't accept a content input or some thing like that..
l
little-cartoon-10569
12/21/2023, 6:42 PMGrr, that silly idea that they hide the Input/Output of constructor parameters in the docs.
little-cartoon-10569
12/21/2023, 6:42 PMI'll look in the actual code 🙂
little-cartoon-10569
12/21/2023, 6:46 PMYep, it's an Input<string>. So you could do the work there.
little-cartoon-10569
12/21/2023, 6:47 PMOnesec I'll hack your code above.
i
important-lion-7565
12/21/2023, 6:47 PMThanks was about to ask 😅
l
little-cartoon-10569
12/21/2023, 6:49 PMHmm. It's already suitable. That apply should resolve before the copy does. There must be a bug in the library.
little-cartoon-10569
12/21/2023, 6:49 PMOr else my analysis is off, which is likely too. I shall look in the code for CopyFile.
i
important-lion-7565
12/21/2023, 6:51 PMYou sir are a soldier 🫡
l
little-cartoon-10569
12/21/2023, 6:58 PMMy golang isn't the best, but it looks like reading the file is correctly done in the engine: https://github.com/pulumi/pulumi-command/blob/9858a482d99e7331dd5962602fd3010637647e79/provider/pkg/provider/remote/copyfileController.go#L65
I was "hoping" that it was a bug like in the old Docker provider, where reading was done in the resource constructor.
little-cartoon-10569
12/21/2023, 6:59 PMIf this is correct and the file is read after its inputs resolve, then your code should work.
i
important-lion-7565
12/21/2023, 7:00 PMIn an event that it doesn't (it doesn't), how would I go about troubleshooting?
l
little-cartoon-10569
12/21/2023, 7:01 PMThe best reason I can think that it doesn't wait would be maybe
cfCredsTmpFile.namelittle-cartoon-10569
12/21/2023, 7:02 PMIs
namei
important-lion-7565
12/21/2023, 7:03 PM.name is a parameter of the return object of generateTmpFile function
l
little-cartoon-10569
12/21/2023, 7:04 PMIt's tmpFile.name, yep. So there's no reason why the tmpfile wouldn't have been created at that time.
little-cartoon-10569
12/21/2023, 7:06 PMIt is possible that /pulumi/cf-credentials/ doesn't exist? The error message doesn't say which file doesn't exist... maybe I was wrong in my assumption that it was localFile?
i
important-lion-7565
12/21/2023, 7:08 PMThe directory?
l
little-cartoon-10569
12/21/2023, 7:08 PMYes. That machine is created from a vanilla image, I can't see anything in there that creates that directory, are you sure it's already there in the container?
i
important-lion-7565
12/21/2023, 7:09 PMI thought copyfile will create directories automatically?
important-lion-7565
12/21/2023, 7:09 PMWe're talking about line 60 right?
l
little-cartoon-10569
12/21/2023, 7:09 PMI don't see anything in the docs suggesting that.
little-cartoon-10569
12/21/2023, 7:09 PMyes
i
important-lion-7565
12/21/2023, 7:10 PMlet me try running mkdir before
l
little-cartoon-10569
12/21/2023, 7:10 PMmkdir --parentsi
important-lion-7565
12/21/2023, 7:12 PMWell it was exactly that
l
little-cartoon-10569
12/21/2023, 7:12 PMGood stuff.
little-cartoon-10569
12/21/2023, 7:12 PMPity that error message is so vague. Could have saved ourselves 30 minutes :)
i
important-lion-7565
12/21/2023, 7:12 PMSucks a bit we need to run a command mkdir before copyfile, I'd assume copyfile handles non existent parent directories.
l
little-cartoon-10569
12/21/2023, 7:13 PMNo, I think that's by design. All copy commands in all OSes do exactly that.
little-cartoon-10569
12/21/2023, 7:13 PMThere needs to be a way to fail to copy if the directory doesn't exist and you don't want it to exist.
little-cartoon-10569
12/21/2023, 7:13 PMFor example, if the dest parameter is wrong, or if you only want it to work if things are configured in a particular way.
i
important-lion-7565
12/21/2023, 7:14 PMFair
important-lion-7565
12/21/2023, 7:14 PMThank you so much for your immense help.
important-lion-7565
12/21/2023, 7:14 PMSaved me probably a couple hours.
l
little-cartoon-10569
12/21/2023, 7:15 PMIt wasn't that immense, I just made it bigger through assumptions. 30+ years in the industry, you'd think I'd assume fewer things...
i
important-lion-7565
12/21/2023, 7:16 PMHaha, don't we all assume everything, I assumed a directory will be created automatically (spoiled like that)
l
little-cartoon-10569
12/21/2023, 7:16 PM👍 Anyway, season's greetings🎄and good luck with the rest!
i
important-lion-7565
12/21/2023, 7:16 PMCheers!
4 Views