Any tips on speeding up this node docker build &am...
# generalr
rich-alligator-53421
09/13/2023, 10:24 AMAny tips on speeding up this node docker build & deployment. it takes often > 5 minutes, while locally building is around 10-20seconds. I'll post my code into thread
rich-alligator-53421
09/13/2023, 10:24 AMconst registry = new gcp.container.Registry("image-registry", {}, { retainOnDelete: true });
const registryUrl = registry.id.apply(_ => gcp.container.getRegistryRepository().then(reg => reg.repositoryUrl));
const imageName = registryUrl.apply(url =>
${url}/cloud-run-test-imagerich-alligator-53421
09/13/2023, 10:27 AM"dependencies": {
"@pulumi/docker": "^4.3.1",
"@pulumi/gcp": "^6.0.0",
"@pulumi/pulumi": "^3.0.0"
}
c
cuddly-computer-18851
09/13/2023, 10:35 AMIs that because locally you have a bunch of cached layers and remotely you're pulling / building everything?
r
rich-alligator-53421
09/13/2023, 10:35 AMYes, it could be. How can i cache it locally? while also uploading the image to remote gcr
c
cuddly-computer-18851
09/13/2023, 10:36 AMWell both node_modules and docker layers will cache automatically
r
rich-alligator-53421
09/13/2023, 10:36 AMwell, that shouldn't be a problem then? or am i missing something
c
cuddly-computer-18851
09/13/2023, 10:37 AMYou're saying its fast locally and slower when building remotely? Or which case are you trying to solve?
r
rich-alligator-53421
09/13/2023, 10:38 AMYes, so normal docker build command locally is fast as it supposed to be. however pulumi up is slow, "dockerindexImage cloud-run-test-image updated (595s) [diff: ~build]; 1 message". the message mentioned is about not specifying build platform
rich-alligator-53421
09/13/2023, 10:39 AMand the building image part of the update is the slowest. uploading seems to be fast.
c
cuddly-computer-18851
09/13/2023, 10:40 AMAre you running pulumi via a native install or from within a docker run command?
My guess is whatever context pulumi is building is is not re-using the docker layer cache
r
rich-alligator-53421
09/13/2023, 10:41 AMits a install in windows WSL2, natively there though.
c
cuddly-computer-18851
09/13/2023, 10:43 AMcan you try adding these to your Image() parameters?
``` args: {
"BUILDKIT_INLINE_CACHE": "1"
},
builderVersion: "BuilderBuildKit", // can also be set to `BuilderV1````
cuddly-computer-18851
09/13/2023, 10:45 AMand possibly
``` cacheFrom: {
images: ["docker.io/pulumibot/demo-image:cache-base"]
},```with
imagescuddly-computer-18851
09/13/2023, 10:45 AMr
rich-alligator-53421
09/13/2023, 10:46 AMSure, into the build json? like this:
const image = new docker.Image("cloud-run-test-image", {
build: {
context: "cloud-run-test/",
dockerfile: "cloud-run-test/Dockerfile",
args: {
"BUILDKIT_INLINE_CACHE": "1"
},
builderVersion: "BuilderBuildKit",
cacheFrom: {
images: ["docker.io/pulumibot/demo-image:cache-base"]
},
},
imageName,
}, { retainOnDelete: true });
export const endpoint = registryUrl
c
cuddly-computer-18851
09/13/2023, 10:48 AMyep - but set cacheFrom to your own
imageNamer
rich-alligator-53421
09/13/2023, 10:49 AMYes thanks 😄 , "docker.io/pulumibot/cloud-run-test-image:cache-base"?
c
cuddly-computer-18851
09/13/2023, 10:50 AM Copy code
const image = new docker.Image("cloud-run-test-image", {
build: {
context: "cloud-run-test/",
dockerfile: "cloud-run-test/Dockerfile",
args: {
"BUILDKIT_INLINE_CACHE": "1"
},
builderVersion: "BuilderBuildKit",
cacheFrom: {
images: [imageName]
},
},
imageName,
}, { retainOnDelete: true });r
rich-alligator-53421
09/13/2023, 11:00 AMright. the first build took only a minute, but updating it is still extremely slow. now at two minutes building and still going
c
cuddly-computer-18851
09/13/2023, 11:08 AMHmm maybe from the debug pulumi output you can see the full list of arguments its passing to docker and isolate why its not caching.
Also check you're not cross compiling arm64 <-> x86 or something.
Is your Dockerfile doing a multi-stage build or anything complex?
r
rich-alligator-53421
09/13/2023, 11:11 AMHow do i get the debug output?
Nope, the build is just a npm install and copies. I shouldn't be cross compiling, ill add the platform specification though
rich-alligator-53421
09/13/2023, 11:12 AMrich-alligator-53421
09/13/2023, 11:19 AMhere are the arguments, https://pastebin.com/gTGWVG7K
rich-alligator-53421
09/13/2023, 12:32 PMRight, so it takes around 3mins now to build. What I think is missing, is that it might be picking a older image to use as cache, which results in more missing layers and therefore longer build. is it possible for pulumi to tag latest or somehow figure the latest image to use?
2 Views