https://garden.io logo
#🌱|help-and-getting-started
Action for building non-container artifacts in K8s cluster
# 🌱|help-and-getting-started
o

orange-ability-1812

08/12/2023, 9:20 PM
I'm kind of using Garden as a replacement for manually scripting builds in either CI/CD scripts (i.e. Gitlab yaml) or in my Dockerfiles. I like being able to run the same thing locally and in CI as it makes the whole cycle much faster; and I like writing the script outside of the Dockerfile since its much easier to debug failing builds when its outside of the Dockerfile and I have to deal less with injecting tokens/keys etc. which is a PITA with docker (and different if you use
docker build
locally, and kaniko remotely). My goal is that I want an action to download/clone another repo, run (in effect)
make build
, and then have the outputs be available to other build tasks in my garden graph. I've run into a couple dead-ends so far though: 1. I tried just using "Build exec", which works if you don't sandbox anything which would be the more desirable way of working. Furthermore, this is not not ideal for running in CI and doesn't work in most cases. First, my CI runner is using the
gardendev/garden-gcloud
image which is good for running garden, but not so much for my own toolchain and may actually be incompatible (for instance this image is on alpine). I could make my own image but then it would be a weird hybrid and hard to maintain. Without that concern it would be better just to run exactly the same build container locally and in CI. 2. So I tried running the builds inside of a Pod in the cluster (whether that is local minikube or remote GKE). The problem here is that there is no Build type for running in an exec-like command in a pod (like
kubernertes-pod
for the Run action type). Using Run kubernetes-pod works, but the semantics around passing data between actions is only really set up for Build action types. I can output an artifact but AFAIK there is no good way to get this into the Build container workspace. So I think my feature request would be Build types for kubernetes-pod and kubernetes-exec. Would this be a difficult thing to add?
q

quaint-dress-831

08/14/2023, 2:02 PM
Hey @orange-ability-1812 I have a whole bunch of questions for you so bear with me: 1. Reading your first paragraph I'm thinking he's talking about Workflows! But I checked and you're already aware of their existence. You go on to mention a few things that might not be a fit for them but for what it's worth we do support using outputs from previous steps just in case you weren't already aware. If so, where do they fall apart for you? https://docs.garden.io/using-garden/workflows#step-outputs 2. I wonder why we don't publish buster builds for the cloud providers like we do for the standard
garden
image? I will ask for @big-spring-14945's help here since he's the genius behind those.
3. For your point 2, I would just open the feature request so we can get a discussion going with our devs on the feasibility. If you opened a feature request, could you please let me know when it's up so I can raise it in our weekly meetings?
o

orange-ability-1812

08/14/2023, 3:00 PM
> we do support using outputs from previous steps just in case you weren't already aware. If so, where do they fall apart for you?
q

quaint-dress-831

08/14/2023, 3:54 PM
@orange-ability-1812 only the quote part came through for me
o

orange-ability-1812

08/14/2023, 5:44 PM
Ya sorry got involved in something trying to edit 😛 I will respond
Edited. And yes I will make a feature request. As for point 2. I agree that would be a workaround and having more OS options would be nice, ultimately for the reasons I said above I'm fine with that image being minimal since I want things to be reproducible locally and in CI its easier to just have those dependencies wrapped up in the K8s manifests/containers rather than the OS actually running garden, beyond simple stuff like echoing debug info.
q

quaint-dress-831

08/15/2023, 11:28 AM
Great! Let's start with the feature request. I will make a feature request for the Buster-flavored distros if you want to submit one for the Build action 🙂 Steffen is on vacation until Monday so we'll need to sit tight on a response until then
o

orange-ability-1812

08/16/2023, 4:56 PM
As noted in the issue I have a fine workaround so not urgent.