I’m trying to learn proper logs, monitoring, otel, and grafana. Today I
imported a bunch of pre-made k8s dashboards and made a few of my own for
specific apps, and it made me want to know how I can turn my own custom
dashboards into infrastructure as code. Turns out grafana makes it pretty easy
to do this, if you have the grafana dashboard sidecar running. It will pick up
any ConfigMap with the grafana_dashboard label and import it.
Go to Dashboards -> Pick a Dashboard -> Export -> JSON.
Today I’m upgrading my distrobox, but don’t want to end up in a situation where I can’t get anything done becauase I work out of my distrobox. Terminal bash
Diun Receive notifications when a Docker image is updated on a Docker registry crazymax.dev Diun, looks like a very interesting tool to monitor for image updates, it does not make any change, it only makes notifications. This feels like an easy start to getting image updates started with low effort, keep git ops, but requires manual updates. I see this as a tool that would be a great start and pair well with automated image updaters to ensure they are working as expected.
Keel Kubernetes Operator to automate Helm, DaemonSet, StatefulSet & Deployment updates keel.sh Keel looks interesting, I might give it a try as a simple image updater. I’m unsure if it fits my gitops patterns though. I like to keep everything defined in git, I don’t like drift outside of that so Keel might not be the thing I want.
I’m setting up longhorn in my homelab, and I ran into an issue where I initially setup some pvcs under longhorn, and later realized that to get longhorn to snapshot and backup I needed to hand edit volumes after the fact or change storage class. I’m all in on gitops so option 1 was not an option. So changing storageclass it is. Now the issue is that you CANNOT mutate storageclass on a provisioned pvc, it is an immutable attribute. Migration Job This migration job will create a new pvc with the new storageclass and move the data from the old pvc to the new pvc. Existing Pods This migration job will not work if you have a pod using the old pvc. You will need to shutdown the pod and delete it. yaml Apply the manifests and wait for the job to complete. Terminal bash Cleanup I had chatgpt create me a script to help me find what is using the pvc so that it can be deleted. Terminal bash I had still had cronjob pods completed, so I had to delete them first. Terminal bash Terminal bash
AI workloads on Talos Linux Companies are exploring how to run GPU accelerated workloads on Kubernetes. Sidero Labs · siderolabs.com cool article for setting up talos linux with an nvidia gpu. What a wild world it we are living in where these devices that started out being only for hardcore gamers are becoming commonplace in servers and slowly entering the homelab space.
Kelsey says several times in this interview, you don’t need kubernetes. If you are running one node you don’t need kubernetes. My question though is, would you use kubernetes? Ya I get it if you are a web developer, data scientist, backend dev, but if you are looking to bee a whole ass engineer, or infrastructure engineer, you know kubernetes, Should you use kubernetes on single node?
poolers.postgresql.cnpg.io CRD metadata.annotations Too long · Issue #325 · cloudnative-pg/charts Unable to deploy helm chart using ArgoCD. Getting following error Failed sync attempt to: one or more objects failed to apply, reason: CustomResourceDefinition.apiextensions.k8s.io "poolers.postgr... GitHub · github.com I’ve never seen or needed to use a serversideapply in kubernetes before, but I ran into this same issue in my k3s homelab while installing cloudnative-pg. You can do it with argo yaml and you can do it with kubectl Terminal bash
I recently noticed that my og images were missing emoji. They were taken using
headless chrome in a container. I fixed it by adding an emoji font in the
containerfile / dockerfile.
dockerfile
RUN apt-get update && apt-get install -y \
# Add fonts with emoji support fonts-noto-color-emoji \
&& rm -rf /var/lib/apt/lists/*
Keycloak Keycloak - the open source identity and access management solution. Add single-sign-on and authentication to applications and secure services with minimum effort. Keycloak · keycloak.org Keycloak looks like an interesting way to setup sso. It’s part of the cncf so it’s got a good backing. I want something better for argo workflows and this might be it. I’m curious what else I can tie into it.
Today I learned that the docs in postiz are a bit behind, (fantastic docs btw,
they are to the point, and cover almost all of what you need). The docs state
that you need to include an R2 bucket to handle uploads.
This issue shows that
more work has been done, one of which is local storage. The compose
file they use in the
quick start has the required env variables to set this up.
GitHub - ngalaiko/tree-sitter-go-template: Golang template grammar for tree-sitter Golang template grammar for tree-sitter. Contribute to ngalaiko/tree-sitter-go-template development by creating an account on GitHub. GitHub · github.com This setup fixed my nvim syntax highlighting in helm templates.
I’m running a two node k3s cluster at home, I thought I could simply mount an nfs share on each worker node, and essentially have the same storage accross all nodes. I’m already learning why this is not reccommended. Slow I’ve been running some cronjobs and argo workflows on the second node for awhile, these are things that run in the background and I don’t care if they take a bit longer to keep my master node freed up for more critical work. I just started trying to build this site in a cronjob, It was taking 20 minutes to build, and something I noticed was that markata was taking minutes to run glob ( search for files), normally this happens in a few ms and I never notice this step. Permissions I have seen where you can get diffent permissions on the nfs share based on user id. Since I’m homelabbing here I only have one user per machine. As you step into enterprise level VMs with tighter controls and dozens of users for all the different services that might run on it. I’ve ran into m…
Depot Status Latest service status for Depot Depot Status · status.depot.dev Depot’s uptime seems to be great. I definitely hit some issues with it this afternoon 12/24/24 that were not reported. I wonder if my issues were with the fly integration. Maybe fly ran out of credits to depot or something.
Deploy to Fly using a Depot builder Using Fly.io's new Depot builder, we'll walk you through how to deploy a TypeScript service globally with speed. Depot · depot.dev Here the integration to depot appears to be opt in using the flag on. This must have changed over time though because today it was giving me issues and I had to opt out using. Looks like a great service and I just learned about them on their bad day.
Depot | Software Delivery built for machine scale Depot provides fast source control, builds, CI runners, sandboxes, caches, and registries to ship reliable software at machine scale. Depot · depot.dev Just learned about depot today ironically because it seems to be down and fly is using them under the hood to do the container builds, seems like a really great service for fast builds accross your team.
docker context (and an issue to question your sanity) docker contexts are great, would recommend putting them in your prompt though (via starship or something else)... here's why My mental data-lake · pype.dev Dang context can really cause you to pull your hair out. Context seems so freaking convenient, but I’ve avoided it and just ssh in for these reasons. Maybe I’ll come around eventually but for now ssh is my friend.
Add a healthcheck to your FastAPI app I'm building a few FastAPI apps to throw in docker and run on my homelab... I wanted to add healthchecks and here's a simple way to do it My mental data-lake · pype.dev Nice example of adding a healthcheck to fastapi, and integrating it with docker. Don’t forget to include curl in the install, nice touch.
@changelog) on X — 🗣️@dhh on Kubernetes' migration pitch: “Oh, we’re on Amazon? Flip the switch, George! Let’s move over to GCP.” Vs reality: "Flip the switch, George! We’ll start having the meetings about the meetings about how we can move out four years from now."" loading=“lazy”> Changelog ( @changelog) on X 🗣️@dhh on Kubernetes' migration pitch: “Oh, we’re on Amazon? Flip the switch, George! Let’s move over to GCP.” Vs reality: "Flip the switch, George! We’ll start having the meetin… X (formerly Twitter) · x.com switching cloud providers, theres no easy way. K8s was supposed to get us there, haha, the deep integrations with each vendor just keep locking us in
This is a really amazing documentary of argocd. I got into k8s pretty late in the game. Which is pretty typical for me. As I went to use k8s for the first time i was using workflows, then cd. both of these tools had a level of polish that made them seem like they had been there forever and not quite as young as they actually are. I thought it was interesting how they focused on how the name must be two syllables or less, start with a or b, logo needs to be cutesy funny and recognizable seemed interesting, but puts them at the top of lists and makes them look like they’ve been there forever.