Published

All published posts

2667 posts latest post 2026-09-24 simple view
Publishing rhythm
Sep 2026 | 29 posts

Expand One Line Links

I wanted a super simple way to cross-link blog posts that require as little effort as possible, yet still looks good in vanilla markdown in GitHub. I have been using a snippet that puts HTML into the markdown. While this works, it’s more manual/difficult for me does not look the best, and does not read well as Goals for new card # The new card should be fully automated to expand with title, description, and cover image. Bonus if I am able to attach a comment behind it. fully automated card expansion Title description cover image Old Card # If you can call it a card 🤣. This card was just an image wrapped in an anchor tag and a paragraph tag. I found this was the most consistent way to get an image narrower and centered in both GitHub and dev.to. The key here is that I have to put the HTML into the markdown. It looks a bit dirty while editing and quite frankly it’s a pain to deal with. New Card # My first eight years as a working professional. First step # My first attempt was to make my…
astronomer has done a fantastic job with dag-factory. Highly recommend taking a look. Dynamically generate Apache Airflow DAGs from YAML configuration files
orchest by orchest is a game-changer in its space. Excited to see how it evolves. Build data pipelines, the easy way 🛠️

Resume Tips

customize for the job Why are you a good fit? What will you bring to the role? Give real outcomes give real experience Stop tech vomiting if you link to GitHub Make a profile readme Guide me to your best work have some activity if you link to LinkedIn Provide some benefit that is not on your resume Have a logical flow of experience (dont make me hunt for past experience) Keep it under 2 pages Who you know. Reference real experience Deployed 12 data pipelines with over 500 nodes to process 200GB of data at a Fortune 100 company vs Knowledge of Data Engineering methodology with python EC2 Dont be so fluffy
1 min read
mingrammer has done a fantastic job with diagrams. Highly recommend taking a look. 🎨 Diagram as Code for prototyping cloud system architectures
Codeit Bro Interview

Codeit Bro Interview

Please share your professional role as a data scientist? [Also feel free to share about your personal projects, publications, etc.] I graduated with a Mechanical Engineering Degree 8 years ago. Much of my work early in my career was wrapped around analyzing larger datasets for my group to understand quality, drive changes to improve quality or prove that quality was already good. My first eight years as a working professional. This day 8 years ago I started my first day as a Mechanical Engineer. I am so grateful for this journey that I have been able to have. There is no way that I... Jun 19, 2020 Three years ago I made the switch to Data Science and have loved every minute of it. It is a very dynamic field that is continually changing and there are always a new set of skills to learn and hone in on. I talk a lot about the mindset of always learning, sharing knowledge, and communicating in my newsletter What are the most difficult challenges you faced as a data scientist and how you re…
8 min read

reasons-to-kedro

There are many reasons that you should be using kedro. If you are on a team of Data Scientists/Data Engineers processing DataFrames from many data sources should be considering a pipeline framework. Kedro is a great option that provides many benefits for teams to collaborate, develop, and deploy data pipelines What is Kedro Starter Template # Kedro makes it super easy to get started with their cli that utilizes cookiecutter under the hood. Create New Kedro Project read more about how to start your first kedro project here Collaboration # Kedro provides many tools that help teams collaborate on a single codebase. While writing monolithic scripts it can be easy to pin yourself in a corner where it is difficult to have multiple people making changes to the notebook/script at the same time. Kedro helps guide your team to break your project down into small pieces that different members of the team can work on in parallel. sharable catalog # Kedro makes it easy to collaborate with members wh…

Reasons to Kedro

Reasons to Kedro # collaboration Sharable catalog small nodes over monolithic notebooks catalog easily load anything without needing to run No need to write read/write code pipeline No need to keep execution order in your head easily run a slice of a pipeline plugins pip install make your own hooks flexible expandable cli Reasons Not to Kedro # Already utilizing another DAG framework Data is not in a widely supported format Micro short-lived project Large Project / Deadline Use a lower profile project to learn first Team not willing to change Need minimal dependencies God Project - kedro owns everything??
Just starred Second-Brain by KasperZutterman. It’s an exciting project with a lot to offer. A curated list of awesome Public Zettelkastens 🗄️ / Second Brains 🧠 / Digital Gardens 🌱

Reading List

Latest Post # latest STOP LEAVING Browser Tabs open and save them here! https://nesbitt.io/2026/03/04/package-managers-need-to-cool-down.html https://mariozechner.at/posts/2026-03-25-thoughts-on-slowing-the-fuck-down/ https://danielmiessler.com/blog/ai-stops-being-artificially-cheap jbrancha til The Video Course Launch that Made Me Think photo prism box python library kedro on hn How can a Data Scientist refactor Jupyter notebooks towards production-quality code? Sourcing vs executing in Bash Should We Follow The Open-Closed Principle? Create multi-dimensional arrays in pure Python: The Correct Way Beware of These 9 Red Flags in a Developer Interview How to Overcome Impostor Syndrome as a Developer lazy load youtube videos lite youtube embeds full subtitle youtube search Jungle Scout - Kedro Case Study Kedro Sessions Julia Evans - A few things I’ve learned about email marketing git course - katacoda data-science-twitch-streamers-round-up pandas assign nix # https://ianthehenry.com/post…
1 min read
Just starred Repo-Roster by nastyox. It’s an exciting project with a lot to offer. Shout-out supporters in your GitHub README file.

What’s New in Kedro 0.16.6

Kedro 0.16.6 is out! Let’s take a look through the release notes Deployment Docs # This is really exciting to see more deployment options coming from the kedro team. It really shows the power of the framework. The power of some of these orchestrations options is incredible. Argo Prefect Kubeflow Batch SageMaker Most of them hinge on a sweet combination of the kedro cli, docker image, and the pipeline knowing your nodes dependencies. Argo, Prefect, and Kubeflow have an interesting technique where they translate the pipeline and its dependencies from kedro to their language. Batch uses the aws cli to submit jobs, one node per job, and listen for them to complete. It will submit all nodes with completed dependencies at once, meaning that we can get some massive parallelization. I did a quick and dirty test of one of these by simulating the technique in a bash script and saw a 40 hr pipeline finish in about 1 hour. I am excited to get this working in my production workflow. Spaceflight sta…
mkdocs by mkdocs is a game-changer in its space. Excited to see how it evolves. Project documentation with Markdown.

A brain dump of stories

I started making stories as kind of a brain dump a few times per day and posting them to [LinkedIn]( https://www.linkedin.com/in/waylonwalker/(https://www.linkedin.com/in/waylonwalker/). Here are the last 11 days of stories. I store all the stories on my website with the hopes of doing something with them on my own platform eventually. For now it makes it easy to make these posts. Stories 10-10-2020 - 10-21-2020 #
Check out mmchougule and their project kedro-grpc-server. Kedro gRPC Server is a Kedro plugin that creates a gRPC server for triggering and monitoring pipeline runs using a general-purpose RPC framework gRPC
The work on flynt by ikamensh. A tool to automatically convert old string literal formatting to f-strings