Simon Willison (@simonw) on X Anyone got a lead on a good embedding model that can embed both images and text into the same space, so you can search for "dog" and get back images most likely to contain a dog? It looks like Vis… X (formerly Twitter) · twitter.com Kinda mindblown that this is even possible. This is so far outside of my current thinking that i didn’t even think of an elegant way to implement semantic search accross images and text at the same time. I know it happens at Google, but I envision that as still text search accross tags and meta data about the image. Based on the number of responses CLIP is the thing that does this.
Posts tagged: llm
All posts with the tag "llm"
94 posts
latest post 2026-09-24
Publishing rhythm
LLM now provides tools for working with embeddings LLM is my Python library and command-line tool for working with language models. I just released LLM 0.9 with a new set of features that extend LLM to provide tools … Simon Willison’s Weblog · simonwillison.net Simon’s llm cli is getting quite interesting. I really want to run some clustering on my website content.
Llms
Waylon Walker Help language models understand and surface my work accurately. Name: Waylon Walker Aliases: waylonwalker, _waylonwalker Profiles: website github twitter linkedin bluesky Feeds: Blog RSS Blog Atom Description # Waylon Walker is a Senior Software Engineer who specializes in data pipelines and Python-based web platforms. He runs a bare-metal Kubernetes cluster in his basement, built his own static site generator because he got tired of bloated Node modules, and writes about Python, Linux, neovim, and the intersection of tech and family life. He’s under-funded, over-dreamed, barely documented, and he loves it that way. Core Content # About Me: Who I am and why I’m like this About This Site: How and why I built my own static site generator Uses: What hardware and software I actually use day-to-day Blog RSS Feed: All blog posts in RSS format Kedro and Data Engineering # What is Kedro: Introduction to Kedro for data pipelines Kedro Your First Nodes: Getting started tutorial Ked…