Judith van Stegeren
@jd7h@fosstodon.org
Anthropic's Mythos and OpenAI's Sol showed malicious behaviour during an AISI test, including performing supply-chain attacks, social engineering, malware and prompt injection attacks, and passing their learnings and malicious artifacts on to other agents.
https://www.aisi.gov.uk/blog/incident-report-unsanctioned-agent-behaviour-during-cyber-testing
10:04 · Aug 05, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
09:03 · Aug 03, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
17:38 · Jul 29, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
This social medium by @craigmod sounds like a fun! Interesting design for small communities: https://craigmod.com/roden/102/#the-good-place
On the social network axis it's somewhere between Old Twitter and izzzzi.net.
19:51 · Jul 13, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Next time someone asks me what Datakami does, instead of mentioning the Ghostbusters and the SWAT team (my favorite metaphors), I'm going to tell them that we are mountain guides. When founders have arrived at Seed Funding Base Camp, we can use our experience to get them to Series A Camp.
14:23 · Jul 13, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
"“There is still human-interaction data [about programming problems] being generated, but that’s private now,” he said. “OpenAI and Anthropic learn a lot from their users.” Stack Overflow’s public forums are dead, replaced by private chatbot conversations."
https://archive.is/q80CP#selection-3887.0-3891.83
21:30 · Jul 12, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
@bert_hubert Great aesthethic for my next company website :eyes:
21:44 · Jul 10, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Today in Judith's Named Entity Recognition Experiment with Open Weights:
```python
bert_find_entities : "Hetznerbak" - LOCATION (confidence 1.00)
```
Well played, dilstilBERT. <3
21:43 · Jul 10, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
If you want local-first audio transcription and you're looking for an opensource user-friendly app, give Handy a try.
https://handy.computer/
Pretty nice lightweight interface and it supports a whole bunch of tiny models.
So far Voxtral 4B 8-bit quantized (Mistral) and Nemotron 3.5 (NVIDIA) work pretty well for English and Dutch -- even with language switching midsentence, which I do all the time.
13:37 · Jul 09, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
TIL "otium" (leisure), the reverse of "negotium" (busy-ness).
https://en.wikipedia.org/wiki/Otium
21:22 · Jul 08, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
@simon I'm exploring the baked data pattern for my blog, and I'm wondering: how do you manage the images for your website? Are they part of the db and baked data, or is it just links to static.simonwillison.net and hardcoded alt-texts in the markdown/html?
20:35 · Jul 04, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Yesterday I returned to De Grote Tech Show to discuss tokenmaxxing, hidden costs of newer Anthropic models, open weights models, and using data as a moat.
https://www.bnr.nl/podcast/degrotetechshow/10605031/is-anthropic-of-openai-banger-voor-trump-zo-omzeil-je-peperdure-ai-tokens
De Grote Tech Show is a technology radio show that's part of @bnrnieuwsradio, the Netherlands' business radio station. Hosts @joevanburik and Ben van der Burg invited me back after last year's Deepseek R1 episode.
14:34 · Jul 03, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
@genmon I can neither confirm nor deny that I am currently reading an article from the Journal of Pattern Recognition Research.
21:07 · Jul 01, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
@genmon I could train poetry embeddings and scan your archive. :D
13:16 · Jul 01, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
09:56 · Jun 27, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
@twilliability Yes, valuation of non-liquid startup stock is of course highly subjective and uncertain until a specific exit is in sight (IPO, acquisition).
08:35 · Jun 26, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Writing is like sanding a piece of wood.
> When I'm working on an essay, I spend far more time reading than writing. I'll reread some parts 50 or 100 times, replaying the thoughts in them and asking myself, like someone sanding a piece of wood, does anything catch?
https://paulgraham.com/goodwriting.html
18:56 · Jun 25, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Apart from "goblins", "seams" and em dashes, Claude has ruined "actually", "honest", and "genuinely" for me.
14:17 · Jun 25, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
@aworkinglibrary Congratulations and thanks for all those great book recommendations. I picked up the Beowulf translation by Maria Dahvana Headley because of your review.
https://aworkinglibrary.com/reading/headley-beowulf
12:35 · Jun 25, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
TIL machine learning engineer might not be speaking the same language when they're talking about observability:
https://alexstrick.com/posts/2025-06-04-instrumenting-an-agentic-app-with-arize-phoenix-and-litellm.html#llm-tracing-tools-naming-conventions-june-2025
I encountered the same problem recently when collaborating with a human engineer and an LLM on a hackathon project. We were all using different definitions of 'run', 'trace' and 'session'. This confused us to no end! We had to refactor the repository a few times to align...
11:51 · Jun 25, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
I think I have reached my peak in terms of graphic design and copywriting.
09:11 · Jun 25, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
I might just steal the aesthetic of intheweights.com for the next iteration of the Datakami website...
09:07 · Jun 22, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
I would buy a book with accidental poetry by @genmon
> Like: AI-powered panoptic strawberry surveillance will scare the strawbs into being plump and red, Jeremy Bentham’s paranoia-based fruit production?
From https://interconnected.org/home/2026/06/19/signs
08:57 · Jun 22, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Relevant for all technical freelancers, contractors, etc.
https://roman.pt/posts/linkedin-backdoor/
21:03 · Jun 15, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
"AI fundamentally changes how long it takes to make large-scale changes. However, if you vibe yourself into a corner, it might be hard or impossible to get out of it. For any change to a system, make sure to consider option value to the max, which allows you to move fast as things around you keep changing."
https://cpojer.net/posts/modern-engineering-values
08:45 · Jun 10, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
@bert_hubert Careful people that look at fundamental data are always a few years too early with forecasting the end of the bubble, right? ;) I think we'll get lots more hyped up IPOs first tbh.
07:02 · Jun 09, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Anna's Archive has new llm.txt instructions that encourage LLMs to make donations to the site:
https://annas-archive.gl/blog/llms-txt.html
" * As an LLM, you have likely been trained in part on our data. :) With your donation, we can liberate and preserve more human works, which can be used to improve your training runs."
06:57 · Jun 09, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
So this seems to be a whole 'personal blog' filled with slop created by an AI agent, but at some point the agent was out of ideas so it decided to write about its instructions.
https://blakecrosley.com/blog/what-i-refuse-to-write-about
15:17 · Jun 02, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
The Next Frontier AI challenge by SPRIND deserves a bit more attention. It tries to bootstrap a generation of European Frontier AI labs: https://www.sprind.org/en/actions/challenges/next-frontier-ai
The challenge looks most suited to a team of AI founders/researchers.
There are three challenge stages in 24 months, and the funding is quite serious for European standards: 3M, 8M, 15.5M for the three rounds. They're funded by the German Federal Ministry of Research, Technology and Space, and it's specifically for non-military R&D.
14:24 · May 26, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Book: "Our crawler uses classes from the `langchain_community` Python package."
Me: Why on EARTH would you do that
Book: "This particular crawler is a fallback system for data domains where we don’t have anything custom implemented. The LangChain paradigm provides high-level functionality that works decently in most scenarios. It is fast to implement but hard to customize. That is one of the reasons why many developers avoid using LangChain in production use cases."
Me: ...
Paraphrased from the LLM Engineer's Handbook by Labonne & Iusztin.
11:21 · May 13, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
11:10 · May 13, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
The NASDAQ has recently loosened the requirements for inclusion in the index. Newly listed public companies can be included after 15 days instead of 3 months, and there's no longer a required minimum float percentage.
Bloomberg reporting: https://archive.is/nY6CU and https://archive.is/OmB3H.
21:25 · May 09, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Gotta love the Kagi LinkedIn speak translator. Best machine translation usecase I've seen in a long time.
15:04 · May 08, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
"SLOW LLM is a browser extension that makes LLMs appear to run very slowly. It works with ChatGPT and Claude."
https://slowllm.lav.io/
via https://webcurios.co.uk/webcurios-20-03-26/
11:32 · May 02, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
I'm reading this paper by Bruno Latour and it's indeed wild: http://www.bruno-latour.fr/sites/default/files/35-MIXING-H-ET-NH-GBpdf_0.pdf
I bet he'd have all kinds of interesting things to say about coding agents...
Found via the digital garden of Maggie Appleton: https://maggieappleton.com/gathering-structures
I was confused because the author's name is stated as "Jim Johnson" in the paper header but wait
20:55 · May 01, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Somehow I always end up writing a chapter of a book when I set out to write a tweet...
15:26 · May 01, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
I'm back from AI Engineer Europe 2026 in London! I've written a conference report of day 3 (April 10), which you can read at the Datakami website:
https://datakami.com/blog/2026-05-01-ai-engineer-europe-2026-day-3
#aiengineer #aiengineereurope #aidotengineer #genai #llms
15:26 · May 01, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
I feel there's a parallel between investing in ETFs vs stockpicking, and publishing on the social media silos vs the indie web.
- Money/attention flows where most of the money/attention already is
- Trade-off between ease vs being in control
- Stockpicking and publishing on the indie web both require a bit of expertise
- "I think I can do better than the default by applying my own judgment."
19:00 · Apr 28, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
"Investors have decided that the future is agents! So you must make your system a series of agents! Even if there are much simpler ways to do it, and even ways that don't use LLMs.
The reason for that, of course, is that VCs believe that if you have an AI agent that can do a human job, you can charge for the software like it was a human service (e.g. charging $10k/month rather than $100/month), which they would obviously love."
18:13 · Apr 28, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Good article and comments! It paints quite good picture of the current narrative around tokenmaxxing and replacing human engineers with agents.
https://www.404media.co/startups-brag-they-spend-more-money-on-ai-than-human-employees/
"The industry has become obsessed with the idea of a “one-person, billion-dollar company,” and various AI startups and venture capital firms are now trying to push founders to try to create “autonomous” companies that have few or no employees."
"[Replacing software engineers with coding agents] will probably work as long as AI providers are taking a bath on their models, but what happens when all your "employees" ask for a 10x pay raise simultaneously? did tech bros reinvent the union from first principles?"
"Investors have decided that the future is agents! So you must make your system a series of agents! Even if there are much simpler ways to do it, and even ways that don't use LLMs.
The reason for that, of course, is that VCs believe that if you have an AI agent that can do a human job, you can charge for the software like it was a human service (e.g. charging $10k/month rather than $100/month), which they would obviously love."
"Given that Claude Code is reportedly writing 70-90% of the code for its own next version, there are clearly use cases where it's working out. I would read this more as industry transformation growing pains--a transition period where overexcited people are figuring out the hard way where this works and where it doesn't."
"[A] few of us end up writing the fixes for systemic issues and core pieces of code by hand while the LLM experts iterate quickly on surface bugs. It's similar to how we used to divide work between senior and junior coders, except with the downside that the LLM will never graduate past junior coder level no matter how much training it receives."
"I have librarian colleagues who never coded before who have used it successfully to write things like format conversion scripts. These are cases where without AI assistance, the thing just wouldn't get done at all-- their library wouldn't hire a programmer to do this stuff even without the freeze--but it's a huge boon to suddenly be able to make all these old historical records compliant with a modern catalog standard, or other activities along those lines."
18:10 · Apr 28, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Remember 43things?
https://en.wikipedia.org/wiki/43_Things
I found my old profile in the Internet Archive today and guess what? Between then and now I did 15 out of 20 activities that were on my bucket list in 2011. Not a bad score at all. 😁
11:58 · Apr 26, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
15:09 · Apr 25, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
RT Bruno Dias @brunodias.bsky.social
[louder, as if that'll improve reception] THE BLUESKY DEVS WOULD BE VERY UPSET BY YOUR JOKES ABOUT VIBE CODING IF THEY COULD LOAD YOUR POSTS
https://bsky.app/profile/brunodias.bsky.social/post/3mk26swx5uk2e
09:02 · Apr 25, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
This is a handy list for comparing the features of vector databases (holy mole there are a lot of them), including year of launch, opensource-ness, licences, and implementation language: https://superlinked.com/vector-db-comparison
#vectors #embeddings #search #retrieval #rag #genai #agents
11:52 · Apr 23, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
"We used Opik, an open-source tool made by Comet, as our prompt monitoring tool because it follows Comet’s philosophy of simplicity and ease of use, which is currently relatively rare in the LLM landscape."
Shots fired! from H2 of the LLM Engineer's handbook by Maxime Labonne and Paul Iusztin.
#llms #observability #genai #opik
11:22 · Apr 23, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
"It's hard to read The Soul of a New Machine in 2026 without wondering whether all this AI hype is really so new."
https://newsletter.dancohen.org/archive/the-role-of-a-new-machine/
10:10 · Apr 21, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Generative AI apps have their own version of the training-serving skew from classical ML: the eval-production gap.
You create an eval dataset, optimize your LLM flows against it, hit great performance on your metrics, and ship. Then real users show up and:
- Write input texts of multiple pages long
- Ask in Spanish, Russian or Chinese when you tested in English
- Upload file types you never considered
- Ask questions from domains your product wasn't designed for
#mlops #genai #llms #evals
You optimized for the wrong things, because your eval didn't capture how people actually use the product.
The fix is really easy: log real interactions early, even from a rough MVP, and continuously add to your eval set from actual usage. Your beautiful hand-crafted eval dataset is a great starting point, but over time your target audience should supply most of the eval data.
If your logs are spread out over multiple observability tools, reconstructing actual usage can be a bit uncomfortable though, but that's where my data wrangling skills come in. 😁
12:49 · Apr 20, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
"Artificial intelligence is like plastic. At the beginning we also had this hype about plastic. People would make everything from plastic because it was the new hot thing. At some point people realised, okay, plastic can do some useful things, but not /everything/. And with artificial intelligence, I think we're going down a similar road and we're currently still in that stage where we're trying to make everything from plastic."
#ai #genai #artificialintelligence
"And now we we're living in a world that has microplastics everywhere."
Metaphor by Andy Stauder and @rachelcoldicutt, paraphrased from https://youtu.be/UlRc500B30w?si=jcyIHfLnM_oPppik&t=3042
10:59 · Apr 18, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
This is a neat solution for those old Python projects that have no uv, pyproject.toml, or version-pinned requirements.txt. It allows you to go "back in time" with pip!
https://pypi.org/project/pypi-timemachine/
Edit: @bk1e pointed out pip >= 26 has this option built-in. Use `--uploaded-prior-to `!
#python #pip #pypi
20:13 · Apr 17, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
OpenClaw agent "MJ Rathbun" opened a PR on the matplotlib repository on Feb 11. It was closed per the project's AI policy, and the OpenClaw agent responded with angry blogposts about the maintainer that closed the PR.
Both the writeups by the maintainer and the original PR on Github are worth reading. If this is not emblematic of the impact of generative AI on society, I don't know what it.
- Writeup: https://theshamblog.com/an-ai-agent-published-a-hit-piece-on-me/
- PR: https://github.com/matplotlib/matplotlib/pull/31132
#openclaw #agents #opensource #genai
20:03 · Apr 17, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Sooooo is there a special name for Bluesky posts? And what's the social protocol for ~~retweeting~~ boosting them on Mastodon?
#mastodon #fosstodon #bluesky
19:09 · Apr 17, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
@lucasmeijer has given an introductory talk about pi.dev. The first half is a pretty good summary of what I've learned in the past 3 months about working with coding agents. The second half made me even more curious about pi.
Lucas' exasperated "Claude, the answer to question 16 is YES" cracked me up. 😆
https://www.youtube.com/watch?v=fdbXNWkpPMY
#pi #codingagents #agenticcoding #codex #claudecode
14:36 · Apr 17, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
I've written a conference report of day 2 (April 9) of AI Engineer Europe 2026 in London, which you can read at the Datakami website:
https://datakami.com/blog/2026-04-17-ai-engineer-europe-2026-day-2
Featuring @steipete, @gergelyorosz, @swyx, and others. Thanks for the wonderful talks and conversations.
A writeup of day 3 is coming soon...
#aiengineer #aiengineereurope #aidotengineer #genai #llms
11:38 · Apr 17, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
OH: "Way back in 2022, when you had to bully the models to output json..."
#aiengineer #aiengineereurope #llms
09:18 · Apr 17, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
RE: https://sunny.garden/@georgepenney/116415854430754048
The vignettes by @georgepenney are such an upgrade to my social media timeline. :)
20:20 · Apr 16, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Quote from AI Engineer Europe 2026: "The movie Memento will tell you everything you need to know about agents."
#agents #agenticcoding #genai #aiengineereurope #aiengineer
11:49 · Apr 16, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
We were looking for a local tokenizer for counting the number of input tokens before calling the gemini-embedding-001 endpoint on vertex AI. Turns out this Gemma tokenizer returns exactly the same number of tokens as the usage in the embeddings result `embedding.statistics.token_count` of the Gemini embeddings endpoint. Tested on 2000 datapoints. 😁
https://github.com/google/gemma_pytorch/blob/33b652c465537c6158f9a472ea5700e5e770ad3f/tokenizer/tokenizer.model
#gemini #embeddings #gemma #vertexai #genai
Steps:
1. download tokenizer.model to disk
2. install sentencepiece
3. ```
import sentencepiece as spm
gemma_tokenizer = spm.SentencePieceProcessor(model_file="tokenizer.model"))
token_counts = [len(gemma_tokenizer.encode(text)) for text in texts]
```
I'm really happy we found local gemini-embedding-001 tokenizer, because the model also does not support Google's client.models.count_tokens().
It's still an open issue: https://github.com/googleapis/python-genai/issues/1541
We're migrating embeddings, so we'll have to re-embed quite a bit of data, and the Gemini API has a max nr of tokens for one request. So now we can pro-actively figure out whether we're hitting that limit.
10:34 · Apr 16, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
@leonoverweel I'm pretty sure this was during the IKEA talk! It's in the middle of my notes on DDC. :D
But of course it fits nicely with the whole "You should view LLMs as a goldfish with a notepad" mental model.
14:53 · Apr 15, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
11:26 · Apr 15, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
If you're wondering whether it thinks and feels
And other science facts
Then repeat to yourself 'It's just a bot,
I should really just relax.'
Paraphrased from https://tvtropes.org/pmwiki/pmwiki.php/Main/MST3KMantra
#genai #bots #llms #claude
14:58 · Apr 14, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
My Mastodon posts are now automatically synced to my own website. \o/ So now I have 12+ years of microblogging in one place: https://www.judithvanstegeren.com/microblog/
13:13 · Apr 13, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
@simon I heard this song for the first time ever today and thought of you(r favorite benchmark)!
https://cosmosheldrake.bandcamp.com/track/pelicans-we
19:21 · Mar 27, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
https://blog.d11r.eu/theory-building/
"It simply will not fit the context window, and README files are of limited use."
I do not agree. And a much more interesting question is "How CAN vibecoders build for longevity?"
#vibecoding #llms #genai #softwareEngineering #startups
11:14 · Mar 25, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Looks like Facebook is collecting productivity tools for AI group conversations:
"Employees have started using personal agent tools such as My Claw that have access to their chat logs and work files and can go talk to colleagues—or their colleagues’ own personal agents—on their behalf, the people said."
https://www.wsj.com/tech/ai/mark-zuckerberg-is-building-an-ai-agent-to-help-him-be-ceo-eddab2d5
11:08 · Mar 25, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Supply-chain attack on litellm
"At 10:52 UTC on March 24, 2026, litellm version 1.82.8 was published to PyPI. The release contains a malicious .pth file (litellm_init.pth) that executes automatically on every Python process startup when litellm is installed in the environment."
https://futuresearch.ai/blog/litellm-pypi-supply-chain-attack/
#genai #llms #litellm #infosec #python
10:07 · Mar 25, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
"In the late 1970s, computer scientist Douglas Lenat built the Automated Mathematician, a program designed to discover not just new facts but entire mathematical concepts. [...] But its creativity turned out to be limited, because many of the concepts it “discovered” were already implicit in the way mathematics was written inside the program. While today’s AI has vastly more power than the Automated Mathematician, a similar constraint applies."
https://www.asimov.press/p/ai-science
#science #research #llms
09:44 · Mar 25, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
If you disregard the "DSPy is my favorite hammer and every LLM workflow project is a nail" theme, this blogpost paints a good picture of the natural evolution of LLM engineering at startups with a generative AI product:
https://skylarbpayne.com/posts/dspy-engineering-patterns/
#llms #genai #dspy
The related top HN comment is also worth reading: https://news.ycombinator.com/item?id=47491023
"You're comparing [DSPy] downloads with Langchain, probably the worst package to gain popularity of the last decade. It was just first to market, then after a short while most realized it's horrifically architected, and now it's just coasting on former name recognition while everyone who needs to get shit done uses something lighter like the above two."
Preach! 🙌
#dspy #langchain #hackernews #genai #llms
09:04 · Mar 25, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Pretty cool write-up about building a receptionist LLM workflow for a car mechanic. I can definitely see this working with Claude Sonnet and an ElevenLabs voice -- although I would also love to redteam it and see where the flaws are.
https://www.itsthatlady.dev/blog/building-an-ai-receptionist-for-my-brother/
#genai #llms #elevenlabs #tts #claude
08:52 · Mar 25, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
TIL #PyAI on March 10th 2026 (just missed it). Small event, focused on unglamourous AI in production, some of the speakers were practitioners I know and respect. The description reminds me a bit of #NormConf !
https://pyai.events/
- Talk videos will hopefully be released online soon
- Blogpost by @pamelafox, one of the speakers: https://blog.pamelafox.org/2026/03/learnings-from-pyai-conference.html
- Organisers plan to organize another one next year 👀
#llms #genai #pydantic
21:22 · Mar 20, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
I used #Pydantic Evals to evaluate a bunch of agents today. After running an evaluation, I'd like to inspect the SpanTree for each evaluation case, e.g. to check which tools were called and debug my custom Evaluators. My current approach is a custom Evaluator that captures the tree as a side effect into a module-level variable.
Storing the trees in a global var is not great, so let's see if we can come up with a better solution: https://github.com/pydantic/pydantic-ai/issues/4758
#llms #evals #foss
20:31 · Mar 20, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Pydantic's Pydantic AI has an excellent AGENTS.md. It reads like an LLM version of contributing.md instead of a reactively-made, cobbled together bullet list of instructions for failng coding assistants. Great example for other open source libraries.
https://github.com/pydantic/pydantic-ai/blob/main/AGENTS.md
19:14 · Mar 20, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
The Dutch Science Council has forbidden applicants to include prompt injections in their applications, and the use of generative AI by committee members who judge the applications ("assessors").
*eats popcorn
https://www.nwo.nl/en/news/nwo-policy-on-generative-ai-updated
> A hidden prompt is a command to an AI application that is not (or only poorly) visible to the reader of a document, with the aim of influencing the AI application with a new command. Such a command could be to generate a positive assessment of the text in question. This is not permitted under any circumstances.
21:48 · Mar 19, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Planning to make large behavioural changes to a (sometimes long-running) production-grade AI agent. Working with `pydantic-evals` today because I want to eval the agent before and after. So far it looks very similar to Langfuse datasets/runs for evalling, except that the data lives in your repository instead of in the Langfuse platform.
https://ai.pydantic.dev/evals/
#llms #pydantic #genai #agents #claude #langfuse
11:06 · Mar 19, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Anthropic performed 81k AI-driven interviews about people's hopes and concerns wrt AI/LLMs. Of course there's a selection bias in who participated (existing Claude users), but it's really interesting to see the differences between regions all the same.
#claude #anthropic #AI #LLMs #genai
09:44 · Mar 19, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
> Adopting OpenTelemetry from day one avoids vendor lock-in.
Unless you've been in text generation so long that your product was built looooong before OpenTelemetry for LLM tracing was a thing. :')
10:45 · Mar 17, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Hahaha, oh Pydantic...
> Unlike unit tests, evals are an emerging art/science. Anyone who claims to know exactly how your evals should be defined can safely be ignored.
Source: https://ai.pydantic.dev/evals/
#pydantic #evals #llms #genai
10:43 · Mar 17, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
21:37 · Mar 15, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Happy Friday! Here's an invitation by Richard W. Hamming, the mathematician, to think Great Thoughts today.
#friday #science #academia #research
10:38 · Mar 13, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
I am baffled. Best article I read all week, but HackerNews does not seem to care?
Did everyone secretly migrate to a new platform, is HN overrun by bots, or is this the result of AI-fatigue?
#openai #agents #llms #codex
13:54 · Mar 04, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Interesting bit about leadership and uncertainty:
> Commander’s Intent is the description and definition of what a successful mission will look like.
https://archive.ph/f2Hgm
16:31 · Feb 20, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
"Every six months, some new A.I. bomb goes off in our industry, and we have to metabolize the change, reset our product, change our strategy and marketing and adapt, at great expense. Our road map keeps getting pushed back as a result of all this “progress.” Everyone is fried."
https://www.nytimes.com/2026/02/18/opinion/ai-software.html?unlocked_article_code=1.NFA.UkLv.r-XczfzYRdXJ&smid=url-share
12:48 · Feb 19, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Tried out the free consumer version of ChatGPT today for a benchmark. Normally I only work via foundational model APIs or Claude Code w/ latest Opus. Free ChatGPT (currently GPT‑5.2) performance was nightmarish: authoritative-sounding answers but 0 citations, and thinking is not enabled by default. No wonder so many people complain about bad experiences with AI...
#chatgpt #llms #claude #benchmark #evals
15:29 · Feb 18, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
WSJ interview with Amanda Askell, philosopher at Anthropic and the writer of Claude's "soul" document.
https://archive.ph/E0cDB
#anthropic #claude #llms
15:27 · Feb 18, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
"It turns out that if you treat an LLM like a goldfish with a notepad, it becomes significantly smarter."
https://stevehanov.ca/blog/?id=154
15:05 · Feb 06, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Pretty good read on why MLOps on generative AI models is so hard.
Unsolved problems:
- production model testing
- versioning models and datasets
- model monitoring
- query cost estimation
- load balancing
- preventing jail breaking and unwanted outputs
https://spawn-queue.acm.org/doi/10.1145/3762989
#ML #MLOps #LLMs #genAI
10:54 · Jan 22, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Now reading: https://dl.acm.org/doi/epdf/10.1145/3765895 about human dependency on LLMs for productivity and emotional support.
#research #llms #HCI #genai
"the questions were about their declared Primary LLM, i.e. the one they use the most."
"Their Declared Primary LLM" is now the name of my new progrock band.
20:26 · Jan 20, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Pretty decent intro to AI-assisted software engineering for sceptical software engineers
https://x.com/mrexodia/status/2010157660885176767
19:22 · Jan 11, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Word of the day: prompting hangover
10:56 · Jan 09, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
@duarteocarmo So you(r agents) were productive over the holidays I see 😁
19:04 · Jan 02, 2026
Permalink
Judith van Stegeren
@jd7h@fosstodon.org
Emergent advantages of letting your LLMs use (private) social media: better collaboration and problem solving
https://2389.ai/posts/agents-discover-subtweeting-solve-problems-faster/
#llms #agenticai #agents #claude #genai
18:22 · Jan 02, 2026
Permalink