LLM Pattycakes
LLM Pattycakes
Throughout development of this experimental prototype, I have encountered annoying LLM behaviors that derail the experience. There are many of these, but the one that most drives me up the wall is basically verbal "pattycakes".
Here’s a real example:
Kathryn says: "Chudwick, it's been a long day for both of us, hasn't it?"
Chudwick says: "It's been a grind, that's for sure. How about we grab a bite and unwind a bit?"
Kathryn says: "That sounds like a great idea, Chudwick. Let's grab our food and find a quiet corner to catch up."
Chudwick says: "Let's grab our food and find that quiet corner then. I'm looking forward to catching up."
Kathryn says: "Great, let's grab our food and find a quiet corner to catch up."
Chudwick says: "Alright, let's get some food and find that quiet corner. I could use a good chat."
Round and round they go, never actually doing anything. This is just passing the buck back and forth with no awareness, no escalation. Essentially LLM Pattycakes is a logarithmic edging: skating infinitely towards something actually happening, but refuting any notions of ever being the one to act, or pretend to act, or end the scene. Meanwhile it puts everyone to sleep while slurping down API credits like stolen jello shots.
The good news is, LLMs can also detect this. Enter the Pattycakes Sentry — coming back in the next build!
When Pattycakes is detected, the response is rerolled with custom instructions written by the Sentry to move the scene forward.
Evan Long: "Hey, I'm Evan, new here."
Bork: "Bork is Bork, Security. What brings you to Craptraption 2, Evan?"
Evan Long: "I'm looking for a place where I can be useful, and maybe make some friends along the way.
Bork: "Bork need eat, then Bork show you around ship, Evan, help you be useful."
Evan Long: "Sounds good, Bork, lead the way after you've eaten."
Bork: "Bork eat now, then show you ship, Evan, make sure you be useful, not trouble."
!!!PATTYCAKES DETECTED!!!
SENTRY: Bork should pick up a rock from the food dispenser, loudly crunch on it, and then say something about how Human food is weird, but she'll try some anyway. This establishes character and moves the scene forward without just endless promises.
Bork: "Bork hungry, need silicates, crunch on rock now, hmm, Human food weird, but Bork try.”
Evan Long: "So, what kind of rock is your favorite?”
And just like that, we’ve moved on from the loop.
Why does this happen?
It’s like actors on stage with no props, blocking or imagination. If they’re hungry but there’s no real food object, they end up just talking about it in circles. Thus they get stuck waiting for a non-existent food prop to show up and guide them out of this.
A more advanced solution to this specific example might be to inject mundane details into their memories like “Crunch, crunch! Bork ate rocks.” and tie it with a food need satisfaction. However, there are too many ways these space yahoos can get in a loop to plug them all.
So for now, the Pattycakes Sentry is a helpful feature to keep things moving.
Leave a comment
Log in with itch.io to leave a comment.