Not Every Nail Needs a Non-Deterministic Hammer

Most of the world we live in feels deterministic. Press a button on the lift, and you expect it to stop at the right floor. Check your bank balance, and it matches down to the last paisa. Even the software we write often gives us a sense of repeatability, though the truth is less comforting. Ask anyone who has tried to get perfectly reproducible builds and they will tell you: unless you enforce strict conditions, builds are not reproducible most of the time. This is less about some mystical property of code and more about the current state of tooling and practice. Predictability feels like the default. But it isn’t.

Underneath the surface, everything is probabilistic. Atoms jiggle, weather patterns evolve, cosmic rays flip bits. Determinism is not a natural state – it is a carefully manufactured illusion. We build redundancy, consensus, and error correction to give ourselves the comfort of order. Determinism is what lets planes fly and bridges stand. It is what makes society function without all of us collapsing into existential dread.

From a philosophical angle, this is not far from what the second law of thermodynamics tells us: entropy, or disorder, always increases. I am using entropy here as a loose frame of reference, not a precise physics definition. If entropy is chaos, then order is the fragile exception we carve out against the tide of nature. Heroes in stories often strive to preserve order, while villains are agents of chaos. Yet if chaos is the natural flow, then the roles blur. Are heroes fighting nature itself? And are disruptors sometimes just accelerating what would happen anyway? (I reflected more on this in a short note here.)

Determinism is not the natural order, it is the illusion we laboriously construct to keep chaos at bay.

Yet non-determinism is not the villain of this story. Without it, we would have no evolution, no creativity, no discovery. Life itself is one giant probabilistic experiment that happened to work out. Music improvisation thrives on it, so does art, and even scientific discovery often stumbles forward through serendipity.

If anything, our struggle is one of balance. Humans crave the stability of the predictable, but history shows that progress often comes from chance, accident, or surprise. Penicillin was discovered because of mold on a plate, not because of a well-planned experiment. The same random noise that drives mutation in biology fuels the diversity of ideas in human culture. Without randomness, we would have safety but no spark. Without order, we would have sparks but no fire to control.

The problem is not non-determinism itself but where we choose to let it in. Randomness in a jazz performance is delightful. Randomness in open-heart surgery is terrifying. Which brings us back to the hammer: once you learn how to swing it, you are tempted to see nails everywhere. But not every problem is a nail, and not every nail needs a non-deterministic hammer.

The question is never “which is better?” It is always “where does it belong?”

---

When Non-Determinism is Valuable

• Exploration: Optimization algorithms, evolutionary biology, fuzz testing. Randomness helps escape local traps.
• Resilience: Chaos engineering injects failure at random to prepare systems for the unknown. Netflix’s Chaos Monkey is the classic example: it randomly shuts down production servers to force engineers to design for resilience rather than luck.
• Security & Privacy: Nonces, salts, address randomization, and noise injection keep deterministic systems safer.
• Art & Creativity: Procedural worlds, improvisational music, generative art – all thrive on the unexpected.
• Simulation of complex systems: Weather models, financial markets, or epidemiological spread need non-determinism to approximate reality. Monte Carlo methods, which rely on repeated random sampling, are indispensable in finance and risk modeling because determinism alone cannot capture the richness of uncertainty.

Determinism builds trust. Non-determinism builds discovery.

---

When Non-Determinism is Wasteful

• Critical infrastructure: A ventilator or airplane cannot decide to “experiment” today.
• Auditable systems: Regulators don’t like surprises in your bank account.
• Basic plumbing: A database that returns different answers for the same query is not creative, it’s broken.
• Excessive randomness in design: Adding noise just for the sake of it creates confusion, not resilience.

If all you have is dice, the world looks like a casino.

---

A Contemporary Example

Large Language Models are just one modern embodiment of non-determinism. The same prompt might yield slightly different answers each time. To someone raised on deterministic software, this feels odd. Computers were supposed to be machines of certainty, not improvisers. Yet here we are, typing the same input and watching the machine offer alternate phrasings, examples, or directions.

This behavior makes sense once you see them as tools for exploration rather than execution. In areas like brainstorming, research, or creative writing, the unpredictability is an advantage. It breaks you out of local traps of thought, much like a randomized search algorithm. It is the system saying, “Here is another path you might not have walked.”

But the danger lies in misplacing this tool. Just because LLMs work well for generating ideas does not make them fit for deterministic tasks. You don’t want your compliance reports to vary from run to run. You don’t want your accounting ledger to “get creative.” The risk isn’t that the machine is bad : it’s that we are applying it in contexts where discovery is not the goal, and predictability is non-negotiable.

Even when tuned for deterministic outputs, an LLM is not suddenly intelligent. It is simply operating with less freedom of movement. The confidence in its answers does not mean correctness – just as our own brains fill gaps with convincing but sometimes false certainty.

Not every configuration file needs creative reinterpretation. Not every compliance report benefits from variation.

In many ways, LLMs remind us of the larger lesson: non-determinism is a hammer worth swinging only when the problem is truly a nail.

---

Closing Thought

Non-determinism is not chaos, and determinism is not absolute truth. Both are strategies carved out of a probabilistic universe. The art of building systems, and perhaps of living itself, lies in knowing when to enforce certainty and when to allow surprise. Chaos Monkey and Monte Carlo methods show us that randomness, when directed, can be a powerful teacher. But history also reminds us that unchecked randomness in the wrong domain leads to disaster.

Determinism without flexibility becomes stagnation. Non-determinism without boundaries becomes destruction.

The conclusion is simple but worth repeating: non-determinism is neither a hammer to hit every nail nor a poison to be purged. It is a tool. Like all tools, it finds greatness only in context. Our job is to master that context – to decide when the world needs certainty and when it needs the unexpected gift of surprise.

If you’re curious about a more personal angle on this theme, I’ve written separately about how LLM behavior made me reflect on the way my own brain works. That piece is less about systems and more about cognition, but together they reinforce a simple truth: unpredictability isn’t an error – it’s a lens.