The Improvisational Nature of LLMs and Human Thought

Source: Art: DALL-E/OpenAI

Miles Davis, the legendary jazz musician, once famously said, “Don’t play what’s there; play what’s not there.” Within that phrase lies the very essence of jazz—the magic of the unexpected, the brilliance of improvisation, and the ability to explore the musical space between notes. Jazz isn’t always just a series of predetermined scales or scripted melodies; it’s the art of creating something new from familiar structures. It’s about finding unexpected connections, riffing on themes, and bending the boundaries of what we know. And isn’t this a interesting analogy for how we interact with large language models (LLMs) today?

John Coltrane and the Structured Yet Surprising Leaps of AI

Another good example is the work of John Coltrane, the jazz visionary who redefined musical boundaries through his innovative use of harmony. His exploration of the circle of fifths, especially with his Coltrane Changes in Giant Steps, introduced complex, rapid chord progressions that broke free from traditional tonal centers. This approach mirrors how modern AI and large language models navigate language—structured yet capable of surprising leaps. Coltrane’s music perfectly illustrates the fusion of structured patterns with improvisation, much like the interplay between human creativity and the emergent properties of AI.

LLMs as Instruments of Cognitive Jazz

Much like a jazz musician pulls notes from the ether, we now have the ability to weave knowledge and information into new and transformative combinations using AI. In a sense, LLMs offer us a form of cognitive jazz. These models don’t just process static pieces of information; they open up a dynamic, ever-changing canvas on which we can orchestrate new ideas. Each interaction, each query, is an improvisational performance, where the “notes” of language and fact can be assembled into endless forms and expressions.

Blurring the Lines Between Thinker and Instrument

What’s fascinating is how LLMs extend the nature of thought itself. Traditionally, thinking has been a solitary pursuit—structured, sometimes linear, confined within the walls of logic or reason. But now, with the emergence of AI as an intellectual collaborator, the very nature of our thought processes is evolving. The LLM isn’t just a tool for answering questions or producing content; it’s an instrument that enables us to riff on ideas in ways we might never have considered before. Yet, a curious entanglement arises: who is the artist, and what is the instrument? In this relationship between human and machine, roles blur, as each plays off the other, co-creating a form of cognitive jazz that challenges the boundaries of traditional thought.

A Symphony of Interplay: Human and Machine

Imagine sitting down at your computer, your LLM ready to play. You start with a simple prompt, a musical equivalent of a theme or chord progression. From there, the conversation flows—iterative, interactive, dynamic. It’s as if you’re engaging in a duet where the AI offers counterpoints, harmonies, and even dissonances that you hadn’t anticipated. The joy here is in the interplay, the back-and-forth exchange of ideas that brings you to new places in your thinking.

What’s exciting is that this new form of cognitive improvisation isn’t confined to the elite or the academic. With the accessibility of LLMs, we all have the opportunity to become cognitive musicians, riffing on concepts and orchestrating knowledge in ways that were previously unimaginable. The playing field of intellectual exploration has been democratized. It’s no longer just about the pursuit of cold, hard facts; it’s about the joyful exploration of how those facts can be spun into new narratives, fresh perspectives, and groundbreaking ideas.

The Transformative Nature of AI-Driven Thought

We are witnessing the birth of a new kind of thinking—a methodology that is fluid, interactive, and full of the unexpected. It mirrors jazz in that it’s not about following a rigid script but about allowing space for spontaneity, mistakes, and even atonality. In this context, the LLM acts not just as a source of information but as an intellectual partner, facilitating a style of thinking that feels almost musical. The boundaries between structured logic and creative exploration blur, giving rise to a form of cognitive orchestration that is both exhilarating and fundamentally transformative.

Consider the parallels: In jazz, musicians work within a framework—scales, chords, and rhythms—but they are free to play with those elements, twist them, and turn them into something new. Similarly, LLMs work within the framework of language and facts. But when we engage with them, we’re not just retrieving information; we’re actively playing with those “notes,” exploring how they can weave together in unexpected ways to create new insights—sometimes even finding the magic between the notes.

The Risks of Over-Structuring Creativity

OpenAI's latest LLM, known as o1, introduces new capabilities but also raises concerns about its impact on creativity. With structured processes like Chain of Thought (CoT) reasoning, there's a risk that these models could become overly formulaic. While these advances enhance accuracy and coherence, they might also limit the fluid, free-form exploration that characterizes true creative expression. The evolution of LLMs like o1 could inadvertently constrain the improvisational nature of creativity, much like setting too many rules in jazz could dilute its soul.

Environment Essential Reads

Can We Stop Sabotaging Our Climate? Yes, With These Mindsets

How Nature Makes Us Human

Embracing Our Role as Cognitive Musicians

So, as we continue to explore this emerging and creative landscape, it might be fun to embrace our role as cognitive musicians. Let's use the LLM instrument not just to retrieve information but to riff on it, to explore the spaces between the known and the unknown. For in that improvisational engagement between human and machine lies the future of thought—a future as dynamic, unpredictable, and beautiful as the finest jazz.