This article was published on August 14, 2023

"I stand in the library where a voice soars"

Ed Newton-Rex, a creative AI pioneer and VP Audio at Stability AI , says that he’s become the first author to publish a piece of classical music that uses generative AI . The musician and entrepreneur wrote his “ I stand in the library ,” a piece for the choir and piano, to a poem produced by OpenAI ‘s generative AI model GPT3.

Written back in 2022, the 15-minute composition has been premiered at the Live from London online classical music festival, performed by a choral group VOCES8. The full version of the performance is available (behind paywall) on the festival’s website , but here’s an exclusive preview to give you a general idea:

Talking to TNW about writing the piece, Newton-Rex said that the idea came when he got access to GPT3 as one of the early testers. The prompt he gave the model was simply “below is a poem about music and solitude”. Based on that, the system came up with the first line — “I stand in the library where a voice soars,” — which the musician found appealing enough to encourage the model to keep going.

“Probably some five to 10 times I would delete a line and tell it to regenerate because it would get stuck in a loop,” Newton-Rex recalled. “So, I curated it, but I really didn’t do that much. I also decided where it should end; it got to the end of a sentence, and I thought, ‘okay, that’s a nice ending’.

All in all, he said, the poem “is not going to win any poetry competitions. But it’s not bad.”

The latest rumblings from the EU tech scene, a story from our wise ol' founder Boris, and some questionable AI art. It's free, every week, in your inbox. Sign up now!

An important question about creating art with the support of AI is understanding what role it actually plays. In the case of “I stand in the library,” the GPT-generated lyrics had quite some influence on the human composer’s creative process.

“What GPT3 really did here was provide inspiration,” Newton-Rex said. “It just randomly chose to mention a piano. And because it did that, I ended up thinking, ‘well, I’ll write this piece for choir and piano,’ which I don’t usually do. Choir and piano is not a very common combination.

“But what I found super interesting is that I enjoyed that process so much that I ended up writing a bunch more choir and piano pieces, and it’s now become one of my go-to styles. And that’s interesting, because if I didn’t use GPT3 on that one particular day, and this stochastic process did not randomly output the word piano, my writing style would now be quite different.”

Newton-Rex has been composing choral music for many years now. Most of his work is published by UK -based sheet music publisher Boosey & Hawkes.

“It is not the biggest industry in the world, my royalty checks are very small,” he remarked with a laugh.

With the latest piece, the publisher had a hard time working out the legalities, Newton-Rex added. It was not able to get guidance from the UK’s Performing Rights Society (PRS) on registering the copyright on both the music and the text if the latter is generated by AI.

As a result, “I stand in the library” is published as an instrumental composition, meaning that the lyrics aren’t protected by copyright laws. This is not the first time AI generated music has been afforded intellectual property rights. For example, soundtrack composer AIVA (Artificial Intelligence Virtual Artist), is registered under the France and Luxembourg authors’ right society (SACEM).

“I would guess that it’s not ideal for a music publisher to not be able to protect the text,” Newton-Rex said. “I suspect that actually wouldn’t be something that could really scale, which may be good for human creators.”

Although working with AI on his day job at Stability AI, Newton-Rex doesn’t consider changing his creative process for now.

“It’s much more of an artistic experiment and artistic statement than it is a question of [large language models] replacing poets,” he said. “It’s not like I’m going to use GPT for all of my texts — I’m going back to normal poetry.”

There’s definitely a role for AI to play in creative endeavours, as it adds random (or pseudo-random) inputs to spark human creativity.

“AI can get us out of creative loops, it can just give us new ideas,” Newton-Rex said. “It’s like being in a writing room with someone.”

If you’re curious about the text generated by AI for the choral piece, here it is in full:

As I was borne along by the music, a solitary tear ran down my cheek. I did not understand why I was crying. I did not know that the voice I heard was my own.

I can find knowledge in their words.

I can find safety in their presence.

I am never alone when I am with them.

And they quench our thirst for understanding

Without knowledge, we would be lost

But with knowledge, we can find our way

Andrii is the Head of Media at TNW, with over a decade of experience in covering the European tech ecosystem. Talk to him about new and exci (show all) Andrii is the Head of Media at TNW, with over a decade of experience in covering the European tech ecosystem. Talk to him about new and exciting developments in tech, especially those involving vastly underreported industry niches and geographies.