ChatGPT appears to be able to generate music in lilypond notation. It gets the notation, but not the music. You could probably fine tune a model on some lilypond files to get better results.
this post was submitted on 05 Oct 2023
7 points (100.0% liked)
LocalLLaMA
3357 readers
24 users here now
Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.
Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.
As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.
Rules:
Rule 1 - No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.
Rule 2 - No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.
Rule 3 - No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since <over 10 years ago>.
Rule 4 - No implying that models are devoid of purpose or potential for enriching peoples lives.
founded 2 years ago
MODERATORS
I tried getting it to write out a simple melody using MIDI note numbers once. I didn't think of asking it for LilyPond format, I couldn't think of a text-based format for music notation at the time.
It was able to produce a mostly accurate output for a few popular children's songs. It was also able to "improvise" a short blues riff (mostly keeping to the correct scale, and showing some awareness of/reference to common blues themes), and write an "answer" phrase (which was suitable and made musical sense) to a prompt phrase that I provided.
Just my unqualified opinion, but it probably wouldn't work the way you want it to. Just like if you ask it spatial-orientation questions or to draw a graph with ASCII, it can imitate the form of the answer, but since it doesn't really understand the domain (can't hear the music) what it outputs would be of pretty limited quality.
There are AI models that are designed to produce music though, and they seem like they do a pretty passable job. Also, for what it's worth, there's this:
Write a score for a space opera in Lilypond notation.
Creating an entire space opera score in LilyPond notation would be a massive undertaking that would require a lot of space and time. I can, however, provide a short excerpt or motif that might be representative of such a work. Here's a simple motif for a space opera, assuming a majestic and futuristic tone for a lead instrument (like a trumpet or synthesizer) and some chords for a backing instrument (like strings or a keyboard):
\version "2.20.0"
global = {
\key c \major
\time 4/4
}
leadMelody = \relative c' {
\global
c2. d4 | e2. d4 | c2. r4 | g'2. a4 | g2. a4 | f2. r4 |
e2. d4 | c2. r4 | c2.
}
backingChords = \chords {
c2:maj7 d:min7 | e:min7 d:min7 | c:maj7 r4 | a:min7 g:maj7 | a:min7 g:maj7 | f:maj7 r4 |
e:min7 d:min7 | c:maj7 r4 | c2:maj7
}
\score {
<<
\new Staff \leadMelody
\new ChordNames \backingChords
>>
\layout { }
\midi { \tempo 4=80 }
}
This is just a very basic example, and a real space opera would have more instruments, voices, motifs, and variations. You could expand upon this, develop more motifs, and incorporate more instruments to fit the mood and narrative of your opera. Remember, LilyPond is powerful and can accommodate complex musical ideas, so the sky's the limit!
Thank you. Thats really cool.