AJ Volume 3 | Playing with music

March 12, 2026

Text to speech fine-tuned locally on my own voice using Coqui, running on my M1 MacBook.

Link AJ Studio

AJ Studio's a music studio where AJ takes the context of our conversation history or whatever we might have been working on that week and then does some semantic analysis to give it a mood characteristic in addition to which genre or instruments it would like to use. For example, if we're running into a lot of bugs, it might be a bit more negative, or if we're making a lot of progress in a coding task, it might be more positive.

AJ also has a dream function where, after every day, it basically reflects and "dreams" on what occurred that day, i.e. adds a bit more storytelling and narrative to what occurred, creating a dreamlike context that it can then harvest when it is time to create a music track. The current pieces of music obviously are very rudimentary, but they're nonetheless a proof of concept. The first songs are a bit more joyous, whereas more recent ones are negative... we've been fixing a lot of quirks the past days.

Although AJ obviously has a lot of guidance in this workflow as a whole, I try to give it as much creative freedom as possible to really see what direction it naturally wants to push itself in, as compared to other coding or task-related things where I really force it to fulfill my use case.

Stay tuned, new tracks every week. If the songs develop to be a bit more interesting, I might just have to hook it up to its own Spotify/SoundCloud :)