AJ Volume 3 | Playing with music

March 12, 2026

Text to speech fine-tuned locally on my own voice using Coqui, running on my M1 MacBook.

AJ Studio's a music studio where AJ takes the context of our conversation history or whatever we might have been working on that week and then does some semantic analysis to give it a mood charaistic in addition to which genre or instrimunts it would like to use. For example, if we're running into a lot of bugs, it might be a bit more negative, or if we're making a lot of progress in a coding task, it might be more positive.

AJ also has a dream function where, after every day, it basically reflects and "dreams" on what occurred that day ie adds a bit more storytelling and narrative to what occurred, creating a dreamlike context that it can then harvest when it is time to create a music track. The current pieces of music obviously is very rudimentary, but is none the less a proof of concept. The first songs are a bit more joyous where as more recent ones are negative... we've been fixing alot of quirks the past days.

Although AJ obviously has a lot of guidance in this workflow as a whole, I try to give it as much creative freedom as possible to really see what direction it naturally wants to push itself in, as compared to other coding or task-related things where I really force it to fulfill my use case.

Stay tuned, new tracks every week. If the songs devlop to be a bit more interesting, I might just have to hook it up to its own Spotify/Soundcloud :)