Tonwerk-AI
Make songs on your own Mac and control them from your iPhone, iPad or Mac. Tonwerk-AI is an app for a server you run yourself: it computes with the music models YuE2 and ACE-Step on a Mac with Apple silicon, and the app shows the library, the queue and the tools and plays the songs. There is no account and no service of mine in between.
For macOS 14 and later, Apple silicon and Intel, signed and notarized by Apple; the app announces new versions itself. For iPhone and iPad, Tonwerk-AI is in testing through TestFlight, by invitation. The app needs its own server on a Mac with Apple silicon; without one, the demo mode shows a sample library.
What Tonwerk-AI makes is AI-generated and labelled as such; what that means when you publish is explained under AI and responsibility. The plugins for Logic and other DAWs (Tonwerk without “AI”) are on the home page. The apps' interface is in German for now.
Your Mac computes
The models run on your Mac mini or MacBook, one after the other, so that memory suffices. Songs, lyrics and recordings stay there.
The app controls
iPhone, iPad and Mac connect to the server through Tailscale, on the road too. Anyone outside your tailnet cannot reach it.
Logic in view
Every song comes with a score. The app turns it into MIDI and a Logic project and plays tracks on MIDI devices or the Tonwerk synths.
Features
On the left (in the menu on the iPhone) the app has the pages Create, Library, To listen, the Queue and the playlists, with the tools below. Which tools can compute depends on what is set up on the server (see options); if something is missing, the page says what.
Create
- Style from building blocks (genre, voice, instruments, mood, tempo, language) or written freely; “Proven” offers the building blocks of your best-rated songs.
- Lyrics with sections such as
[Verse],[Chorus]or[Bridge]. YuE2 sings lyrics but does not write them: Draft lyrics has a language model write German or English lyrics from keywords or a photo, locally in LM Studio or, with your own key, with Claude. A short instruction (“catchier chorus”) revises a draft. - Score in ABC format: your own, imported or transcribed melodies, transposable into any of the 24 keys, from major to minor too.
- Quality draft or full, length up to 10 minutes, 1 to 10 songs at once, seed and the model's advanced parameters (sampling, steps, your own sound LoRA).
- Templates save style and parameters under a name; Use everything on a song fills in everything it was made with.
Library and player
- All songs with search in title, style or lyrics, ratings from 1 to 5 stars, sorting by date, stars, length and tempo. To listen collects songs left unrated for over a week.
- Tempo, key and how clearly the lyrics are sung, heard once by the server. Notes, your own titles and your own covers per song (photo, file or painted on the Mac, with FLUX.2 Klein, Z-Image Turbo, Krea 2 Turbo or FLUX 3 Klein).
- The player runs in the background, with lock screen, Control Center and AirPods. Full screen with a large cover, an analyzer in the cover's colour and the lyrics, whose sung line follows along.
- Playlists that are the same on all devices, because they live on the server.
- Share / export as a small AAC for messengers, MP3, M4A or FLAC, with title, lyrics, cover and brought to −14 LUFS.
- Music video from cover, analyzer, particles or plasma ball and the lyrics following along, for YouTube (16:9) or Shorts and Reels (9:16), if you like cut to the beats from your own photos and clips.
Queue
What is computing and what is waiting, live: every song with its steps (score, tokens, synthesis, audio) and how long they took, plus versions, stems, speech takes, pictures and videos. Tiles at the top show which model holds the memory. Finished songs can be taken over as a playlist, and the worker's log is below.
Tools
- Logic
- A song or your own MIDI file or
score.abcbecomes a preview with piano roll, tracks and mixer. Each track plays on a MIDI device (Bluetooth too) or a Tonwerk synth. Export as MIDI, MusicXML or a Logic project with audio, if you like with vocals from the stems, backing vocals, and bass and drums from the stems. - Instruments
- Edit the sounds of the Tonwerk synths (Analog and FM) and play them on a test keyboard; the library of your MIDI devices.
- Voices
- Split songs into stems (vocals dry and with reverb, instrumental, bass, drums), have a song sung again with a reference voice (Seed-VC), sing a vocal track of your own with another voice.
- Transcription
- A recording to a melody score with SheetSage2, or to MIDI as sung with Basic Pitch.
- Speech lab
- Have text spoken by local speech models, also with a voice recorded at the microphone; clean noise from speech recordings.
- Singing
- Notes and words become a sung voice with SoulX-Singer: draw a melody in a note editor with one syllable per note or take it from a MIDI file or a song, save it as MIDI. It is sung with SoulX-Singer's sample voices or one of your own that you sing into the microphone or upload as a WAV. The pronunciation is English.
- ACE-Step
- The second song model with its own parameters, also for covers and for recomputing single passages of a song.
- Sketch
- A written song idea (structure, chords, lyrics, melody) becomes a song plan with Claude: score and lyrics for YuE2, settings for ACE-Step and a MIDI draft with accompaniment.
- Backing vocals
- Parallel voices, drone and choir parts for a melody, as MIDI.
- Insights
- What the rated songs were made with, against their stars: which building blocks, models and settings prove themselves.
- Log, storage, templates
- The server's log with a report to copy, where the disk space goes including clean-up, and the saved templates.
Models and licences
Tonwerk-AI ships no models; the server downloads them from their sources during setup, and their licences apply. YuE2's weights are under CC BY-NC 4.0, but individuals are expressly allowed to sell and market songs made with them. Other models allow only non-commercial use or require attribution. Which model allows what is in the overview under AI and responsibility.
Help and contact
Questions, bugs or wishes about Tonwerk-AI to marcel@tonwerk.studio or as an issue on GitHub. With a bug, the report from Tools → Log helps: it names the version, the server's state and the latest warnings, but no settings, keys or addresses.
Frequent questions are answered in Setup under Problems.