TONWERK-AI

Tonwerk-AI

Make songs on your own Mac and control them from your iPhone, iPad or Mac. Tonwerk-AI is an app for a server you run yourself: it computes with the music models YuE2 and ACE-Step on a Mac with Apple silicon, and the app shows the library, the queue and the tools and plays the songs. There is no account and no service of mine in between.

Download for Mac All versions

For macOS 14 and later, Apple silicon and Intel, signed and notarized by Apple; the app announces new versions itself. For iPhone and iPad, Tonwerk-AI is in testing through TestFlight, by invitation. The app needs its own server on a Mac with Apple silicon; without one, the demo mode shows a sample library.

What Tonwerk-AI makes is AI-generated and labelled as such; what that means when you publish is explained under AI and responsibility. The plugins for Logic and other DAWs (Tonwerk without “AI”) are on the home page. The apps' interface is in German for now.

Your Mac computes

The models run on your Mac mini or MacBook, one after the other, so that memory suffices. Songs, lyrics and recordings stay there.

The app controls

iPhone, iPad and Mac connect to the server through Tailscale, on the road too. Anyone outside your tailnet cannot reach it.

Logic in view

Every song comes with a score. The app turns it into MIDI and a Logic project and plays tracks on MIDI devices or the Tonwerk synths.

Go to setup

Features

On the left (in the menu on the iPhone) the app has the pages Create, Library, To listen, the Queue and the playlists, with the tools below. Which tools can compute depends on what is set up on the server (see options); if something is missing, the page says what.

Create

Library and player

Queue

What is computing and what is waiting, live: every song with its steps (score, tokens, synthesis, audio) and how long they took, plus versions, stems, speech takes, pictures and videos. Tiles at the top show which model holds the memory. Finished songs can be taken over as a playlist, and the worker's log is below.

Tools

Logic
A song or your own MIDI file or score.abc becomes a preview with piano roll, tracks and mixer. Each track plays on a MIDI device (Bluetooth too) or a Tonwerk synth. Export as MIDI, MusicXML or a Logic project with audio, if you like with vocals from the stems, backing vocals, and bass and drums from the stems.
Instruments
Edit the sounds of the Tonwerk synths (Analog and FM) and play them on a test keyboard; the library of your MIDI devices.
Voices
Split songs into stems (vocals dry and with reverb, instrumental, bass, drums), have a song sung again with a reference voice (Seed-VC), sing a vocal track of your own with another voice.
Transcription
A recording to a melody score with SheetSage2, or to MIDI as sung with Basic Pitch.
Speech lab
Have text spoken by local speech models, also with a voice recorded at the microphone; clean noise from speech recordings.
Singing
Notes and words become a sung voice with SoulX-Singer: draw a melody in a note editor with one syllable per note or take it from a MIDI file or a song, save it as MIDI. It is sung with SoulX-Singer's sample voices or one of your own that you sing into the microphone or upload as a WAV. The pronunciation is English.
ACE-Step
The second song model with its own parameters, also for covers and for recomputing single passages of a song.
Sketch
A written song idea (structure, chords, lyrics, melody) becomes a song plan with Claude: score and lyrics for YuE2, settings for ACE-Step and a MIDI draft with accompaniment.
Backing vocals
Parallel voices, drone and choir parts for a melody, as MIDI.
Insights
What the rated songs were made with, against their stars: which building blocks, models and settings prove themselves.
Log, storage, templates
The server's log with a report to copy, where the disk space goes including clean-up, and the saved templates.

Models and licences

Tonwerk-AI ships no models; the server downloads them from their sources during setup, and their licences apply. YuE2's weights are under CC BY-NC 4.0, but individuals are expressly allowed to sell and market songs made with them. Other models allow only non-commercial use or require attribution. Which model allows what is in the overview under AI and responsibility.

Help and contact

Questions, bugs or wishes about Tonwerk-AI to marcel@tonwerk.studio or as an issue on GitHub. With a bug, the report from Tools → Log helps: it names the version, the server's state and the latest warnings, but no settings, keys or addresses.

Frequent questions are answered in Setup under Problems.