Recording to MIDI: pick the model by material, then check it

Three local transcription models fail in different directions. The skill picks one by what the material is, runs it, and checks the result before you trust it.

Claude Codeintermediate20 minunverified
Use the audio-to-midi skill on {recording.wav}. First tell me what the material is (full mix, one melody, solo guitar) and which of the three models fits it: MuScriptor for a band with drums, Basic Pitch for polyphony you may ship, SwiftF0 for a single line. Run it locally, then check the MIDI: tempo, key, note count, and a re-play against the recording. Say which parts you do not trust.

In Claude Code, paste the prompt as a message.

Install

npx skills add fortunto2/superduper-dsp --skill audio-to-midi
# or the whole set as a Claude Code plugin (commands then look like /superduper-dsp:audio-to-midi):
claude plugin marketplace add https://github.com/fortunto2/superduper-dsp
claude plugin install superduper-dsp@superduper-dsp --scope user

Steps

  1. Install the skill. MuScriptor and Basic Pitch run through uvx, so you need uv. MuScriptor weights are gated on Hugging Face and need an HF_TOKEN.
  2. Paste the prompt with your file. The skill runs the model and compares the result with the recording.
  3. For one melody, the skill's third path (SwiftF0) uses scripts that live in the author's own project; the other two work from the commands in the skill.

Tips

  • MuScriptor: instruments and drums, accurate tempo and key, but all velocities are 100 and the weights are CC BY-NC 4.0 (no products).
  • Basic Pitch: Apache-2.0, real velocities, but no drums and a placeholder 120 BPM.
  • Speed on 3:12 of audio, measured by the author: SwiftF0 1 s, Basic Pitch 35 s, MuScriptor 52 s.
works withClaude Code: Runs as a skill or a prompt in the terminal; can read your files and write the result.
costFree. No API, no key.
statusUnverified: written from the technique, not yet run end to end by us.
sourceaudio-to-midi skill in superduper-dsp (MIT)
licenseCC BY 4.0 for the text here; skills are MIT.
updated2026-11-10
for agentsaudio-to-midi-pick-the-model-by-material.md
#midi#transcription#basic-pitch#muscriptor#audio#local

Related

Music & sound intermediate

Nine agent skills for mixing, mastering and making music (superduper-dsp)

A Claude Code plugin that teaches an agent to mix by measurement, build songs in REAPER, render plugin chains headless, turn audio into MIDI and tear down a reference track.

Claude Code
Music & sound intermediate

Mix and master by measurement: sdsp-mix

An agent mixes the way an engineer would: render, measure against a commercial reference, change one thing. Mix map of who masks whom, kick and bass ducking, mastering to a loudness target.

Claude Code
Music & sound advanced

Tear down a reference track by numbers: tempo, key, groove, balance

The agent reads a spectrogram instead of listening, splits stems with Demucs, fits tempo and phase to the kick, and rebuilds the vibe until the numbers match the reference.

Claude Code
Music & sound beginner

Compare two microphones by numbers, not impressions: mic-compare

Record the same phrase on two mics at matched gain and let the agent report response, noise floor, per-band SNR, plosives and sensitivity, and what EQ can still fix.

Claude Code
Skills & tools intermediate

Listen to a live room and keep one running summary (/solo-supervox)

With supervox transcribing locally, the agent keeps one evolving summary on screen during a talk or a call, coaches a pitch's Q&A, or analyses a saved recording afterwards.

Claude Code
Music & sound advanced

Build a track in REAPER with an agent: superduper-song

The agent writes the song into REAPER through its MCP bridge on the SuperDuper instruments, with parameter maps by name, preset recall and expression via CC.

Claude Code