---
url: https://superduperai.co/library/audio-to-midi-pick-the-model-by-material/
title: Recording to MIDI: pick the model by material, then check it
description: Three local transcription models fail in different directions. The skill picks one by what the material is, runs it, and checks the result before you trust it.
category: music
platforms: [any]
works_with: [claude-code]
tags: [midi, transcription, basic-pitch, muscriptor, audio, local]
difficulty: intermediate
verified: false
created: 2026-11-10
updated: 2026-11-10
source: https://github.com/fortunto2/superduper-dsp/tree/main/skills/audio-to-midi
---

# Recording to MIDI: pick the model by material, then check it

Three local transcription models fail in different directions. The skill picks one by what the material is, runs it, and checks the result before you trust it.

## Prompt

```text
Use the audio-to-midi skill on {recording.wav}. First tell me what the material is (full mix, one melody, solo guitar) and which of the three models fits it: MuScriptor for a band with drums, Basic Pitch for polyphony you may ship, SwiftF0 for a single line. Run it locally, then check the MIDI: tempo, key, note count, and a re-play against the recording. Say which parts you do not trust.
```

## Install

```sh
npx skills add fortunto2/superduper-dsp --skill audio-to-midi
# or the whole set as a Claude Code plugin (commands then look like /superduper-dsp:audio-to-midi):
claude plugin marketplace add https://github.com/fortunto2/superduper-dsp
claude plugin install superduper-dsp@superduper-dsp --scope user
```

## Steps

1. Install the skill. MuScriptor and Basic Pitch run through uvx, so you need uv. MuScriptor weights are gated on Hugging Face and need an HF_TOKEN.
2. Paste the prompt with your file. The skill runs the model and compares the result with the recording.
3. For one melody, the skill's third path (SwiftF0) uses scripts that live in the author's own project; the other two work from the commands in the skill.

## Tips

- MuScriptor: instruments and drums, accurate tempo and key, but all velocities are 100 and the weights are CC BY-NC 4.0 (no products).
- Basic Pitch: Apache-2.0, real velocities, but no drums and a placeholder 120 BPM.
- Speed on 3:12 of audio, measured by the author: SwiftF0 1 s, Basic Pitch 35 s, MuScriptor 52 s.

## Works with

- Claude Code: Runs as a skill or a prompt in the terminal; can read your files and write the result.
