Identify and separate multiple speakers in audio recordings with speaker diarization.

Overview

Speaker diarization answers the question “who spoke when?” It segments audio by speaker, making it invaluable for:
  • Meeting transcripts — Attribute statements to participants
  • Interviews — Separate interviewer and interviewee
  • Podcasts — Identify hosts and guests
  • Call recordings — Distinguish callers
Granite Speech speaker-turn transcripts are documented separately as Speaker Attributed ASR. Use diarization when you need timestamped speaker segments.

Getting Started

Download Diarization Pipeline Models

For best results, use a diarization + ASR + aligner pipeline:

Start the Server


Using the Web UI

  1. Navigate to Transcription in the sidebar
  2. Switch to Diarization mode
  3. Upload an audio file with multiple speakers
  4. Click Analyze
  5. View the speaker-segmented transcript

Output

The diarization view shows:
  • Speaker labels — Speaker 1, Speaker 2, etc.
  • Timestamps — When each speaker talks
  • Transcript — What each speaker said
Example output:

Using the API

Endpoint

Request (multipart/form-data)

Example (curl)

Response

The create response is a persisted diarization job. Poll the returned id with GET /v1/speech-to-text/jobs/{record_id}?job_kind=diarization until processing_status is ready.
Ready job records include segments, words, utterances, speaker_count, duration_secs, alignment_coverage, LLM refinement status, processing metrics, and the formatted transcript. See the API Reference for JSON input and exact response shapes.

Configuration

Number of Speakers

If you know how many speakers are in the audio, specify it for better accuracy:

Speaker Labels

By default, speakers are labeled “Speaker 1”, “Speaker 2”, etc. You can rename them in the UI after processing.

Tips for Best Results

  1. Quality audio — Clear recordings with minimal background noise
  2. Distinct voices — Works best when speakers have different voice characteristics
  3. Minimal overlap — Speakers talking over each other reduces accuracy
  4. Specify speaker count — If known, helps the algorithm
  5. Longer segments — Short utterances are harder to attribute

Limitations

  • Similar voices — May confuse speakers with very similar voices
  • Overlapping speech — Simultaneous talking is challenging
  • Background noise — Reduces speaker detection accuracy
  • Very short clips — Need enough audio to identify speaker patterns

Use Cases

Meeting Minutes

Upload a meeting recording to get a transcript with speaker attribution:
  1. Record your meeting
  2. Upload to Diarization
  3. Export the speaker-labeled transcript
  4. Edit speaker names as needed

Interview Transcription

Perfect for journalist interviews or research:
  1. Record the interview
  2. Process with diarization
  3. Get clean Q&A format output

Podcast Production

Identify speakers for editing and show notes:
  1. Upload raw podcast audio
  2. See who spoke when
  3. Use timestamps for editing

See Also