lumen-ai/com.subhashh.lumen.ai/SpeechDetector

SpeechDetector

class SpeechDetector(dir: File) : AutoCloseable(source)

Where people speak in 16 kHz audio: Silero VAD v6 (MIT, 1.3 MB) on ONNX Runtime. Whistle invents sentences ("Thank you.", "Vielen Dank.") from music, and most edits are music, so only what this marks as speech is transcribed. Tested on the owner's clips: a music reel 0% speech, two talking ones 74% and 79%.

Constructors

SpeechDetector

constructor(dir: File)

Functions

open override fun close()

speech

fun speech(pcm: FloatArray): List<LongRange>

Speech stretches in ms from the start of pcm, padded and merged across short pauses.