Skip to main content

Questions tagged [audio-recognition]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
1 answer
36 views

Detection of musical instruments using Yamnet

My goal is to detect musical instruments with AI (machine learning). I'm currently using the Yamnet model to make inferences, but it has a very wide range of categories, for example, "Growling&...
Maxime Dupré's user avatar
0 votes
0 answers
28 views

Segment a spectrogram into a series of images by (constant) beats per minute to train a Deep Neural Network

I have a .csv file with information about a soundtrack and it is divided into beats (per minute), which are ordered by row. As in: the index corresponds to each beat, and the columns have info about ...
Johnathan Smitherton's user avatar
0 votes
0 answers
18 views

Drum sound classification using RNN issues - help needed

I am new to the field of machine learning, even tho I have solid background in semi-related fields (am control system engineer by trade) and as a hobby project I wanted to work a bit with sound ...
APasagic's user avatar
0 votes
1 answer
58 views

Generate VTT file from speech to text

I was able to generate text from an audio file using huggingface, using this code ...
Kelly Goedert's user avatar
0 votes
0 answers
8 views

Best practice for classification of parts of a sound file based on content

I have a collection of raw recordings. I also have a text file for each recording with the starts and ends of subparts of interest from the original recording. I want to train a model to classify ...
David Harar's user avatar
0 votes
0 answers
23 views

Using Transformers on a seq2seq task with sparse labels

I'm new to the ML world and would like to ask for architecture advice for a project I'm building. I want to detect a certain event throughout an audio. For example, if the audio is divided into 10 ...
TigerHix's user avatar
  • 101
0 votes
1 answer
52 views

Using a SVM to classify audio data

If I had 1000 audio files where three people are independently saying an animal at the same time, there can be 9 independent labels of animals. What features should I select from the audio file, and ...
Joe's user avatar
  • 1
0 votes
0 answers
16 views

File length in audio classification

I am dealing with audio data with samples as long as 20 min. I was wondering if I can use their spectrograms as input for Resnet18 or is it better to split them to obtain files with smaller size. Does ...
ml_nnoobb's user avatar
1 vote
0 answers
30 views

How to make a dataset for Audio Speech Recognition of Arabic Language

I am trying to map Quranic Verses for the identification of errors. Different audios for the same verse have different durations as it depends on the reciter. I used Audacity to normalize but the ...
Sijran's user avatar
  • 11
0 votes
0 answers
112 views

Cannot load audio files using AudioSegment

I am trying to load an mp3 file using pydub's AudioSegment method with below code. ...
Kevin Shah's user avatar
1 vote
2 answers
53 views

Classification on sound data

My goal is to detect a problem in a windturbine. I have a dataset of 2h (1 hour for each class). To keep in mind, it will be embedded on an MCU target, so the neural network have to be less than 10M ...
Nept0's user avatar
  • 11
0 votes
0 answers
21 views

Input shape CNN speech

The shapes of x_train=(514, 256), y_train=(514,) x_test=(254, 256), y_test=(254,) I have 256 features and 770 samples of which ...
Srikanth's user avatar
1 vote
0 answers
41 views

Labelling spectrograms

Currently I'm working on a ML project, just need an information, is there any tool that is present that can load audios file and generates spectrograms as well as an option to annotating/ label the ...
Karthik Sudapelli's user avatar
1 vote
1 answer
40 views

What process actually takes place during audio feedback suppression machine learning

After training a neural network (NN) to tell the difference between a clean audio signal and a signal with a specific "noise", what is the mechanics that actually takes place where an unseen ...
Joe's user avatar
  • 147
0 votes
0 answers
87 views

Best Feature Extraction Practise for Long Audio Data

I have a video dataset and my aim is classifying predefined scenes in these videos at 1fps (that means I perform classification at each second). Therefore, I plan to fuse audio and visual features for ...
kubicwerke's user avatar
0 votes
1 answer
732 views

Dimensions of mel spectrogram

Can someone explain me dimensions in ASR? For example, if I have an audio, convert it to mel spectrogram and now I have a tensor of dimension [1, 128, 850]. Am I understand right that 128 - number of ...
randomuser228's user avatar
1 vote
0 answers
17 views

How to normalize(or other) the audio data so that the same labels with the similar characteristics from different records?

I am trying to detect swallows from recordings taken from hospital. I manually labelled the recordings on the Praat. Now the valid labels are silence, swallows and nonswallows(noise, enviromenment ...
Yalçın Cenik's user avatar
0 votes
1 answer
395 views

MEL VS linear spectrograms for bioacoustics machine learning

I don't have background in bioacoustics but working on a data-science project in bioacoustics. I am working with animal vocalizations recorded at sampling rate of 250000. Animals are bats, which are ...
user305883's user avatar
1 vote
0 answers
16 views

Speaker Recognition using Deep Learning

I am trying to develop a speaker recognition model using deep learning. I want to use the VoxCeleb2 audio dataset but I cannot find it. The one on their website has YouTube links, but I would rather ...
Omar's user avatar
  • 11
0 votes
1 answer
3k views

How to extract embeddings from an audio file using wav2vec along with context

I am trying to use wav2vec embeddings from the XLSR model for emotion recognition on the EMODB dataset. How can I extract embeddings using wav2vec? I want to use the XLSR model pre-trained with ...
Aun Zaidi's user avatar
1 vote
2 answers
1k views

Issues with audio embedding using wav2vec

I am having issues with audio embedding using the wav2vec library while trying to classify emotions using audio signals from the EMODB dataset (Emotions dataset in German). I am using the following ...
Aun Zaidi's user avatar
1 vote
1 answer
1k views

How can I write a Python program, that recognizes clapping sounds in an audio file, and saves them to disk?

I would like to write a Python program that takes an audio file as input, recognizes clapping sounds in it, then extracts these sounds into a file. My idea is the following: Get (or create) a dataset ...
Klangen's user avatar
  • 113
0 votes
0 answers
83 views

How to extract all timestamps of badminton shot sound in an audio clip using Neural Networks?

I am trying to find the instances in a source audio file taken from a badminton match where a shot was hit by either of the players. For the same purpose, I have marked the timestamps with positive (...
ChaoS Adm's user avatar
  • 141
0 votes
0 answers
40 views

Is it possible for computers to tell how many people are speaking in a audio recording

Suppose I had a audio recording of 15 students saying "Here" all at the same. Can I tell how many students were speaking and who they were using machine learning? I want to create a school ...
Mustafa's user avatar
  • 101
0 votes
1 answer
36 views

How to generate structured parameters from a spectrogram?

Say I have an algorithm that accepts as input structured parameters of the following format, generates an audio clip and then a 512x512 spectrogram out of it: ...
Golitan11's user avatar
  • 101
0 votes
0 answers
34 views

Finding the optimum sample lenght for sound recoginition

I am working on a sound recognition problem with a self-made data set of very long recordings. My current process looks like this: Time series segmentation to extract sound events cropped to a fixed ...
Jelt0's user avatar
  • 1
0 votes
0 answers
20 views

How should I process the output from this neural network?

I have a neural network that takes an np.array of a mel spectrogram of a 3 second audio clip from a song as input, and outputs vector of individual predictions that it is from 494 given (individual) ...
user135409's user avatar
0 votes
0 answers
75 views

TensorFlow Speech Emotion Recognition Model gives same prediction for all inputs

Dataset used: RAVDESS (I've only used the audio only files) Here's a sample after I've processed the data: And the code for the label encoding: ...
ForkyTheEditor's user avatar
2 votes
0 answers
218 views

Detecting Data Drift in Audio Data

For a give set of audio files collected from an industrial process via a microphone, I have extracted suitable features and fed them into a neural network for training a binary classifier as depicted ...
TwinPenguins's user avatar
  • 4,279
3 votes
1 answer
32 views

Trim left tail of music in audio file

I have audio files, most of them start with the same music, and then a conversation begins. I want to trim the part of the music (which can be varied in length). I have no labels, I can transcribe the ...
David Harar's user avatar
1 vote
1 answer
148 views

Audio Classification with Counter

I'm trying to create a model that can identify one particular sound, and every time it hears that sound, it increases a counter by 1. So for example, if it hears a specific bird chirping ten times, ...
Matthew 's user avatar
0 votes
0 answers
27 views

Augmentation for sound recognition of dog barks for CNNs

I am training CNNs to recognize dog barking, and for this I would like to augment the data sets I have (~30'000 10s clips with either barks, or no-barks in them). The straight forward idea was to mix ...
JumboJetlin's user avatar
0 votes
1 answer
92 views

Evaluate Text-to-speech without Human Involved?

I've explored text-to-speech evaluation matrices and they seem to used Mean Opinion Score (MOS) to evaluate a particular model. This matrice required humans to help to judge the model based on a scale ...
Nontawat Wutticome's user avatar
1 vote
1 answer
18 views

Smooth transistion of music notes using music processing

I need advice regarding a small dataset of individual music notes played on a harmonica that I created a while ago. I want to build a system that reads notations in a text file and create realistic ...
InputBlackBoxOutput's user avatar
2 votes
1 answer
475 views

Using MFCC and MFCC Delta features with a CNN

A lot of studies feed MFCCs as well as MFCC delta and double deltas directly to a CNN for audio classification. My question is, are the MFCC Deltas concatenated with the MFCC matrix? Most papers ...
saad's user avatar
  • 123
2 votes
2 answers
983 views

Should I train the "Unknown" class separately from the other classes

I have a CNN model that classifies 10 classes of audio spectrograms. However, since I work with the open set of data, I need to classify the unknown audio data as an "Unknown" class. The ...
Nontawat Wutticome's user avatar
2 votes
0 answers
86 views

Multiple timestamp values for training data

I am trying to extract features from audio WAV-files with the openl3 package. It is working so far, but since openl3 works with windows, I have now for each WAV-file two numpy files, one with the ...
Link's user avatar
  • 21
2 votes
1 answer
40 views

Discouraging values or smoothing out results when model fitting

I'm working on training a network to do direction of arrival prediction and I'm having the issue that no matter what my network is (ResNet 18 - 101, CRNN, CNN, etc...) my results tend toward one small ...
user25758's user avatar
1 vote
0 answers
67 views

Unsupervised Learning with audio recordings

I had a (probably crazy) idea for a project and I was wondering if you all think it would be in any way possible. I'm interested in analyzing sounds made by different types of animals (for example ...
AffableAmbler's user avatar
3 votes
1 answer
58 views

How to double audio dataset?

I am trying to develop a mispronunciation detection model for English speech. I use TIMIT dataset, this is phoneme labeled audio dataset. A phoneme is any of the perceptually distinct units of sound. ...
Abylay Omar's user avatar
1 vote
0 answers
177 views

Correct Mel Spectogram Generation

I recently discovered this article that details moving audio classification into the image domain and I was intrigued enough to dive in and take a closer look. A good portion of the article details ...
Jammer's user avatar
  • 111
1 vote
1 answer
299 views

Baby cry detection model using binary classification through logistic regression

I need some help regarding my final year project. I am fairly new to machine learning and I have tried a lot to understand how to train a model using logistic regression. I have two datasets of audio ...
Muhammad Waqar Anwar's user avatar
1 vote
1 answer
31 views

Looking for research for separating conversational audio files

I have been looking for conversational audio speech separation. Looking for researches around this topic, I came to across asteroid framework that was implemented on LibriMix dataset for audio speech ...
thanatoz's user avatar
  • 2,425
0 votes
1 answer
82 views

Sound Classification for Multiple Classes for English Letters

I have recorded audio files for the English letters, each file includes 26 letters. I have split each letter into a separate audio file. Now I want to put similar audio letters into one folder. I can ...
Fatimah Mohmmed's user avatar
1 vote
1 answer
144 views

Machine learning classification with time-domain signals how to ignore signal arrival time?

I am training a Tensorflow classifier model with signal data (converting signals to the spectrograms). I want the model to be insensitive to the arrival time of the signal within the fixed window. ...
boyfarrell's user avatar
0 votes
1 answer
37 views

Emotion detection on audio

I'm trying to apply emotion detection on audio. Basically, given an audio file, it must generate emotional labels for a segment of any durations, say every 5s chunks, like happy, sad, angry, etc. Is ...
Mary's user avatar
  • 217
0 votes
0 answers
53 views

IIoT Sound Classification with Little Data

[Problem Statement] I have been working on a sound a classification problem with less 200 sound files (wav format) with the following imbalanced class distribution: ...
TwinPenguins's user avatar
  • 4,279
2 votes
0 answers
72 views

Normalisation of features extracted from audio files

I am building CNN and SVM models which take in MFCC features as input. The MFCC matrices shape is (13, n). The 13 rows are coefficients and n columns represent n time frames. So each row in the matrix ...
user75252's user avatar
0 votes
0 answers
117 views

What is the suggested way to create features (Mel-Spectograms) from speech signal for classification with ResNet?

At the moment I have this piece of code which cuts a Spectogram into fixed length tensors: ...
3r1c's user avatar
  • 101
0 votes
1 answer
1k views

How to extract audio features for each video frame using pyAudioAnalysis

I'm trying something like extracting audio features for each video frame. I know there are 30 video frames and 16000 audio frames per second in the video file. I'm using pyAudioAnalysis python lib to ...
DevLoverUmar's user avatar