Questions tagged [neural-network]

Artificial neural networks (ANN), are composed of 'neurons' - programming constructs that mimic the properties of biological neurons. A set of weighted connections between the neurons allows information to propagate through the network to solve artificial intelligence problems without the network designer having had a model of a real system.

Filter by
Sorted by
Tagged with
0
votes
0answers
6 views

saving a model during training of an RL agent

I am training an RL agent using PPO2 algorithm. Iam using stable-baselines library. During the training process, my rewards are slowly increasing and stabilizing, but are falling down suddenly. I ...
-1
votes
0answers
6 views

What point processes can I use to model Spikes? [on hold]

I would like to know in Python. I'm new to Python and I don't know how to proceed.
1
vote
2answers
36 views

Understandable and explainable machine learning model

I want to find formula for best financial portfolio. Inputs: Historical fundamental data for last 15 years. For 3000 companies for every quatal we have things like ...
1
vote
1answer
26 views

Doubt in Derivation of Backpropagation

I was going through the derivation of backpropagation algorithm provided in this document (adding just for reference). I have doubt at one specific point in this derivation. The derivation goes as ...
3
votes
2answers
39 views

Why activation functions used in neural networks generally have limited range?

Why do we generally use activation functions with only limited range in neural networks? for e.g. $sigmoid$ activation function has range $[0, 1]$ $tanh$ activation function has range $[-1, 1]$ Q1) ...
0
votes
0answers
13 views

Can I use/modify an Autoencoder to handle missing data?

I am about to implement an Autoencoder to detect anomalies. Therefore, e.g., in my test set, there is a situation where the data stream broke for some days. This results in a lack of data and should ...
-1
votes
0answers
26 views

Python Neural Network choose correct text

Hey I am new into the neural network scene. I would like to create a network which takes as input several file names. To train it I would say which files are usable and which are not. For example: ...
1
vote
1answer
34 views

How can different classification algorithms expressed as neural networks?

I have heard that each of the different classification algorithms can be expressed as a neural network architecture. How can the different algorithms like Logistic Regression, SVM(Support Vector ...
0
votes
0answers
7 views

Understanding the output of embeddings and an error message when I change a parameter in the embedding layer in Keras/tensorflow 2.0 [on hold]

I am trying to understand and familiarize myself with embeddings. I created an artficial dataset of 5000 observations comprised from the union of 5 datasets: Sample of 1000 values drawn from a ...
-1
votes
1answer
26 views

Advice on machine learning for small inputs and outputs

I am planning on using a machine learning algorithm to learn the mapping between sets of four coordinates (x,y,z + a distance d ...
0
votes
0answers
17 views

What kind of loss function should be used for a problem like this?

My dataset consists of hierarchical timeseries. One could imagine it as "total sales" and segmentation per product. Something like this: ...
1
vote
1answer
46 views

What model should I use for multiple time series input

I want to predict bacteria plate count from time series(around 10000 values in a row) of water temperature in the water on a one minute granularity, and other daily climate data including min and max ...
2
votes
0answers
53 views

Results are too good.. what is wrong? How to predict correctly?

I am about to evaluate a neural network and want to check whether the predictions make sense. The variables: ...
0
votes
0answers
18 views

Convolutional Neural Network for Structured Data

I am having a student dataset which is a record of student academic details I know that that CNN is mostly used in computer vision and image processing for analyzing visual imagery But here it is ...
0
votes
0answers
11 views

Keras Custom Loss Function

I am looking to design a custom loss function for Keras model. The model itself is neural network that accepts a set of images and is supposed to run a regression to get an output, which is a value. ...
0
votes
0answers
15 views

What's the input for the cost function?

I'm trying to implement deep Q-learning, but I do not know what to put into the cost function. My net has 8 scalar inputs, 4 scalar outputs (from 0-1) and no hidden layers. To calculate the cost I ...
0
votes
0answers
23 views

Time series forecasting produce same values with different training data

I'm developing a python program which predict daily timeseries values. Each daily timeseries contains 288 values (a record every 5 minutes). The main idea is to train a LSTM model with 7 days data ...
1
vote
1answer
31 views

How do I know how to construct the layers of my CNN

I've done a CNN project with Keras and OpenCV, and I've got roughly 65% accuracy. And now I have to present this work in my University, but I'm afraid if the teachers ask me for how do I knew how to ...
0
votes
0answers
43 views

Neural Network for text generation

I'm new into ML and NN and I would like to figure out what is the best way to solve this (initially little) problem. Suppose i have a {number} in input and i want as output the phrase "The number in ...
0
votes
3answers
55 views

Neural network returning same value for different inputs in keras

I am trying to predict an array of values with a Keras neural network, as follows: ...
1
vote
0answers
22 views

Understanding reduced dimension embedding from tabular data

Background I am working on building a collaborative filtering recommender system in Keras for a school project, following an approach from this article. The approach is to take tabular user, item ...
0
votes
1answer
18 views

Reshape () Error in RNN (Recurrent neural networks)

The script below creates the arrays for data prediction using recurring neural networks, If I set the period to 4, the script runs, but I have a 5 value input, how to fix my reshape? DATA SET ...
0
votes
0answers
9 views

DL classification loss lowers but doesn't go to zero

I'm trying to train a text classifier using pytorch and the model currently uses pretrained embeddings, a bi-lstm followed by a linear layer and dropout. When I start training the loss is at 60-70, ...
0
votes
0answers
12 views

How is this function (for updating a Stochastic Gradient Descent model) called without a parameter?

I'm in the middle of a Deep Learning Course offered by DataCamp and the example below was given for optimizing a SGD model: As you can see, the function "get_new_model" requires one parameter: "...
0
votes
1answer
11 views

What's the meaning of precomputed features?

When i learn about deep learning, I found dataset with precomputed features form. Link (http://cs.stanford.edu/people/karpathy/deepimagesent/coco.zip). What's the different with usual dataset?
0
votes
0answers
35 views

How to use additional variables that are not available in test set?

I have additional variables in my dataset that are somewhat correlated to the continuous target variable, but that are completely unavailable in the test set. So, I'm wondering how the best to use ...
0
votes
1answer
16 views

Can an R^2, or coefficient of determination be used on non-linear data?

I have used the $R^2$ metric to determine how well my neural network performs a non-linear regression. And it seems to work. The plots look almost identical, and I get an $R^2$ value of 0.93... it ...
0
votes
0answers
21 views

Recurrent Python Neural Networks - Reshape () Error [duplicate]

The script below creates the arrays for data prediction using recurring neural networks, If I set the period to 4, the script runs, but I have a 5 value input, how to fix my reshape? DATA SET ...
0
votes
0answers
46 views

For loop and assignment procedure in losses.py for customizing loss function of ML model

I want to customize a loss function for neural networks. A computation of the loss function requires the inclusion of a for loop like below. However, it is super difficult to implement because ...
1
vote
0answers
26 views

How does the distribution of “features” in the hidden layers of neural networks work?

I would love some additional help understanding the hidden layers of neural networks. I’ve read that each of the neurons of the hidden layers will relate to various features from the given data set. ...
0
votes
0answers
12 views

can i get weights per iteration of MLP?

im building an mlp with scikit learn. Is there a way I can access weights and biases of the output layer per iteration? There is an option mlp.coefs_ But it ...
2
votes
2answers
31 views

how to access weights of individual Neurons in the output layers in MLPs?

im working on a neural network using Keras. Its an mlp(multi-layer perceptron). With 8 Neurons in the output layer. Is there a way I can access weights and biases of individual neurons of the output ...
0
votes
0answers
2 views

Best DDPG use case when having sensor historical data and virtual environment of a real world system

I have a historical data (from real sensors) which have enough knowledge of the actions and states needed for the use of reinforcement learning and a modeled virtual environment of a real system (...
0
votes
0answers
12 views

What will happen if we replace the transformer of BERT to evolved transformer?

If we replace the official BERT's transformer to evolved transformer, do the change accelerate the inference speed without losing accuracy?
1
vote
1answer
26 views

Structure of LSTM gates

It is my impression that a single layer LSTM architecture consists of $t$ LSTM cells that are identical duplicates, where $t$ is the number of time steps. Then there are gates within the LSTM cell. I ...
2
votes
0answers
31 views

Why are discriminative models denoted as P(Y|X?

In general, we can speak we know deterministic and probabilistic models. Discriminative ones are deterministic, while generative one is probabilistic. But I have been reading about the difference ...
1
vote
0answers
14 views

Binary classification of graph pairs

I have a dataset made of pairs of graphs and a binary label (0 or 1 depending on if the graphs are similar). I am trying to find a model that, when given two graphs, will output if these two graphs ...
0
votes
0answers
15 views

normalization/standardization of input/output of autoencoder and Gaussian Process

I have two machine learning algorithms that deal with time series data. My data consist of 1500 time series, each of 500 time components. The first machine learning algorithm is an autoencoder, ...
0
votes
1answer
21 views

Back-propagation and stochastic gradient descent

Is backpropagation a learning method or an optimisation method? How are backpropagation and stochastic gradient descent related to each other?
3
votes
1answer
64 views

Grid search or gradient descent?

Assume we have a neural network and one if its activation functions is a function of parameter a. We want to find the weights and parameter a that leads to the minimum loss on the validation set which ...
0
votes
1answer
30 views

Deep Learning for non-continuous dataset

I am working with this dataset which is record of student academic details and I want to predict the student's performance. since the dataset is non-continuous I cannot apply CNN on this dataset. ...
1
vote
0answers
17 views

How to approach mapping families of vectors on a lattice and forecast resulting value

I describe here a model to describe how neighbours influence a node. I wish to implement it to attempt forecasting to values associate nodes; I post here asking for suggestions on mathematical model ...
0
votes
0answers
16 views

LSTM pulse signal prediction

i'm trying to capture long-term dependencies using LSTM, by creating a unit pulse signal every 62 points. The idea is to go back 62 time-steps and copy the value for the next time-step, so as to ...
0
votes
0answers
16 views

What's the meaning of having a UNK token for out of vocabulary words during decoding?

Adding a UNK token to the vocabulary is a conventional way to handle oov works in tasks of NLP. It is totally understandable to have it for encoding, but what's the ...
0
votes
0answers
7 views

Can I download the Multi-Dimensional Voice Program online?

I'm trying to extract acoustic features from WAV files to create a neural network. The dataset (https://archive.ics.uci.edu/ml/datasets/parkinsons) I got these files from used the MDVP to extract ...
0
votes
0answers
7 views

How to proceed after tuning hyperparameters?

As I am still on the journey to understand what when and how to use, I am now at the point how to proceed after finding the best hyperparameters: Define Model (NN) Split Data into ...
1
vote
2answers
29 views

Why Keras Dense layer is expanding number of tensors in each layer

I have following model: and I wonder why is the number of parameters different for e.g. dense_2477 and dense_2482? Both layers ...
0
votes
0answers
8 views

Unable to achieve expected results using Artificial Neural Networks & NEAT (Neuro Evolution of augmenting topologies) on snake game

I am trying to implement NEAT for the snake game. My game logic is ready, which is working properly and NEAT configured. But even after 100 generations with 200 genomes per generation, the snakes ...
1
vote
1answer
24 views

Dealing with irrelevant features in dataset (Homework)

I have a specific question pertaining to one of my machine learning homeworks. Basically, we are required to build a model that takes a 5000*10000 dataset X (5000 examples each with 10000 features), ...