Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The idea behind unsupervised training #2

Open
hockman1 opened this issue Dec 26, 2020 · 0 comments
Open

The idea behind unsupervised training #2

hockman1 opened this issue Dec 26, 2020 · 0 comments

Comments

@hockman1
Copy link

Hi, I refer to the training of digit recognition. Is my interpretation correct:

  1. We train each output neuron with a specific class. Meaning to say, suppose I have 100 images of class 1 ( 16 x 16 size). I initialise 256 input Poisson neurons with spike rate proportional to the pixel intensity and 1 output neuron, so there are 256 synapses specific to that output neuron. I run the simulation over 300ms x 100 (suppose I expose each image for 300ms) then I extract all the synaptic weights once training is done. Now if I have 100 images of class 2, I initialise a NEW set of 256 input poisson neurons and 1 NEW output neuron and I repeat the workflow, ...

  2. In this case, there is no concept of trained model, but rather trained synaptic weights. So each output neuron is characterised by their own 256 synaptic weights. This means that if I have 10 classes, and I use 10 output neurons, I will have 10 sets of 256 synaptic weights and together with the STDP definition, this constitutes a model.

  3. To assign a class to that output neuron, all I need is to feed the training images over the 10 sets of 256 synapses and record the spiking activity, albeit at zero learning rate, so weights will always be constant (The ones that are trained), the only change is how the output potential evolves and hits the threshold?

Thank you and have a happy holiday!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant