Skip to content

Commit

Permalink
Merge branch 'release-1.1' into develop
Browse files Browse the repository at this point in the history
  • Loading branch information
tlimbacher committed Oct 22, 2020
2 parents 78631b8 + 8185e9c commit 8a0e0a5
Showing 1 changed file with 18 additions and 2 deletions.
20 changes: 18 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# H-Mem: Harnessing synaptic plasticity with Hebbian Memory Networks
This is the code used in the paper "[H-Mem: Harnessing synaptic plasticity with Hebbian Memory
Networks](https://www.biorxiv.org/content/10.1101/2020.07.01.180372v1)" for training H-Mem on a single-shot
Networks](https://www.biorxiv.org/content/10.1101/2020.07.01.180372v2)" for training H-Mem on a single-shot
image association task and on the bAbI question-answering tasks.

![H-Mem schema](https://i.imgur.com/fK3UWaP.png)
Expand Down Expand Up @@ -48,5 +48,21 @@ python babi_task_single.py --task_id=4 --memory_size=20 --epochs=50 --logging=1

will train the model with an associative memory of size 20 on task 4 for 50 epochs. The results will be stored in `results/`.

### Memory-dependent memorization
In our extended model we have added an 'read-before-write' step. This model will be used if the
command line argument `--read_before_write` is set to `1`. Run the following command

```bash
python babi_task_single.py --task_id=16 --epochs=250 --read_before_write=1
```

to start training on bAbI task 16 in the 10k training examples setting (note that we trained the extended
model for 250 epochs---instead of 100 epochs). You should get an accuracy of about 100% on this task. Compare
to the original model, which does not solve task 16, by running the following command

```bash
python babi_task_single.py --task_id=16 --epochs=250
```

## References
* Limbacher, T., Legenstein, R. (2020). H-Mem: Harnessing synaptic plasticity with Hebbian Memory Networks bioRxiv https://www.biorxiv.org/content/10.1101/2020.07.01.180372v1
* Limbacher, T., Legenstein, R. (2020). H-Mem: Harnessing synaptic plasticity with Hebbian Memory Networks bioRxiv https://www.biorxiv.org/content/10.1101/2020.07.01.180372v2

0 comments on commit 8a0e0a5

Please sign in to comment.