Source code of "Graph-Bert: Only Attention is Needed for Learning Graph Representations".
The paper at arXiv is available at https://arxiv.org/abs/2001.05140
At our group homepage, we also have a copy released: http://www.ifmlab.org/files/paper/graph_bert.pdf
Please check the script.py as the entry point. We suggest to run the code with Pycharm.
Several toolkits may be needed to run the code (1) pytorch (https://anaconda.org/pytorch/pytorch) (2) sklearn (https://anaconda.org/anaconda/scikit-learn) (3) transformers (https://anaconda.org/conda-forge/transformers) (4) networkx (https://anaconda.org/anaconda/networkx)
Learning results of Graph-Bert with graph-raw residual on Cora dataset.
Learning results of Graph-Bert with raw residual on Cora dataset.