From c4988f36e63b3a8f67011080877e669764b20240 Mon Sep 17 00:00:00 2001 From: cheneydon Date: Wed, 11 May 2022 13:55:49 +0800 Subject: [PATCH 1/2] update README --- materials/paper_list/FL-NLP/README.md | 48 ++++++++++++++++++++++++++- 1 file changed, 47 insertions(+), 1 deletion(-) diff --git a/materials/paper_list/FL-NLP/README.md b/materials/paper_list/FL-NLP/README.md index 1177aa7f7..afd812bd1 100644 --- a/materials/paper_list/FL-NLP/README.md +++ b/materials/paper_list/FL-NLP/README.md @@ -1 +1,47 @@ -## The paper list of Federated Learning in NLP will go here. \ No newline at end of file +## Federated Learning for NLP +This list is constantly being updated. Feel free to contribute! + + +### 2022 +| Title | Venue | Link | +| --- | --- | --- | +| FedBERT: When Federated Learning Meets Pre-Training | TIST | [pdf](https://dl.acm.org/doi/pdf/10.1145/3510033) | +| FedKC: Federated Knowledge Composition for Multilingual Natural Language Understanding | WWW | [pdf](https://dl.acm.org/doi/pdf/10.1145/3485447.3511988) | + + +### 2021 +| Title | Venue | Link | +| --- | --- | --- | +| FedMatch: Federated Learning Over Heterogeneous Question Answering Data | CIKM | [pdf](https://dl.acm.org/doi/pdf/10.1145/3459637.3482345), [code](https://github.com/Chriskuei/FedMatch) | +| Federated Chinese Word Segmentation with Global Character Associations | ACL | [pdf](https://aclanthology.org/2021.findings-acl.376.pdf), [code](https://github.com/cuhksz-nlp/GCASeg) | +| Improving Federated Learning for Aspect-based Sentiment Analysis via Topic Memories | EMNLP | [pdf](https://aclanthology.org/2021.emnlp-main.321.pdf), [code](https://github.com/cuhksz-nlp/ASA-TM) | +| A Secure and Efficient Federated Learning Framework for NLP | EMNLP | [pdf](https://aclanthology.org/2021.emnlp-main.606.pdf) | +| Distantly Supervised Relation Extraction in Federated Settings | EMNLP | [pdf](https://aclanthology.org/2021.findings-emnlp.52.pdf), [code](https://github.com/DianboWork/FedDS) | +| FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Tasks | arXiv | [pdf](https://arxiv.org/pdf/2104.08815.pdf), [code](https://github.com/FedML-AI/FedNLP) | +| Scaling Federated Learning for Fine-tuning of Large Language Models | arXiv | [pdf](https://arxiv.org/pdf/2102.00875.pdf) | + + +### 2020 +| Title | Venue | Link | +| --- | --- | --- | +| Empirical Studies of Institutional Federated Learning For Natural Language Processing | EMNLP | [pdf](https://aclanthology.org/2020.findings-emnlp.55.pdf) | +| FedED: Federated Learning via Ensemble Distillation for Medical Relation Extraction | EMNLP | [pdf](https://aclanthology.org/2020.emnlp-main.165.pdf) | +| FedNER: Privacy-preserving Medical Named Entity Recognition with Federated Learning | arXiv | [pdf](https://arxiv.org/pdf/2003.09288.pdf) | +| Federated Pretraining and Fine Tuning of BERT Using Clinical Notes from Multiple Silos | arXiv | [pdf](https://arxiv.org/pdf/2002.08562.pdf) | +| Pretraining Federated Text Models for Next Word Prediction | arXiv | [pdf](https://arxiv.org/pdf/2005.04828.pdf), [code](https://github.com/federated-learning-experiments/fl-text-models) | + + +### 2019 +| Title | Venue | Link | +| --- | --- | --- | +| Federated Learning of N-gram Language Models | CoNLL | [pdf](https://arxiv.org/pdf/1910.03432.pdf) | +| Learning Private Neural Language Modeling with Attentive Aggregation | IJCNN | [pdf](https://arxiv.org/pdf/1812.07108.pdf) | +| Federated Learning Of Out-Of-Vocabulary Words | arXiv | [pdf](https://arxiv.org/pdf/1903.10635.pdf) | +| Federated Learning for Emoji Prediction in a Mobile Keyboard | arXiv | [pdf](https://arxiv.org/pdf/1906.04329.pdf) | + + +### 2018 +| Title | Venue | Link | +| --- | --- | --- | +| Federated Learning for Mobile Keyboard Prediction | arXiv | [pdf](https://arxiv.org/pdf/1811.03604.pdf) | +| Applied Federated Learning: Improving Google Keyboard Query Suggestions | arXiv | [pdf](https://arxiv.org/pdf/1812.02903.pdf) | From 987b2845107f792903940ad583d88c5118176b78 Mon Sep 17 00:00:00 2001 From: cheneydon Date: Wed, 1 Feb 2023 12:03:39 +0800 Subject: [PATCH 2/2] update paper list for FL-NLP --- materials/paper_list/FL-NLP/README.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/materials/paper_list/FL-NLP/README.md b/materials/paper_list/FL-NLP/README.md index 20996563f..2886ca054 100644 --- a/materials/paper_list/FL-NLP/README.md +++ b/materials/paper_list/FL-NLP/README.md @@ -5,6 +5,10 @@ This list is constantly being updated. Feel free to contribute! ### 2022 | Title | Venue | Link | | --- | --- | --- | +| When Federated Learning Meets Pre-trained Language Models' Parameter-Efficient Tuning Methods | arXiv | [pdf](https://arxiv.org/pdf/2212.10025.pdf), [code](https://github.com/iezhuozhuo/FedETuning/tree/deltaTuning) | +| FewFedWeight: Few-shot Federated Learning Framework across Multiple NLP Tasks | arXiv | [pdf](https://arxiv.org/pdf/2212.08354.pdf) | +| Federated NLP in Few-shot Scenarios | arXiv | [pdf](https://arxiv.org/pdf/2212.05974.pdf) | +| AUG-FedPrompt: Practical Few-shot Federated NLP with Data-augmented Prompts | arXiv | [pdf](https://arxiv.org/pdf/2212.00192.pdf) | | FedPrompt: Communication-Efficient and Privacy Preserving Prompt Tuning in Federated Learning | arXiv | [pdf](https://arxiv.org/pdf/2208.12268.pdf) | | Fair NLP Models with Differentially Private Text Encoders | arXiv | [pdf](https://arxiv.org/pdf/2205.06135.pdf), [code](https://github.com/saist1993/DPNLP) | | FedQAS: Privacy-aware Machine Reading Comprehension with Federated Learning | arXiv | [pdf](https://arxiv.org/pdf/2202.04742.pdf), [code](https://github.com/aitmlouk/FEDn-client-FedQAS-tf) |