A Survey on Contribution Evaluation in Vertical Federated Learning

Welcome to the GitHub repo of our survey paper on contribution evaluation in VFL!

Taxonomy Overview

Contribution Evaluation Workflow

Contribution Evaluation in the Lifecycle of VFL

Data Collection and Preprocessing

• Hierarchical Federated Learning Incentivization for Gas Usage Estimation [paper]
• VF-PS: How to Select Important Participants in Vertical Federated Learning, Efficiently and Securely? [paper]
• Data Valuation for Vertical Federated Learning: An Information-Theoretic Approach [paper]
• FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learning [paper]

VFL Training

• Secure Feature Selection for Vertical Federated Learning in eHealth Systems [paper]
• Failure Prediction in Production Line Based on Federated Learning [paper]
• FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learning [paper]
• An Embedded Vertical-federated Feature Selection Algorithm based on Particle Swarm Optimisation [paper]
• Vertically Federated Learning with Correlated Differential Privacy [paper]
• LESS-VFL: Communication Efficient Feature Selection for Vertical Federated Learning [paper]
• Hierarchical Federated Learning Incentivization for Gas Usage Estimation [paper]
• Fair and efficient contribution valuation for vertical federated learning [paper]
• Incentive Allocation in Vertical Federated Learning Based on Bankruptcy Problem [paper]

Model Inference

• EVFL: An explainable vertical federated learning for data-oriented Artificial Intelligence systems [paper]
• Interpret Federated Learning with Shapley Values [paper]
• Distributed Model Interpretation for Vertical Federated Learning with Feature [paper]
• Falcon: A Privacy-Preserving and Interpretable Vertical Federated Learning System [paper]
• Measure Contribution of Participants in Federated Learning [paper]
• Fed-EINI: An Efficient and Interpretable Inference Framework for Decision Tree Ensembles in Vertical Federated Learning [paper]

Granularity of Evaluation

Feature Level

• Secure Feature Selection for Vertical Federated Learning in eHealth Systems [paper]
• Fed-EINI: An Efficient and Interpretable Inference Framework for Decision Tree Ensembles in Vertical Federated Learning [paper]
• Failure Prediction in Production Line Based on Federated Learning [paper]
• FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learning [paper]
• Falcon: A Privacy-Preserving and Interpretable Vertical Federated Learning System [paper]
• An Embedded Vertical-federated Feature Selection Algorithm based on Particle Swarm Optimisation [paper]
• Vertically Federated Learning with Correlated Differential Privacy [paper]
• Data Pricing in Vertical Federated Learning [paper]
• Vertical Federated Learning-based Feature Selection with Non-overlapping Sample [paper]
• MMVFL: A Simple Vertical Federated Learning Framework for Multi-Class Multi-Participant Scenarios [paper]
• Distributed Model Interpretation for Vertical Federated Learning with Feature [paper]
• LESS-VFL: Communication Efficient Feature Selection for Vertical Federated Learning [paper]
• Data Valuation for Vertical Federated Learning: An Information-Theoretic Approach [paper]

Party Level

• EVFL: An explainable vertical federated learning for data-oriented Artificial Intelligence systems [paper]
• Fair and efficient contribution valuation for vertical federated learning [paper]
• Incentive Allocation in Vertical Federated Learning Based on Bankruptcy Problem [paper]
• VF-PS: How to Select Important Participants in Vertical Federated Learning, Efficiently and Securely? [paper]
• Measure Contribution of Participants in Federated Learning [paper]
• Efficient Participant Contribution Evaluation for Horizontal and Vertical [paper]
• Hierarchical Federated Learning Incentivization for Gas Usage Estimation [paper]
• Interpret Federated Learning with Shapley Values [paper]
• A Bargaining-based Approach for Feature Trading in Vertical Federated Learning [paper]
• Data Valuation for Vertical Federated Learning: An Information-Theoretic Approach [paper]

The Privacy Issue of Contribution Evaluation

Protocol 0 (P-0), Private Data Based

• Hierarchical Federated Learning Incentivization for Gas Usage Estimation [paper]
• Secure Feature Selection for Vertical Federated Learning in eHealth Systems [paper]

Protocol 1 (P-1), Intermediate Data Based

• EVFL: An explainable vertical federated learning for data-oriented Artificial Intelligence systems [paper]
• Fair and efficient contribution valuation for vertical federated learning [paper]
• Falcon: A Privacy-Preserving and Interpretable Vertical Federated Learning System [paper]
• Distributed Model Interpretation for Vertical Federated Learning with Feature [paper]
• Efficient Participant Contribution Evaluation for Horizontal and Vertical [paper]
• LESS-VFL: Communication Efficient Feature Selection for Vertical Federated Learning [paper]

Protocol 2 (P-2), Model-related Data Based

• Failure Prediction in Production Line Based on Federated Learning [paper]
• FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learning [paper]
• An Embedded Vertical-federated Feature Selection Algorithm based on Particle Swarm Optimisation [paper]
• Vertical Federated Learning-based Feature Selection with Non-overlapping Sample [paper]
• Hierarchical Federated Learning Incentivization for Gas Usage Estimation [paper]
• Incentive Allocation in Vertical Federated Learning Based on Bankruptcy Problem [paper]

Protocol 3 (P-3), Derived Data Based

• Interpret Federated Learning with Shapley Values [paper]
• Measure Contribution of Participants in Federated Learning [paper]
• VF-PS: How to Select Important Participants in Vertical Federated Learning, Efficiently and Securely? [paper]
• MMVFL: A Simple Vertical Federated Learning Framework for Multi-Class Multi-Participant Scenarios [paper]
• Vertically Federated Learning with Correlated Differential Privacy [paper]
• Fed-EINI: An Efficient and Interpretable Inference Framework for Decision Tree Ensembles in Vertical Federated Learning [paper]
• Data Valuation for Vertical Federated Learning: An Information-Theoretic Approach [paper]

Contribution Evaluation Methods

Shapley Value Based

• Interpret Federated Learning with Shapley Values [paper]
• Measure Contribution of Participants in Federated Learning [paper]
• Data Pricing in Vertical Federated Learning [paper]
• Fair and efficient contribution valuation for vertical federated learning [paper]
• Data Valuation for Vertical Federated Learning: An Information-Theoretic Approach [paper]
• Efficient Participant Contribution Evaluation for Horizontal and Vertical [paper]

Leave-one-out Based

• Hierarchical Federated Learning Incentivization for Gas Usage Estimation [paper]
• Efficient Participant Contribution Evaluation for Horizontal and Vertical [paper]
• Incentive Allocation in Vertical Federated Learning Based on Bankruptcy Problem [paper]
• A Bargaining-based Approach for Feature Trading in Vertical Federated Learning [paper]

Entropy Based

• Failure Prediction in Production Line Based on Federated Learning [paper]
• Vertical Federated Learning-based Feature Selection with Non-overlapping Sample [paper]
• Secure Feature Selection for Vertical Federated Learning in eHealth Systems [paper]
• Distributed Model Interpretation for Vertical Federated Learning with Feature [paper]

Others

• LESS-VFL: Communication Efficient Feature Selection for Vertical Federated Learning [paper]
• Vertical Federated Learning-based Feature Selection with Non-overlapping Sample [paper]
• MMVFL: A Simple Vertical Federated Learning Framework for Multi-Class Multi-Participant Scenarios [paper]
• Vertically Federated Learning with Correlated Differential Privacy [paper]
• An Embedded Vertical-federated Feature Selection Algorithm based on Particle Swarm Optimisation [paper]
• Fed-EINI: An Efficient and Interpretable Inference Framework for Decision Tree Ensembles in Vertical Federated Learning [paper]
• Falcon: A Privacy-Preserving and Interpretable Vertical Federated Learning System [paper]
• EVFL: An explainable vertical federated learning for data-oriented Artificial Intelligence systems [paper]

Tasks Related to Contribution Evaluation

Feature Selection

• LESS-VFL: Communication Efficient Feature Selection for Vertical Federated Learning [paper]
• Vertical Federated Learning-based Feature Selection with Non-overlapping Sample [paper]
• VF-PS: How to Select Important Participants in Vertical Federated Learning, Efficiently and Securely? [paper]
• FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learning [paper]
• Secure Feature Selection for Vertical Federated Learning in eHealth Systems [paper]
• An Embedded Vertical-federated Feature Selection Algorithm based on Particle Swarm Optimisation [paper]
• Vertically Federated Learning with Correlated Differential Privacy [paper]

Interpretable VFL

• Interpret Federated Learning with Shapley Values [paper]
• Fed-EINI: An Efficient and Interpretable Inference Framework for Decision Tree Ensembles in Vertical Federated Learning [paper]
• Falcon: A Privacy-Preserving and Interpretable Vertical Federated Learning System [paper]
• Distributed Model Interpretation for Vertical Federated Learning with Feature [paper]
• EVFL: An explainable vertical federated learning for data-oriented Artificial Intelligence systems [paper]

Incentive Mechanism Design

• Data Valuation for Vertical Federated Learning: An Information-Theoretic Approach [paper]
• Measure Contribution of Participants in Federated Learning [paper]
• Efficient Participant Contribution Evaluation for Horizontal and Vertical [paper]
• Data Pricing in Vertical Federated Learning [paper]

Payment Allocation

• Incentive Allocation in Vertical Federated Learning Based on Bankruptcy Problem [paper]
• A Bargaining-based Approach for Feature Trading in Vertical Federated Learning [paper]

Plain Contribution Measuring

• Measure Contribution of Participants in Federated Learning [paper]
• Hierarchical Federated Learning Incentivization for Gas Usage Estimation [paper]
• Efficient Participant Contribution Evaluation for Horizontal and Vertical [paper]
• Data Valuation for Vertical Federated Learning: An Information-Theoretic Approach [paper]
• Data Pricing in Vertical Federated Learning [paper]