Machine Learning
Federated Learning

Aggregating Low Rank Adapters in Federated Fine-tuning

Fine-tuning large language models requires high computational and memory resources, and is therefore associated with significant costs. When training on federated datasets, an increased communication effort is also needed. For this reason, parameter-efficient methods (PEFT) are becoming increasingly important.

Read the article: https://ieeexplore.ieee.org/document/10840125

References

IEEE
Share article on LinkedIn

NEWSLETTER

Read past editions on LinkedIn