The Sherpa.ai Federated Learning and Differential Privacy Framework is an open-source framework for Machine Learning that allows collaborative learning to take place, without sharing private data. It has been developed to facilitate open research and experimentation in Federated Learning and Differential Privacy. Federated Learning is a Machine Learning paradigm aimed at learning models from decentralized data, such as data located on users’ smartphones, in hospitals, or banks, and ensuring data privacy. This is achieved by training the model locally in each node (e.g., on each smartphone, at each hospital, or at each bank), sharing the model-updated local parameters (not the data) and securely aggregating them to build a better global model. Federated Learning can be combined with Differential Privacy to ensure a higher degree of privacy. Differential Privacy is a statistical technique to provide data aggregations, while avoiding the leakage of individual data records. This technique ensures that malicious agents intervening in the communication of local parameters can not trace this information back to the data sources, adding an additional layer of data privacy. This technology could be disruptive in cases where it is compulsory to ensure data privacy, as in the following examples:
- When data contains sensitive information, such as email accounts, personalized recommendations, and health information, applications should employ data privacy mechanisms to learn from a population of users whilst the sensitive data remains on each user’s device.
- When data is located in data silos, an automotive parts manufacturer, for example, may be reluctant to disclose their data, but would benefit from models that learn from other manufacturers' data, in order to improve production and supply chain management.
- Due to data-privacy legislation, banks and telecom companies, for example, cannot share individual records, but would benefit from models that learn from data across several entities.
Sherpa.ai is focused on democratizing Federated Learning by providing methodologies, pipelines, and evaluation techniques specifically designed for Federated Learning. Hereunder there are some examples that illustrates the benefits of using our platform.