Skip to content
Snippets Groups Projects
README.rst 958 B
Newer Older
Rishi Sharma's avatar
Rishi Sharma committed
==============
Rishi Sharma's avatar
Rishi Sharma committed
decentralizepy
==============

Rishi Sharma's avatar
Rishi Sharma committed
-------------------------
Setting up decentralizepy
-------------------------

* Fork the repository.
* Clone and enter your local repository.
Rishi Sharma's avatar
Rishi Sharma committed
* Check if you have ``python>=3.8``.
Rishi Sharma's avatar
Rishi Sharma committed
* (Optional) Create and activate a virtual environment.
Rishi Sharma's avatar
Rishi Sharma committed
* Update pip. ::

Rishi Sharma's avatar
Rishi Sharma committed
    pip3 install --upgrade pip
    pip install --upgrade pip

Rishi Sharma's avatar
Rishi Sharma committed
* Install decentralizepy for development/ ::

    pip3 install --editable .\[dev\]
    
Rishi Sharma's avatar
Rishi Sharma committed
Node
----
* The Manager. Optimizations at process level.

Dataset
-------
* Static

Training
--------
* Heterogeneity. How much do I want to work?

Graph
-----
* Static. Who are my neighbours? Topologies.

Mapping
-------
Rishi Sharma's avatar
Rishi Sharma committed
* Naming. The globally unique ids of the ``processes <-> machine_id, local_rank``
Rishi Sharma's avatar
Rishi Sharma committed

Sharing
-------
* Leverage Redundancy. Privacy. Optimizations in model and data sharing.

Communication
-------------
* IPC/Network level. Compression. Privacy. Reliability
Rishi Sharma's avatar
Rishi Sharma committed

Model
-----
* Learning Model