This is the source code for the book Distributed AI Systems by Fuheng Wu.
Mind maps, study materials, a reader group, problem sets, videos, and seminars to support your learning. Sign up for a free companion account to ask the author questions directly and get DRM-free, high-resolution diagrams.
This repository is actively maintained. If you find a bug, have a question about the code, or run into issues getting an example to run, please open an issue or pull request — updates and fixes will continue to be published here as the book evolves. Found an error in the book itself? Check or report it in the errata.
For chapter 1-4, to run the code, install the dependencies:
pip install torch torchvision numpy distaiFor other chapters, please check the requirements.txt in each chapter folder, and run:
pip install -r requirements.txtDistributed AI Systems: A Practical Guide to GPU Compute and Experimental Environments