Tools

Estimate bandwidth needed to reach a particular level of compute utilization when doing DiLoCo-type of communication.

Interactive visualization of Mixture-of-Experts (MoE) architecture showing self-attention, router, layer norms, and expert MLPs.

Helper tool to compute tax and take-home for London, Paris, NYC, and San Francisco in three different currencies.

Visualize and compare different clipping strategies for probability ratios in Group Relative Policy Optimization.