Blog Posts | Joshua Berkowitz

2 Articles

github × Large Language Models ×

TorchTitan: Democratizing Large-Scale Distributed Training with PyTorch

TorchTitan: Democratizing Large-Scale Distributed Training with PyTorch A comprehensive look at PyTorch's native solution for production-ready LLM pre-training Distributed training of large language m...

AI Infrastructure Context Parallel Distributed Training Float8 FSDP2 Large Language Models Open Source Pipeline Parallel PyTorch Tensor Parallel torch.compile TorchTitan

Oct 7, 2025

0 26774

Github Repos

Pruning LLMs With Regional Gradients: Inside Wanda++

Large language models are hard to deploy because memory and latency balloon with scale. In Findings of the Association for Computational Linguistics: ACL 2025, Yifan Yang and colleagues from the Unive...

AWQ Quantization Fine Tuning Large Language Models LLaMA Model Compression Model Pruning OpenLLaMA Regional Gradients Semi-Structured Sparsity Sparsity TensorRT Wanda++

Aug 29, 2025

0 5896

Papers

Our latest content

Check out what's new !

See all

Ads

Prompt Maker Image Generator

Struggling with the perfect AI image prompt? My free app helps you generate brilliant ideas and instantly creates an image to match. Go from concept to creation in two clicks!

Try It

Most Popular Articles

Check out what the hot topics are!

See all

Follow us

Our latest content

Prompt Maker Image Generator

Most Popular Articles

Every shirt tells a story—and every story

#ClothingForACause