Blog Posts | Joshua Berkowitz

8 Articles

github × deep learning ×

Dion Optimizer: Transforming Distributed AI Training Efficiency

Optimizers such as Adam and AdamW have been essential to training large-scale neural networks. However, as model sizes soar into the trillions of parameters, the need for more efficient training metho...

AI optimization deep learning distributed training large language models open source orthonormal updates PyTorch scalability

Nov 16, 2025

0 5049

News

TorchAO: A PyTorch-Native Shortcut To Smaller, Faster Models

TorchAO is PyTorch's native toolkit for model efficiency: it unifies post-training quantization (PTQ), quantization-aware training (QAT), float8 (FP8) training, and structured sparsity in one coherent...

deep learning FP8 model efficiency open source PyTorch QAT quantization sparsity TorchAO

Nov 4, 2025

0 17677

Github Repos

Revolutionizing Genome Annotation: The Power of SegmentNT

Deciphering the human genome, with its 3 billion nucleotides, remains one of biology’s greatest challenges. Precisely mapping genes and regulatory elements is crucial for understanding gene expression...

bioinformatics deep learning foundational models genome annotation genomics machine learning multi-species SegmentNT

Oct 30, 2025

0 1804

News

AI-Powered DeepSomatic Sets New Standard in Tumor Variant Detection

Genetic mutations drive cancer, but pinpointing true variants amid sequencing errors has been a challenge for researchers. DeepSomatic is an AI tool developed by Google Research and collaborators that...

AI in healthcare bioinformatics cancer genomics deep learning open source tools precision medicine variant detection

Oct 23, 2025

0 2695

News

Skala: The Deep Learning Breakthrough Accelerating Computational Chemistry

What if you could forecast chemical reactions and design new materials with laboratory-level precision, all without setting foot in a lab? Skala, a revolutionary deep-learning-based exchange-correlati...

AI for Science Azure AI computational chemistry deep learning density functional theory Microsoft Research molecular simulation

Oct 13, 2025

0 5665

News

How Foundation Models Are Transforming Scientific Discovery

Foundation models such as large language models have made waves in language processing and computer vision, but their leap into scientific disciplines is both exciting and complex. Scientific fields d...

data efficiency deep learning foundation models machine learning physical constraints scientific discovery time series forecasting uncertainty quantification

Sep 29, 2025

0 10296

Scaling Laws Unveiled: The Mathematical Blueprint Behind Smarter, Cheaper AI Models

Training a state-of-the-art language model can cost tens of millions of dollars and months of computation time, not to mention the expertise needed for development. Yet until now, researchers have bee...

AI Chinchilla deep learning GPT-3 language models machine learning neural networks optimization principal component analysis scaling laws statistical methodology

Sep 20, 2025

0 3652

Papers

Neural Networks Are Transforming 3D Rendering: Inside Microsoft's RenderFormer

3D rendering powers our most captivating digital experiences, from blockbuster movies to cutting-edge virtual reality. Traditionally, this field has relied on physics-based methods to recreate the int...

3D rendering AI research computer graphics deep learning machine learning neural networks RenderFormer SIGGRAPH

Sep 11, 2025

0 11539

News

Our latest content

Check out what's new !

See all

Ads

Prompt Maker Image Generator

Struggling with the perfect AI image prompt? My free app helps you generate brilliant ideas and instantly creates an image to match. Go from concept to creation in two clicks!

Most Popular Articles

Check out what the hot topics are!

See all

Every shirt tells a story—and every story

#ClothingForACause