Blog Posts | Joshua Berkowitz

4 Articles

semantic routing ×

Unleashing Enterprise AI: The Power of Signal-Decision Routing

Modern AI systems face escalating complexity when routing user queries to the right models and workflows. Standard classification-based approaches, like the old vLLM Semantic Router, struggle to keep ...

AI architecture compliance decision logic enterprise AI Kubernetes plugin orchestration semantic routing signal extraction

Nov 19, 2025

0 1243

News

Modular Architecture and LoRA Supercharge Semantic Routing Efficiency

Semantic routing has historically hit a wall when scaling to new classification tasks. Each new intent or filter often required an additional heavy machine learning model, driving up computational cos...

cloud-native Flash Attention LoRA machine learning modular architecture multilingual models Rust semantic routing

Oct 27, 2025

0 4070

News

Intent-Aware LLM Gateways: A Practical Review of vLLM Semantic Router

Large language model applications rarely involve a single task or a single best model. A customer conversation can shift from arithmetic to code to creative writing within minutes. The vLLM Semantic R...

envoy extproc llm gateway modernbert openai-compatible api owasp llm top 10 semantic caching semantic routing

Oct 14, 2025

0 26191

Github Repos

Smarter LLMs: How the vLLM Semantic Router Delivers Fast, Efficient Inference

Large language models are evolving rapidly. Instead of simply increasing their size, innovators now focus on maximizing efficiency, reducing latency, and assigning compute resources according to query...

enterprise AI Kubernetes latency optimization LLM inference model efficiency open source AI semantic routing

Sep 17, 2025

0 51359

News

Our latest content

Check out what's new !

See all

Ads

Prompt Maker Image Generator

Struggling with the perfect AI image prompt? My free app helps you generate brilliant ideas and instantly creates an image to match. Go from concept to creation in two clicks!

Most Popular Articles

Check out what the hot topics are!

See all

Every shirt tells a story—and every story

#ClothingForACause