Blog Posts | Joshua Berkowitz

35 Articles

Databricks ×

How Dicer Is Revolutionizing Auto-Sharding for Distributed Systems

Engineering teams can struggle to scale distributed systems efficiently while maintaining performance and reliability. The introduction of Dicer, Databricks’ open-source dynamic auto-sharder looks to ...

auto-sharding caching cloud infrastructure Databricks distributed systems open source performance optimization service architecture

Jan 15, 2026

0 297

News

How Databricks and Tecton Are Revolutionizing Real-Time Data for AI Agents

Databricks is integrating Tecton , a leader in real-time feature engineering, into its platformto deliver fast, reliable, and context-rich data to AI agents, empowering smarter, real-time decisions in...

AI agents Databricks data integration feature store machine learning personalization real-time data Tecton

Dec 21, 2025

0 825

News

Databricks SQL in 2025: Unleashing Fast, Intelligent, and Open Analytics

Today’s data teams demand speed, intelligence, and flexibility, without the complexity of traditional data warehouses. Databricks SQL (DBSQL) is meeting this challenge head-on, empowering organization...

AI analytics Cost management Databricks Data warehouse Lakehouse Migration Performance SQL

Dec 19, 2025

0 682

News

GPT-5.2 and Databricks Are Setting a New Standard for Trusted, Data-Aware AI Agents

You can now deploy AI agents that not only deliver accurate reasoning but also interact securely with your enterprise data, all without convoluted setups thanks to the integration of OpenAI GPT-5.2 an...

Agent Bricks AI agents Databricks Data governance Enterprise AI GPT-5.2 Multimodal AI Responses API

Dec 16, 2025

0 1342

News

Databricks GenAI Partner Accelerators Are Powering Data Engineering and Migration

Organizations are facing mounting challenges as they strive to modernize data infrastructure in the era of AI. Manual migration processes and complex, fragmented data pipelines often hinder progress, ...

AI Automation Databricks Data Engineering GenAI Legacy Modernization Migration Partner Ecosystem

Dec 11, 2025

0 957

News

OfficeQA: The Next Frontier in AI Enterprise Reasoning Evaluation

The evolution of AI agents has brought us closer to automating complex business tasks, yet measuring their true capabilities remains a challenge. Databricks' OfficeQA is anewly released, open-source b...

AI benchmarking AI evaluation Databricks data retrieval document intelligence enterprise AI grounded reasoning OfficeQA

Dec 11, 2025

0 1045

News

Genesis Workbench: Empowering Life Sciences Innovation with Generative AI on Databricks

Generative AI is reshaping biotechnology, but many researchers still grapple with technical barriers from configuring high-performance compute environments to managing secure data access. Genesis Work...

Databricks data governance generative AI life sciences ML workflow NVIDIA BioNeMo protein modeling single-cell analysis

Dec 9, 2025

0 748

News

How Automated Prompt Optimization: Efficient Performance at a Fraction of the Cost

Enterprises striving to leverage AI for complex tasks often face a trade-off: high accuracy usually comes at a high cost, especially with leading proprietary models. Recent Databricks research reveals...

AI benchmarking automation cost reduction Databricks enterprise AI large language models open-source AI prompt optimization

Dec 6, 2025

0 1683

News

How Apache Spark’s Real-Time Mode Delivers Millisecond Latency for Streaming Applications

Today’s organizations rely on real-time insights to stay competitive. Apache Spark Structured Streaming has introduced a groundbreaking real-time mode, empowering data teams to process streaming event...

Apache Spark Databricks fraud detection low latency machine learning real-time streaming stream processing

Dec 6, 2025

0 858

News

Instant Analytics: How Databricks Serverless Workspaces Transform Data Projects

Launching analytics or AI initiatives often means wrestling with complex infrastructure before any real work can begin. Now, with Databricks' Serverless Workspaces, teams can bypass these hurdles and ...

AI infrastructure cloud computing cost management Databricks data governance serverless workspaces

Dec 4, 2025

0 726

News

Gemini 3 Pro Arrives on Databricks

For thehassle of complex setup or moving sensitive information to integrate your buiness data with AI. With the native integration of Google’s Gemini 3 Pro model into Databricksusers can tap into cutt...

agentic reasoning AI agents Databricks enterprise AI Gemini 3 Pro multimodal models real-time automation

Nov 28, 2025

0 2871

News

Databricks Unveils Distributed Machine Learning on Serverless and Standard Clusters

Databricks is lowering the barriers to powerful machine learning (ML) by introducing distributed ML on both serverless and standard clusters, now in public preview. This advancement streamlines the sc...

Databricks data governance distributed ML Lakeguard machine learning Optuna serverless Spark MLlib

Nov 25, 2025

0 2981

News

1
2
3

Our latest content

Check out what's new !

See all

Ads

Prompt Maker Image Generator

Struggling with the perfect AI image prompt? My free app helps you generate brilliant ideas and instantly creates an image to match. Go from concept to creation in two clicks!

Most Popular Articles

Check out what the hot topics are!

See all

Every shirt tells a story—and every story

#ClothingForACause