News | Joshua Berkowitz

28 Articles

Databricks ×

How Automated Prompt Optimization: Efficient Performance at a Fraction of the Cost

Enterprises striving to leverage AI for complex tasks often face a trade-off: high accuracy usually comes at a high cost, especially with leading proprietary models. Recent Databricks research reveals...

AI benchmarking automation cost reduction Databricks enterprise AI large language models open-source AI prompt optimization

Dec 6, 2025

0 143

How Apache Spark’s Real-Time Mode Delivers Millisecond Latency for Streaming Applications

Today’s organizations rely on real-time insights to stay competitive. Apache Spark Structured Streaming has introduced a groundbreaking real-time mode, empowering data teams to process streaming event...

Apache Spark Databricks fraud detection low latency machine learning real-time streaming stream processing

Dec 6, 2025

Instant Analytics: How Databricks Serverless Workspaces Transform Data Projects

Launching analytics or AI initiatives often means wrestling with complex infrastructure before any real work can begin. Now, with Databricks' Serverless Workspaces, teams can bypass these hurdles and ...

AI infrastructure cloud computing cost management Databricks data governance serverless workspaces

Dec 4, 2025

0 132

Gemini 3 Pro Arrives on Databricks

For thehassle of complex setup or moving sensitive information to integrate your buiness data with AI. With the native integration of Google’s Gemini 3 Pro model into Databricksusers can tap into cutt...

agentic reasoning AI agents Databricks enterprise AI Gemini 3 Pro multimodal models real-time automation

Nov 28, 2025

0 2068

Databricks Unveils Distributed Machine Learning on Serverless and Standard Clusters

Databricks is lowering the barriers to powerful machine learning (ML) by introducing distributed ML on both serverless and standard clusters, now in public preview. This advancement streamlines the sc...

Databricks data governance distributed ML Lakeguard machine learning Optuna serverless Spark MLlib

Nov 25, 2025

0 1947

Databricks Launches a Game-Changing IDE for Data Engineering Teams

Databricks has introduced a purpose-built Integrated Development Environment (IDE) tailored for data engineers working with Lakeflow Spark Declarative Pipelines. This innovative workspace brings toget...

AI Assistance Automation CI/CD Databricks Data Engineering Declarative Pipelines IDE Lakeflow

Nov 21, 2025

0 4169

Databricks ai_parse_document: Transforming Unstructured Documents into Actionable Data

With Databricks’ new ai_parse_document capability, every PDF, diagram, or table in your organization could be instantly transformed into structured, queryable data. Considering that nearly 80% of ente...

AI agents Databricks data governance document intelligence enterprise AI PDF parsing unstructured data

Nov 18, 2025

0 4906

Databricks Unveils General Availability of Native OpenAI Models for Enterprises

You can now leverage the power of OpenAI’s most advanced models, such as GPT-5, right where your organizational data resides. Databricks has announced that OpenAI models are now generally available on...

AI governance AI integration AI models Databricks Data intelligence Enterprise AI GPT-5 OpenAI

Nov 10, 2025

0 3025

From Pilot to Production: Building Custom AI Judges with Databricks

Transitioning generative AI (GenAI) projects from pilot to production is a common stumbling block. Many organizations struggle to measure and meet quality requirements, which are critical for ensuring...

AI evaluation AI governance Databricks GenAI Judge Builder LLM judges subject matter experts

Nov 10, 2025

0 1496

Espresso AI's SQL Optimizer Supercharges Databricks Performance

As organizations harness ever-larger datasets, keeping SQL queries fast and budgets under control is a growing pain. Espresso AI’s Databricks SQL Optimizer tackles this challenge head-on, promising to...

AI tools Cloud cost savings Data analytics Databricks Enterprise data Performance tuning SQL optimization

Nov 7, 2025

0 1474

Databricks Agent Bricks Elevates Trust and Scalability in Enterprise AI

As organizations accelerate their adoption of AI agents, the challenge lies in combining innovation with rigorous trust, accuracy, and compliance. Databricks Agent Bricks addresses these imperatives b...

AI agents Databricks document intelligence enterprise AI governance MCP Catalog MLflow scalability

Nov 4, 2025

0 11836

Databricks Delivers Fast, Scalable PEFT Model Serving for Enterprise AI

Enterprises aiming to deploy AI agents tailored to their proprietary data face the challange of delivering high-performance inference that can scale with complex, fragmented workloads. Parameter-Effic...

Databricks enterprise AI GPU optimization inference LoRA model serving PEFT quantization

Oct 28, 2025

0 3542

Our latest content

Check out what's new !

See all

Ads

Prompt Maker Image Generator

Struggling with the perfect AI image prompt? My free app helps you generate brilliant ideas and instantly creates an image to match. Go from concept to creation in two clicks!

Try It

Most Popular Articles

Check out what the hot topics are!

See all

Follow us

Our latest content

Prompt Maker Image Generator

Most Popular Articles

Every shirt tells a story—and every story

#ClothingForACause