Blog Posts | Joshua Berkowitz

29 Articles

Databricks ×

Genesis Workbench: Empowering Life Sciences Innovation with Generative AI on Databricks

Generative AI is reshaping biotechnology, but many researchers still grapple with technical barriers from configuring high-performance compute environments to managing secure data access. Genesis Work...

Databricks data governance generative AI life sciences ML workflow NVIDIA BioNeMo protein modeling single-cell analysis

Dec 9, 2025

0

News

How Automated Prompt Optimization: Efficient Performance at a Fraction of the Cost

Enterprises striving to leverage AI for complex tasks often face a trade-off: high accuracy usually comes at a high cost, especially with leading proprietary models. Recent Databricks research reveals...

AI benchmarking automation cost reduction Databricks enterprise AI large language models open-source AI prompt optimization

Dec 6, 2025

0 451

News

How Apache Spark’s Real-Time Mode Delivers Millisecond Latency for Streaming Applications

Today’s organizations rely on real-time insights to stay competitive. Apache Spark Structured Streaming has introduced a groundbreaking real-time mode, empowering data teams to process streaming event...

Apache Spark Databricks fraud detection low latency machine learning real-time streaming stream processing

Dec 6, 2025

0 231

News

Instant Analytics: How Databricks Serverless Workspaces Transform Data Projects

Launching analytics or AI initiatives often means wrestling with complex infrastructure before any real work can begin. Now, with Databricks' Serverless Workspaces, teams can bypass these hurdles and ...

AI infrastructure cloud computing cost management Databricks data governance serverless workspaces

Dec 4, 2025

0 253

News

Gemini 3 Pro Arrives on Databricks

For thehassle of complex setup or moving sensitive information to integrate your buiness data with AI. With the native integration of Google’s Gemini 3 Pro model into Databricksusers can tap into cutt...

agentic reasoning AI agents Databricks enterprise AI Gemini 3 Pro multimodal models real-time automation

Nov 28, 2025

0 2156

News

Databricks Unveils Distributed Machine Learning on Serverless and Standard Clusters

Databricks is lowering the barriers to powerful machine learning (ML) by introducing distributed ML on both serverless and standard clusters, now in public preview. This advancement streamlines the sc...

Databricks data governance distributed ML Lakeguard machine learning Optuna serverless Spark MLlib

Nov 25, 2025

0 2145

News

Databricks Launches a Game-Changing IDE for Data Engineering Teams

Databricks has introduced a purpose-built Integrated Development Environment (IDE) tailored for data engineers working with Lakeflow Spark Declarative Pipelines. This innovative workspace brings toget...

AI Assistance Automation CI/CD Databricks Data Engineering Declarative Pipelines IDE Lakeflow

Nov 21, 2025

0 4290

News

Databricks ai_parse_document: Transforming Unstructured Documents into Actionable Data

With Databricks’ new ai_parse_document capability, every PDF, diagram, or table in your organization could be instantly transformed into structured, queryable data. Considering that nearly 80% of ente...

AI agents Databricks data governance document intelligence enterprise AI PDF parsing unstructured data

Nov 18, 2025

0 5632

News

Databricks Unveils General Availability of Native OpenAI Models for Enterprises

You can now leverage the power of OpenAI’s most advanced models, such as GPT-5, right where your organizational data resides. Databricks has announced that OpenAI models are now generally available on...

AI governance AI integration AI models Databricks Data intelligence Enterprise AI GPT-5 OpenAI

Nov 10, 2025

0 3190

News

From Pilot to Production: Building Custom AI Judges with Databricks

Transitioning generative AI (GenAI) projects from pilot to production is a common stumbling block. Many organizations struggle to measure and meet quality requirements, which are critical for ensuring...

AI evaluation AI governance Databricks GenAI Judge Builder LLM judges subject matter experts

Nov 10, 2025

0 1540

News

Espresso AI's SQL Optimizer Supercharges Databricks Performance

As organizations harness ever-larger datasets, keeping SQL queries fast and budgets under control is a growing pain. Espresso AI’s Databricks SQL Optimizer tackles this challenge head-on, promising to...

AI tools Cloud cost savings Data analytics Databricks Enterprise data Performance tuning SQL optimization

Nov 7, 2025

0 1529

News

Databricks Agent Bricks Elevates Trust and Scalability in Enterprise AI

As organizations accelerate their adoption of AI agents, the challenge lies in combining innovation with rigorous trust, accuracy, and compliance. Databricks Agent Bricks addresses these imperatives b...

AI agents Databricks document intelligence enterprise AI governance MCP Catalog MLflow scalability

Nov 4, 2025

0 12661

News

1
2
3

Our latest content

Check out what's new !

See all

Ads

Prompt Maker Image Generator

Struggling with the perfect AI image prompt? My free app helps you generate brilliant ideas and instantly creates an image to match. Go from concept to creation in two clicks!

Most Popular Articles

Check out what the hot topics are!

See all

Every shirt tells a story—and every story

#ClothingForACause