Blog Posts | Joshua Berkowitz

4 Articles

data engineering ×

Databricks Variant: The Open Standard For Semi-Structured Data in the Lakehouse

Organizations increasingly face the challenge of managing vast amounts of semi-structured data, such as logs and telemetry, in analytics and AI workflows. Historically, teams had to choose between slo...

Apache Iceberg data engineering data performance Delta Lake lakehouse Parquet semi-structured data Variant

Oct 10, 2025

0 374

News

Hugging Face’s FinePDFs Dataset For AI Training

AI research has long relied on web-scraped content, but Hugging Face’s FinePDFs dataset is set to change the landscape. By sourcing over 475 million documents directly from PDFs, often considered too ...

AI data engineering datasets Hugging Face language models machine learning open source PDF

Sep 19, 2025

0 5907

News

AI-Driven Vibe Coding and Rust Are Changing Data Engineering

Building high-performance, reliable data tools is more crucial than ever and Rust is at the forefront of this movement. Thanks to the surge in AI-powered development, a new approach called vibe coding...

AI coding asynchronous processing data engineering parallel computing performance optimization Rust vibe coding

Sep 9, 2025

0 2310

News

Rust Is Disrupting Data Engineering and Outpacing Python and Java

Data engineering is undergoing a quiet revolution. Rust, a language once known mainly to systems programmers, is rapidly gaining traction in data engineering and challenging Python and Java’s dominanc...

data engineering ELT pipelines Java memory safety performance Python Rust software development

Jun 30, 2025

0 1914

News

Get All The Latest Research & News!

Subscribe

Our latest content

Check out what's new !

See all

Ads

Prompt Maker Image Generator

Struggling with the perfect AI image prompt? My free app helps you generate brilliant ideas and instantly creates an image to match. Go from concept to creation in two clicks!

Most Popular Articles

Check out what the hot topics are!

See all

Every shirt tells a story—and every story

#ClothingForACause