Empowering Developers: Microsoft Fabric Extension for VS Code Goes Open Source Microsoft is inviting developers to take the reins with the open-source Fabric Core extension for Visual Studio Code. This strategic move not only demonstrates the company’s commitment to transparency... community data engineering developer tools extensions GitHub Microsoft Fabric open-source VS Code
Databricks Data Orchestration: Table Update Triggers in Lakeflow Jobs Start eliminating the guesswork from your data workflows where pipelines launch the moment fresh data lands, and insights never lag behind reality. With Databricks’ latest table update triggers in Lak... automation Databricks data engineering data orchestration event-driven Lakeflow Jobs table triggers Unity Catalog
Docker MCP Toolkit Supercharges Codex: From Code Generation to Data Engineering Today’s AI coding assistants are impressive, but what if they could do more than just suggest code? By connecting OpenAI’s Codex to Docker’s Model Context Protocol (MCP) servers with the Docker MCP To... AI assistants automation Codex data engineering Docker knowledge graphs MCP Toolkit Neo4j
dbt Agents and the Remote MCP Server Are Shaping Trusted AI Analytics Analytics is entering a new era, driven by AI-powered agents and robust governance frameworks. dbt Labs recently unveiled the remote dbt MCP Server alongside dbt Agents, a suite of secure, task-specif... AI agents analytics data engineering dbt Fusion engine governance MCP server self-service analytics
Databricks Variant: The Open Standard For Semi-Structured Data in the Lakehouse Organizations increasingly face the challenge of managing vast amounts of semi-structured data, such as logs and telemetry, in analytics and AI workflows. Historically, teams had to choose between slo... Apache Iceberg data engineering data performance Delta Lake lakehouse Parquet semi-structured data Variant
Hugging Face’s FinePDFs Dataset For AI Training AI research has long relied on web-scraped content, but Hugging Face’s FinePDFs dataset is set to change the landscape. By sourcing over 475 million documents directly from PDFs, often considered too ... AI data engineering datasets Hugging Face language models machine learning open source PDF
AI-Driven Vibe Coding and Rust Are Changing Data Engineering Building high-performance, reliable data tools is more crucial than ever and Rust is at the forefront of this movement. Thanks to the surge in AI-powered development, a new approach called vibe coding... AI coding asynchronous processing data engineering parallel computing performance optimization Rust vibe coding
Rust Is Disrupting Data Engineering and Outpacing Python and Java Data engineering is undergoing a quiet revolution. Rust, a language once known mainly to systems programmers, is rapidly gaining traction in data engineering and challenging Python and Java’s dominanc... data engineering ELT pipelines Java memory safety performance Python Rust software development