Comparisons
- Delta Lake vs Iceberg: A Neutral, Practical Comparison: how the two open table formats differ in metadata model, partitioning, deletes and clustering, catalogs, and ecosystem, plus a decision guide.
- Read and Write Delta Lake and Iceberg from One Engine: operate on both open table formats through one SQL engine without separate Spark and JVM stacks.
- Self-Hosted Databricks Alternatives for Open Lakehouse Tables: compare DuckDB, Trino, delta-rs, and DeltaForge by deployment model and write capability.
Delta Lake operations
- How to Connect Power BI to Delta Lake Without Databricks or Spark: Power BI options for Delta Lake without Databricks, including why raw Parquet is wrong and how native ODBC enables live DirectQuery.
- Query Delta Lake with SQL, ODBC and ADBC: connect Power BI, Tableau, Excel, Python, and other clients directly to Delta tables.
- MERGE, UPDATE and DELETE on Delta Lake Without Spark: full SQL DML on Delta tables in object storage, with the engine landscape laid out honestly.
- SCD Type 2 on Delta Lake in Pure SQL: a copy-paste MERGE tutorial for slowly changing dimensions, including expire-and-insert in one atomic statement.
- Delta Lake Change Data Feed in SQL: enable CDF, query table_changes(), and build an incremental pipeline end to end.
- OPTIMIZE, VACUUM and Z-ORDER Without Spark: the Delta maintenance runbook, including ordering, cadence, and partitioning guidance.
- Cannot Time Travel Delta Table to Version X: why the error happens, the retention math behind it, and the RESTORE recovery paths.
- GDPR Right to Be Forgotten on Delta Lake, in SQL: what DELETE really removes, how deletion vectors and VACUUM interact with erasure, and where pseudonymisation fits.
Apache Iceberg
- Iceberg INSERT, UPDATE, DELETE and MERGE in SQL, No Spark Required: a complete worked DML lifecycle on Iceberg tables, verified with time travel.
File formats
- Query a Folder of Files with One SQL Command: point DISCOVER at a file or folder to detect its format and generate a queryable table definition.
- CSV to Delta Lake Without Spark: Two SQL Statements: external table with automatic schema discovery, then CTAS.
- Query Excel Files with SQL, No OPENROWSET, No Notebook: xlsx workbooks in object storage as queryable tables.
- Yes, You Can Query EDI Files with SQL: X12, EDIFACT and TRADACOMS documents queried in place, no parser pipeline first.
Healthcare data
- HL7 to SQL: Query HL7v2 Messages Without an Interface Engine: ADT and ORU messages as patient and lab tables.
- FHIR Analytics Without Spark: a lighter stack for FHIR bundles and bulk-export NDJSON, joined in SQL.
Performance and scale
- DeltaForge at Scale: Table Size, Delta Log Depth, and Performance: what changes as Delta tables grow to hundreds of millions of rows, and which maintenance operations keep planning overhead predictable.
- Reduce Delta Lake Cloud Metadata Overhead with Meta Store: serve planning metadata from PostgreSQL while the Delta log remains the source of truth.
- B+ Tree Indexes for Fast Delta Lake Updates: accelerate targeted UPDATE, DELETE, and MERGE statements with row-level lookup.
- Composite PGM Indexes for Delta Lake: use a compact learned multi-column index for equality and range predicates on the indexed prefix.
- Serve Power BI Slicers from Memory with a DIM Index: answer distinct-value and slicer probes without scanning Parquet files.
Geospatial analytics
- GPS Fleet Tracking on Delta Lake with H3 SQL: index GPS pings, map them to service regions, and query fleet activity directly on Delta Lake.
Graph analytics
- Build a Property Graph on Delta Lake Tables: define a graph over existing Delta tables, then query it with Cypher or SQL without copying the data.
- Community Detection in SQL: Louvain on Delta Lake Tables: graph clustering on warehouse tables, validated against ground-truth communities.