josiete.com

DuckDB

DBeaver: the data engineer's Swiss Army knife

A beaver working with Parquet data and DuckDB in DBeaver

Some tools solve one specific task. Others eventually become the whole toolbox. DBeaver belongs to the second category: it is a cross-platform database client for connecting to, querying, exploring, editing, and exporting data without changing applications. For a data engineer, it feels a lot like a graphical Swiss Army knife.

What is DBeaver?

DBeaver is a desktop application for working with databases and other data sources. It supports JDBC connections, schema and table browsing, SQL with autocomplete, execution-plan inspection, record editing, and data export.

DuckDB: the analytical duck that just landed at AWS

Illustration of DuckDB connected to Amazon Web Services infrastructure

Some tools appear in data pipelines because a large company imposes them. Others spread because they solve an everyday problem with an elegance that is hard to ignore. DuckDB belongs to the second category. It is a small, fast, embeddable analytical database that can query local or remote files with SQL. In recent years it has become a common part of Data Engineering, Data Science, and Analytics Engineering workflows.