josiete.com

Csvkit

csvkit: a toolkit for working with CSV files in the terminal

Illustration of a terminal connected to CSV documents and data tables through processing stages

A CSV file arrives. Before loading it into a database, you want to see its columns, check for missing values, and find the records you need. Opening a spreadsheet works, but becomes inconvenient when you have to repeat the same operation across several files. Writing a program for every check is not always worthwhile either.

csvkit brings together command line tools for converting and processing tabular data. It is written in Python and handles many of these tasks with short commands you can save and run again.