Announcing: query, a command line tool to run queries on big data files (csv, parquet, avro etc) with syntax highlighting and autocomplete

Query is a command line tool to view big data files (avro, parquet, orc, csv, json and all spark supported formats) as tables and query them from an interactive console. It supports syntax colouring and autocomplete of keywords, table names and column names. Csv, json, avro, parquet, orc formats are supported. The tool is written over spark sql 3 and supports the formats that spark supports and also auto-detects the columns of the tables.

scala-cli is the only requirement to use query. scala-cli will download the jdk and dependencies automatically for query.

Screenshots and usage instructions on the github repo:

tweets

2 Likes