Query is a tool to view big data files (avro, parquet, orc, csv, json and all spark supported formats) as a database and query them from an interactive console or scala ammonite scripts. It supports syntax coloring and basic autocomplete. A single csv, json or avro file or spark-generated directories with parquet, orc, csv, avro data are supported. The tool is written over spark sql 3 and supports the formats that spark supports and also autodetects the columns of the tables.
The files/directories with the data can be easily configured using ammonite scripts and spark autodetect the table structure.