Back

@sanityinc hey, thanks for that! TIL about parquet and duckdb.

@xenodium Yeah, you can also use duckdb to directly query sqlite DBs, compressed (or plain) CSV files, JSON, and more, even over http. It's a pretty great set of powertools, and their extensions to regular SQL are very interesting. There are even spatial extensions for it now. Worth checking out the #duckdb hashtag.

@sanityinc @xenodium Wow, I saw your earlier post about duckdb and filed it away as maybe someday. I’m quite partial to sqlite’s commitment to minimum faff and status as an established option, but you’re doing a good job bumping duckdb up my queue.

@acowley @xenodium Definitely worth checking out. Like sqlite, it's not just that it's satisfyingly efficient and minimal, but it's also just somehow fun.

@acowley @xenodium In the MELPA case, I'm even thinking about converting the web logs to parquet for long-term storage. If I can't use an open source project like that for random self-indulgence, what's even the point? But also, just about to get someone at work started with DuckDB for an upcoming project...

@xenodium @sanityinc Took a look at C++ usage, and is there actually no API documentation? I was able to finally piece something together with clangd’s help, but I felt like I had to roam somewhat alarmingly far from the beaten path.

@acowley @xenodium I think development is quite fast and I suspect a little chaotic, so that doesn't surprise me.

@sanityinc @xenodium Have you used client libraries in any other languages? I imagine C and Python might be the tier 1 choices.

@acowley @xenodium I've only used the Python bindings. I just looked for OCaml bindings and there aren't any usable ones yet... danger of yaks...