hachyderm.io is one of the many independent Mastodon servers you can use to participate in the fediverse.
Hachyderm is a safe space, LGBTQIA+ and BLM, primarily comprised of tech industry professionals world wide. Note that many non-user account types have restrictions - please see our About page.

Administered by:

Server stats:

9.7K
active users

Stacey Vetzal 🏳️‍⚧️🇨🇦

A short github gist on some data I gathered this weekend. gist.github.com/svetzal/970267

TL;DR Google's Gemma2 9B parameter model is the rock-star at accurate text transcription between documents and data structures, and will run on prosumer hardware like Macbook M series machines (common as dev workstations) and high-end Nvidia graphics cards (16GB+).

I continue to experiment with LLMs and knowledge management. I haven't published the source project yet on my github (an augmentation tool for people using the Zettelkasten method for personal knowledge management). I'm not sure when I will, I've thrown it out three times now and I'm on my fourth restart.

Performance Testing of LLMs on Text Manipulation in a Zettelkasten - README.md
GistPerformance Testing of LLMs on Text Manipulation in a ZettelkastenPerformance Testing of LLMs on Text Manipulation in a Zettelkasten - README.md