This can work for some things but I wanted to run hermes with 16gb but 12b is to... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

gargola_ 3 months ago | parent | context | favorite | on: Ask HN: Has anyone replaced Claude/GPT with a loca...

This can work for some things but I wanted to run hermes with 16gb but 12b is too low and the context was too limited, they recommend 27b

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact