Text-summarizing apps on Linux?

winety, 9 months ago

This is the library one of the Lemmy summarisation bots uses. It can be used as a CLi utility.

mrmojo, 9 months ago

Check out localAI, an open source drop in replacement for OpenAI APIs, in particular the section about text generation. From here, you can load a model with a specific prompt, in order to summarize text.

Guenther_Amanita, 9 months ago

Not exactly CLI, but GPT4All works perfectly for that.

If you want to have super simple to understand man pages, use “tldr” in the terminal, that’s very helpful!

lunicoDee, 9 months ago

PrivateGPT, takes some gigs of storage tho

art, 9 months ago

Might want to look at Llama.cpp.

Gebruikersnaam, 9 months ago

Maybe you can use what those tl;dr bots on lemmy use.

TheButtonJustSpins, 9 months ago

Just post it as an article and wait for the bots to show up.

257m, 9 months ago

You can use tldr for man pages but for generic text I don’t know. You would probably need a LLM.

zoe, 9 months ago

could anyone recommend an LLM that could be run locally or on google colab ? thanks

257m, 9 months ago (edited 9 months ago)

I believe Llama is open source but not sure how complicated it is to get running locally. Nevermind: replicate.com/blog/run-llama-locally

You can probably write a bash wrapper around it that feeds in “Can you summarize this text: (text here)” by setting the PROMPT variable the bash script. (Probably just do PROMPT=“Can you summarize this text: $1”) (Obviously don’t recompile everytime so remove the clone build and download code)

zoe, 9 months ago

thx

257m, 9 months ago

Just to warn you it might be very bulky and the model that the script is downloading is deprecated so you’ll have to find a different .gguf model on hugging face. Try to find a lightweight .gguf model and replace the MODEL variable with it nane as well the rest of the link. Or just download from a browser and move it into the models folder.

mertn, 9 months ago

head and tail

mypasswordis1234, 9 months ago

Llama2?