97
What do people really ask chatbots? It’s a lot of sex and homework.
(www.washingtonpost.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 07 Aug 2024
97 points (97.1% liked)
Technology
58123 readers
4039 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
There are models you can download and run at home that doesn't have the politically correct censorship inside. It's very nice to not have artificial politeness for example, and the models actually answers your actual questions.
You need a powerful computer for some of them though.
Such as? Where would technologically proficient AI-beginner start?
For a user without much technical experience using a ready-made gui like Jan.ai with automatic model download and ability to run models with the ggml library on consumer grade hardware like mac M-series chips or cheap GPUs by either Nvidia or AMD is probably a good start.
For a little bit more technically proficient users Ollama is probably a great choice to start to host your own OpenAI-like API for local models. I mostly run gemma2 or small llama 3.1 like models with that.
OpenWebUI is also a great and simple solution, that's using Ollama under the hood. Was pretty easy to setup with Docker.