111
submitted 7 months ago by GrymEdm@lemmy.world to c/technology@lemmy.world
you are viewing a single comment's thread
view the rest of the comments
[-] jaemo@sh.itjust.works 5 points 7 months ago

Ollama is actually pretty decent at stuff now, and comparable in speed to chat gpt on a sort of busy day. I'm enjoying having a constant rubber duck to bounce ideas off.

[-] harsh3466@lemmy.ml 4 points 7 months ago

That’s cool. I haven’t looked at any local/foss llms or other generators, largely because I don’t have a use case for them.

[-] FaceDeer@fedia.io 4 points 7 months ago

If your concern is that we're "not getting anything" in exchange for the training data AI trainers have gleaned from your postings, then those open-source AIs are what you should be taking a look at. IMO they're well worth the trade.

[-] harsh3466@lemmy.ml 2 points 7 months ago

Agree. When I feel like playing and/or have a use case for myself I’ll be looking at open source ai.

[-] Evotech@lemmy.world 3 points 7 months ago

It's with playing around with. This is a good one which packages all the basics including RAG

https://github.com/imartinez/privateGPT

[-] jaemo@sh.itjust.works 2 points 7 months ago

I've been playing with a locally installed instance of big agi really like the UI but it's missing the RAG part. I'm also cobbling my own together for fun and not profit to try to stay relevant in these hard times. Langchain is some wild stuff.

[-] harsh3466@lemmy.ml 1 points 7 months ago

Thank you. Gonna save the link for when I have a use case and/or want to play around

this post was submitted on 05 Mar 2024
111 points (89.4% liked)

Technology

58737 readers
4334 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS