21
Database hosting? (lemmy.world)
submitted 3 weeks ago by Dust0741@lemmy.world to c/selfhost@lemmy.ml

Say I have a large txt or CSV file with data I want to search. And say I have several files.

What is the best way to index and make this data searchable? I've been using grep, but it is not ideal.

Is there any self hostable docker container for indexing and searching this? Or maybe should I use SQL?

you are viewing a single comment's thread
view the rest of the comments
[-] eager_eagle@lemmy.world 5 points 3 weeks ago* (last edited 3 weeks ago)

Excel / OnlyOffice?

I love self-hosted tools, but you can do a lot on a spreadsheet.

Btw, if the files are not too large, you can query them using SQL without even hosting a database just by using Pandas. This avoids the problem of updating entries and handling migrations in case the CSVs change over time.

[-] Dust0741@lemmy.world 2 points 3 weeks ago

Files won't change and are hundreds of GBs

[-] brownmustardminion@lemmy.ml 1 points 3 weeks ago

Are they roughly 55GB compressed?

load more comments (3 replies)
load more comments (3 replies)
this post was submitted on 20 Aug 2024
21 points (100.0% liked)

Self Hosted - Self-hosting your services.

11190 readers
15 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules

Important

Beginning of January 1st 2024 this rule WILL be enforced. Posts that are not tagged will be warned and if not fixed within 24h then removed!

Cross-posting

If you see a rule-breaker please DM the mods!

founded 3 years ago
MODERATORS