I’d look at karlicoss’s personal data infrastructure for inspiration (or perhaps deterrent).
this post was submitted on 18 Jun 2023
28 points (100.0% liked)
Selfhosted
39939 readers
578 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 1 year ago
MODERATORS
Deterrent is right. That graph is terrifying! I feel their frustration regarding getting data from Android apps. Part of what got me started thinking about this was when I realized that the years of data I entered into my fitness pal was suddenly locked behind a subscription service :-( Thanks for sharing!
Wait My Fitness Pal went subscription model? Also, pay once, export once, cancel?
Not entirely, just for some features, including data export past a certain date iirc. I probably will wind up doing just that though if I cannot figure out how to get the data off my phone. Right now the phone app is the only place I can even see that the data exists, so I'm slightly afraid of changing anything in mfp lest it 'sync' my data out of existence 😕
Oof on that last one. I know for experience how some apps handle sync and poof data is gone forever.
Damn, that's as fascinating as it is daunting. Some impressive dedication in there regardless!
I use Home Assistant for similar purposes, with Influx DB and Grafana. There are many integrations to automatically populate data. For example, I have heart rate data from my Apple Watch flow in so I can view it in Grafana.
Brainstorming a bit, I think wiring up InfluxDB, Grafana plus some convenient way of inputting all those data sources sounds ideal. As a time series database, keeping track of how data evolves over time is InfluxDB's whole thing, Grafana or similar would be for visualizing said data. I guess the complicated part would be getting your data sources to write to it in a convenient way, not sure if there's a generic enough project out there already.
Looking around a bit, not too dissimilar to what this blog post has done.
Thanks for the suggestions. At a quick glance, grafana looks to be perfect for the visualization aspect (at least in terms of capabilities). Glad to see there are free utilities for that and I might not have to resort to chicken scratch html/pyplot :-) I have yet to dig into influxDB still...
It's not exactly what you're asking for, but you should check out the opensource Android app Track & Graph. It's also on F-Droid
It's a local app though, I don't think it has any sync function.
Nextcloud notes support markdown. It may be a starting point.
Others have mentioned influxdb, but I will recommend timescale as it extends postresql which is out of the box supported by a ton of shit
I like Obsidian. It's not open source, but all the notes, lists, habit tracking data are mostly markdown files. You can move them, back them up, convert them etc...
There are alternatives (like Logseq) but most of them lack mobile apps or plugins.
I don't see the need for complex selfhosted architectures if the goal is to get things done.