this post was submitted on 05 Jun 2024
820 points (98.8% liked)

linuxmemes

22168 readers
408 users here now

Hint: :q!

Sister communities:

Community rules (click to expand)

1. Follow the site-wide rules

2. Be civil
  • Understand the difference between a joke and an insult.
  • Do not harrass or attack users for any reason. This includes using blanket terms, like "every user of thing".
  • Don't get baited into back-and-forth insults. We are not animals.
  • Leave remarks of "peasantry" to the PCMR community. If you dislike an OS/service/application, attack the thing you dislike, not the individuals who use it. Some people may not have a choice.
  • Bigotry will not be tolerated.
  • These rules are somewhat loosened when the subject is a public figure. Still, do not attack their person or incite harrassment.
    • 3. Post Linux-related content
  • Including Unix and BSD.
  • Non-Linux content is acceptable as long as it makes a reference to Linux. For example, the poorly made mockery of sudo in Windows.
  • No porn. Even if you watch it on a Linux machine.
    • 4. No recent reposts
  • Everybody uses Arch btw, can't quit Vim, <loves/tolerates/hates> systemd, and wants to interject for a moment. You can stop now.
    • 5. ๐Ÿ‡ฌ๐Ÿ‡ง Language/ัะทั‹ะบ/Sprache
  • This is primarily an English-speaking community. ๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฆ๐Ÿ‡บ๐Ÿ‡บ๐Ÿ‡ธ
  • Comments written in other languages are allowed.
  • The substance of a post should be comprehensible for people who only speak English.
  • Titles and post bodies written in other languages will be allowed, but only as long as the above rule is observed.
    • ย 

    Please report posts and comments that break these rules!

    Important: never execute code or follow advice that you don't understand or can't verify, especially here. The word of the day is credibility. This is a meme community -- even the most helpful comments might just be shitposts that can damage your system. Be aware, be smart, don't remove France.

    founded 2 years ago
    MODERATORS
    poopsmith
    zephyr
    rtxn
    820
    Not Total Recall (1990) (lemmy.world)
    submitted 8 months ago* (last edited 8 months ago) by ordellrb to c/linuxmemes
    64 comments fedilink hide all child comments
     
    you are viewing a single comment's thread
    view the rest of the comments
    [โ€“] [email protected] 7 points 8 months ago (3 children)

    Can you search the screenshots with OCR though? That's Recall's main selling point

    [โ€“] Aux 59 points 8 months ago (3 children)

    You can start by running sudo apt install tesseract-ocr and then reading its docs.

    [โ€“] [email protected] 29 points 8 months ago

    Fulfills the AI quota ๐Ÿ‘

    [โ€“] [email protected] 4 points 8 months ago* (last edited 8 months ago) (1 children)

    It appears to be as simple as tesseract <infile> <outfile>. Possibly could even pipe (or tee) the screenshot straight into that and save both an image and a text file in a single command line.

    So something like this should do the trick:

    gnome-screenshot -f - | tee /Microsoft/yourPrivacy/$(date +%s).png | tesseract - /Microsoft/yourPrivacy/$(date +%s).txt

    Skip the database, just use grep to search that directory if you need to find anything. Voilร , homemade Recall.

    [โ€“] Aux 1 points 7 months ago (1 children)

    It is much better to search using ElasticSearch or Sphinx. Grep is super slow, non indexed and can't do natural language full text searches. It's pretty much useless for any real world text search you'd want from OCRed content. And all these better tools are free and open source, so really a no brainer.

    [โ€“] [email protected] 1 points 7 months ago

    Iโ€™m sure there are many ways to improve on this solution, but they would all require significantly more effort (ElasticSearch isnโ€™t exactly trivial to set up).

    This is really just a proof of concept, the most minimal viable implementation that gets you something similar in terms of functionality.

    For instance, Windows Recall stores OCR content tagged by app, this solution doesnโ€™t. Also, as others have mentioned, a practical implementation should likely check if anything has changed at all and discard any screenshots that donโ€™t have any new data.

    [โ€“] [email protected] 21 points 8 months ago (3 children)

    I can't imagine it'd be that hard to write some code that does that using an existing AI model.

    [โ€“] [email protected] 9 points 8 months ago

    I found a small command to run KDE Spectacle (screenshot software) with Tesseract so I can OCR a screenshot if I want to, I only had to install Tesseract and a main language, you could easily do the same with an API and/or a local AI.

    [โ€“] [email protected] 5 points 8 months ago

    You're probably right.

    [โ€“] [email protected] 3 points 8 months ago

    Llava and Bakllava are two Ollama models than can not only extract text but also describe what's happening on screen.

    Using tesseract-ocr, as the other guy suggested, is probably simpler and less resource intensive though.

    [โ€“] [email protected] 7 points 8 months ago

    This is a shitpost and not a real suggestion.