This has been posted before, he has some weird criteria and no one has been able to replicate his kagi results
this post was submitted on 02 Feb 2024
132 points (83.0% liked)
Technology
59674 readers
4499 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
What a huge wall of text, so horribly formatted using a very ineligible font and it looks awful on the phone.
Plus it is kind of dumb to measure search engines based on such a low number of queries. You are introducing a huge bias and the generated search results are ranked by a single person also introducing his own bias. The idea is interesting the execution not so much.
Idk, doing this "properly" would take an immense amount of effort and manpower. This feels more like a "let me get enough info for an educated guess" EDA process, which still seems to have taken a lot of effort and I appreciate it a lot.
But basing a recommendation on a ballpark anectdotal evidence is eidiculous.
Did he actually recommend one? That said, it's obvious the author favors Marginalia personally, but there's no point pretending they don't have biases. At least for me, making them obvious helps.
I was skeptical at first though let me tell you, Kagi is so much better. I get exact search terms, which is immensely useful as a programmer, rather than providing results for what Google thinks I want to search for. It's also really, really nice not seeing ads as search results anymore, ad blocker or no ad blocker.
Is it as comprehensive as Google search? It meets about 95-96% of my needs. I still use Google very infrequently for some really obscure domain specific searches if Kagi doesn't find anything useful, though that's getting rarer and rarer.
It's also easy to block AI generated sites that pop up providing just enough likeness, but really are regurgitated AI trash, or are 'Wikipedia clones'.
I have no financial interest in Kagi, other than paying to use it. It has certainly been worth it for me.
Did you try Marginalia?
it meets your criteria+ it's opensource.
Is it broken? It returns nothing.
???
It seems like the query was the problem. “Bitscan forward NASM” didn’t return anything but “NASM bsf” did return 2 results although they weren’t very useful.
So this whole post is an advertisement, then.
Personal recommendations are not really advertisements.
I really liked Kagi at first, especially since I use it mainly for programming as well, but recently I feel like the quality has gone downhill. Right around the time they integrated the Brave stuff I've noticed a significant amount of me having to scroll down past the usual Google-like fluff results before getting to actually relevant information. It's a little sad to see because when I first used it, it was so good now it basically feels like a skinned Google-lite at this point. I'm still a customer but only because I haven't found a good alternative yet.
Are people actually using ChatGPT as a search engine?
It depends. Chatbots are terrible at broad queries or parsing very detailed information, but they're surprisingly good with very fuzzy searches. If I want a link to a specific website I go to a search engine. If I want to ask "hey, what's that 80s horror comedy that's kinda like Gremlins but not Gremlins and it has one of the monsters coming out of the toilet in the poster?" I go to a chatbot.
EDIT: Heh. Just for laughs, I tried that exact query on Perplexity.ai. It got it right:
The movie you are referring to is "Ghoulies." It is a 1984 horror comedy film that features small, impish creatures similar to those in Gremlins. One of the iconic images associated with the movie is a Ghoulie coming out of a toilet, which is also featured on the poster.
I find this fascinating because that seems like the most difficult of the 3 to do for a normal search engine and sounds like an incredibly useful tool, but everybody and their mother seems to only care about whether it can do the other 2 or if you can trick it into spilling military secrets.
Well, yeah. So much of this conversation has gotten really dumb, with both advocates and detractors misrepresenting the tech and its capabilities and applying it to the wrong uses and applications as a result.
Honestly, early on I did think as a summary service for search queries it'd be more useful than it ended up being. It quickly became obvious that without the search results onscreen you basically have to fact check every piece of info you get, so it's only really useful to find answers you already know but had forgotten or that you need a source for.
But hey, at least I noticed that it kinda isn't before I built it as a key part of Windows. At this point if I was going to build a search app around this tech I'd use it for a short summary to replace Google's little blurb cards and still give you the raw results immediately below. It's only really good at parsing a wonky search prompt into a more accurate query. That's why when I have to use one of these I go to Perplexity instead of raw ChatGPT or Bing or whatever, it's the one that's built the most like that, although you still end up having to argue with it when it insists on being wrong and gets sidetracked by its own mistakes.
I use it as an answer engine. Queries like: what's that css property for xyz, or please summarize this email, or give me the top 25 most commonly used color words in English in a json schema like this.
All of that could be found with a normal search engine but I'd have to work harder and sort through a lot of trash along the way.
ChatGPT just understands what I'm looking for almost no matter how poorly worded my query is and just answers the question.
please summarize this email
As long as you realize they store and use that email.
It's a whatever question you ask engine. You can ask for the information directly and/or ask for sources to back it up.
https://www.youtube.com/watch?v=oqSYljRYDEM&pp=ygUTbGVnYWwgZWFnbGUgY2hhdGdwdA%3D%3D
Yes, they do. Lawyers in the US did, citing invented cases in court.
Here is an alternative Piped link(s):
https://www.piped.video/watch?v=oqSYljRYDEM&pp=ygUTbGVnYWwgZWFnbGUgY2hhdGdwdA%3D%3D
Piped is a privacy-respecting open-source alternative frontend to YouTube.
I'm open-source; check me out at GitHub.
More and more yes. You often get an answer without having to link out to some bullshit site with ads everywhere. It's often pretty clean and precise.
Wrong, but precise.
Interesting responses here - perhaps I’ll add it to my daily rotation as a science experiment.
I like duck duck go, but it is so hopeless when it comes to finding a local company website,
It's just Bing.
What a painful read. Search results will vary to a degree based on your profession and interests. Personally I haven't found anything that beats Kagi and the UI is too notch which matters to me since I use search quite a bit.
The queries are:
download youtube videos
ad blocker
download firefox
Why do wider tires have better grip?
Why do they keep making cpu transistors smaller?
vancouver snow forecast winter 2023
A sample size of 6? This is useless.
Friendly reminder to go use searxng
Google just killed its cache service. Bad news for searxng.
How are they related? I have no idea how searxng works.
Seconded
Someone will fix it and untill then i guess ill survive without google results in my searches
I am happy with kagi, so... But I abondoned google a long time ago and basically switched from DuckDuckGo to Kagi
Anyone else wonder if Dan Luu’s stuff is ever worth the read? Generally I’m interested in what he talks about and has to say, but every article/post of his gives me serious info dump vibes. And sure, I like deep dives and long form as much, even today, but I with his content I’m always feeling like I didn’t need to read all of this and that he just likes writing a lot. Anyone else? Not I didn’t bother reading this one because it definitely seemed not worth it.
At least what I see with this experiment/article is that is overly verbose, he takes a long time to get to the point. And then when he does his methodology shows an experiment that cannot be verified. Even when something is "subjective" we can still draw conclusions from it if we set up proper non-subjective ways of evaluating the results we see (ie. Rubrics). The fact that he doesn't really say what leads him to say in detail what is a "terrible/v. bad/bad/good result" is a massive red flag in his method.
After seeing that, I no longer read the rest of it. Any conclusions drawn from a flawed methodology are inherently fallacies or hearsay.
If in any case it is further explained in the article and that somehow refutes what I've postulated later on, then I would have to say that the article is poorly written.
All this to say... I agree with you, not worth the read.
The entire post is exact details for why he decides each rating for each query
No it isn’t. He for example evaluate that Kagi and Marginalia get the same score if you have to read as far down as to the 10th result for Kagi, while Marginalia has no answer. How is that the same score? There is no explanation. There is a lot of text, and then in the end he has made some subjective choices.
Oh, then that's a bit inconsistent
load more comments
(3 replies)
Marks who are getting swindled into paying for a bad product sold by a bad dude are real upset in these comments.
Great read, thanks! On my way to try marginalia
You fell for the marginalia ad!
Well, my bad. Anyway, I can't make it work with Firefox focus. The search results analysis is still relevant though. I miss the early days of light fast clean Internet search
view more: next ›