Hacker Newsnew | past | comments | ask | show | jobs | submit | fullstacking's commentslogin

heres the rub, whos to say in the future or even now that google is really respecting the robot.txt in the first place. I know for a fact that my sites are still getting hit by AI bots but I'm "blocking" them via cloudflare. Way too many IP's originating from data center ISP. Just saying respecting the robot.txt maybe just PR lip service.


This reads like a self centered narcissist.

"How dare this person write something not pleasing me and my needs..."


I've been thinking a lot about what it would take to build a simple search engine again. I think the time for a decentralized search engine that is human vetted is now. In a way that's what sites like reddit/HN ect have become, but I think we need a real search engine not just a social network. Looking to alternatives does not leaving me feeling great right now, DuckDuckGo is just bing IE microsoft and that's not really a better trade.


Morgan from DuckDuckGo here! Some of our web links come from Bing; that's never been a secret. But at this point, we're significantly more than that. For the past two years, we've been building our own web index (see https://insideduckduckgo.substack.com/p/duck-tales-why-duckd...). Beyond web links, many of our search results, such as local results, maps, knowledge panels, answers, sports, weather, and AI features, don't come from Bing at all. When you combine all of this with our commitment to privacy and a completely different design and user experience, it's clear that DuckDuckGo is a fundamentally different search engine.


Wow, first thank you. I mean you no disrespect as I do think DuckDuckGo is the better of the options. Sadly for me Microsoft is a big deal as I'm a Jew by ethnicity who takes great issue with the harm Israel has caused people in the name of my ancestors. For me anything that helps provide Microsoft any financial support is real a conflict of interest for me. That said these are my own personal issues and I don't expect other people to confirm to my own ethical views. Outside of that I'm also a programmer of 25+ years who has spent a great deal of my time watching Microsoft cause a great deal of harm to the industry. IDK about you, but I feel github has been hijacked, and don't get me started on all the tax dollars we have been spent on sharepoint type BS that can't seem do the basic requirements our governments / institutions have paid for. So yeah anything you can do to distance yourself from them would be something that makes me take a real look at duckduckgo again.

Aside my ranting about M$, if I may ask why go beyond web search, or put another way how do you not end up on the same path as google / bing going that path?


Is there a path to submit new content, ie websites, to be indexed and crawled? How does new content get seeded into DDG’s internal index?


ditch Bing, and make AI go away, or at least make it opt-in.

those things are why i went somewhere other than DDG.

i find myself searching with cUrl a lot more lately.


How do you search with curl?


you bash on perl, with pipes and cURL.


Sure, I understand the interface - I'm primarily asking what URLs you pass to the cli

Thoughts on Kagi? It's a paid product which slows down network effects. However, I'd argue search being "free" is part of the problem.


I think the issue of search being free greatly depends on who is providing the content / doing the work. If the links are provided by the public than yeah it should be free, but if the links are provided by a singular entity who had to do the work then the question is did they provide you a service and what is it worth to you? I would argue the core issue is less a monetary issue and more a public domain vs corporate ownership issue. We need a publicly owned web search so that the ethics involved with using said search can be better enforced.


I meant from a software architecture / maintenance standpoint. I assume its that much more work to backport vs just pushing the next change, I also assume this type of issue is only going to happen more thus more backporting / hotpatches ect.


Many users will never accept rolling releases so it doesn't matter if that's easier for the distro developers.


The address optional. So no its not required to provide your address.

Also that's not a non zero chance there are people like this but honestly, whos gonna get on a plane in today's economy, fly to some random place, break in to someone ones house all over a what is on average a $2k bike. IDK risk vs reward seems a little crazy to me.


It does not look like encryption is even stated on their homepage.

1: bkmker is encrypted. Think 1pass but for bookmarks.

2: This is not a browser bookmark syncing tool. Its a stand alone bookmarking tool and website, it does not share your bookmarks with the browser. You can review the bookmarks from any browser.

3: Zero knowledge privacy. The only data bkmker knows about your bookmarks is the opaque binary produced from the encryption that happened client side. We never store or ever see your private key, we have zero web tracking (the exception your IP only used for tracking auth tokens so you as a user can revoke them)

4: We also allow you to save meta data about the site such as their preview image, tags and notes, this makes reviewing your bookmarks a much more enjoyable experience vs just looking at the title.

5: We are just simply bookmarks, by keeping the ui simple and distraction free don't overwhelm you when you just need to navigate to your bookmarks.

6: Our plugin focuses on fast and simple, one click add bookmark operations.

7: We don't data mine you, the only thing we know about you is your email used to register and the total number of bookmarks you have, that's it. We will never sell or share anything about you with anyone ever.


This is cringe AF though.

"Just to put it on a pin: Danes hate flashy cars with a passion that stretches back much further than the current green excuses. But buying a $300,000 Ferrari in Denmark is one of the most patriotic things you can possibly do! You'll end up paying almost three times the price for the privilege, and sending 2/3s of that to the treasury in taxes. Truly a contribution to the common cause worthy of admiration, not scorn! "


Thanks, I hate it.


The link is the example. I built a static site generator for this same template, but now I offer free hosting via a subdomain and a simple to use admin for those with no idea how to host their own. I will be adding custom domains later but for now its supported via subdomain

Also only supporting US, CA and MX at the moment


Thats not even the same thing.

My other link is a static site generator for restaurants.

Note the sub domain?

It's a completely different project.

* Food near me - https://localcafe.org

* Full Serverisde Website for restaurants - https://full.localcafe.org

* Static Site generator for restaurants - https://lite.localcafe.org

* Simple form for listing biz on OSM - https://localcafe.org/locations/submit/new

This url is a form for submitting a location that I review and add to OSM on someone's behalf making it much easier for small biz people to add their location to OSM.

Again this is not the same


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: