I can understand — is price too much? how much are you willing to pay for this? how about paying for indexing only ie, non recurring payment? eg: $5 for 1000 pages etc.
adrianwaj 1 days ago [-]
Wouldn't mind seeing a "search inside your upvotes" thing for HN.
Good idea on the whole.. could end up being implemented by the browsers themselves over time.
I personally think pages themselves, if they're in the cache should be easily viewable when offline - even videos and music if they're in the cache too. Don't see why it hasn't yet happened with browser caches ballooning out so easily. "Cache Viewer with search." No need to depend on bookmarks or deliberate actions.
In fact, with the local-first Fediverse, I see friends and connected people building up copies of the web themselves and only going out to "publically fetch" when the "aggregate local cache" needs updating. It could be called "stealth communities." You could even tell a page to pingback if it is updated and then all stealth communities get notified of the change for either refetch or are pushed the diff patch.
Furthermore, I have been thinking about how to host a webpage locally but have the whole world be able to access it without performance degradation in any hug-of-death scenario - cascading stealth communities are the answer. I might only send out 5 diff patches, but those changes cascade down some pyramid structure that takes up the load.
I suspect this would have a benefit to censorship and anonymity too - I just haven't thought it through. The goal is to be able to change something from anonymous to identified and vice versa. It would be so cool to release some information anonymously, but be able to de-cloak once a threshold has been reached and safety-in-numbers could be obtained - especially after user feedback, which may be anonymous too. Smart contracts that can "auto un-redact."
With stealth communities, it would act as a decentralized archive.org alternative over time. I'm sure crypto could be worked into it too - micropayments for data exchanges. People's ISP fees - can't that be distributed to hosts and communities? That would definitely be an improvement and a viable monetization strategy, right? The whole ISP model could change. Start local and work outward.
ISPs know everything about their customers, and VPNs are conglomerated too from what I've read. Something to think about. It leaves people open to cyber gang-stalking by people up the chain in the system. Do you want to have your economic and social activity usurped while being blind-sided the whole time? Are there any places left where people can get and stay online anonymously? Why? When doesn't encryption work?
shafkathullah 15 hours ago [-]
I think browsers can't go that far I guess. I don't think say google chrome would offer sync service for saves from X, Instagram, YouTube etc. with deep media indexing etc.
adrianwaj 13 hours ago [-]
"As of January 2026, custom search engines can no longer query more than 50 domains."
"All" you really need is a search engine, and then be able to customize it for each user with a set of URLs that they consider important. Use that to search/query for them.
Can a user run a conventional search?
How is it distributed? Where does the training take place? Are there minimum hardware requirements?
Good idea on the whole.. could end up being implemented by the browsers themselves over time.
I personally think pages themselves, if they're in the cache should be easily viewable when offline - even videos and music if they're in the cache too. Don't see why it hasn't yet happened with browser caches ballooning out so easily. "Cache Viewer with search." No need to depend on bookmarks or deliberate actions.
In fact, with the local-first Fediverse, I see friends and connected people building up copies of the web themselves and only going out to "publically fetch" when the "aggregate local cache" needs updating. It could be called "stealth communities." You could even tell a page to pingback if it is updated and then all stealth communities get notified of the change for either refetch or are pushed the diff patch.
Furthermore, I have been thinking about how to host a webpage locally but have the whole world be able to access it without performance degradation in any hug-of-death scenario - cascading stealth communities are the answer. I might only send out 5 diff patches, but those changes cascade down some pyramid structure that takes up the load.
I suspect this would have a benefit to censorship and anonymity too - I just haven't thought it through. The goal is to be able to change something from anonymous to identified and vice versa. It would be so cool to release some information anonymously, but be able to de-cloak once a threshold has been reached and safety-in-numbers could be obtained - especially after user feedback, which may be anonymous too. Smart contracts that can "auto un-redact."
With stealth communities, it would act as a decentralized archive.org alternative over time. I'm sure crypto could be worked into it too - micropayments for data exchanges. People's ISP fees - can't that be distributed to hosts and communities? That would definitely be an improvement and a viable monetization strategy, right? The whole ISP model could change. Start local and work outward.
ISPs know everything about their customers, and VPNs are conglomerated too from what I've read. Something to think about. It leaves people open to cyber gang-stalking by people up the chain in the system. Do you want to have your economic and social activity usurped while being blind-sided the whole time? Are there any places left where people can get and stay online anonymously? Why? When doesn't encryption work?
https://en.wikipedia.org/wiki/Google_Programmable_Search_Eng...
"All" you really need is a search engine, and then be able to customize it for each user with a set of URLs that they consider important. Use that to search/query for them.
Can a user run a conventional search?
How is it distributed? Where does the training take place? Are there minimum hardware requirements?