DuckDuckGo, Bing, Mojeek, and other search engines are not returning full Reddit results any more.

  • Boozilla@lemmy.world
    link
    fedilink
    English
    arrow-up
    305
    arrow-down
    1
    ·
    4 months ago

    I am hoping (probably naively so) that lemmy’s stock of technical answers will continue to grow and eventually become a half decent archive for people to search for potential solutions.

    • Hot Potato@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      177
      arrow-down
      1
      ·
      4 months ago

      tbh I’ve never seen a Lemmy link when searching for stuff. Is it too small to show up? Or do search engines not index Lemmy instances?

      • TimeSquirrel@kbin.melroy.org
        link
        fedilink
        arrow-up
        145
        ·
        4 months ago

        A lot of Fediverse admins are just normal people like you and me with a budget, and disallowing bots and spiders helps save bandwidth, and the budget.

        • Admiral Patrick@dubvee.org
          link
          fedilink
          English
          arrow-up
          91
          ·
          4 months ago

          Yep. I block all bots to my instance.

          Most are parasitic (GPTBot, ImageSift bot, Yandex, etc) but I’ve even blocked Google’s crawler (and its ActivityPub cralwer bot) since it now feeds their LLM models. Most of my content can be found anyway because instances it federated to don’t block those, but the bandwidth and processing savings are what I’m in it for.

            • Admiral Patrick@dubvee.org
              link
              fedilink
              English
              arrow-up
              3
              ·
              4 months ago

              Kinda long, so I’m putting it in spoilers. This applies to Nginx, but you can probably adapt it to other reverse proxies.

              1. Create a file to hold the mappings and store it somewhere you can include it from your other configs. I named mine map-bot-user-agents.conf

              Here, I’m doing a regex comparison against the user agent ($http_user_agent) and mapping it to either a 0 (default/false) or 1 (true) and storing that value in the variable $ua_disallowed. The run-on string at the bottom was inherited from another admin I work with, and I never bothered to split it out.

              'map-bot-user-agents.conf'
              # Map bot user agents
              map $http_user_agent $ua_disallowed {
                  default 		0;
                  "~CCBot"		1;
                  "~ClaudeBot"	1;
                  "~VelenPublicWebCrawler"	1;
                  "~WellKnownBot"	1;
                  "~Synapse (bot; +https://github.com/matrix-org/synapse)" 1;
                  "~python-requests"	1;
                  "~bitdiscovery"	1;
                  "~bingbot"		1;
                  "~SemrushBot" 	1;
                  "~Bytespider" 	1;
                  "~AhrefsBot" 	1;
                  "~AwarioBot"	1;
                  "~GPTBot" 		1;
                  "~DotBot"	 	1;
                  "~ImagesiftBot"	1;
                  "~Amazonbot"	1;
                  "~GuzzleHttp" 	1;
                  "~DataForSeoBot" 	1;
                  "~StractBot"	1;
                  "~Googlebot"	1;
                  "~Barkrowler"	1;
                  "~SeznamBot"	1;
                  "~FriendlyCrawler"	1;
                  "~facebookexternalhit" 1;
                  "~*(?i)(80legs|360Spider|Aboundex|Abonti|Acunetix|^AIBOT|^Alexibot|Alligator|AllSubmitter|Apexoo|^asterias|^attach|^BackDoorBot|^BackStreet|^BackWeb|Badass|Bandit|Baid|Baiduspider|^BatchFTP|^Bigfoot|^Black.Hole|^BlackWidow|BlackWidow|^BlowFish|Blow|^BotALot|Buddy|^BuiltBotTough|
              ^Bullseye|^BunnySlippers|BBBike|^Cegbfeieh|^CheeseBot|^CherryPicker|^ChinaClaw|^Cogentbot|CPython|Collector|cognitiveseo|Copier|^CopyRightCheck|^cosmos|^Crescent|CSHttp|^Custo|^Demon|^Devil|^DISCo|^DIIbot|discobot|^DittoSpyder|Download.Demon|Download.Devil|Download.Wonder|^dragonfl
              y|^Drip|^eCatch|^EasyDL|^ebingbong|^EirGrabber|^EmailCollector|^EmailSiphon|^EmailWolf|^EroCrawler|^Exabot|^Express|Extractor|^EyeNetIE|FHscan|^FHscan|^flunky|^Foobot|^FrontPage|GalaxyBot|^gotit|Grabber|^GrabNet|^Grafula|^Harvest|^HEADMasterSEO|^hloader|^HMView|^HTTrack|httrack|HTT
              rack|htmlparser|^humanlinks|^IlseBot|Image.Stripper|Image.Sucker|imagefetch|^InfoNaviRobot|^InfoTekies|^Intelliseek|^InterGET|^Iria|^Jakarta|^JennyBot|^JetCar|JikeSpider|^JOC|^JustView|^Jyxobot|^Kenjin.Spider|^Keyword.Density|libwww|^larbin|LeechFTP|LeechGet|^LexiBot|^lftp|^libWeb|
              ^likse|^LinkextractorPro|^LinkScan|^LNSpiderguy|^LinkWalker|msnbot|MSIECrawler|MJ12bot|MegaIndex|^Magnet|^Mag-Net|^MarkWatch|Mass.Downloader|masscan|^Mata.Hari|^Memo|^MIIxpc|^NAMEPROTECT|^Navroad|^NearSite|^NetAnts|^Netcraft|^NetMechanic|^NetSpider|^NetZIP|^NextGenSearchBot|^NICErs
              PRO|^niki-bot|^NimbleCrawler|^Nimbostratus-Bot|^Ninja|^Nmap|nmap|^NPbot|Offline.Explorer|Offline.Navigator|OpenLinkProfiler|^Octopus|^Openfind|^OutfoxBot|Pixray|probethenet|proximic|^PageGrabber|^pavuk|^pcBrowser|^Pockey|^ProPowerBot|^ProWebWalker|^psbot|^Pump|python-requests\/|^Qu
              eryN.Metasearch|^RealDownload|Reaper|^Reaper|^Ripper|Ripper|Recorder|^ReGet|^RepoMonkey|^RMA|scanbot|SEOkicks-Robot|seoscanners|^Stripper|^Sucker|Siphon|Siteimprove|^SiteSnagger|SiteSucker|^SlySearch|^SmartDownload|^Snake|^Snapbot|^Snoopy|Sosospider|^sogou|spbot|^SpaceBison|^spanne
              r|^SpankBot|Spinn4r|^Sqworm|Sqworm|Stripper|Sucker|^SuperBot|SuperHTTP|^SuperHTTP|^Surfbot|^suzuran|^Szukacz|^tAkeOut|^Teleport|^Telesoft|^TurnitinBot|^The.Intraformant|^TheNomad|^TightTwatBot|^Titan|^True_Robot|^turingos|^TurnitinBot|^URLy.Warning|^Vacuum|^VCI|VidibleScraper|^Void
              EYE|^WebAuto|^WebBandit|^WebCopier|^WebEnhancer|^WebFetch|^Web.Image.Collector|^WebLeacher|^WebmasterWorldForumBot|WebPix|^WebReaper|^WebSauger|Website.eXtractor|^Webster|WebShag|^WebStripper|WebSucker|^WebWhacker|^WebZIP|Whack|Whacker|^Widow|Widow|WinHTTrack|^WISENutbot|WWWOFFLE|^
              WWWOFFLE|^WWW-Collector-E|^Xaldon|^Xenu|^Zade|^Zeus|ZmEu|^Zyborg|SemrushBot|^WebFuck|^MJ12bot|^majestic12|^WallpapersHD)" 1;
              
              }
              

              Once you have a mapping file setup, you’ll need to do something with it. This applies at the virtual host level and should go inside the server block of your configs (except the include for the mapping config.).

              This assumes your configs are in conf.d/ and are included from nginx.conf.

              The map-bot-user-agents.conf is included above the server block (since it’s an http level config item) and inside server, we look at the $ua_disallowedvalue where 0=false and 1=true (the values are set in the map).

              You could also do the mapping in the base nginx.conf since it doesn’t do anything on its own.

              If the $ua_disallowed value is 1 (true), we immediately return an HTTP 444. The 444 status code is an Nginx thing, but it basically closes the connection immediately and wastes no further time/energy processing the request. You could, optionally, redirect somewhere, return a different status code, or return some pre-rendered LLM-generated gibberish if your bot list is configured just for AI crawlers (because I’m a jerk like that lol).

              Example site1.conf
              
              include conf.d/includes/map-bot-user-agents.conf;
              
              server {
                server_name  example.com;
                ...
                # Deny disallowed user agents
                if ($ua_disallowed) { 
                  return 444;
                }
               
                location / {
                  ...
                }
              
              }
              
              
              
              • Mac@federation.red
                link
                fedilink
                English
                arrow-up
                2
                ·
                edit-2
                4 months ago

                So I would need to add this to every subdomain conf file I have? Preciate you!

                • Admiral Patrick@dubvee.org
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  ·
                  edit-2
                  4 months ago

                  I just include the map-bot-user-agents.conf in my base nginx.conf so it’s available to all of my virtual hosts.

                  When I want to enforce the bot blocking on one or more virtual host (some I want to leave open to bots, others I don’t), I just include a deny-disallowed.conf in the server block of those.

                  deny-disallowed.conf
                    # Deny disallowed user agents
                    if ($ua_disallowed) { 
                      return 444;
                    }
                  
                  site.conf
                  server {
                    server_name example.com;
                     ...
                    include conf.d/includes/deny-disallowed.conf;
                  
                    location / {
                      ...
                    }
                  }
                  
                • Admiral Patrick@dubvee.org
                  link
                  fedilink
                  English
                  arrow-up
                  0
                  ·
                  4 months ago

                  Yeah, if’s are weird in Nginx. The rule of thumb I’ve always gone by is that you shouldn’t try to if on variables directly unless they’re basically pre-processed to a boolean via a map (which is what the user agent map does).

          • MCasq_qsaCJ_234@lemmy.zip
            link
            fedilink
            English
            arrow-up
            1
            ·
            4 months ago

            I have two questions. How much do those bots consume your bandwidth? And by blocking search robots, do you stop being present in the search results or are you still present, but they do not show the content in question?

            I ask these questions because I don’t know much about the topic when managing a website or an instance of the fediverse.

            • Admiral Patrick@dubvee.org
              link
              fedilink
              English
              arrow-up
              2
              ·
              edit-2
              4 months ago

              How much do those bots consume your bandwidth?

              Pretty negligible per bot per request, but I’m not here to feed them. They also travel in packs, so the bandwidth does multiply. It also costs me money when I exceed my monthly bandwidth quota. I’ve blocked them for so long, I no longer have data I can tally to get an aggregate total (I only keep 90 days). SemrushBot alone, before I blocked it, was averaging about 15 GB a month. That one is fairly aggressive, though. Imagesift Bot, which pulls down any images it can find, would also use quite a bit, I imagine, if it were allowed.

              With Lemmy, especially earlier versions, the queries were a lot more expensive, and bots hitting endpoints that triggered a heavy query (such as a post with a lot of comments) would put unwanted load on my DB server. That’s when I started blocking bot crawlers much more aggressively.

              Static sites are a lot less impactful, and I usually allow those. I’ve got a different rule set for them which blocks the known AI scrapers but allows search indexers (though that distinction is slowly disappearing).

              And by blocking search robots, do you stop being present in the search results or are you still present, but they do not show the content in question?

              I block bots by default, and that prevents them from being indexed since they can’t be crawled at all. Searching “dubvee” (my instance name / url) in Google returns no relevant results. I’m okay with that, lol, but some people would be appalled.

              However, I can search for things I’ve posted from my instance if they’ve federated to another instance that is crawled; the link will just be to the copy on that instance.

              For the few static sites I run (mostly local business sites since they’d be on Facebook otherwise), I don’t enforce the bot blocking, and Google, etc are able to index them normally.

        • Cyborganism@lemmy.ca
          link
          fedilink
          English
          arrow-up
          23
          arrow-down
          2
          ·
          4 months ago

          Could it be possible to have one major global instance that aggregates everything so it can be indexed by search engines? Would that work? Or do I not fully understand how federation works?

          • wholookshere@lemmy.blahaj.zone
            link
            fedilink
            English
            arrow-up
            32
            arrow-down
            2
            ·
            4 months ago

            That would defeat the purpose of federation.

            It becomes a central choke point of moderation. Who gets to decide what instances are part of global and which ones aren’t. Because a free for all isn’t going to end well. And then you’re back at Reddit.

            • WanderingVentra@lemm.ee
              link
              fedilink
              English
              arrow-up
              12
              ·
              edit-2
              4 months ago

              I wonder if you could have an instance federated to every other instance just for archived purposes, to save the data on every other instance’s post and comment. Because copies of posts and comments are saved to federated instances, too, right? Or do I understand the tech wrong?

              So it could have an admin team but no users, to prevent people worried about spammers and bots joining that instance to get around defederation rules. Maybe it just has a bot that crawls Lemmy, looking for instances to federate to. Could that work?

            • rbits@lemm.ee
              link
              fedilink
              English
              arrow-up
              2
              ·
              4 months ago

              Right, but having a centralised search index thingy is better than none at all. Maybe there could be something where it’s a joint effort from admins from many of the biggest servers, idk if that would work.

          • barsoap@lemm.ee
            link
            fedilink
            English
            arrow-up
            5
            ·
            edit-2
            4 months ago

            Lemmy search already is quite excellent… at least here on lemm.ee, we don’t have many communities but tons of users subscribed to probably about everything on the lemmyverse so the servers have it all.

            It might be interesting to team up with something like YaCy: Instances could operate as YaCy peers for everything they have. That is, integrate a p2p search protocol into ActivityPub itself so that also smaller instances can find everything. Ordinary YaCy instances, doing mostly web crawling, can in turn use posts here as interesting starting points.

        • Amanda@aggregatet.org
          link
          fedilink
          English
          arrow-up
          4
          ·
          4 months ago

          I was worrying about precisely this. I’d be ok with blocking search engines if there was a better way of searching but AFAICT there isn’t federated search of any kind?

          • thejml@lemm.ee
            link
            fedilink
            English
            arrow-up
            20
            ·
            4 months ago

            Any data transit costs money. Both in the data transit itself and in the increased server resources to respond to the web queries in the first place.

            • chrischryse@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              ·
              4 months ago

              Ah that makes sense not really familiar iwth this stuff so didn’t think it’s that intensive lol

      • u/lukmly013 💾 (lemmy.sdf.org)@lemmy.sdf.org
        link
        fedilink
        English
        arrow-up
        24
        ·
        4 months ago

        I’ve seen some when I appended “Lemmy” just like “Reddit”. But it relies on lemmy being in the domain name.

        Also I assume even when people click on those results, they don’t get ranked much higher because it’s so many different domains while reddit is just one.

        • Ibuthyr@discuss.tchncs.de
          link
          fedilink
          English
          arrow-up
          10
          ·
          edit-2
          4 months ago

          Kagi has a button that lets you search fediverse forums. I haven’t tested it yet though.

          Edit: yup, works like a charm!

      • infeeeee@lemm.ee
        link
        fedilink
        English
        arrow-up
        18
        arrow-down
        2
        ·
        4 months ago

        Most of the originalish content on lemmy are linux related stuff, memes and porn. The latter 2 are mostly image/video based, so you don’t search for that very frequently and easily. I can see that in the future it will become a very relevant source of info in linux admin and user circles.

        I go back to r*ddit sometimes for some local content which is non existent on lemmy. I see that the tech related subs are mostly dead there, or at least only shadows of their former selfs. E.g. go to r/linux, sort by top all time. In the first 100 results you will barely find anything posted after the exodus.

        • MudMan@fedia.io
          link
          fedilink
          arrow-up
          12
          ·
          4 months ago

          Yeah, the notion that Lemmy is a Reddit replacement is misguided. It definitely doesn’t have the same Q&A balance Reddit does. It feels a lot more like 90s and early 2000s forums than the large-scale self-service link and customer service churn Reddit encourages.

          Which I’m all for. I was never a Reddit guy and I do like it here. But in terms of how bad it is now that Reddit is not happy to host most of the actually useful online content for free… well, that’s a different conversation.

      • BombOmOm@lemmy.world
        link
        fedilink
        English
        arrow-up
        15
        arrow-down
        3
        ·
        edit-2
        4 months ago

        You can always add “site:lemmy.world” to your search (remove the quotes). I commonly do that, as well as the same for reddit or stack overflow.

      • NotAnotherLemmyUser@lemmy.world
        link
        fedilink
        English
        arrow-up
        9
        ·
        4 months ago

        One of the major problems with Lemmy is that many posts get deleted and that nukes the comment section (which is where most of the answers will be).

        I wish Lemmy deleted posts closer to how Reddit deletes posts - the post content should be deleted, but leave the comments alone.

      • Gerudo@lemm.ee
        link
        fedilink
        English
        arrow-up
        5
        ·
        4 months ago

        Twice I have come across links to lemmy, definitely not the norm though.

      • chiisana@lemmy.chiisana.net
        link
        fedilink
        English
        arrow-up
        4
        ·
        4 months ago

        I’m inclined to think due to the nature of the platform, contents are constantly duplicated to the eyes of search engines, which hurts authoritativeness of each instance thereby hurts ranking.

    • daniskarma@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      15
      ·
      4 months ago

      Problem is that we’ll probably need a dedicated search engine for that. As answers are spread in lots of instances, some of them without “lemmy” in the name, I assume.

      • tea@lemmy.today
        link
        fedilink
        English
        arrow-up
        5
        ·
        4 months ago

        Seems like a solvable problem though. We have a list of federated servers inately built into activitypub, right? Just need to tag results from those servers as being linked to a “lemmy” keyword search.

        I’m sure I’m oversimplifying it, but all the pieces are there, just need search engines to be smart about how they index. Since there are a couple of federation based models that would be good to index, not just lemmy, it would probably behoove them to figure it out.

    • XNX@slrpnk.net
      link
      fedilink
      English
      arrow-up
      11
      ·
      4 months ago

      Yeah but we need non technical stuff too which i what i hate about the ui and stuff mot trying to be made simpler for non tech people to start using lemmy. I want doctors, lawyers, and casual people asking questions about everyday items and stuff so i can search “best sleep mask lemmy” or any product category and find good discussions. Would also help if lemmy.com was an instance instead of just redirecting to lemm.ee

      • brbposting@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 months ago

        I think we have to contribute our hours of UX assistance to see changes there. The brilliant engineers who donate their time probably both focus on working features first and specialize more in technical problem-solving than visual design.

        Voyager is quite lovely btw!

        • XNX@slrpnk.net
          link
          fedilink
          English
          arrow-up
          1
          ·
          4 months ago

          I use voyager and its great but people will discover it through the website so its should be improved/simplified as well

    • NuXCOM_90Percent@lemmy.zip
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      2
      ·
      edit-2
      4 months ago

      Highly doubtful.

      The few times I have bothered to ask technical questions I mostly get one of the following:

      1. Ideological ranting. “The problem is you aren’t running arch linux in that corporate environment with proprietary hardware you need to interface with”
      2. Complete refusal to read the question. “I totally didn’t read that you said Foo was not viable for reasons XYZ but you should use Foo”
      3. Complete nonsense

      Reddit has a lot of that too but ALSO has the institutional knowledge of people who actually care enough to answer. Similar to stack overflow.

      I try to help where I can but this is an enthusiast “site”. So you have all the people who suggest all the crap they heard on linus tech tips rather than “Okay, for my day job we use X but no sane person should use that at home. Look into Y”.


      That said: I have said it before and I’ll say it again. The age of the online message board for tech support is long gone. Because the super useful results might be talking about a bug from five years ago rather than a bug from today. The answer really is ephemeral discord servers.

      • fuzzzerd@programming.dev
        link
        fedilink
        English
        arrow-up
        9
        ·
        4 months ago

        Ephemeral discord servers are awful because they don’t scale and they can only ever help the lowest common denominator of questions/issues. We need something else, but it has yet to present itself as a solution.

        • NuXCOM_90Percent@lemmy.zip
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          4 months ago

          I’m sure you’ve had bad experiences but they actually scale as well as any forum ever did and are great because the general vibe is not “This was asked ten years ago, go figure out some search terms” and more actually responding to and helping people.

          The key is to have a moderated support channel.

          • fuzzzerd@programming.dev
            link
            fedilink
            English
            arrow-up
            4
            ·
            4 months ago

            It’s a never ending onslaught of beginner questions and experienced folks with domain knowledge burn out. I’m sure it’s good when it’s new and fresh and everyone is exited to participate, but that wears out. It’s why things went away from mailing lists, or why mailing lists started getting archived, so they could be searched.

            I guess with most things it comes in cycles, and we’re at the on demand answers cycle right now.

            • NuXCOM_90Percent@lemmy.zip
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              1
              ·
              4 months ago

              That has not at all been my experience over the years.

              Yes, the vast majority of questions are “beginner questions”. Which… is true no matter where you go.

              But when someone has the ability to articulate a “real” problem? Everyone comes out of the woodwork because that is actually interesting. And there is a very strong communal feeling of “we all have the same problem and are trying to collect data”

    • butter@midwest.social
      link
      fedilink
      English
      arrow-up
      4
      ·
      4 months ago

      Drop a link to a few places people ask tech questions and I will do my part to contribute

    • communism@lemmy.ml
      link
      fedilink
      English
      arrow-up
      3
      ·
      4 months ago

      Really for technical answers things should be on a forum. Troubleshooting a linux distro, post on the distro’s forums. Troubleshooting a piece of software, make an issue on its codeberg/github/gitlab/etc. It makes sense that if you’re having an issue with a specific thing you ask for help on a forum dedicated to that thing. I don’t think it’s a positive that things are becoming centralised onto generalised social media, even for more decentralised federated social media like Lemmy. It just makes support for a given piece of software more spread out and harder to find.

    • object [Object]@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      3
      ·
      4 months ago

      This might be a hot take, but I hope that we as a platform are toxic enough to advertisers so that big tech’s enshittification and advertising never becomes a problem.

      • tea@lemmy.today
        link
        fedilink
        English
        arrow-up
        3
        ·
        4 months ago

        As I understand it, Lemmy, being FOSS, is pretty immune to this since there are no big tech shareholders to appease. Lemmy is susceptible to EEE (embrace, extend, extinguish) via something like Threads, however.

  • daniskarma@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    117
    arrow-down
    1
    ·
    4 months ago

    To be fair, Reddit is no longer that good of a source for answers in the later years.

    Quality drop in comments is insane. Sometimes it looks like Quora.

    • villainy@lemmy.world
      link
      fedilink
      English
      arrow-up
      80
      ·
      4 months ago

      Also my collection of hobbies seems to match up well with the people who nuked their post history after the API-ocalypse. Even when I get good search results I click through and… so many deleted comments…

      • LifeOfChance@lemmy.world
        link
        fedilink
        English
        arrow-up
        9
        ·
        4 months ago

        As someone who hobby hops I’ve had to just accept reddit is just not a viable option anymore. I’ve been using YouTube (revanced) to learn and get tips. I miss the interactions with people though…

      • Mnemnosyne@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        10
        arrow-down
        15
        ·
        4 months ago

        It irritates me that so many forums and media sites allow you to edit your posts at will. There’s one site I go to that I like very much - it has a 5 minute edit window, and after that, your post can no longer be edited. You can’t change what you said, pretend you never said things, etc, once you say something it remains. It would be nice if more sites were like that. Or at least, if you edit/delete something, for there to be an option to check the history to see what it used to be, so if you try to delete some comment you made people can still check it. Whether it’s informational, or it’s because you’re trying to hide something you said that you realize was actually super shitty and people are getting angry at you for it, I prefer things to stick.

        • Liz@midwest.social
          link
          fedilink
          English
          arrow-up
          23
          ·
          4 months ago

          Nah, people should be able to take back what they said. No humans in all of history had to account for every thing thing they ever said. Better to let the past be forgotten. Can that be abused? Sure. But I think there’s value in letting people realize what they said was bad and take it down.

          • Halosheep@lemm.ee
            link
            fedilink
            English
            arrow-up
            3
            ·
            4 months ago

            I think there’s a happy middle ground where deletion just disassociates the comment with you. It will show (deleted) or something but the original text remains.

            Maybe there should be exclusions for personal or identifying information in such a system.

            • umbrella@lemmy.ml
              link
              fedilink
              English
              arrow-up
              1
              ·
              4 months ago

              text can easily be traced back to its original writer nowadays using AI statistical analysis. especially on internet forums where people are not necessarily worrying about grammar and accuracy.

          • Mnemnosyne@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            4 months ago

            Better to acknowledge it in a response. I prefer to do that myself if I’m wrong or something of that nature, post a reply acknowledging instead of trying to cover up that I was ever wrong in the first place.

            • Liz@midwest.social
              link
              fedilink
              English
              arrow-up
              3
              ·
              4 months ago

              I agree with you, and I never delete what I post unless it was straight-up a glitch or a typo or something. But, I still think other people should have that option if they want it.

    • Kecessa@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      29
      ·
      4 months ago

      I was looking for Bluetooth speakers recommendations and it’s the first time I really noticed “generic bot replies” like “I’ve got this great product to recommend, not only is it good but it offers great sound quality as well! The product is [link to Amazon page]”

      Gotta start searching using “before:” to get quality results…

      • brbposting@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 months ago

        I’m seeing bots promoted and sold to generate those kinds of replies, RIP internet, looking forward to SSN/DNA+background check review verification (I kid but I half dream of that privacy nightmare partially plugging the review fraud hole).

        • Halosheep@lemm.ee
          link
          fedilink
          English
          arrow-up
          2
          ·
          4 months ago

          I’m with you on embracing the privacy nightmare to kill off cheaters in games. Tie an account to a real identity and that problem will quickly reduce.

      • Angry_Autist (he/him)@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        4
        ·
        4 months ago

        Haha wtf are you saying Lemmy is now like what reddit was in 2016 and by the end of next year it will be like reddit is now.

        Same reason for the downfall too: Activist mods and hands-off admins that don’t care if their mods harass.

        Only a matter of time

        • smort@lemmy.world
          link
          fedilink
          English
          arrow-up
          5
          ·
          4 months ago

          Lemmy needs people with a wider range of expertise and interests. Right now it’s more niche than reddit c.2010

        • ThunderWhiskers@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          4 months ago

          This is patently untrue. I want Lemmy to be successful as much as any other user on here but reddit had 150-200 million MAU in 2016. Lemmy is being recorded as a generous 2 million.

  • Kowowow@lemmy.ca
    link
    fedilink
    English
    arrow-up
    96
    ·
    4 months ago

    They should include reddit in the list of search engines that don’t work well with reddit

  • jackyard@lemmy.world
    link
    fedilink
    English
    arrow-up
    76
    ·
    4 months ago

    After seeing this news I just created this lemmy account. I hope people make the right decision and move on to lemmy.

  • JackbyDev@programming.dev
    link
    fedilink
    English
    arrow-up
    74
    ·
    4 months ago

    If you use Bing, DuckDuckGo, Mojeek, Qwant or any other alternative search engine that doesn’t rely on Google’s indexing and search Reddit by using “site:reddit.com,” you will not see any results from the last week.

    That’s absolutely insane… Reddit truly is making things awful. The “just add reddit” or “just add site:reddit.com” has been trash for a while because they bombard you with the “pwease use the app” and not showing more than like three comments at a time. It’s useless.

    • UnderpantsWeevil@lemmy.world
      link
      fedilink
      English
      arrow-up
      24
      arrow-down
      1
      ·
      4 months ago

      Reddit truly is making things awful.

      They’re no longer interested in driving traffic to the site, is my guess. They’re far more interested in devising new ways to extract rents from the existing participant base. So rather than pay Google to prioritize their site, or incentivize Google to link to their site with internal content hygenie techniques, now they’re getting paid by Google to exclusively serve up content.

      It’s useless.

      The sheer volume of junk content, the amount of content that just shows up as deleted or archived, and the rate at which I’m served “Reddit” as a source of data when there’s no conceivable reason why it should be near the top of my search list is very frustrating.

    • umbrella@lemmy.ml
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      4 months ago

      “pwease use the app”

      the ublock origin annoyances list can filter this out at least, i strongly recommend it

    • namingthingsiseasy@programming.dev
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      2
      ·
      4 months ago

      The “just add reddit” or “just add site:reddit.com” has been trash for a while

      Has that ever been true? I always assumed it was some sort of shadow marketing campaign to get people to look at reddit more. Pretending that one website is the only reliable source of answers on the internet is incredibly audacious, it always seemed very farfetched to suggest that

      • JackbyDev@programming.dev
        link
        fedilink
        English
        arrow-up
        3
        ·
        4 months ago

        It’s not that it was the “only” source, it’s just that it would fit out a bunch of garbage articles like “top 10 best ways to blah blah blah”

    • lightnsfw@reddthat.com
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 months ago

      I mean, it’s unlikely anything of value has been posted to reddit in the last week anyway. Or like the last 2 years.

  • splonglo@lemmy.world
    link
    fedilink
    English
    arrow-up
    71
    ·
    4 months ago

    It’s honestly a travesty what’s happened to Reddit. If I want to search for a forum topic or something where random people give their honest opinions, Reddit was about the only place left on the internet and now that’s gone too.

    • Katrisia@lemm.ee
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      1
      ·
      4 months ago

      I mean, the people still exist and the need for honest opinions is still there. We just need to find a new place where money isn’t such a big problem (although it will always be a problem to some degree). I really think a more stable and easy to use Lemmy could attract a large crowd.

    • Lets_Eat_Grandma@lemm.ee
      link
      fedilink
      English
      arrow-up
      8
      arrow-down
      1
      ·
      edit-2
      4 months ago

      Reddit has been viral marketing for over a decade. Very little of what is on there should be taken at face value in terms of reviews of products. The only thing it’s good for is to find information about fixes for things or some very broad generic info.

      The recent crowdstrike debacle had a fix on their subreddit before it was communicated anywhere else. Stuff like that is still relevant at least.

      • model_tar_gz@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        4 months ago

        Niche subreddits were still good. Fuck the mains, but there was a lot of really good content, even very technical, in tightly focused communities like r/LocalLLaMA, etc. In a lot of ways the format of how conversations flow there work better (and worse) than stackoverflow. Still is good content, but I really can’t bring myself to go there because of the nasty shenanigans that spez put the communities through.

        I really hoped for a while that Reddit would be the one to break the embrace, extend, extend, enshittify mold that so many great techs succumb.

        But everyone has a sellout price and so the EEEE seems to be a law of nature.

    • filcuk@lemmy.zip
      link
      fedilink
      English
      arrow-up
      49
      arrow-down
      2
      ·
      4 months ago

      Unfortunately (for me, I guess), appending ‘reddit’ is still the way to go for many queries…

      • ShepherdPie@midwest.social
        link
        fedilink
        English
        arrow-up
        27
        arrow-down
        1
        ·
        4 months ago

        I’ve notice a huge decline in the reliability of using this now that every company on earth knows about this trick. You’ll just be served up posts with 0-3 comments and few upvotes when searching for product reviews or recommendations for example.

      • communism@lemmy.ml
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 months ago

        Really? For what queries though? I mostly look up tech troubleshooting when ime there are much higher quality results from forums or sometimes stack exchange sites

        • rbits@lemm.ee
          link
          fedilink
          English
          arrow-up
          2
          ·
          4 months ago

          Yeah for tech stuff stack exchange is the way to go. But if I’m looking for info on non-tech stuff, there’s not really a site that I know of that has a bunch of general user submitted q&a. There’s quora, but that’s absolutely horrible.

          Also even with stack exchange, the rules are a bit more strict there, low effort posts are uncommon which can mean you can’t find some stuff there. Although usually there’s some other forum you can find your answer on.

  • III@lemmy.world
    link
    fedilink
    English
    arrow-up
    65
    ·
    4 months ago

    Great, neither Google search or reddit work anymore. They deserve each other.

  • cmrn@lemmy.world
    link
    fedilink
    English
    arrow-up
    65
    ·
    4 months ago

    Every time I click a Reddit link now it’s just “download the app to verify your age” regardless of what it is

      • PraiseTheSoup@lemm.ee
        link
        fedilink
        English
        arrow-up
        37
        ·
        4 months ago

        There’s a firefox extension “old reddit redirect” that’ll do this for you. Been using it for years. But yeah any day now I expect old reddit to be offline.

        • Omniraptor@lemm.ee
          link
          fedilink
          English
          arrow-up
          5
          arrow-down
          2
          ·
          4 months ago

          I don’t, I’m convinced it’s a “if you raise the price of the hotdog, I will kill you” kind of deal (as in, some of the devs still use the old UI for themselves)

          • rbits@lemm.ee
            link
            fedilink
            English
            arrow-up
            3
            ·
            4 months ago

            I mean, I would’ve said the same about the mobile apps, but here we are.

            • Omniraptor@lemm.ee
              link
              fedilink
              English
              arrow-up
              2
              ·
              edit-2
              4 months ago

              That’s different, they didn’t remove the apis that enable mobile apps, they just made them unreasonably expensive. But you can theoretically still use them

  • Todd Bonzalez@lemm.ee
    link
    fedilink
    English
    arrow-up
    55
    ·
    4 months ago

    Oh good, I can’t view most reddit threads without an account anymore, so it’ll be nice to see those results go away.

        • sugar_in_your_tea@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          7
          ·
          edit-2
          4 months ago

          Yes you can. I literally just did it now to check, and it works fine. I get the “download the app” nonsense, edit the URL, then I can see the content just fine. It works every time.

    • McOkapi@lemmy.ml
      link
      fedilink
      English
      arrow-up
      2
      ·
      4 months ago

      I wasn’t aware of this, when did it start? So far, it has never happened to me not to be able to view reddit threads

      • Wispy2891@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 months ago

        They’re so scared from ai scrapers stealing “their” content that they blocked wide ranges of IP address

        I can’t see it from my VPN for example

    • gmtom@lemmy.world
      link
      fedilink
      English
      arrow-up
      59
      arrow-down
      1
      ·
      4 months ago

      No, they’re transitioning to different use bases that don’t give a shit when they’re screwed over.

      Go to reddit now and it’s celebrity drama, pop music, and Indian sub reddit. Oh and Love Island.

      • cheddar@programming.dev
        link
        fedilink
        English
        arrow-up
        9
        arrow-down
        2
        ·
        4 months ago

        Oh yes! They have a quite popular sub where people actively hate Taylor Swift. The sub’s mods remove your comments and threaten to ban you if you ask: “Guys, are you okay? Is this how you want to live your life?” I don’t care about her much, but this is so bizarre. Absolute madness.

        • limelight79@lemm.ee
          link
          fedilink
          English
          arrow-up
          4
          ·
          4 months ago

          Some subs are very negative. I remember antimlm was, as well, people spent all day mocking people who got involved in MLM schemes. I subbed for a while because my wife was in one, and I was hoping for help, advice, tips, etc., but it was all just mocking them and calling them “hon bots” or whatever the term was. I had to unsub, I don’t need that negativity in my life.

          The hobby subs, on the other hand, always seemed extremely supportive, or at least the ones I was in were. For example, the radio control (cars, planes, boats, etc.) sub members were totally into it and totally supportive of whatever it was you were doing. It was inspiring and made me want to get back into the hobby. Those kinds of subs were the best part of reddit, and unfortunately we haven’t recreated that energy for things like that here - just not enough users.

      • PrivateNoob@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 months ago

        I think Reddit is already in the “too big to die” stage, but I hope you will be right.

        For example Elon made everything significantly more awful on Twitter, seemingly like his objective is to just kill Twitter, but it’s still only lost like 15% of users, after ALL the dramas.