Reddit to update web standard to block automated website scraping

Canadian News News

Reddit to update web standard to block automated website scraping
Canada NewsBreaking News VideoCanadian Breaking News
  • 📰 globeandmail
  • ⏱ Reading Time:
  • 28 sec. here
  • 49 min. at publisher
  • 📊 Quality Score:
  • News: 179%
  • Publisher: 92%

The move comes at a time when artificial intelligence firms have been accused of plagiarizing content from publishers to create AI-generated summaries without giving credit or asking for permission

Social media platform Reddit said on Tuesday it will update a web standard used by the platform to block automated data scraping from its website, following reports that AI startups were bypassing the rule to gather content for their systems.

Reddit said that it would update the Robots Exclusion Protocol, or “robots.txt,” a widely accepted standard meant to determine which parts of a site are allowed to be crawled. More recently, robots.txt has become a key tool that publishers employ to prevent tech companies from using their content free-of-charge to train AI algorithms and create summaries in response to some search queries.

This follows a Wired investigation which found that AI search startup Perplexity likely bypassed efforts to block its web crawler via robots.txt.

We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

globeandmail /  🏆 5. in CA

Canada News Breaking News Video Canadian Breaking News Breaking News Globe And Mail Breaking News Globe And Mail Canada News Photos World News Local News National News Us News Foreign News Sports News Arts News Life News Lifestyle Canada Traffic Canada Weather Trudeau Government Federal Government Canada Sports Canada Sports News Politics Politics News Political News Political Opinion Environment Economy Technology Education Travel Canada Alberta Bc British Columbia Manitoba Ontario Quebec Nova Scotia Pei New Brunswick Newfoundland And Labrador Nunavut Northwest Territories Yukon Globe And Mail

Canada Latest News, Canada Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Here's why Reddit has more room to grow: AnalystHere's why Reddit has more room to grow: AnalystShares of Reddit (RDDT) are up almost 25% since its IPO debut in March. Needham & Company senior entertainment and internet analyst Laura Martin raised her...
Read more »

GameStop’s Meme Moment Returns Again With Gill’s Reddit PostGameStop’s Meme Moment Returns Again With Gill’s Reddit PostGameStop Corp.’s shares are set for a wild ride at Monday’s opening after the Reddit account that drove the meme-stock mania of 2021 posted what appeared to be a $116 million position in the stock.
Read more »

GameStop soars 90% after super bull Keith Gill's Reddit post shows $116 million betGameStop soars 90% after super bull Keith Gill's Reddit post shows $116 million betExplore stories from Atlantic Canada.
Read more »

GameStop soars 90% after super bull Roaring Kitty’s Reddit post shows US$116-million betGameStop soars 90% after super bull Roaring Kitty’s Reddit post shows US$116-million betKeith Gill’s disclosure sparks spike in meme stocks
Read more »

GameStop soars as 'Roaring Kitty' reveals $116 million bet in Reddit postGameStop soars as 'Roaring Kitty' reveals $116 million bet in Reddit postRoughly $390 million worth of GameStop shares had changed hands by 5:53 a.m. ET (0953 GMT), more than the $343 million in Wall Street favourite Nvidia...
Read more »

Roaring Kitty’s Reddit Post on GameStop Could Spell $485 Million Paper FortuneRoaring Kitty’s Reddit Post on GameStop Could Spell $485 Million Paper FortuneIt was just a screenshot of a portfolio, posted without comment on Reddit by an account associated with Keith Gill.
Read more »



Render Time: 2025-02-14 02:18:24