AI
X updates its terms to ban crawling and scraping
X has updated its terms of service to explicitly ban web scraping and crawling without prior written consent. This move is likely aimed at preventing AI models from training on its data. The previous terms allowed crawling in line with the platform's robots.txt file, but the new terms remove this provision. Additionally, X has modified its robots.txt file to disallow crawlers from accessing specific types of information like likes and retweets. The changes come after Musk has expressed oppositio