X has updated its terms of service to explicitly ban web scraping and crawling without prior written consent. This move is likely aimed at preventing AI models from training on its data. The previous terms allowed crawling in line with the platform's robots.txt file, but the new terms remove this provision. Additionally, X has modified its robots.txt file to disallow crawlers from accessing specific types of information like likes and retweets. The changes come after Musk has expressed opposition to companies using Twitter/X data to train AI models, even going as far as filing lawsuits against unknown entities for scraping data.