Bookmark Article
Timothy B. Lee reports on a study from Stanford, Cornell, and West Virginia University revealing that Meta’s Llama 3.1 70B model has memorized 42% of the first Harry Potter book, significantly more than its predecessor, Llama 1 65B. The findings raise concerns about text memorization in AI models, particularly regarding copyright issues, as Llama 3.1 shows notable memorization of popular books but minimal for others.
More Context
