Meta's Llama 3.1 Can Recall 42% of the First Harry Potter Book

Timothy B. Lee reports on a study from Stanford, Cornell, and West Virginia University revealing that Meta’s Llama 3.1 70B model has memorized 42% of the first Harry Potter book, significantly more than its predecessor, Llama 1 65B. The findings raise concerns about text memorization in AI models, particularly regarding copyright issues, as Llama 3.1 shows notable memorization of popular books but minimal for others.

More Context