Meta's Llama model has memorized Harry Potter and Bijli Ka Pyaar (2025) Hindi Short Filmthe Sorcerer's Stoneso well that it can reproduce verbatim excerpts from 42 percent of the book, according to a new study.
Researchers from Stanford, Cornell, and West Virginia University analyzed dozens of books from the now-infamous Books3 dataset, a collection of pirated books used to train Meta's Llama models. Books3 is also at the center of a copyright infringement lawsuit against Meta,Kadrey v. Meta Platforms, Inc.The study's authors say their findings could have major implications for AI companies facing similar lawsuits.
According to the research paper, the Llama 3.1 model "memorizes some books, like Harry Potterand 1984, almost entirely." Specifically, the study found that Llama 3.1 has memorized 42 percent of the first Harry Potter book so well that it can reproduce verbatim excerpts at least 50 percent of the time. Overall, Llama 3.1 could reproduce excerpts from 91 percent of the book, though not as consistently.
"The extent of verbatim memorization of books from the Books3 dataset is more significant than previously described," said the paper. But the researchers also discovered that "memorization varies widely from model to model and from book to book within each model, as well as varying in different parts of individual books." For example, the study estimated that Llama 3.1 only memorized 0.13 percent of Sandman Slimby Richard Kadrey, one of the lead plaintiffs in the class action copyright suit against Meta.
So, while some of the paper's findings seem damning, don't call it a smoking gun for plaintiffs in AI copyright infringement cases.
"These results give everyone in the AI copyright debate something to latch on to," wrote journalist Timothy B. Lee in his Understanding AI newsletter. "Divergent results like these could cast doubt on whether it makes sense to lump J.K. Rowling, Richard Kadrey, and thousands of other authors together in a single mass lawsuit. And that could work in Meta’s favor, since most authors lack the resources to file individual lawsuits."
Why is Llama able to reproduce some books more than others? "I suspect that the difference is because Harry Potter is a much more famous book. It's widely quoted and I'm sure that substantial excerpts from it on third-party websites found their way into the training data on the web," said James Grimmelmann, a professor of digital and information law at Cornell University, who was cited in the paper.
What this also shows, Grimmelmann said, is that "AI companies can make choices that increase or reduce memorization. It's not an inevitable feature of AI; they have control over it."
Meta and other AI companies have argued that using copyrighted works to train their models is protected under fair use, a complex legal doctrine. However, the extent of memorization could complicate those arguments.
“Yes, I do think that the likelihood that LLMs are memorizing more than previously thought changes the copyright analysis,” Robert Brauneis, a professor with the George Washington University Law School, said in an email to Mashable. He concluded that the study’s findings could ultimately weaken Meta’s fair use argument.
We asked Meta for comment on the study's findings, and we'll update this article if we receive a response.
Disclosure: Ziff Davis, Mashable’s parent company, in April filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.
Topics Artificial Intelligence Meta
Best robot vacuum deal: Eufy Omni C20 robot vacuum and mop at record
Redux: A Pin
CU vs. UM basketball without cable: Game time, streaming deals, and more
On Summer Crushing by Hanif Abdurraqib
SpaceX's Starlink will provide free satellite internet to families in Texas school district
One Word: Striking by Myriam Gurba
'May December' versus 'All
Scientists discover unknown prehistoric world — on Earth
Mary Shows Up
Remi Cruz on her Twice bias, Maangchi, and being Lana Del Rey's favorite vlogger
NYT Connections Sports Edition hints and answers for May 19: Tips to solve Connections #238
The Postmenopausal Novel by Darcey Steinke
Escaping Samuel Johnson by Peter Martin
Running into My Dead Mother at 7
Philips now allows customers to 3D print replacement parts
Staff Picks: Odes, #Ads, and Amazing Grace by The Paris Review
Redux: Lost Causes Confound by The Paris Review
Best Buy 3
Operation Mensch
Inside 'Game Changer,' the internet's favorite game show
Lara Trump is here to deliver our souls from the epidemic of fake newsThe early internet kept showing us the future, and we rolled our eyes every time11 inspiring children’s books to teach kids about gender equalitySmall beauty vlogger innovates new makeup use for pantylinerWhat you should know before buying the Pixel 5'Game of Thrones' star Sophie Turner said her social media followers help her land gigsI'm one of the local milk people Trump was talking about and I freaking love milkApple reveals the iPhone 12 Pro and iPhone 12 Pro MaxEverything Apple unveiled at its big iPhone eventCoast Guard chief vows to stand with transgender personnelThe 6 most bonkers lines from that bombshell Fox News lawsuitWhy Netflix's 'The Haunting of Bly Manor' didn't workHere lies possibly the world's shortest political interviewLittle girl rides her pony through a corner store to pick up treatsAncient fidget spinner confirms there's really nothing new under the sun'Game of Thrones' star Sophie Turner said her social media followers help her land gigs6 feminist activists to follow on social mediaAdorable toddler doesn't really want her aunt to take a selfieLucid Air reveals price and range for its cheapest EVApple's iPhone 12 launch was like a 'Black Mirror' episode without the plot Clever dude masterfully Photoshops himself into every Best Picture Nominee poster Twitter has pretty cold feelings toward the 'Game of Thrones' block of ice stunt Behold, the glory of our Trump White House LEGO set Daredevil just crossed the Atlantic in the most epic way A song of ice and fail: Why HBO's 'Game of Thrones' stunt was the worst Neymar savagely roasts Paris Saint Instead of telling women who might get pregnant they can't drink, study suggests trusting them Airbnb raises another $1 billion, and it's actually profitable Theresa May laughs awkwardly in Parliament, instantly becomes meme Exclusive: Samsung to bring Samsung Pay to non Salman Khan may soon have his own line of smartphones 'No Man's Sky' photo mode leveled up and look at the amazing things it can do 'Overwatch' reveals one of its playable characters is on the autism spectrum 'Beauty and the Beast' inspires Doug the pug to find his own love The internet wants to bring a rare picture of Harriet Tubman back to her homestead Elon Musk makes a bet to fix a state's energy woes in 100 days, or it's free Twitter cofounder Biz Stone now works for Pinterest Chelsea Clinton horrified the internet with spinach pancakes Google says it already fixed 'many' of the security flaws from Vault 7 leak The ACLU is fighting police who want private info on a political Facebook group
2.2798s , 8223.9765625 kb
Copyright © 2025 Powered by 【Bijli Ka Pyaar (2025) Hindi Short Film】,Charm Information Network