AI

Spawning wants to build more ethical AI training datasets

Comment

An illustration of stacks of filing cabinets
Image Credits: Getty Images

Jordan Meyer and Mathew Dryhurst founded Spawning AI to create tools that help artists exert more control over how their works are used online. Their latest project, called Source.Plus, is intended to curate “non-infringing” media for AI model training.

The Source.Plus project’s first initiative is a dataset seeded with nearly 40 million public domain images and images under the Creative Commons’ CC0 license, which allows creators to waive nearly all legal interest in their works. Meyer claims that, despite the fact that it’s substantially smaller than some other generative AI training data sets out there, Source.Plus’ data set is already “high-quality” enough to train a state-of-the-art image-generating model.

“With Source.Plus, we’re building a universal ‘opt-in’ platform,” Meyer said. “Our goal is to make it easy for rights holders to offer their media for use in generative AI training — on their own terms — and frictionless for developers to incorporate that media into their training workflows.”

Rights management

The debate around the ethics of training generative AI models, particularly art-generating models like Stable Diffusion and OpenAI’s DALL-E 3, continues unabated — and has massive implications for artists however the dust ends up settling.

Generative AI models “learn” to produce their outputs (e.g., photorealistic art) by training on a vast quantity of relevant data — images, in that case. Some developers of these models argue that fair use entitles them to scape data from public sources, regardless of that data’s copyright status. Others have attempted to toe the line, compensating or at least crediting content owners for their contributions to training sets.

Meyer, Spawning’s CEO, believes that no one’s settled on a best approach — yet.

“AI training frequently defaults to using the easiest available data — which hasn’t always been the most fair or responsibly sourced,” he told TechCrunch in an interview. “Artists and rights holders have had little control over how their data is used for AI training, and developers have not had high-quality alternatives that make it easy to respect data rights.”

Source.Plus, available in limited beta, builds on Spawning’s existing tools for art provenance and usage rights management.

In 2022, Spawning created HaveIBeenTrained, a website that allows creators to opt out of the training datasets used by vendors who’ve partnered with Spawning, including Hugging Face and Stability AI. After raising $3 million in venture capital from investors, including True Ventures and Seed Club Ventures, Spawning rolled out ai.text, a way for websites to “set permissions” for AI, and a system — Kudurru — to defend against data-scraping bots.

Source.Plus is Spawning’s first effort to build a media library — and curate that library in-house. The initial image dataset, PD/CC0, can be used for commercial or research applications, Meyer says.

Spawning Source.Plus
The Source.Plus library.
Image Credits: Spawning

“Source.Plus isn’t just a repository for training data; it’s an enrichment platform with tools to support the training pipeline,” he continued. “Our goal is to have a high-quality, non-infringing CC0 dataset capable of supporting a powerful base AI model available within the year.”

Organizations including Getty Images, Adobe, Shutterstock and AI startup Bria claim to use only fairly sourced data for model training. (Getty goes so far as to call its generative AI products “commercially safe.”) But Meyer says that Spawning aims to set a “higher bar” for what it means to fairly source data.

Source.Plus filters images for “opt-outs” and other artist training preferences, showing provenance information about how — and from where — images were sourced. It also excludes images that aren’t licensed under CC0, including those with a Creative Commons BY 1.0 license, which require attribution. And Spawning says that it’s monitoring for copyright challenges from sources where someone other than the creators are responsible for indicating the copyright status of a work, such as Wikimedia Commons.

“We meticulously validated the reported licenses of the images we collected, and any questionable licenses were excluded — a step that many ‘fair’ datasets don’t take,” Meyer said.

Historically, problematic images — including violent and pornographic, sensitive personal images — have plagued training datasets both open and commercial.

The maintainers of the LAION dataset were forced to pull one library offline after reports uncovered medical records and depictions of child sexual abuse; just this week, a study from Human Rights Watch found that one of LAION’s repositories included the faces of Brazilian children without those children’s consent or knowledge. Elsewhere, Adobe’s stock media library, Adobe Stock, which the company uses to train its generative AI models, including the art-generating Firefly Image model, was found to contain AI-generated images from rivals such as Midjourney.

Spawning Source.Plus
Artwork in the Source.Plus gallery.
Image Credits: Spawning

Spawning’s solution is classifier models trained to detect nudity, gore, personally identifiable information and other undesirable bits in images. Recognizing that no classifier is perfect, Spawning plans to let users “flexibly” filter the Source.Plus dataset by adjusting the classifiers’ detection thresholds, Meyer says.

“We employ moderators to verify data ownership,” Meyer added. “We also have remediation features built in, where users can flag offending or possible infringing works, and the trail of how that data was consumed can be audited.”

Compensation

Most of the programs to compensate creators for their generative AI training data contributions haven’t gone exceptionally well. Some programs are relying on opaque metrics to calculate creator payouts, while others are paying out amounts that artists consider to be unreasonably low.

Take Shutterstock, for example. The stock media library, which has made deals with AI vendors ranging in the tens of millions of dollars, pays into a “contributors fund” for artwork it uses to train its generative AI models or licenses to third-party developers. But Shutterstock isn’t transparent about what artists can expect to earn, nor does it allow artists to set their own pricing and terms; one third-party estimate pegs earnings at $15 for 2,000 images, not exactly an earth-shattering amount.

Once Source.Plus exits beta later this year and expands to datasets beyond PD/CC0, it’ll take a different tack than other platforms, allowing artists and rights holders to set their own prices per download. Spawning will charge a fee, but only a flat rate — a “tenth of a penny,” Meyer says.

Customers can also opt to pay Spawning $10 per month — plus the typical per-image download fee — for Source.Plus Curation, a subscription plan that allows them to manage collections of images privately, download the dataset up to 10,000 times a month and gain access to new features, like “premium” collections and data enrichment, early.

Spawning Source.Plus
Image Credits: Spawning

“We will provide guidance and recommendations based on current industry standards and internal metrics, but ultimately, contributors to the dataset determine what makes it worthwhile to them,” Meyer said. “We’ve chosen this pricing model intentionally to give artists the lion’s share of the revenue and allow them to set their own terms for participating. We believe this revenue split is significantly more favorable for artists than the more common percentage revenue split, and will lead to higher payouts and greater transparency.”

Should Source.Plus gain the traction that Spawning is hoping it does, Spawning intends to expand it beyond images to other types of media as well, including audio and video. Spawning is in discussions with unnamed firms to make their data available on Source.Plus. And, Meyer says, Spawning might build its own generative AI models using data from the Source.Plus datasets.

“We hope that rights holders who want to participate in the generative AI economy will have the opportunity to do so and receive fair compensation,” Meyer said. “We also hope that artists and developers who have felt conflicted about engaging with AI will have an opportunity to do so in a way that is respectful to other creatives.”

Certainly, Spawning has a niche to carve out here. Source.Plus seems like one of the more promising attempts to involve artists in the generative AI development process — and let them share in profits from their work.

As my colleague Amanda Silberling recently wrote, the emergence of apps like the art-hosting community Cara, which saw a surge in usage after Meta announced it might train its generative AI on content from Instagram, including artist content, shows the creative community has reached a breaking point. They’re desperate for alternatives to companies and platforms they perceive as thieves — and Source.Plus might just be a viable one.

But if Spawning always acts in the best interests of artists (a big if, considering Spawning is a VC-backed business), I wonder whether Source.Plus can scale up as successfully as Meyer envisions. If social media has taught us anything, it’s that moderation — particularly of millions of pieces of user-generated content — is an intractable problem.

We’ll find out soon enough.

More TechCrunch

Featured Article

CIOs’ concerns over generative AI echo those of the early days of cloud computing

CIOs trying to govern generative AI have the same concerns they had about cloud computing 15 years ago, but they’ve learned some things along the way.

3 hours ago
CIOs’ concerns over generative AI echo those of the early days of cloud computing

It sounds like the latest dispute between Apple and Fortnite-maker Epic Games isn’t over. Epic has been fighting Apple for years over the company’s revenue-sharing requirements in the App Store.…

Epic Games CEO promises to ‘fight’ Apple over ‘absurd’ changes

As deep-pocketed companies like Amazon, Google and Walmart invest in and experiment with drone delivery, a phenomenon reflective of this modern era has emerged. Drones, carrying snacks and other sundries,…

What happens if you shoot down a delivery drone?

A police officer pulled over a self-driving Waymo vehicle in Phoenix after it ran a red light and pulled into a lane of oncoming traffic, according to dispatch records. The…

Waymo robotaxi pulled over by Phoenix police after driving into the wrong lane

Welcome back to TechCrunch’s Week in Review — TechCrunch’s newsletter recapping the week’s biggest news. Want it in your inbox every Saturday? Sign up here. This week, Figma CEO Dylan…

Figma pauses its new AI feature after Apple controversy

We’ve created this guide to help parents navigate the controls offered by popular social media companies.

How to set up parental controls on Facebook, Snapchat, TikTok and more popular sites

Featured Article

You could learn a lot from a CIO with a $17B IT budget

Lori Beer’s work is a case study for every CIO out there, most of whom will never come close to JP Morgan Chase’s scale, but who can still learn from how it goes about its business.

1 day ago
You could learn a lot from a CIO with a $17B IT budget

For the first time, Chinese government workers will be able to purchase Tesla’s Model Y for official use. Specifically, officials in eastern China’s Jiangsu province included the Model Y in…

Tesla makes it onto Chinese government purchase list

Generative AI models don’t process text the same way humans do. Understanding their “token”-based internal environments may help explain some of their strange behaviors — and stubborn limitations. Most models,…

Tokens are a big reason today’s generative AI falls short

After multiple rejections, Apple has approved Fortnite maker Epic Games’ third-party app marketplace for launch in the EU. As now permitted by the EU’s Digital Markets Act (DMA), Epic announced…

Apple approves Epic Games’ marketplace app after initial rejections

There’s no need to worry that your secret ChatGPT conversations were obtained in a recently reported breach of OpenAI’s systems. The hack itself, while troubling, appears to have been superficial…

OpenAI breach is a reminder that AI companies are treasure troves for hackers

Welcome to Startups Weekly — TechCrunch’s weekly recap of everything you can���t miss from the world of startups. Sign up here to get it in your inbox every Friday. Most…

Space for newcomers, biotech going mainstream, and more

Elon Musk’s X is exploring more ways to integrate xAI’s Grok into the social networking app. According to a series of recent discoveries, X is developing new features like the…

X plans to more deeply integrate Grok’s AI, app researcher finds

We’re about four months away from TechCrunch Disrupt 2024, taking place October 28 to 30 in San Francisco! We could not bring you this world-class event without our world-class partners…

Meet Brex, Google Cloud, Aerospace and more at Disrupt 2024

In its latest step targeting a major marketplace, the European Commission sent Amazon another request for information (RFI) Friday in relation to its compliance under the bloc’s rulebook for digital…

Amazon faces more EU scrutiny over recommender algorithms and ads transparency

Quantum Rise, a Chicago-based startup that does AI-driven automation for companies like dunnhumby (a retail analytics platform for the grocery industry), has raised a $15 million seed round from Erie…

Quantum Rise grabs $15M seed for its AI-driven ‘Consulting 2.0’ startup

On July 4, YouTube released an updated eraser tool for creators so they can easily remove any copyrighted music from their videos without affecting any other audio such as dialog…

YouTube’s updated eraser tool removes copyrighted music without impacting other audio

Airtel, India’s second-largest telecom operator, on Friday denied any breach of its systems following reports of an alleged security lapse that has caused concern among its customers. The telecom group,…

India’s Airtel dismisses data breach reports amid customer concerns

According to a recent Dealroom report on the Spanish tech ecosystem, the combined enterprise value of Spanish startups surpassed €100 billion in 2023. In the latest confirmation of this upward trend, Madrid-based…

Spain’s exposure to climate change helps Madrid-based VC Seaya close €300M climate tech fund

Forestay, an emerging VC based out of Geneva, Switzerland, has been busy. This week it closed its second fund, Forestay Capital II, at a hard cap of $220 million. The…

Forestay, Europe’s newest $220M growth-stage VC fund, will focus on AI

Threads, Meta’s alternative to Twitter, just celebrated its first birthday. After launching on July 5 last year, the social network has reached 175 million monthly active users — that’s a…

A year later, what Threads could learn from other social networks

J2 Ventures, a firm led mostly by U.S. military veterans, announced on Thursday that it has raised a $150 million second fund. The Boston-based firm invests in startups whose products…

J2 Ventures, focused on military healthcare, grabs $150M for its second fund

HealthEquity said in an 8-K filing with the SEC that it detected “anomalous behavior by a personal use device belonging to a business partner.”

HealthEquity says data breach is an ‘isolated incident’

Roll20 said that on June 29 it had detected that a “bad actor” gained access to an account on the company’s administrative website for one hour.

Roll20, an online tabletop role-playing game platform, discloses data breach

Fisker has a willing buyer for its remaining inventory of all-electric Ocean SUVs, and has asked the Delaware Bankruptcy Court judge overseeing its Chapter 11 case to approve the sale.…

Fisker asks bankruptcy court to sell its EVs at average of $14,000 each

Teddy Solomon just moved to a new house in Palo Alto, so he turned to the Stanford community on Fizz to furnish his room. “Every time I show up to…

Fizz, the anonymous Gen Z social app, adds a marketplace for college students

With increasing competition for what is, essentially, still a small number of hard tech and deep tech deals, Sidney Scott realized it would be a challenge for smaller funds like…

Why deep tech VC Driving Forces is shutting down

A guide to turn off reactions on your iPhone and Mac so you don’t get surprised by effects during work video calls.

How to turn off those silly video call reactions on iPhone and Mac

Amazon has decided to discontinue its Astro for Business device, a security robot for small- and medium-sized businesses, just seven months after launch.  In an email sent to customers and…

Amazon retires its Astro for Business security robot after only 7 months

Hiya, folks, and welcome to TechCrunch’s regular AI newsletter. This week in AI, the U.S. Supreme Court struck down “Chevron deference,” a 40-year-old ruling on federal agencies’ power that required…

This Week in AI: With Chevron’s demise, AI regulation seems dead in the water