Featured Article

Social networks are getting stingy with their data, leaving third-party developers in the lurch

Comment

Steve Huffman, CEO of Reddit attends Variety & Reddit An Evening With Future Makers at Wynn Las Vegas on January 05, 2023 in Las Vegas, Nevada.
Image Credits: Greg Doherty / Variety / Getty Images

2023 was the year social networks realized that they were sitting on massive troves of data. And some companies, such as Twitter (now X) and Reddit, decided to change their terms to shut out third-party experiences on these platforms. In the process, they also put a price on their data — something they believe is highly valuable today as it can be used to train AI models.

After talking to several third-party developers who built apps and services on top of these larger social networks, we learned that there are mixed feelings among the developers about building experiences around social networks. While they are excited about the rise of decentralized networks, some of them haven’t seen enough incentives to build out new apps.

The APIcalypse

Twitter has historically been one of the most popular social networks when it comes to third-party apps. Some of those apps even pre-date the name “tweet.” In January, however, the company started to shut out these clients without any notice. Within days, in typical Elon Musk style, the social network silently changed its developer terms to effectively shut down third-party apps.

Twitterrific was one of the earliest Twitter clients. Image Credit: Twitterrific

In the following months, the company shuttered free access to its API and raised prices for other tiers. These new prices and limitations were so high that some third-party experiences, such as automatic alert posting services and research, suffered alongside the third-party clients. It only made sense to develop a paid application for teams and enterprises to bear costs as high as $42,000 per month for enterprise-tier access.

In contrast, Reddit gave notice to developers about changing its API terms in April. However, in May, Christian Selig, the developer of the popular iOS client Apollo, had a call with the company where he learned that the cost demanded by the platform was so high that his app would go out of business. Following that news, many subreddits staged blackouts in protest. Reddit CEO Steve Huffman gave multiple interviews defending the changes made by the company and Reddit started forcing rebel moderators out by removing them from moderator posts.

apollo-reddit-lockscreen
Image Credits: Apollo app image by TechCrunch
Image Credits: Apollo app image by TechCrunch

As Reddit implemented its API changes, many apps, including ApolloRIF (Reddit is Fun), ReddPlanetSync and BaconReader shut down. Some apps like Narwhal remained available with a subscription model, while RedReader, Dystopia and Luna were exempted from API changes because they provided accessibility features without any commercialization.

Narwhal developer Rick Harrison, who is also the co-founder and CTO of YC-backed dispensary software Meadow, told TechCrunch that he plans to maintain his Reddit client.

“I have continued developing this app because I primarily make this app for myself. I originally made Narwhal before Reddit even had an app and I wanted one for my daily commute. Now, I continue working on it as a side project, because I find it fun, and I have a small community of users who also enjoy the app,” he said.

On the other hand, Selig, who had to stop the development of the more popular Reddit client Apollo, isn’t bullish on continued collaboration between social media companies and developers. He calls that era “a bit of a distant memory.”

“The challenges and the severity of them depend on the host platform and their willingness to have developers on their platform, within those constraints, things can go either very smoothly or with great difficulty,” Selig said.

“For instance with Reddit, at the beginning, they were very communicative with developers and the development of the API, however in recent years they instead chose to use a different API internally and no longer use the ‘traditional’ API that developers depended on, which meant it was effectively left to languish with bugs and missing features.”

Industry observers noted that social networks have gradually closed down their platforms for third-party apps. Tom Coates, the co-founder of an older decentralized app called Planetary, told TechCrunch that social apps were open to allow third-party experiences in the early days of the social web, but over time, platforms like Instagram have proved that closed ecosystems are beneficial.

“Other platforms have been a bit more reliable, but the early spirit of trying to grow the whole ecosystem and to become a good citizen in a wider environment has kind of gone from the corporate social world,” he said.

Social networks want to protect their data from AI

Both Reddit and Twitter put restrictions on their APIs to better monetize the data of their social networks. Apart from introducing new limits on APIs, Musk also limited the number of posts in July 2023 users can view in a day as a measure to “address extreme levels of data scraping.”

Last September, the company updated its policy to ban scraping and crawling. Plus, the updated policy allowed X to train AI models through public data. In November, Musk’s new AI company called xAI launched Grok, an AI chatbot, to leverage that data. Later in December, subscribers of X’s highest-paid tier Premium+ got access to this chatbot.

Reddit also put gates around its data to stop AI companies from using it to train models. In an interview with The New York Times in April, CEO Steven Huffman said that companies need to pay to use Reddit’s data — something that’s valuable not only to AI companies like OpenAI, but also Google Search, which users in recent years have been hacking to get less spammy results by adding “reddit” to their search queries.

“The Reddit corpus of data is really valuable,” Huffman told The NYT. “But we don’t need to give all of that value to some of the largest companies in the world for free,” he said.

Reddit CEO Steve Huffman delivers remarks on “Redesigning Reddit” during the third day of Web Summit in Altice Arena on November 8, 2017 in Lisbon, Portugal. Image Credits: Horacio Villalobos – Corbis / Contributor / Getty Images
Image Credits: Horacio Villalobos – Corbis / Contributor / Getty Images

Weeks later, when Reddit was at a crossroads with third-party developers, in an interview with The Verge, the CEO of Reddit said that the social network’s API was never meant to support third-party clients.

“[Reddit’s API] was never designed to support third-party apps. We let it exist. And I should take the blame for that because I was the guy arguing for that for a long time. But I didn’t know — and this is my fault — the extent that they were profiting off of our API. That these were not charities,” he noted.

The new wave of social networks

The change in guard at X/Twitter gave birth to new social networks like Bluesky, Spill, Pebble (now discontinued), Post and Meta-owned Instagram Threads. While the decentralized network Mastodon has been around since 2016, it gained new prominence in the social sphere, as well.

After Twitter booted longtime third-party developers, many of them began building Mastodon clients, in fact: Tapbots (which built Tweetbot) introduced a Mastodon app called Ivory; Shihab Mehboob (who developed Aviary) built Mammoth, which is now under different management; and Matteo Villa (who built Fenix) is focusing on Woolly.

Image Credits: Mammoth
Image Credits: Mammoth

Mehboob is bullish about Mastodon’s future and told TechCrunch that the open ecosystem helps developers make different experiences.

“Mastodon is my new favorite when it comes to third-party app support as it’s so open. There are no real restrictions apart from rate limiting and pagination — which exist on all social media apps to prevent abuse of the API. Their documentation is also great,” he said.

Bluesky, another Twitter competitor that has just launched publicly, found some promising traction with third-party developers. Despite the closed ecosystem, developers have started making mobile clients like Graysky and multi-column desktop apps such as Skydeck and Blueskydeck.

Bluesky CEO Jay Graber speaks at the Knight Foundation's Informed conference
Bluesky CEO Jay Graber speaks at the Knight Foundation’s Informed conference. Image Credits: Marco Bello and Eva Marie for the Knight Foundation
Image Credits: Marco Bello and Eva Marie for the Knight Foundation

Samuel Newman, the developer of Graysky, said that platforms like Bluesky and Mastodon provide the same tools and APIs to third-party devs as the ones they use to build their official apps. However, as companies race to achieve feature parity with existing networks while also trying to remain unique and differentiated from one another, the pace of changes is rapid.

“Bluesky and the AT Protocol [the decentralized protocol used by Bluesky] are very much in active development, meaning things are moving fast and you have to keep up with any changes that might come up,” Newman said. “However, it’s built around a very strict schema, which means I can generally trust what data will be received.”

Image Credits: Graysky
Image Credits: Graysky

Mastodon and Bluesky seem to have embraced third-party clients for now, but the growth of these social networks will be critical for developers. Third-party clients will need a significant audience of potential users to earn a sustainable income, but Mastodon currently has just 1.5 million monthly active users across instances while Bluesky now has nearly 4 million users after launching publicly this week. In November, Bluesky said that the federation is coming in 2024, which means others can build different servers based on the AT Protocol leading to different servers and services with varied features and moderation rules.

Weaving the Thread(s)

The largest player in this new wave of social networks is Meta’s Threads, which has more than 130 million active users after opening up to EU-based users late last year. The app has started experimenting with ActivityPub integration so users on Mastodon and other compatible social networks can view Threads posts. What’s more, Instagram has started work on a Threads API which will be limited to posting at first.

Isaac Shea, who is working on Threaditor, a draft post saver for Threads, said his biggest worry was platforms copying features from third-party apps rather than acquiring or working with them.

“My biggest worry is not API maintenance — although keeping up with changing APIs can be a pain — but more being Sherlocked by the parent platform, intentionally or not,” he said, using a term that defines a time when Apple bakes features similar to an existing app into its own system. In recent years I have felt a trend away from acquiring or working with third-party developers, in favor of replicating and drowning them,” he added.

The Threads logo on a laptop arranged in the Brookl
The Threads logo on a laptop. Photographer: Gabby Jones/Bloomberg via Getty Images
Image Credits: Gabby Jones/Bloomberg / Getty Images

Though Meta has shown a willingness to work on a Threads API, it’s not clear if it will allow alternative Threads clients to flourish — especially when the company has a track record of shutting down third-party apps made for its social networks. Third-party clients usually don’t feature ads, which is Meta’s main revenue source.

Coates, who is an active advocate of decentralized systems, said that if the Mastodon ecosystem (or any decentralized ecosystem) grows, we will see more third-party services thrive such as moderation companies, scalable hosting companies, CSAM scanning services, identity providers and wallet integrations.

As he wrote in detail on his blog, he noted that Threads starting with ActivityPub integration doesn’t automatically mean that we’ll see a flourishing ecosystem of apps by default.

“Again though, the integration of Threads into this ecosystem doesn’t necessarily equate to a larger market — as Meta may not need to use many of the back-end services, and most likely will not initially allow their users to use alternative clients,” Coates said.

“On the other hand, Meta’s integration may cause a lot more interest in self-hosting and other companies and communities may join the larger Mastodon ecology and that would increase the opportunities and possibility for services and products of this kind,” he noted.

Money-making through apps

Developers like Selig, who have been burnt by social networks, don’t want to rely too much on social platforms to make money going forward.

“Unless you have a contract that is willing to lock in the terms for at least a brief period of time — Reddit was unwilling to do this, for instance — I wouldn’t rely on them whatsoever. As we’ve seen, platform stewards can change their mind at the drop of a hat with next to no notice to developers,” Selig said. “However, if you’re able to establish a good relationship with a platform — built on writing, not just promises — it can be a great opportunity that is a lot of fun to work on.”

Shea and Newman’s apps are early into their journeys. While Threaditor doesn’t have a paid model yet, Graysky has just started offering a premium subscription.

Threaditor helps you write long threads and save them. Image Credits: Threaditor
Image Credits: Threaditor

Bart Decrem, who acquired the app, and now continues to develop Mammoth, admits that platforms often disappoint developers. But he’s hopeful because of the open nature of Mastodon. 

“You’re far better off as a third-party developer if you’re building on an open protocol and/or open source project. ActivityPub and Mastodon are a perfect example. But of course, one famous example is email, with a thriving developer ecosystem,” he said.

The Iconfactory’s principal developer Ged Maheux told TechCrunch that the company has learned to diversify its revenue across different apps after the bad experience of Twitterific’s shutdown.

“We learned this lesson the hard way, of course, pinning so much of our revenue on an app that hinged on API access controlled by a third party. Since then we’ve been working hard to spread our eggs across multiple baskets, which is good advice for anyone developing for social I think,” Maheux said.

project tapestry splash screen
Image Credits: The Iconfactory
Image Credits: The Iconfactory

Earlier this week, Maheux and Iconfactory began a new Kickstarter campaign for a new app called Tapestry, which will allow you to connect your social media accounts and RSS feeds through a chronological timeline. Naturally, there is no support for X in the app.

Legacy social networks closing their doors to developers have given way to a new brand of clients — largely focusing on decentralized platforms. Social platforms like Mastodon and Bluesky have promised that they will support the development of alternative experiences. For users, it’s hard to keep up with new social networks springing up frequently. Their best bet is that developers trying to create bridges between these social networks by trying to implement cross-posting or bringing all feeds together will be able to do so without platforms shutting them down.

If you work at any of the social networks, or a developer trying to build something around social media platforms I’d love to hear from you on im@ivanmehta.com.

More TechCrunch

A police officer pulled over a self-driving Waymo vehicle in Phoenix after it ran a red light and pulled into a lane of oncoming traffic, according to dispatch records. The…

Waymo robotaxi pulled over by Phoenix police after driving into the wrong lane

Welcome back to TechCrunch’s Week in Review — TechCrunch’s newsletter recapping the week’s biggest news. Want it in your inbox every Saturday? Sign up here. This week, Figma CEO Dylan…

Figma pauses its new AI feature after Apple controversy

We’ve created this guide to help parents navigate the controls offered by popular social media companies.

How to set up parental controls on Facebook, Snapchat, TikTok and more popular sites

Featured Article

You could learn a lot from a CIO with a $17B IT budget

Lori Beer’s work is a case study for every CIO out there, most of whom will never come close to JP Morgan Chase’s scale, but who can still learn from how it goes about its business.

18 hours ago
You could learn a lot from a CIO with a $17B IT budget

For the first time, Chinese government workers will be able to purchase Tesla’s Model Y for official use. Specifically, officials in eastern China’s Jiangsu province included the Model Y in…

Tesla makes it onto Chinese government purchase list

Generative AI models don’t process text the same way humans do. Understanding their “token”-based internal environments may help explain some of their strange behaviors — and stubborn limitations. Most models,…

Tokens are a big reason today’s generative AI falls short

After multiple rejections, Apple has approved Fortnite maker Epic Games’ third-party app marketplace for launch in the EU. As now permitted by the EU’s Digital Markets Act (DMA), Epic announced…

Apple approves Epic Games’ marketplace app after initial rejections

There’s no need to worry that your secret ChatGPT conversations were obtained in a recently reported breach of OpenAI’s systems. The hack itself, while troubling, appears to have been superficial…

OpenAI breach is a reminder that AI companies are treasure troves for hackers

Welcome to Startups Weekly — TechCrunch’s weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. Most…

Space for newcomers, biotech going mainstream, and more

Elon Musk’s X is exploring more ways to integrate xAI’s Grok into the social networking app. According to a series of recent discoveries, X is developing new features like the…

X plans to more deeply integrate Grok’s AI, app researcher finds

We’re about four months away from TechCrunch Disrupt 2024, taking place October 28 to 30 in San Francisco! We could not bring you this world-class event without our world-class partners…

Meet Brex, Google Cloud, Aerospace and more at Disrupt 2024

In its latest step targeting a major marketplace, the European Commission sent Amazon another request for information (RFI) Friday in relation to its compliance under the bloc’s rulebook for digital…

Amazon faces more EU scrutiny over recommender algorithms and ads transparency

Quantum Rise, a Chicago-based startup that does AI-driven automation for companies like dunnhumby (a retail analytics platform for the grocery industry), has raised a $15 million seed round from Erie…

Quantum Rise grabs $15M seed for its AI-driven ‘Consulting 2.0’ startup

On July 4, YouTube released an updated eraser tool for creators so they can easily remove any copyrighted music from their videos without affecting any other audio such as dialog…

YouTube’s updated eraser tool removes copyrighted music without impacting other audio

Airtel, India’s second-largest telecom operator, on Friday denied any breach of its systems following reports of an alleged security lapse that has caused concern among its customers. The telecom group,…

India’s Airtel dismisses data breach reports amid customer concerns

According to a recent Dealroom report on the Spanish tech ecosystem, the combined enterprise value of Spanish startups surpassed €100 billion in 2023. In the latest confirmation of this upward trend, Madrid-based…

Spain’s exposure to climate change helps Madrid-based VC Seaya close €300M climate tech fund

Forestay, an emerging VC based out of Geneva, Switzerland, has been busy. This week it closed its second fund, Forestay Capital II, at a hard cap of $220 million. The…

Forestay, Europe’s newest $220M growth-stage VC fund, will focus on AI

Threads, Meta’s alternative to Twitter, just celebrated its first birthday. After launching on July 5 last year, the social network has reached 175 million monthly active users — that’s a…

A year later, what Threads could learn from other social networks

J2 Ventures, a firm led mostly by U.S. military veterans, announced on Thursday that it has raised a $150 million second fund. The Boston-based firm invests in startups whose products…

J2 Ventures, focused on military healthcare, grabs $150M for its second fund

HealthEquity said in an 8-K filing with the SEC that it detected “anomalous behavior by a personal use device belonging to a business partner.”

HealthEquity says data breach is an ‘isolated incident’

Roll20 said that on June 29 it had detected that a “bad actor” gained access to an account on the company’s administrative website for one hour.

Roll20, an online tabletop role-playing game platform, discloses data breach

Fisker has a willing buyer for its remaining inventory of all-electric Ocean SUVs, and has asked the Delaware Bankruptcy Court judge overseeing its Chapter 11 case to approve the sale.…

Fisker asks bankruptcy court to sell its EVs at average of $14,000 each

Teddy Solomon just moved to a new house in Palo Alto, so he turned to the Stanford community on Fizz to furnish his room. “Every time I show up to…

Fizz, the anonymous Gen Z social app, adds a marketplace for college students

With increasing competition for what is, essentially, still a small number of hard tech and deep tech deals, Sidney Scott realized it would be a challenge for smaller funds like…

Why deep tech VC Driving Forces is shutting down

A guide to turn off reactions on your iPhone and Mac so you don’t get surprised by effects during work video calls.

How to turn off those silly video call reactions on iPhone and Mac

Amazon has decided to discontinue its Astro for Business device, a security robot for small- and medium-sized businesses, just seven months after launch.  In an email sent to customers and…

Amazon retires its Astro for Business security robot after only 7 months

Hiya, folks, and welcome to TechCrunch’s regular AI newsletter. This week in AI, the U.S. Supreme Court struck down “Chevron deference,” a 40-year-old ruling on federal agencies’ power that required…

This Week in AI: With Chevron’s demise, AI regulation seems dead in the water

Noplace had already gone viral ahead of its public launch because of its feature that allows users to express themselves by customizing the colors of their profile.

noplace, a mashup of Twitter and Myspace for Gen Z, hits No. 1 on the App Store

Cloudflare analyzed AI bot and crawler traffic to fine-tune automatic bot detection models.

Cloudflare launches a tool to combat AI bots

Twilio says “threat actors were able to identify” phone numbers of people who use the two-factor app Authy.

Twilio says hackers identified cell phone numbers of two-factor app Authy users