How big technology systems are slowing innovation

How big technology systems are slowing innovation

The great IT revolution is no longer promoting economic dynamism. It’s preventing it.

By James Bessen

In 2005, years before Apple’s Siri and Amazon’s Alexa came on the scene, two startups—ScanSoft and Nuance Communications—merged to pursue a burgeoning opportunity in speech recognition. The new company developed powerful speech-processing software and grew rapidly for almost a decade—an average of 27% per year in sales. Then suddenly, around 2014, it stopped growing. Revenues in 2019 were roughly the same as revenues in 2013. Nuance had run into strong headwinds, as large computer firms that were once its partners became its competitors. 

Nuance’s story is far from unique. In all major industries and technology domains, startups are facing unprecedented obstacles. New companies are still springing up to exploit innovative opportunities. And these companies can now tap into an extraordinary flood of venture capital. Yet all is not healthy in the startup economy. Innovative startups are growing much more slowly than comparable companies did in the past. 

Surprisingly, a major culprit is technology—specifically, proprietary information technology in the hands of large firms that dominate their industries. We’re accustomed to thinking of technology as creating disruption, in which innovations introduced by smaller, newer companies enable them to grow and ultimately replace older, less productive ones. But these proprietary technologies are now suppressing industrial turnover, which has declined sharply over the last two decades. This loss of dynamism has broad negative implications for the US economy. It has slowed the growth of innovative firms. And researchers have tied that slower growth to substantially slackened productivity growth, which affects the entire economy, all the way down to personal incomes.

Nuance began in 1994 as a spinoff from SRI, a Stanford laboratory that had developed speech-­recognition technology for the US government. ScanSoft was a Xerox spinoff. Before the two merged in 2005, speech recognition was constrained by computer processing power. Systems recognized only limited vocabularies, though they nevertheless proved useful in narrow commercial applications such as telephone customer support centers and transcription of medical records.

By the late 2000s, things had changed. As computers became more powerful, Nuance was able to develop a major innovation: “large vocabulary continuous speech recognition.” Now you could say anything about any topic, and the technology could accurately transcribe it in real time. Nuance used this technology in an app called Dragon Dictation, which Apple featured when it introduced the iPhone 3GS at its 2009 Worldwide Developers Conference. Once Apple validated the product, Samsung and all the other phone manufacturers wanted it. So did Google, Amazon, and Microsoft. Nuance grew rapidly, both by signing up these major customers and also through millions of individual consumers who purchased the iPhone app, which became the number-one business productivity application in the iTunes store. In 2011, Apple introduced Siri, which was based on Nuance technology. Nuance’s revenues grew to $1.7 billion in 2013.

But this growth was short-lived. Nuance wasn’t the only one to realize that voice was poised to become a prime channel for human interaction with computers and cloud services. Voice recognition was no longer just about dictating text but about shopping, searching for information, selecting music and video entertainment, controlling appliances, and much more. It was fast, hands-free, and—compared with the keyboard and mouse—a much more natural way for humans to communicate.

Big Tech started plowing big money and talent into this opportunity. Apple invested in developing its own systems, Amazon pursued its Alexa voice assistant, and Google followed quickly with its Home Assistant. And those companies successfully raided Nuance’s talent pool, bringing top people into their folds. Amazon now has over 10,000 engineers working on Alexa products, more than 10 times the number of core R&D employees Nuance had at its peak.

In addition to their financial resources, the big companies also had the advantage of large customer bases, complementary products, and vast amounts of data at their disposal, enabling them to continually improve their voice-recognition systems. Today there are 300 million Alexa devices installed; Google handles 5.6 billion searches each day on average, and half its users report using voice for search. Amazon has a thriving ecosystem where third-party developers add new “skills” to Alexa—over 100,000 of them, ranging from playing specific radio stations to telling jokes. In addition, Amazon has licensed the Alexa far-field technology to appliance manufacturers, which use it to control dishwashers, clothes washers and dryers, and vacuum cleaners. 

Nuance could not compete on this battlefield. It retreated to focus on market niches such as health care before being acquired by Microsoft in 2021.


What happened to Nuance is not just a retelling of the old story of large firms out-investing startups. Across a wide range of industries, dominant firms are employing large-scale information systems to outflank their competitors, including innovative startups. They are using proprietary software to better manage complexity and thus differentiate themselves from rival firms. And this has allowed them to increase their market dominance and avoid being overtaken by rivals.

In retail, Walmart’s inventory management and logistics software allows it to stock its stores with a far greater selection of products at lower cost, tailor each store to local needs, and respond quickly as demand changes and hot products emerge. Using large data systems, leading financial companies tailor credit cards and home equity loans to individual consumers on a massive scale and then target the marketing of these products. Even the top waste-management companies and health insurers are making large investments in proprietary software to beat their competition. In aggregate, firms (excluding those whose product is software) now invest over $240 billion in their internal software each year, up from $19 billion in 1985. Large firms account for most of that change. The top four companies in each industry, ranked by sales, have increased their investment in their own software eightfold since 2000, far more than even second-tier firms.

And these investments have paid off. Since the 1980s, the top four firms in each industry have increased their market share by 4% to 5% in most sectors. My research shows that investments in proprietary software caused most of this increase. 

This greater industry dominance by top firms is accompanied by a corresponding decline in the risk that they will be disrupted, a prospect that has obsessed corporate managers ever since Clayton Christensen’s The Innovator’s Dilemma came out in 1997. At the time Christensen wrote his book, disruption was on the rise. But since about 2000—when top firms started their investment spree in proprietary systems—this trend has declined sharply. In a given industry, the chance that a high-ranking firm (as measured by sales) will drop out of one of the top four spots within four years has fallen from over 20% to around 10%. Here, too, investments by dominant firms in their internal systems largely account for the change. While some new technologies disrupt entire industries—think of what the internet did to newspapers or DVDs—others are now suppressing the disruption of dominant firms.

How does this happen, and why does it apparently affect so much of the economy? It is because these business systems address a major shortcoming of modern capitalism. Beginning in the late 19th century, innovative firms found that they could often achieve dramatic cost savings by producing at a large scale. The shift dramatically reduced consumer prices, but there was a trade-off: in order for companies to achieve those large volumes, products and services needed to be standardized. Henry Ford famously declared that car buyers could have “any color so long as it is black.” Retail chains achieved their efficiencies by providing a limited set of products to their thousands of stores. Finance companies offered standard mortgages and loans. As a result, products had limited feature sets; stores had limited selection and were slow to respond to changing demand; and many consumers could not get credit or obtained it only on terms that were costly and not suited for their needs. https://datawrapper.dwcdn.net/dC0Ek/2/

Software changes the equation, partly overcoming these limitations. That’s because it reduces the costs of managing complexity. With the right data and the right organization, software allows businesses to tailor products and services to individual needs, offering greater variety or more product features. And this allows them to best rivals, dominating their markets. Walmart stores offer far greater selection than Sears or Kmart stores, and they respond faster to changing customer needs. Sears was long the king of retail; now Walmart is, and Sears is in bankruptcy. Toyota quickly produces new models when it detects new consumer trends; smaller car companies cannot afford the billions of dollars it takes to do that. Similarly, only Boeing and Airbus can manage to build highly complex new jumbo jets. The top four credit card companies have the data and the systems to effectively target offers to individual consumers, gaining maximum profit and market share; they dominate the market.

These software-enabled platforms have allowed top firms to cement their dominance. They have also slowed the growth of rivals, including innovative startups.


A variety of evidence supports the idea that startup growth has slowed down substantially. One sign is how long it takes for venture-­backed startups to receive funding: from 2006 to 2020, the median age of a startup in the seed-round funding stage increased from 0.9 years to 2.5 years. The median age of a late-stage startup rose from 6.8 years to 8.1 years in that same period. Among firms that were acquired, the average time from first financing to acquisition tripled, from a little over two years in 2000 to 6.1 years in 2021. The story was similar for firms that went public. But the clearest evidence of a slowdown is what happens when firms become more productive.

Big firms are employing large-scale technologies that make it harder for startups to grow.

The key feature of dynamic economies, what economist Joseph Schumpeter called “creative destruction,” is that more productive firms—those with better products or lower costs or better business models—grow faster than less productive incumbents, eventually displacing them. But after 2000, on average, firms with a given level of productivity grew only half as fast as firms with that same level of productivity grew in the 1980s and 1990s. In other words, productivity has less effect on growth than it used to. And when productive firms grow more slowly, they are less likely to “leapfrog” industry leaders and displace them—the hallmark of disruption. Last year, research I conducted with my colleague Erich Denk directly linked the waning impact of productivity improvement to the greater industry dominance of large firms and their investments in software and other intangibles.

Another view, expressed forcefully by congressional investigators in hearings and in a staff report published in 2020, attributes the decline in economic dynamism to a different source: the weakening of government antitrust policy since the 1980s. In this account, large firms have been permitted to acquire their rivals, reducing competition. Acquisitions have made these firms more dominant, especially in Big Tech, leading to a decline both in the emergence of new tech firms and in venture capital funding for early-stage firms. But in fact, the rate at which new tech firms enter the market is down only modestly from the exceptional surge of the dot-com boom, and early-stage venture capital financing is at record levels, with twice as many financings today as in 2006 and four times the amount invested. The problem isn’t that large firms are preventing startups from entering markets or getting funding; the problem is that big firms are employing large-scale technologies that make it harder for startups to grow. Moreover, big firms like Walmart and Amazon have grown mainly by adopting superior business models, not by buying rivals. Indeed, the rate of acquisitions by dominant firms has declined since 2000.

Of course, such acquisitions do sometimes affect the startup landscape. Some researchers have identified so-called “kill zones,” where Big Tech makes acquisitions to shut down competition, and venture capital becomes hard to find. But other researchers find that startups often respond by moving their innovative activity to a different application. Moreover, the prospect of acquisition by a large firm often incentivizes people to found startups. Indeed, despite what happened to Nuance, the number of speech-recognition and natural-language-processing startups entering the market has quadrupled since 2005, and 55% of these startups have received venture capital investments.


The slowdown in the growth of innovative startups is not just a problem for a few thousand firms in the tech sector; the headwinds blowing against companies like Nuance are responsible for problems that affect the health of the entire economy. Researchers at the US Census Bureau have shown that the slower growth of productive firms accounts for much of the slowdown in growth of aggregate productivity, a figure that measures the amount of output the economy produces per person and serves as a rough index of economic well-being. My own work has also shown that it plays a role in growing economic inequality, greater social division, and the declining effectiveness of government.

What will it take to reverse the trend? Stronger antitrust enforcement might help, but the changes in economic dynamism are driven more by new technology than by mergers and acquisitions. A more basic problem is that the most important new technologies are proprietary, accessible only to a small number of huge corporations. In the past, new technologies have spread widely, either through licensing or as firms independently developed alternatives; this enabled greater competition and innovation. Government sometimes helped this process. Bell Labs developed the transistor but was forced by antitrust authorities to license the technology broadly, creating the semiconductor industry. Similarly, IBM created the modern software industry when, in response to antitrust pressure, it began to sell software separately from computer hardware. 

Today we are seeing some similar developments even without government action. Amazon, for example, opened up its proprietary IT infrastructure to create the cloud industry, which has strongly improved the prospects of many small startup firms. But antitrust policy can be used to encourage or compel more large firms to open their proprietary platforms. Loosening the restrictions that noncompete agreements and intellectual-property rights place on employee mobility can also encourage a greater diffusion of technology. 

Coming up with the right balance of policies will be difficult, and it will take time—we don’t want to undercut incentives to innovation. But the starting point is to recognize that in today’s economy, technology has taken on a new role. Once a force driving disruption and competition, it is now being used to suppress them.



Important Notice: Help Stop the Spread and Stay Healthy. (Read now)