The State of the Database Landscape

The 2024 industry report from Redgate includes data from every sector and every company size, from developers, DBAs and software delivery professionals to IT leaders, CTOs and CEOs across the world.

Methodology

  • 3849 respondents
  • 6 continents
  • 15 industry sectors

Overview

Shifting skills to match constant demands

The new database landscape has become increasingly complex as modern-day business demands and data needs evolve. From managing multiple databases to migrating to the cloud, introducing continuous delivery with DevOps, and even incorporating Generative AI. The pace of change is faster than ever, causing a recurring challenge to emerge: the rapid need for skill diversification.

Our key findings reveal how these demands affect data professionals and organizations everywhere and highlight the changes coming up that you need to know about.

Methodology

Organizations are embracing multiple database platforms

As data needs change so does the infrastructure, with the majority of businesses needing different database platforms to fulfil requirements. Our data from 2020 has shown a steady increase in businesses using two or more database platforms (from 62% to 79% in 2024) with the top four being SQL Server, Oracle, MySQL and Postgres.

More database platform insights

“Managing multi platform data estates requires far more from people tasked with running them. They require a more versatile skillset… when operating on more than one database platform.”Tushita Gupta

Tushita Gupta

Head of Product Design, Redgate

Number of database platforms used by an organization over time

202320212020010203040506070809010079%70%62%21%30%38%1 only2 or more
2020
  • 1 only (38%)
  • 2 or more (62%)
2021
  • 1 only (30%)
  • 2 or more (70%)
2023
  • 1 only (21%)
  • 2 or more (79%)

Dynamic changes are occurring in the technology infrastructure landscape, driven by shifts in business requirements that impact the data center, remote work, edge environments, and connectivity.

Forrester

Predictions 2024: Technology Infrastructure Addresses A Tumultuous Environment

Handling multiple database platforms increases skill requirements

Out of the respondents who use more than one database platform, the number one challenge cited was skillset requirements. The effects of which spread across all areas of data management. Handling multiple databases requires a versatile skill set that spans various technologies, architectures, and operational practices.

More database platform insights

“When Postgres became my primary database platform a few years ago, one of the big challenges for me was understanding how to apply the database DevOps best practices that I had been using for years with SQL Server, and bring them into the Postgres space.”Ryan Booz

Ryan Booz

Advocate, Redgate

Top 5 challenges organizations face managing different technologies in a single environment

0100200300400500600700800 Compatibility issues System complexity Monitoring and troubleshooting Data integration complexities Skillset requirements andindividual / team training564590635698808
  • Skillset requirements and individual / team training (808)
  • Data integration complexities (698)
  • Monitoring and troubleshooting (635)
  • System complexity (590)
  • Compatibility issues (564)

Data management is far more complex

When asked what impact multiple database types have had on processes, increased complexity was top of the list, with skill diversification becoming necessary coming second. The difference between database platforms is vast, from programming languages and data models through to architecture and features, there is no one size fits all. While the increasing quantity of data, and kind of data, every organization is now faced with brings advantages, it also makes database estates more complicated and demands more knowledge from those tasked with managing the multiple database types now in use.

More database platform insights

“I’ve rarely met a data professional whose organization wasn’t experiencing data growth and making more demands of their data. It’s not just the growth in data being stored that’s an issue, it’s also where it’s being stored. Behind the scenes, the number of different databases and platforms being used across every business sector has been steadily increasing.”Max Drobot

Max Drobot

Product Manager, Redgate

Top 5 ways using multiple database technologies affect organizations' data management processes

0100200300400500600700 Data security complexities Increased data migration challenges Improved flexibility Skill diversification becamenecessary Increased complexity492557591637752
  • Increased complexity (752)
  • Skill diversification became necessary (637)
  • Improved flexibility (591)
  • Increased data migration challenges (557)
  • Data security complexities (492)

Database practices and tools are impacted

While adopting modern database technologies is essential with growing data demands, the implementation of crucial best practices and processes such as DevOps has become harder. In fact, a significant obstacle cited by 42% of respondents is the lack of appropriate skills. It was the biggest blocker to implementation. As organizations strive to bridge the gap, the need for cross-functional collaboration among developers, database administrators, and operations is only increasing.

More database platform insights

“Developers are expected to become gurus of everything from Kubernetes and infrastructure as code to running services on their own. Which is why cognitive (over)load is one of the biggest reasons behind failed DevOps adoption.”

Luca Galante

Source: Stack Overflow blog

The top 7 reasons cited as obstacles to implementing a DevOps approach

0510152025303540 Lack of support from executiveleadership Lack of budget to invest in newtooling Lack of awareness of benefits tothe business Lack of alignment betweendevelopment and operations teams Lack of understanding of DevOps ingeneral Disruption to existingworkflows/business Lack of appropriate skills in theteam19%25%25%27%29%34%42%
  • Lack of appropriate skills in the team (42%)
  • Disruption to existing workflows/business (34%)
  • Lack of understanding of DevOps in general (29%)
  • Lack of alignment between development and operations teams (27%)
  • Lack of awareness of benefits to the business (25%)
  • Lack of budget to invest in new tooling (25%)
  • Lack of support from executive leadership (19%)

99%+More than 99% of IT leaders say they face problems driving the best outcomes from their digital capability, with the complexity of integration (22%), a perceived inability to extract end-to-end benefits (20%) and siloed working (20%) topping the list of obstacles.

Source: Colt, Digital Infrastructure Report 2023

Standardization across platforms is a problem

In fact, implementing any database change has become increasingly challenging, as revealed by our survey where 31% of respondents reported difficulties stemming from varying internal approaches to application and database development. This complexity is exacerbated by the diverse nature of database platforms. Organizations need to adopt a flexible approach that acknowledges the unique characteristics of each database while aiming for consistency in overarching practices where possible.

More database platform insights

“It’s the single greatest challenge to implementing Database DevOps. Because databases, by their nature, must be persisted, the mechanisms for deployment are necessarily more complex and difficult to implement.”Grant Fritchey

Grant Fritchey

Advocate, Redgate

The greatest challenge in integrating database changes into a DevOps process

024681012141618202224262830 Keeping up with the speed ofdelivery of applications Meeting security or complianceconcerns Preserving and protecting businesscritical data Synchronizing application anddatabase changes Overcoming different approaches toapplication and database development5%16%21%28%31%
  • Overcoming different approaches to application and database development (31%)
  • Synchronizing application and database changes (28%)
  • Preserving and protecting business critical data (21%)
  • Meeting security or compliance concerns (16%)
  • Keeping up with the speed of delivery of applications (5%)

70.5%experience knowledge silo issues at work

Source: Stack Overflow Developer Survey 2023

Cloud migration isn’t always cost effective

Overall, cloud adoption is increasing with over 88% of respondents using the cloud in some capacity. The benefits of which are widely recognized such as Accessibility and Scalability. However, it appears less effective cloud migration strategies such as ‘lift and shift’ are still being undertaken as some respondents are planning to reduce their usage, with cost cited as the number one reason. Properly sizing and optimizing resources are essential for achieving cost efficiency.

More Cloud insights

“It’s really important to be able to identify opportunities to move databases to the cloud, or optimization techniques, or to even understand the business well enough to increase database capacity only when needed.”Chris Yates

Chris Yates

Republic Bank

Source: Redgate blog

Factors driving reduced cloud usage or moving towards on-premises

Client/Vendor requirementsSecurityCost0246810121416182022246%14%24%
  • Cost (24%)
  • Security (14%)
  • Client/Vendor requirements (6%)

88%are using the cloud

Adoption of new technologies is slow

The adoption of emerging technologies like Generative AI remains limited, with 20% of respondents indicating its implementation in their database management practices. The low uptake is attributed to various factors, with a lack of training being one of the main concerns. Strategy and management consulting firm McKinsey forecast that the demand for skills in this area will "gather pace" over the next 6 years.

“Automation and AI will accelerate the shift in skills that the workforce need. While the demand for technological skills has been growing since 2002, it will gather pace by 2030 when the time spent using advanced technological skills will increase by 50 percent in the United States and by 41 percent in Europe."

- McKinsey Global Institute, Skill shift: Automation and the future of the workforce

More AI insights

“The user of AI needs strong domain knowledge to understand if the results from the AI system are useful and correct. Without that, AI code can often be like what a first-year, junior developer produces.”Steve Jones

Steve Jones

Advocate, Redgate

Organizations using AI for database management

Other / N/ANo, and we have no plans toNo, but maybe in the future Yes, we have13%32%35%20%
  • Yes, we have (20%)
  • No, but maybe in the future (35%)
  • No, and we have no plans to (32%)
  • Other / N/A (13%)
The 2025 State of Database Landscape report cover

New report

2025 State of the Database Landscape

The 2025 State of the Database Landscape Report sheds light on the current state of database management and offers valuable insights into how organizations can navigate and simplify the growing complexities.

Download the report