The future of cold data storage: Transforming big data management with DNA technology

In today’s digital age, data generation is accelerating at an unprecedented pace. By 2025, it’s estimated that over 180 zettabytes of data will be generated annually, a significant leap from the 64.2 zettabytes created in 2020. This explosion in data creation presents a critical challenge: how to store it all effectively. Traditional storage technologies are struggling to keep up, and the associated costs are skyrocketing. The market for cold storage, which accounts for approximately 60% of all data stored, is particularly strained. Cold storage—data that is written once and read seldomly, if ever—has seen significant growth, driven by new regulatory requirements, the increasing volume of research data (climate, astrology, genomic sequencing), the proliferation of data from robotics and autonomous vehicles. The bottom line is, we store more data for longer periods.

Current storage solutions, such as hard disk drives (HDDs), solid-state drives (SSDs), and magnetic tape technology, have served us well but are beginning to show their limitations. For instance, while HDDs are relatively cost-effective, they have a limited lifespan of about 3-5 years and are susceptible to physical damage. SSDs, known for their speed and reliability, are considerably more expensive and have a finite lifespan, typically around 10 years under optimal conditions. Magnetic tapes, despite being the backbone of large-scale archival storage, require constant maintenance and environmental controls to prevent degradation, with a lifespan ranging between As the volume of data continues to grow, the total cost of ownership (TCO) for these technologies is becoming an unsustainable burden for organizations. By 2030, the storage demand from hyperscale vendors is projected to grow by up to 50% CAGR, further straining existing infrastructure.

In addition to the challenges of storing vast amounts of data, the environmental impact is becoming a growing concern. Energy consumption in major data centers has been rising significantly, driven by the exponential growth in workloads. Despite improvements in efficiency, energy use in this sector has increased by 20-40% annually over the past several years. Between 2017 and 2021, the combined electricity consumption of industry giants like Amazon, Microsoft, Google, and Meta more than doubled, reaching 72 TWh in 2021 (IEA, 2023).

Although global data center electricity consumption has grown only slightly overall, some countries with expanding data center markets are experiencing rapid increases. For instance, in Ireland, data center electricity use has more than tripled since 2015, accounting for 18% of total electricity consumption in 2022, and could rise to 28% by 2031 unless generation capacity is expanded. Similarly, in Denmark, data center energy use is projected to increase sixfold by 2030, potentially accounting for nearly 15% of the country’s electricity consumption (IEA, 2023).

In response to these challenges and opportunities, DNA data storage technology could be a solution for big data archiving. DNA offers a remarkably compact medium for data storage, with one gram of DNA having the potential to store up to 215 petabytes of data (Integrated DNA Technologies, 2024). In contrast to traditional storage media, DNA can preserve information for thousands of years without degradation, making it an ideal solution for long-term archiving. The stability and durability of DNA are unmatched, and its storage density far surpasses that of any existing technology.

The benefits of DNA data storage extend beyond just density and longevity. DNA storage is also highly scalable, and as the cost and time of encoding into DNA and retrieving it form (DNA synthesis and sequencing) continues to decrease, it is becoming an increasingly viable option for organizations grappling with the challenges of big data management. Additionally, DNA storage is environmentally sustainable. Unlike traditional storage devices that consume significant amounts of energy and resources for maintenance and temperature control, DNA storage requires virtually no energy once data has been encoded, leading to lower operational costs and a reduced environmental impact.

However, DNA data storage is still in its early stages. While the technology holds immense promise, encoding and decoding data in DNA is currently more cumbersome and expensive than traditional methods. Similar challenges were faced by NAND (Flash) storage, which, despite early obstacles, saw an 11x increase in usage from 2008 to 2023 as the technology matured (Library of Congress, 2024). At DATANA, we are committed to addressing these limitations of DNA data storage and pushing the technology closer to everyday use.

For professionals in the storage industry, national archives, and large corporations, DNA data storage represents an opportunity to rethink how data is preserved and managed. The ability to store massive amounts of information in a stable, compact, and sustainable format addresses many of the pain points associated with traditional storage methods. As this exciting technology continues to evolve, it is poised to play a critical role in the future of data archiving.

If interested in hearing more about DATANA, our technology, or DNA data storage in general, reach out to us at datana@biosistemika.com.