Why tape storage is the safe pair of hands behind AI

The rise of AI is driving a resurgence in demand for tape storage and a growing number of organisations are turning to Linear Tape Open (LTO) tape technology to handle the vast quantities of data needed to train and operate their AI models.

According to IDC's ‘Magnetic Tape Market Results and Outlook’ report, LTO tape technology adoption is rising rapidly as organisations look to resolve their storage dilemmas.

Used in applications as diverse as cybersecurity and disaster recovery as well as storage and archiving, in recent years the technology has become the solution of choice for organisations with long-term data retention needs.

Now, however, the growing demands created by AI and big data analytics are fuelling a further surge in demand. 

The AI data challenge

From supply chain demand forecasting through to medical research, AI-powered data analytics are increasingly being utilised for a multitude of industry-specific use cases. 

When trained correctly, the outcomes generated by AI models are impressive. Recently, the BBC reported on how AI took just two days to resolve a complex problem that microbiologists had been investigating for a decade. Asked to analyse vast amounts of published research papers, scientific databases, and other documents, AI was able to synthesise all of this data and confirm why some superbugs are immune to antibiotics.

However, the effectiveness of AI models is directly impacted by the quality and quantity of data that is used to train them. As a result, many organisations are choosing to retain more and more of their data, so they can train new AI tools and algorithms more effectively.

While the prospect of unlocking as-yet untapped value from all this structured and unstructured data in the future is compelling, finding an efficient and cost-effective way to support the retention and processing of this data is becoming a pressing priority.

The data storage capacity issue

As businesses look to capitalise on the benefits of AI, the data storage capacity required to train and operate AI models places a significant strain on existing storage infrastructures. It also means that the expense associated with maintaining and extending their storage ecosystem is spiralling. 

To address these challenges a growing number of organisations are considering their options and turning to LTO tape technology for two reasons. Firstly, to keep costs in check, and secondly to ensure their storage supply chain is appropriately equipped to support AI training and operational needs.

Renowned for its high capacity, durability, and affordability, LTO tape technology can safely preserve data for up to 30 years. Ideal for storing large volumes of archival data, when integrated with modern archiving software in a tiered storage system it also enables intelligent and automated data management that determines when and where to move data for optimal storage.

This facility means organisations can distribute data across various storage options according to requirements such as access frequency, sensitivity, and other key factors. For example, within an active archive, data can be organised across a high-performance storage ecosystem featuring high-end flash, intermediate flash, cloud, disk, and tape. By using this strategic approach, organisations can ensure that primary storage remains available, archive performance is not compromised, and costs are kept in check.

A sustainable and secure data storage option

Ideal for storing decades worth of data for AI model training, LTO tape technology also enables organisations to initiate more sustainable AI by reducing their reliance on energy-hungry hard disc drives (HDDs) in the data centre.

As well as using minimal power when not reading or writing to LTO tape cartridges, the power usage of this technology drops to zero when implemented within an automated library, something that also generates a considerable saving in terms of CO2 emissions.

Meanwhile, from a data security and preservation perspective, modern LTO tape technology features advanced error correction, reliable writing, and an extremely low risk of data loss over time. This makes it ideal for creating secure, tamperproof, and encrypted backups that deliver peace of mind for scenarios such as cyberattacks, ransomware, or natural disasters such as floods, fires, or earthquakes.

Unlike HDDs, which were not designed with removal or transport in mind, the portability of LTO tape cartridges means they can be easily and securely transported between storage locations or data centres. Similarly, while cloud-based downloads can be slow, bandwidth intensive, and vulnerable to security risks, organisations that want to migrate an entire data centre have the option of simply packing up a box of LTO cartridges.

Taking a more balanced approach to storage needs

Tape storage is here to stay, partly thanks to the growing adoption of AI and related technologies. Providing a comprehensive and cost-effective solution for organisations that want to store and manage vast amounts of structured and unstructured data that can be mined by AI to find insights, LTO tape technology is proving to be the ideal host for these gigantic data sets.

Organisations can leverage economies of scale by keeping data sets in a tiered storage architecture, and when needed for analytics or for training AI models, data stored on tape can be seamlessly transferred onto faster storage systems. 

For enterprises that want to optimise their data storage approach and minimise the energy consumption of their data centres, LTO tape technology delivers all the accessibility, security, sustainability, and durability needed for a wide range of high-volume storage needs, playing a key role in addressing today’s modern data storage needs.

Carlos Sandoval Castro is IBM Worldwide Tape Offering Manager at the LTO Program.