Select Page

Is Data Archiving Obsolete?

John Kaufling | | October 23, 2013

With so much data available to organizations these days, is there any benefit associated with archiving data?

Data management is one of an IT department’s key costs. One estimate is that chief information offices spend roughly 70% of their budget maintaining existing systems, which includes data-inundated warehouses and those legacy applications associated with them. Some organizations can see its data volume increase three to five times or more in a two-year period.

Information technology professionals have long advocated a back-up-everything policy; however, Jim McGann, vice president, Index Engines, writing in Enterprise Systems, says some data is important for adhering with legal and compliance issues, but retaining other data could prove a corporate liability.

“Archiving all corporate data forever is not smart. It is not a policy that any legal or compliance team would endorse,” says McGann. He estimates that roughly 90% of an organization’s data does not need to be archived, nor should it be.

Big data and technologies such as cloud computing are pushing organizations to adopt integrated data structures, which may require consideration of new, more complex methods for managing data. These systems will need to use existing information such as structured-transactional data plus new forms of information gathered from social media or sensor networks, for example.

A large global financial institution with more than 200TB of data and as many as five million unique user queries daily was having difficulty managing its data. It was ultimately able to archive and off-load data from its data warehouse, saving more than US$22 million, according to Venkat Lakshminarasimha, global big data integration specialist with Informatica, in a workshop presentation at FutureGov Singapore Forum 2013. With savings continuing to increase, the organization was able to implement data management software that saved 100TB of storage space in two-and-a-half years and, among the other benefits, resulted in a prompt return on investment.

Although hardware-based storage may seem obsolete, it is still effective and efficient for storing. Deni Connor, founding analyst, Storage Strategies NOW/Systems Strategies NOW, told Network Computing that tape is still used, but disk storage has become increasingly important for those users wanting to protect their data. Some small- to medium-sized businesses are moving to cloud-based storage solutions in lieu of tape media archival.

Even with resources like the cloud available, Connor says organizations still need to have some system in place for governance, risk management, and compliance. This means an organization must have systems on-site that can allow it to respond to data queries very quickly.

McGann adds that when organizations are smart about the data they archive, they reap a wide range of benefits, including reduced storage costs as well as managing corporate liability. What are your thoughts? Let us know, we’d love to get your opinion on data archiving.

Subscribe to Our Blog

Never miss a post! Stay up to date with the latest database, application and analytics tips and news. Delivered in a handy bi-weekly update straight to your inbox. You can unsubscribe at any time.

ORA-12154: TNS:could not resolve the connect identifier specified

Most people will encounter this error when their application tries to connect to an Oracle database service, but it can also be raised by one database instance trying to connect to another database service via a database link.

Jeremiah Wilton | March 4, 2009

12c Upgrade Bug with SQL Tuning Advisor

Learn the steps to take on your Oracle upgrade 11.2 to 12.1 if you’re having performance problems. Oracle offers a patch and work around to BUG 20540751.

Megan Elphingstone | March 22, 2017

Using Nulls in DB2

If a column “value” can be null, it can mean one of two things: the attribute is not applicable for certain occurrences of the entity, or the attribute applies to all entity occurrences, but the information may not always be known.

Craig Mullins | April 6, 2015

Work with Us

Let’s have a conversation about what you need to succeed and how we can help get you there.


Work for Us

Where do you want to take your career? Explore exciting opportunities to join our team.