When it comes to data storage, flash storage is synonymous with speed and performance. Solid state flash drives have no moving parts; information is stored in microchips. This lack of moving parts is what makes solid state drives so much faster than hard disk drives.
However, this speed comes with a higher cost. When universities are analyzing their storage needs, they need to turn a critical eye to determining which data needs to be accessed most frequently by the most people. Solid state drives are more costly upfront, but they produce results much faster, cutting costs in the long run. Mission critical applications that are sensitive to performance should be deployed using flash technology. Some storage vendors today incorporate flash as a caching tier to make workloads on traditional mechanical disk storage faster.
Traditional Mechanical Disk Storage
Considered by many to be the faithful work horse of the storage landscape, hard disk drives are a cost-effective way to handle routine data for many workloads. While slower than solid state drives, hard disk drives have a greater capacity than their solid state drive counterparts, which means that they can store far more information. Assigning data that is not in active use, or whose use is not reliant on speed and accessibility from multiple sources, is a good use of hard disk drives in any data analytics system. Some vendors today have technologies to make this storage as efficient as possible using technologies like compression and deduplication. Virtual copies, or snapshots, can also simplify data protection and make backup and recovery very fast.
While universities will want to keep their most sensitive data on-premises, unstructured and semi-structured data is especially well suited to cloud storage, with significant advantages:
- Cost reduction: Data analytics can require significant amount of computing resources to analyze and process large volumes of data. Using the cloud reduces costs to the university, particularly in a pay-per-use, utility pricing model.
- Reduced overhead: By taking advantage of cloud technologies, IT teams can reallocate dollars normally spent on physical hardware. Where many private on-premise data centers are at capacity, using cloud can be a strategy to extend the life of an existing data center.
- Provisioning and scaling: Utilizing the cloud provides the ability to easily scale as required by the amount and type of data being processed. This is especially helpful with regards to research as it allows for decreasing the reliance on high performance computers for routine data, freeing up these HPCs for research efforts.
- Ability to store your data in your own, private data center, while taking advantage of public compute resources. This model enables institutions to maintain complete sovereign control over their data, while taking advantage of public cloud compute resources. This helps institutions avoid cloud lock in and they can maintain a strong negotiation posture with their cloud vendor.
Data analytics allows university faculty and administrators to innovate, support, and enhance the college experience for students and staff alike. In most university settings, the right storage tool for the job is a combination of all three. Taking the time to do a thorough analysis of your data collected and need for access, allows IT teams to determine the right combination of storage options to suit each institution’s needs. Providing the proper support on the storage side can help smooth the way for the continued growth of big data on college campuses for years to come.
Matt Lawson is principal architect for state, local government and education at Net App.