At this very moment, 80% of the data created will be unstructured. Much of the unstructured data is quite valuable. For example, sensors are collecting and generating continuous data streams from scientific experiments, wind turbines, and nuclear reactors. Marketers listen to sentiment data from social networks to quickly respond to your concerns about their products. And your MRI or X-ray from the emergency room in digital form is most certainly precious data.
Data is a resource. To the storage administrator, however, Big Data can also be a nightmare to manage. Think about the file sprawl on your own personal computer. You know from your experience that hierarchical file directories are arbitrary and complex. Steve, a storage administrator, wakes up every morning with ever growing branches of directories to manage. Basic storage management tasks like archiving, backup and disaster recovery is a challenge at scale.
The OpenStack Object Store project, known as Swift, uses a simpler flatter hierarchical address space with unique resource identifiers for the objects it stores. Swift is ideal for storing unstructured data at scale. With no nesting like a traditional file system, capacity scan scale into the Petabytes and the number of objects into the billions.
Can Elastic Storage Object really keep my storage projects under one roof?
Due to its extreme scalability, extensibility, and resilience, OpenStack Swift is emerging as a dominant object storage solution. Despite its benefits, however, OpenStack Swift follows a model of deploying new storage systems for new application domains, effectively separating storage projects from each other.
Elastic Storage Object and Swift, aims to change this model by consolidating File and Object under a single shared storage infrastructure. The global namespace eliminates the need for physical client-to-server mappings making this an ideal platform to perform common storage management tasks such as automated storage tiering and user transparent data migration. Elastic Storage Object simplifies data management even further by creating a flat namespace and eliminating the hassle of organizing data in a hierarchical namespace.
How do I start exploring Object Storage?
If you are in interested in exploring these capabilities, we can help you get your own object storage infrastructure up and running with this new Redpaper | A Deployment Guide for Elastic Storage Object. Click here for your free copy.
The goal of this Redpaper is to describe the benefits of using Elastic Storage as the underlying file system with OpenStack Swift, guide the administrator through the installation and configuration of Elastic Storage Object, and describe the general set of configurations and scenarios that have been validated. So download the Redpaper and see for yourself: