Most Important Cloud Concepts - Episode 7 - Storage

Cloud Storage Concepts: A Deep Dive

Key Concepts: Object Storage, Block Storage, Databases (Relational, NoSQL), Cache Solutions, Volumes, Autoscaling.

1. Object Storage: General Purpose Media Storage

• Definition: Object storage is a general-purpose storage solution for various media types.
• Examples:
  • Media files (MP4, AVI - though its relevance is questioned)
  • Audio files
  • JSON objects (structured data)
  • CSV files
  • Blobs or byte stream data
• Functionality: Acts as a "dumping ground" for miscellaneous media types.
• Accessibility: Data can be accessed later by applications.
• Benefits:
  • Trivializes media storage compared to hosting on application-attached volumes.
  • Eliminates concerns about physical storage location.
  • Provides anytime access from the cloud.
• Use Cases: Storing media, images, JSON configuration files, and CSV data.

2. Block Storage: Scalable Volumes

• Definition: Block storage refers to volumes, essentially like hard drives in the cloud.
• Key Feature: Autoscaling: Cloud providers offer volumes that can automatically scale up or down based on resource needs.
• Example: A hard drive used for a short-term, data-intensive job like machine learning processing.
• Volume Sharing: Supports attaching a single volume to multiple instances, enabling data sharing across them.
• Benefits:
  • Flexibility in allocating storage resources.
  • Cost-effectiveness by scaling resources based on demand.
  • Data consistency across multiple instances.

3. Databases: Structured Data Management

• Overview: Databases are a crucial storage category with diverse types available on cloud platforms.
• Types:
  • Relational Databases: Traditional databases using SQL.
    • Examples: PostgreSQL, MySQL, Microsoft SQL Server, Oracle.
  • NoSQL Databases: Databases that often use a document model.
    • Examples: MongoDB, DynamoDB, OpenSearch/Elasticsearch, Graph Databases.
    • Note: NoSQL is a broad category encompassing various database types.

4. Cache Solutions: Temporary Data Storage

• Definition: Cache solutions involve storing temporary data, typically in memory.
• Purpose: To provide fast access to frequently used data, reducing the need to query databases repeatedly.
• Functionality: Data sits in memory for applications that need it regularly.
• Benefits:
  • Improved application performance.
  • Reduced database load.
• Note: Whether cache solutions are considered databases is a subjective matter.

Synthesis/Conclusion

The video outlines the fundamental storage concepts in cloud computing: object storage for general media, block storage for scalable volumes, databases for structured data management (including relational and NoSQL options), and cache solutions for temporary data storage. Each type serves distinct purposes and offers unique benefits, catering to diverse application needs and performance requirements. Understanding these storage options is crucial for designing efficient and scalable cloud-based solutions.