CLOUD SERVICE · AWS

Amazon S3

Amazon S3 (Simple Storage Service) is a scalable cloud storage service offered by Amazon Web Services (AWS) that allows users to store and retrieve any amount of data from anywhere on the web.

Cloud Services Hub →
Arch_Amazon Simple Storage Service_64 imageIcon source: AWS

Free Amazon S3 tools

What is Amazon S3

Read the extensive description

Amazon S3, which stands for Amazon Simple Storage Service, is a scalable object storage service offered by Amazon Web Services (AWS) that allows users to store and retrieve vast amounts of data from anywhere on the web. It was launched in 2006 and quickly became an essential component of the internet's infrastructure, leveraged by startups, large corporations, and government agencies alike for a variety of storage solutions. 

At its core, Amazon S3 is designed to make web-scale computing easier and more accessible for developers. It provides a simple web services interface that can be used to store and retrieve any amount of data, at any time, from anywhere on the web. S3 is designed to provide 99.999999999% durability and 99.99% availability by default; these are design targets rather than unconditional guarantees. S3 Standard, S3 Standard-IA, S3 Intelligent-Tiering, and the S3 Glacier storage classes store objects across at least three Availability Zones. S3 One Zone-IA instead stores objects redundantly within one Availability Zone, and directory buckets store objects within a single Availability Zone or Local Zone. 

One of the key features of Amazon S3 is its scalability. Users can store as little or as much data as they want and access it when needed, without worrying about pre-provisioning storage space or bandwidth. They only pay for what they use, with no minimum fee or setup cost, which makes it an attractive option for both small-scale projects and enterprise-level operations. The pricing model of Amazon S3 is tiered, based on the amount of data stored and the operations performed on the data, such as requests for access and data transfer out of the AWS region. 

In addition to its high durability and scalability, Amazon S3 offers a rich set of features designed to meet a wide range of requirements. These include various storage classes tailored for different use cases, ranging from frequently accessed data to long-term archiving at lower costs. It also provides comprehensive security and compliance capabilities, ensuring that data is protected both at rest and in transit. Users can manage access to their objects stored in S3, using finely tuned permissions, and secure their data using encryption options. 

S3 uses different bucket types for different workloads. General purpose buckets support all storage classes except S3 Express One Zone. Directory buckets use S3 Express One Zone for low-latency processing within a single Availability Zone. Table buckets store Apache Iceberg tables and automatically maintain them for analytics. Vector buckets use dedicated vector APIs, rather than S3 object APIs, to store vectors and query them by semantic similarity.

S3 on Outposts stores data in an on-premises Outpost unless you explicitly transfer it to an AWS Region.

The flexibility of Amazon S3 extends to its integration with other AWS services and third-party applications, enabling a broad spectrum of workflows and scenarios. Whether it's hosting a website, running big data analytics, backing up and recovering critical data, or serving as a data lake for various applications, Amazon S3 provides the foundation upon which diverse needs can be met. Its API-driven approach also allows developers to easily integrate storage capability into their applications or software, leveraging the extensive documentation and SDKs provided by AWS. 

In summary, Amazon S3 stands out as an innovative, highly reliable, and scalable object storage solution. Its comprehensive features and integrations make it a versatile and essential tool for storing and retrieving data on the cloud, satisfying the demands of evolving digital landscapes and the ever-growing need for efficient, secure, and cost-effective storage solutions.

Key Amazon S3 Features

Amazon S3 is a highly durable, scalable, and secure object storage service that offers cost-effective pricing, easy management, and event notification features, ideal for businesses of all sizes.

High Durability

Amazon S3 provides 99.999999999% durability for objects over a given year, ensuring high levels of data protection and reliability. This is achieved by automatically replicating data across multiple systems.

Scalability

S3 can handle large amounts of data and traffic, seamlessly scaling up or down as needed without compromising performance or speed. This makes it ideal for businesses of any size.

Security and Compliance

Offers comprehensive security features like encryption, access control lists, and bucket policies. S3 also complies with regulatory requirements, providing a secure environment for your data.

Cost-effective

With its pay-as-you-go model, charges depend on usage and the features enabled, rather than storage and transfer alone. S3 offers various storage classes for different use cases, helping to optimize costs.

Easy to Manage

Amazon S3 features an intuitive web interface, enabling users to organize data and configure finely-tuned access controls. Lifecycle policies can automate tasks like transitioning objects between storage classes or archiving.

Event Notifications

S3 can notify applications or services in real time when objects are uploaded or deleted, enabling automation of workflows and integration with other AWS services for processing or analysis.

Amazon S3 Use Cases

Amazon S3 is utilized for backup and disaster recovery, static website and web application hosting, big data analytics, software delivery, and as a backbone for content delivery networks, offering scalable, secure, and cost-effective solutions across diverse use cases.

Backup and Storage

Amazon S3 provides a highly durable and scalable storage solution that can be used for online backup of critical data. It supports versioning, thus ensuring that you can recover files from any point in time, offering a robust solution for disaster recovery plans.

Application Hosting

Developers use Amazon S3 to host static websites and web applications by storing HTML, CSS, JavaScript, and media files. This reduces the need for complex server infrastructure, making it a cost-effective and scalable way to deliver content to users.

Big Data Analytics

Amazon S3 works seamlessly with Amazon Elastic MapReduce (EMR) and other AWS services for analytics and data processing. S3 provides a centralized repository for storage, making it easier to perform big data analytics on a vast amount of data, aiding in generating insights and driving decisions.

Software Delivery

S3 is used by software vendors to distribute applications, updates, and patches. Thanks to its global reach and high availability, it ensures that users around the world can download software quickly and reliably.

Content Delivery

With Amazon S3's integration with Amazon CloudFront, it serves as a robust content delivery network (CDN) solution, caching content at edge locations worldwide. This setup accelerates the delivery of content to end-users, improving user experience and reducing load times.

Amazon S3 pricing models

Amazon S3 offers a variety of pricing models, including Standard Storage for frequently accessed data, Intelligent-Tiering for automatic cost optimization, and several options for infrequently accessed or archived data at lower costs.

Amazon S3 Files

Charges apply to active data stored on the file system's high-performance storage and to reads and writes against that storage. Reads served directly from the S3 bucket incur S3 GET request charges but no S3 Files data access charges.

Amazon S3 Glacier Flexible Retrieval and S3 Glacier Deep Archive

Long-term backup and archive storage charged for storage, applicable requests, and retrievals. S3 Glacier Flexible Retrieval offers retrieval options from 1 minute to 12 hours, while S3 Glacier Deep Archive can restore data within 12 hours. Minimum storage durations are 90 days for Flexible Retrieval and 180 days for Deep Archive; earlier deletion, overwrite, or transition incurs a prorated charge for the remaining duration.

Amazon S3 Glacier Instant Retrieval

Storage has a minimum billable object size of 128 KB and a minimum duration of 90 days, with a prorated remaining-duration charge for earlier deletion, overwrite, or transition.

Amazon S3 Intelligent-Tiering

A cost-optimization feature that automatically moves your data to the most cost-effective access tier, based on how frequently you access each object. Charges apply for storage, monitoring, and automation fees.

Amazon S3 One Zone-Infrequent Access (S3 One Zone-IA)

Similar to S3 Standard-IA, but stores data in a single Availability Zone. Offers lower storage costs at the risk of data availability.

Amazon S3 Standard Storage

This model charges for the storage space you actually use. It is designed for frequently accessed data and prices are based on the amount of data stored per month in gigabytes.

Amazon S3 Standard-Infrequent Access (S3 Standard-IA)

Designed for data that is less frequently accessed, but requires rapid access when needed. Lower storage price compared to S3 Standard, but with a retrieval fee.

Amazon S3 Tables

Table buckets incur storage, request, and per-object monitoring charges, with additional fees for table maintenance and replication.

Amazon S3 Vectors

Charges cover vector storage, requests, uploaded data, and queried data. PUT pricing is based on logical GB uploaded, including vector data, metadata, and keys.

Data Management and Insights

Data management and insights features have separate pricing.

Data Transfer and Transfer Acceleration

Data transfer and transfer acceleration are separate S3 cost components.

Glacier Provisioned Capacity Units

Provisioned Capacity Units reserve expedited Glacier retrieval capacity for a month. Each unit provides at least three expedited retrievals every five minutes and up to 150 MB/s of retrieval throughput.

Replication

Replication has separate pricing.

Requests and Data Retrieval

Requests against buckets and objects are charged by request type and quantity, including requests made through the console. Retrieval charges apply to Standard-IA, One Zone-IA, and Glacier Instant Retrieval reads and to applicable archive restores; a temporarily restored archive copy also incurs S3 Standard storage charges.

Transform and Query

Transform and query features have separate pricing.

Services Amazon S3 integrates with

AWS Glue image AWS Glue

AWS Glue can crawl data in Amazon S3, making it available for ETL (Extract, Transform, Load) operations.

Open AWS Glue →
Amazon Redshift image Amazon Redshift

Amazon Redshift can use Amazon S3 as a data storage backend for loading large datasets into Redshift clusters.

Open Amazon Redshift →
Amazon EC2 image Amazon EC2

Amazon S3 can be used as a storage backend for Amazon EC2 instances, allowing these instances to store and retrieve data from S3 buckets.

Open Amazon EC2 →
Amazon RDS image Amazon RDS

Amazon S3 integrates with Amazon RDS for database backup and restore functionalities.

Open Amazon RDS →
Amazon CloudFront image Amazon CloudFront

Amazon S3 integrates with Amazon CloudFront to deliver content with low latency and high transfer speeds by using S3 as the origin server.

Open Amazon CloudFront →
AWS Lambda image AWS Lambda

AWS Lambda allows you to run code in response to changes in S3 buckets, without provisioning or managing servers.

Open AWS Lambda →

Concepts related to Amazon S3