{"id":419,"date":"2021-11-03T12:32:10","date_gmt":"2021-11-03T12:32:10","guid":{"rendered":"http:\/\/18.141.20.153\/?p=419"},"modified":"2023-05-04T11:33:10","modified_gmt":"2023-05-04T11:33:10","slug":"aws-s3-storage-lens-analytics-solution-for-organization-wide-visibility","status":"publish","type":"post","link":"https:\/\/learning.workfall.com\/learning\/blog\/aws-s3-storage-lens-analytics-solution-for-organization-wide-visibility\/","title":{"rendered":"AWS S3 Storage Lens \u2014 Analytics Solution For Organization-Wide Visibility"},"content":{"rendered":"Reading Time: <\/span> 7<\/span> minutes<\/span><\/span>\n

<\/p>\n\n\n\n

S3 Storage Lens is a recently launched service of AWS for S3 which provides S3<\/a> storage analytics and insights. S3 storage lens is also the first-ever cloud storage analytics solution initially introduced by AWS.<\/p>\n\n\n\n

The S3 storage lens increases object storage visibility into S3 buckets. When you are storing objects in S3 from hundreds to thousands or millions and billions, then it becomes necessary to have deep visibility into your objects as they incur costs. AWS always comes up with feasible solutions and services that help big organizations as well as startups to cost-effectively manage their resources.<\/p>\n\n\n\n

You can access the S3 storage lens using AWS Management Console, AWS SDKs<\/a>, AWS CLI, or REST API.<\/p>\n\n\n\n

S3 storage lens provides interactive dashboards for analyzing data of the entire organization, single or multiple accounts, specific regions, or buckets. It provides more than 30 metrics to visualize the S3 storage usage and account activity of the organization. You can also export metrics in CSV and Apache parquet format in the S3 bucket of your choice to further enhance your view.<\/p>\n\n\n\n

The S3 storage lens<\/a> provides 2 types of metrics:<\/p>\n\n\n\n

Usage Metrics: The usage<\/strong> metric is related to the size, quantity, and characteristics of your storage. It includes total byte stored, object count, and object size, and additionally also includes encrypted bytes and delete market object count. Usage metrics are available free of cost.<\/p>\n\n\n\n

Activity Metrics: <\/strong>If you are subscribed to advanced metrics and recommendation metrics, then you are eligible for activity metrics. It is related to how often storage is requested. It includes requests by type, upload, and downloads bytes and errors. Activity metrics are available with the cost.<\/p>\n\n\n\n

Once you create the dashboard, it will be updated daily if enabled. You can create up to 50 dashboards per home region<\/strong>. <\/p>\n\n\n\n

Every customer of AWS gets a default dashboard set up for them to analyze S3 storage. You can also modify that default dashboard according to your significant usage. You can enable advanced metrics on this dashboard. <\/p>\n\n\n\n

Let\u2019s do some hands-on to better understand the S3 storage lens and how it could benefit your organization.<\/p>\n\n\n\n

In this exercise, first, we will create an S3 bucket and upload some objects to it.<\/p>\n\n\n\n

So, let\u2019s create an S3 bucket in the North Virginia region (us-east-1)<\/strong>.<\/p>\n\n\n\n

\"AWS<\/figure>\n\n\n\n

For Default encryption, we are enabling the encryption with Amazon S3 Key (SSE-S3).<\/p>\n\n\n\n

\"AWS<\/figure>\n\n\n\n

Then, click on Create a bucket<\/strong> and a bucket will be created. Now, select the bucket you created and click on it.\u00a0<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

We will upload some objects inside our bucket workfallbucket-test.<\/strong><\/p>\n\n\n\n

\"AWS<\/figure>\n\n\n\n

Let\u2019s create two folders in this bucket.<\/p>\n\n\n\n

One can be a CSV folder for storing CSV files and another one can be an image folder for storing images. <\/p>\n\n\n\n

Then, upload the required files into the respective folders.<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

We will also create one bucket as a destination bucket in the Ohio region (us-east-2)<\/strong>. We will name this bucket as workfall-destination. <\/strong>This bucket will store the metrics data which will be exported every 24 hours. <\/p>\n\n\n\n

Note: The destination bucket should be created in the region where your dashboard is created.<\/p>\n\n\n\n

Now, we will create a dashboard using an S3 storage lens:<\/p>\n\n\n\n

From the navigation bar, head towards the S3 storage lens, and from the dropdown, select Dashboards<\/strong> and you will be redirected to the S3 storage lens console. Now, click on Create Dashboard<\/strong>.<\/p>\n\n\n\n

\"AWS<\/figure>\n\n\n\n

We will name our dashboard as workfall-dashboard-demo. <\/strong><\/p>\n\n\n\n

\"AWS<\/figure>\n\n\n\n

Home region: Home region is the region where all the metrics data of the dashboard including all the regions will be stored. <\/p>\n\n\n\n

Currently home region is available in all regions except 4 regions mentioned below:-<\/p>\n\n\n\n