This is another exploration of the integration of AWS Services into modern tech and non-tech companies. We continue to explore more how AWS can benefit an organization by taking case examples..

Suppose your company is using an application that writes data directly to AWS S3, which is then processed by AWS Lambda and stored in Redshift for analytics. As an admin, you would like to ensure malware-free data is uploaded from customers, it is advisable to deploy Amazon GuardDuty from a third party on the objects within S3 to detect and scan virus. The reason is that AWS lacks a virus scanning service for the files entering S3.

Jane runs a perfume business online where customers order via her website. She uses VPC for order processing, payment and shipping, and even warehousing. Jane wants to perform analysis and know the number of delayed orders and their features, she would like to cost-effectively view all the infrastructure elements in one place. In such a case, the best solution could be setting up data connectors and registering them to catalog within Athena. Amazon Athena can help the analyst in performing ad hoc analysis of multiple data sources from S3 to determine relationships and extract insights from the data. Read more here

John’s company is using Amazon Redshift to store data and run analytics. Over time, the analytics team has grown and the queries sent to Redshift are increasing. Some teams send complex and CPU intensive queries as compared to others which are short, and fast-running. The admin has to ensure that access to Redshift does not affect the overall performance. To avoid the fast-running queries interfering with the heavy queries, it is advisable to set up a workload management configuration that is configured with the 6 queues (equivalent to the number of teams) with a concurrency level of one. When using Redshift, it is possible to set up a maximum of 8 queues with a maximum of 50 concurrency levels in each queue. For our case, we’ve 6 teams and as a result, it would be advisable to assign each team a queue. Read More here

The data engineering team works to ensure data security of the data lake architecture at ABC Company. The data lake is accessed by different company teams wanting to perform simple and complex queries, analysis, visualization, and reporting then dashboarding for quick business decisions, as a result, the data engineering team has to architect the data lake solution in a way that there is a centralized way to restrict permissions for each team to only access the data they need. The company requires to use Redshift for data warehousing and the users will need to join Redshift data to S3 objects.
The data engineering team can consider using AWS Lake Formation as their central database. The service can be used to grant and resolve permissions to different databases, tables, and data columns stored in S3. Additionally, the Redshift Spectrum can be used to run queries on external tables within S3. Read More here.

Keep an eye for more like this Editor Nick