A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS. - GitHub - awslabs/...

In our previous post, we introduced PyDeequ, an open-source Python wrapper over Deequ, which enables you to write unit tests on your data to ensure data quality. The use case we ran through was on static, historical data, but most datasets are dynamic, so how can you quantify how your data is changing and detect […]

This document describes the AWS Well-Architected Data Analytics Lens, a collection of customer-proven best practices for designing well-architected analytics workloads. The Data Analytics Lens contains insights that AWS has gathered from real-world case studies, and helps you learn the key design elements of well-architected analytics workloads along with recommendations for improvement. The document is intended for IT architects, developers, and team members who build and operate analytics systems.

This post demonstrates how to extend the metadata contained in the Data Catalog with profiling information calculated with an Apache Spark application based on the Amazon Deequ library running on an EMR cluster. You can query the Data Catalog using the AWS CLI. You can also build a reporting system with Athena and Amazon QuickSight to query and visualize the data stored in Amazon S3.

Many organizations are benefiting from the performance gains and ease of administration of the Amazon Aurora database platform. The idea of breaking free from commercial licenses, backup administration, and data center maintenance is always a welcome thought. But where to begin, and how complex is the journey to migrate from SQL Server to Amazon Aurora […]

Configure Amazon S3 for optimal performance, and load incremental data changes to Amazon Redshift by building an ETL pipeline in AWS Glue.

lambdr

The source code for the AWS Lambda tutorials on the Worn Off Keys YouTube channel. - GitHub - AlexzanderFlores/Worn-Off-Keys-Lambda-Tutorials: The source code for the AWS Lambda tutorials on the Wo...

Learn how to use AWS Secrets Manager to rotate a secret for an AWS database that AWS Secrets Manager provided Lambda templates.

How To Use AWS Secrets Manager To Rotate Database Secrets. In this AWS Secrets Manager demo we are are to see how to set up AWS Secrets Manager to work with an AWS RDS Database to rotate AWS Secrets. In this tutorial, you will follow the steps to create a secret for an AWS database and configure the secret to rotate on a schedule. You trigger one rotation manually, and then confirm that the new version of the secret continues to provide access. We will create a MySQL database for this aws secrets tutorial and then we will use the Secrets Manager console to create your secret and populate the secret with the initial user name and password for your MySQL database. We will then use your new secret to test the credentials and ensure you can use them to connect to your database and then setup and test the rotation. You can follow along with the instructions from this AWS Secrets Manager video here: https://docs.aws.amazon.com/secretsmanager/latest/userguide/tutorials_db-rotate.html See how to create and connect to a MYSQL database to complete step 1 of this tutorial here:https://youtu.be/0VTaSbpMLxc AWS Database And Storage Full Playlist: https://youtube.com/playlist?list=PLJjrxjvQuqgAff6KvuPPXCACbBp5z3WaY Watch the full AWS SysOps Administrator/DevOPS Full Playlist: https://youtube.com/playlist?list=PLJjrxjvQuqgCgfcmYTlWNptIh7hZ8ka7Z ++++++For more information on how to successfully migrate applications to the cloud read our latest book Stress Free Cloud Migration. ----------https://amzn.to/3lTTz0J ****For more cloud consulting inquiries email info@rmstechnologyconsulting.com or visit www.rmstechconsulting.com Don't forget to hit the like button and subscribe if you found this video helpful! New videos added weekly. Submit video ideas in the comments below.