How To Upload and Download Files in AWS S3 with Python and Boto3
In this How To tutorial I demonstrate how to perform file storage management with AWS S3 using Python's boto3 AWS library.
Posts about AWS
By Watermarking Videos with AWS Elastic Transcoder S3 and Lambda
In this article I walk through the process of setting up an automated process utilizing AWS S3, Lambda, and Elastic Transcoder to embed a watermark in to videos initiated by uploading to an S3 bucket.
Deploying Flask to AWS: Amazon Linux 2, PostgreSQL, Nginx and, uWSGI
In this article I discuss how to deploy a simple Flask Todo app complete with a PostgreSQL database to the AWS cloud on a Amazon Linux 2 AMI utilizing Nginx web server and uWSGI application server
Creating PostgreSQL Hot Standby Log Shipped Replica using WAL-E
In this article I demonstrate how to setup a log shipped replica of a Postgres v11 master database creating a warm standby replica for High Availability and read scaling utilizing the WAL-E program. WAL-E is a Python based program designed to facilitate performing continuous archiving of PostgreSQL WAL files and base backups.
Migrating Large Heroku Postgres Instances to AWS Aurora without Downtime
In this article I discuss a general process I used recently to migrate a large multi-terabyte Heroku Postgres Database from the Heroku Platform to Amazon Aurora Postgres on a live Heroku based application architecture with near zero downtime and builtin failover during the process.
Implementing a Serverless Flask REST API using AWS SAM
In this article I demonstrate how to build a serverless REST API using the AWS Serverless Application Model (SAM) framework along with the popular Python based Flask micro web framework.
Using Lambda Versions, Aliases and Safe Deployments with AWS Serverless Application Model
In this article I discuss the merits of using Lambda versioning and aliases along with the AWS Serverless Application Model's (SAM) built-in capability to utilize CodeDeploy with weighted traffic routing for Gradual Deployments
Streaming Logs to S3 with Kinesis Firehose in a Serverless Project
In this article I demonstrate how to setup a AWS Serverless Application Model (SAM) project for near realtime streaming of CloudWatch logs to S3 using Kinesis Data Firehose. To keep things interesting I'll be using a Python based demo application that exposes two REST APIs, one for scraping and saving quotes from the web to a DyanmoDB table and another for listing the saved quotes.
Keeping Python AWS Serverless Apps DRY with Lambda Layers
In this article I demonstrate how utilize Lambda Layers to share reuable code among multiple Python AWS Lambda functions within AWS Serverless Application Model (SAM) applications.
Exploring Online Analytical Processing Databases plus Extract, Transform and, Load in PostgreSQL
In this article I give an introduction to Online Analytical Processing databases comparing them against traditional Online Transaction Processing Systems. Emphasis is put on designing and building Star Schemas and Reporting tables using Data Engineering processes like Extract, Transform and Load all within a Aurora PostgreSQL database.
Navigation
Favorites
Tags
Kafka
Data Engineering
DevOps
Gradle
Java
AWS CDK
AWS Kinesis
AWS
AWS S3
Click CLI Framework
Python
Natural Language Processing
MachineLearning
BeautifulSoup
requests
Apache Flink
AWS EMR
Apache Hive
Linux
ksqlDB
Stream Processing
AWS Serverless Application Model
AWS-Lambda
REST
PySpark
Kubernetes
sysadmin
PostgreSQL
Databases
SciKit Learn
AWS Glue
Ubuntu
Redshift
psql
Flask
CentOS
uWSGI
Nginx
AWS Elastic Transcoder
C++
OpenCV
Sorting
Animations
JavaFX
Collections
Java HTTP Client
ChoiceBox
ComboBox
Try-With-Resources
Jsoup
Web Scraping
FXML
JavaScript
NodeJS
Factory Method
OOP
Eclipse
Intro to Java
TextBlob
Build Systems
static assets
cloning
streams
Django Auth
Django
Python Social Auth
Django Guardian
VueJS