Business Solution

Aeris managed a team taking ownership of a medium-sized codebase initially developed by a consulting agency.  The project was the first data warehouse at SkyTouch and consisted of several Glue and Lambda pieces in addition to fairly massive infrastructure including RedShift, Athena, and PostgreSQL.  

Upon project takeover we quickly identified and corrected numerous maintainability issues, adding dashboards and alerting in the process.  SkyTouch built on the warehouse by adding live messaging which involved intercepting SQL statements before data was persisted into Redshift and creating messages sent to Kinesis with structured data, effectively functioning as a business view. 

Aeris also authored a metrics platform to leverage the data warehouse which functions similarly to CloudWatch but provides relationship access to Redshift.  Metrics are communicated via custom CloudWatch messages, effectively using CloudWatch as a transport mechanism, before being ingested by a Glue process and pushed into Redshift.  Other Glue scripts periodically maintain fact tables and the like, exporting assembled data as a sort of reporting.

TECHNOLOGIES USED

• AWS
• AWS/Redshift
• AWS/RDS
• Logi Reports
• AWS/Glue (Python)
• AWS/Lambda (Python)
• Maven (standardized builds)
• Tox
• SQS & SNS
• S3
• Java
• Python