• Big Data Hadoop Developer Certificate
• Technical Skills (TIA) – Actuary
• Big Data with PySpark Track – Data Camp
• Introduction to SQL Bootcamp
• AWS CDK – Cloud Development Kit
• Coding Exercises SQL – LinkedinLearning
• Introduction to Spark SQL Dataframes
• Python OOP – Udemy
• QuantNet C++ Programme for Financial Services
• Terraform Course
• TensorFlow Certificate
• Cloud Computing CompTIA +

Certifications

• AWS Solutions Architect Associate
• AWS Data Engineer Associate
• AWS Security Speciality
• AWS Machine Learning Speciality
• AWS Developer Associate
• AWS Solutions Architect Professional
• DevOps Engineer Professional
• Microsoft Power BI Data Analyst Associae
• SQL Certification – PostGRE SQL
• Google Data Analytics
• Github Certified Git Associate
• AWS Databricks Platform Architect
• SnowPro Core

Some Data Engineer Responsibilities

• Creating Athena Glue Tables
• Monitoring Glue Jobs – Apache Spark, Databricks, PySpark, CDK
• Monitor STEP Functions
• Write PySpark Code for Glue Jobs to distribute them
• Work with Solutions Architect on filtering out jobs and then use the convention to pull out jobs that would run
• Generate CDK code
• Work on Data Products Pipelines
• Create Automated Testing Strategies for AWS Pipeline Data Products
• Code to Merge JSON files into bigger JSON files
• Alation Catalog datasets to write documentation
• Monthly Report on Cost using AWS Billings

Some Useful Notes:

• TIBCO for messaging
• SOLACE for messaging