Insight Global
Must-haves
– 10-12 years experience working within data engineering roles
– 5-7 years experience with AWS cloud services including: EMR, MWAA, LakeFormation, Glue, DMS, QuickSight, and AWS Athena
– 8+ years experience with big data technologies including: Apache Spark, Apache Hudi, Hive, Airflow, Trino, and Databricks
– CICD – Terraform for sure , automation of pipelines
– 10+ years scripting experience with SQL, Python, and PySpark
Plusses
– Experience with GitHub Action
Day-to-Day
Insight Global is looking for two Lead Data Engineers to join a large Asset Management company in Toronto on a full time basis. The successful candidates will be joining the data foundation team leading projects involving infrastructure builds on the foundation of their data platforms. Expertise within AWS cloud services, big data technologies, ci/cd automation, and python/SQL scripting. This is a hybrid role where candidates are required to go into office mandatory 3 days/week at their downtown Toronto location or NYC location.