Apex Systems
Azure Databricks Developer
Apex Systems is a global IT services provider and our consulting practice has an opening for a Databricks Developer who has experience with Azure Data Factory and Data Bricks to drive the design, development, and maintenance of the solutions for a Top Five Bank.
- Client: Big 5 Bank
- Location: Hybrid 1-2 days/ week: Toronto
- Terms: 6 Month Contract, strong possibility of extension or conversion
- Hours: 37.5 hours/week Monday-Friday
Required Skills:
- 8+ years of Azure ADF and Azure Datafactory).
- ADF & Data bricks ADLS primarily required.
- 8+ years of hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks, Python, Pyspark etc.
- Good experience of AZURE Cloud platform services stack – Azure Data Factory, Azure SQL Database, AZURE Data Warehouse, Azure databricks, Azure Blob Storage, HD Insight etc.
- Azure DevOps build and release pipelines
- Data Warehouse, Data lake, Business Intelligence concepts
- Development using SQL Server (T-SQL), SQL and stored procedures
- End-to-end pipeline development on Azure Data Factory
- Troubleshooting of issues
Roles/Responsibilities:
- Works with development teams and senior designers to capture requirements
- Conduct impact assessment with business in order and determine high level design and size of effort based on requirements.
- Work with team to ensure standards and patterns are followed.
- Identifies opportunities for new architectural initiatives makes recommendations on the increasing scalability and robustness of platforms and solutions.
- Support Azure developers by providing technical assistance troubleshooting and alternative development solutions.
- Playing a key role in mentoring other staff members and a proven track record in knowledge transfer to other team members and departments.
- Identifies necessary changes to the current business process.
- Communicates risks and ensures understanding of these risks.
- Responsible for leading the design of prototypes and determining final design to ensure client satisfaction with product