Azure Data Engineer

Back

Azure Data Engineer

@ CGI

Position Description:

• Are you passionate about data engineering and ready to make an impact?
• At CGI, we’re embarking on a Cloud Modernization Project, and we need your expertise to drive success.
• As a Junior Azure Data Engineer, you’ll be at the forefront of innovation, in a client-facing role, working with cutting-edge technologies to transform our client’s data landscape.
• This position is located in our Lafayette, LA CGI office in a hybrid working model.

Your future duties and responsibilities:

• Responsible for development, deployment, maintenance, diagnostics, and support of spark ETL jobs on the MS Databricks platform.
• Streamline code, rationalize datasets and tables to arrive at single source of truth.
• Engage with cloud architects to establish pipelines and develop code using Databricks platform.
• Build detailed architecture diagrams for all workflows and processes.
• Gather and translate business complex requirements into effective solutions and implement them in Azure.
• Support and interact with the client daily in an Agile environment.
• Effectively deal with technical issues and help to support the broader team.

---

Qualifications:

Required qualifications to be successful in this role:

• 3 years of hands-on experience with cloud automation and scripting in an Azure environment.
• Good fundamental knowledge about distributed computing, RDBMS and Dimensional modeling concepts
• Ability to write complex SQL queries.
• Experience in development of Apache Spark code using PySpark/Scala
• Experience in using Azure Databricks Platform
• Experience in using Azure Data Factory to call Azure Databricks notebook activities
• Experience in using Azure Storage (Blob/Data Lake Store), Databricks Delta
• Experience working with large data sets of complex data to be delivered across multiple platforms
• Experience in using Git based repositories.
• Ability to work independently under limited supervision and apply your knowledge of Azure-based ETL
• Bachelor's degree in computer science or related field.

Skills:

• Data Engineering
• ETL

---

How to Apply:

Apply online at https://www.cgi.com/en/careers

Visit Site to Apply