BackDatabricks Developer
@ CGI
Position Description:
- Are you a talented Databricks Developer looking for an exciting opportunity to showcase your skills and make a real impact?
- Join our dynamic team and take on the challenge of supporting client-specific development of our client's cutting-edge BI solution.
- This is a high-stakes, mission-critical project where you will have the opportunity to work alongside a talented group of individuals, pushing the boundaries of innovation.
- Don't miss out on this chance to be part of something exceptional!
- This position can be located at any CGI office in the U.S, preferred location is Arlington, VA; however, a hybrid working model is acceptable.
Your future duties and responsibilities:
- The Databricks Developer will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Databricks.
- The ideal candidate will have a strong background in data engineering, experience with big data technologies, and a deep understanding of Databricks and Apache Spark.
Key Responsibilities:
- Design and develop scalable data pipelines and ETL processes using Databricks and Apache Spark.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Optimize and tune data pipelines for performance and scalability.
- Implement data quality checks and validations to ensure data accuracy and consistency.
- Monitor and troubleshoot data pipelines to ensure reliable and timely data delivery.
- Develop and maintain documentation for data pipelines, processes, and solutions.
- Implement best practices for data security, governance, and compliance.
- Participate in code reviews and contribute to the continuous impro
Qualifications:
Required qualifications to be successful in this role:
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Experience in data engineering or a related field.
- Strong experience with Databricks and Apache Spark.
- Proficiency in programming languages such as Python, Scala, or Java.
- Experience with big data technologies such as Hadoop, Hive, and Kafka.
- Strong SQL skills and experience with relational databases.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud.
- Knowledge of data warehousing concepts and technologies.
- Experience with version control systems such as Git.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
Desired qualifications/non-essential skills required:
- Experience with Delta Lake and Databricks Delta.
- Experience with data visualization tools such as Power BI, Tableau, or Looker.
- Knowledge of machine learning and data science concepts.
- Experience with CI/CD pipelines and DevOps practices.
- Certification in Databricks, AWS, Azure, or Google Cloud.
Skills:
- Back End Development
- Big Data & Analytics Operation
- SQL
- Java
How to Apply:
Apply online at https://cgi.jobs/locations/lafayette-la/jobs/
Visit Site to Apply
Location: Lafayette, LA
Date Posted: October 24, 2024
Application Deadline: November 25, 2024
Job Type: Full-time