// Lafayette Economic Development Authority (LEDA)

Databricks Developer

Back

Databricks Developer

@ CGI

Position Description:

  • Are you a talented Databricks Developer looking for an exciting opportunity to showcase your skills and make a real impact?
  • Join our dynamic team and take on the challenge of supporting client-specific development of our client's cutting-edge BI solution.
  • This is a high-stakes, mission-critical project where you will have the opportunity to work alongside a talented group of individuals, pushing the boundaries of innovation.
  • Don't miss out on this chance to be part of something exceptional!
  • This position can be located at any CGI office in the U.S, preferred location is Arlington, VA; however, a hybrid working model is acceptable.


Your future duties and responsibilities:

  • The Databricks Developer will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Databricks.
  • The ideal candidate will have a strong background in data engineering, experience with big data technologies, and a deep understanding of Databricks and Apache Spark.


Key Responsibilities:

  • Design and develop scalable data pipelines and ETL processes using Databricks and Apache Spark.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Optimize and tune data pipelines for performance and scalability.
  • Implement data quality checks and validations to ensure data accuracy and consistency.
  • Monitor and troubleshoot data pipelines to ensure reliable and timely data delivery.
  • Develop and maintain documentation for data pipelines, processes, and solutions.
  • Implement best practices for data security, governance, and compliance.
  • Participate in code reviews and contribute to the continuous impro


Qualifications:

Required qualifications to be successful in this role:

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Experience in data engineering or a related field.
  • Strong experience with Databricks and Apache Spark.
  • Proficiency in programming languages such as Python, Scala, or Java.
  • Experience with big data technologies such as Hadoop, Hive, and Kafka.
  • Strong SQL skills and experience with relational databases.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud.
  • Knowledge of data warehousing concepts and technologies.
  • Experience with version control systems such as Git.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration skills.


Desired qualifications/non-essential skills required:

  • Experience with Delta Lake and Databricks Delta.
  • Experience with data visualization tools such as Power BI, Tableau, or Looker.
  • Knowledge of machine learning and data science concepts.
  • Experience with CI/CD pipelines and DevOps practices.
  • Certification in Databricks, AWS, Azure, or Google Cloud.


Skills:

  • Back End Development
  • Big Data & Analytics Operation
  • SQL
  • Java


How to Apply:

Apply online at https://cgi.jobs/locations/lafayette-la/jobs/ 

Visit Site to Apply

Location: Lafayette, LA
Date Posted: October 24, 2024
Application Deadline: November 25, 2024
Job Type: Full-time