AWS Data Engineer

Back

AWS Data Engineer

@ CGI

Position Description:

  • We are seeking a passionate and innovative Data Engineer to join our team.
  • The ideal candidate is a skilled technologist with a proven track record in designing, developing, and optimizing complex data solutions.
  • If you are a passionate data engineer who thrives on challenges and enjoys working with cutting-edge technologies, we encourage you to apply.
  • This role can be performed in: Lafayette, LA


Your future duties and responsibilities:

  • You will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
  • The ideal candidate is an experienced modern data technologist with special focus on orchestrating various data solutions in cloud.
  • You should be well-versed in optimizing data systems and building cloud optimized data solutions from ground up.
  • You will support Operational Excellence Squad focused on Standardizing toolsets supporting the Enterprise Analytics platform and would ensure optimal data architecture is formulated and delivered.
  • You must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products.
  • The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives



Qualifications:

Required qualifications to be successful in this role:

  • Bachelors in computer science or related field with at least 3-5 or 6-9 years of relevant experience is desired
  • Candidate should also have strong hands-on experience using the following software/tools: Strong experience with AWS cloud services: EC2, EMR, EKS, Snowflake, Elastic-Search
  • Experience with stream-processing systems: Storm, Spark-Streaming, Kafka etc. Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
  • Experience with big data tools: Hadoop, Spark, Kafka, Kubernates etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with devops, data pipeline and workflow management tools: Concourse, Terraform, Luigi, Airflow, etc.
  • Experience with data management tools: Collibra, Alation, BigID, Alex Solutions etc.
  • Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Strong analytic skills related to working with unstructured datasets.
  • Experience in cloud services such as AWS EMR, EC2, EKS, Jupyter notebooks
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Build processes supporting data transformation, data structures, metadata management, dependency, and workload management.
  • A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
  • Strong project management and organizational skills. Knowledge of agile methods is a plus.
  • Strong organizational skills & excellent team player.


Skills:

  • Adobe Spark
  • Big Data
  • Python
  • Snowflake
  • SQL


How to Apply:

Apply online at https://cgi.jobs/locations/lafayette-la/jobs/ 

Visit Site to Apply

Location: Lafayette, LA
Date Posted: January 31, 2025
Application Deadline: March 07, 2025
Job Type: Full-time