BackCloud Data Engineer
@ CGI
Position Description:
- The best version of us starts with You!
- CGI is seeking a Cloud Data Engineer who can bring in expertise and industry standard methodologies define better development.
- The member will get an opportunity to work with a highly skilled team on the latest technologies. It will help shape the career with matured agile project delivery, sophisticated Tech stack process.
- The objective of this position is to work with business and technical experts to implement software engineering best practices related that promotes the highest re usability across the US and Global.
- The individual must have superb analytical and technical skills coupled with the ability to drive project deliverables.
- The individual will be expected to participate in the collaborative concept definition, architectural refinement, software design and realization of products that support the strategic technology needs to support the organization.
- A full stack engineer is a person that has a breadth of knowledge in computer science, a problem solving mentality and a desire to learn.
- This person is comfortable working within a technical capacity across many of the sectors including core development on platform, data processing and report generation.
- This role can be performed from Lafayette, LA, Bloomfield, CT, Nashville, TN and Plano, TX in a Hybrid model.
Your future duties and responsibilities:
- Drive automation pyramid and integrate with CI/CD tools for continuous validation.
- Drive mentality of building well architected applications for Cloud
- Can identify code defects and work with other developers to address quality issues in product code.
- Passion for finding bottlenecks and thresholds in existing code through the use of automation tools.
- Passion for continuing education and improving code quality.
- Migrating On-Premise solution to cloud including Teradata Vantage
- Develop data pipelines to integrate with enterprise data steams – Cloud and on-perm
- Collaborate on architecture decisions and develop solutions in AWS – Including Python, Databricks, Redshift, elastic search, DynamoDB, Lambda, Kinesis, Glue and AI/ML tools.
- Create Proof of concepts, innovate and integrate cloud-based software in a continuous delivery environment.
Qualifications:
Required qualifications to be successful in this role:
- 8+ years of diverse Technology experience with a minimum of 6 years of experience in Software development.
- 6+ years of experience with AWS capabilities – Databricks, DynamoDB, Lambda, Redshift, elastic search.
- 6+ years of experience with API and Streaming technologies.
- 6+ years of software development experience with Python, PySpark, Apache Spark and Kafka.
- Strong knowledge of Data Integration (e.g. Streaming, Batch, Error and Replay) and data analysis techniques.
- 6+ years of experience with GitHub, Jenkins, and Terraform, experience with Teradata (Vantage) or any RDBMS system/ ETL Tools.
- Good experience on designing and developing data pipelines for data ingestion and transformation using Spark.
- Excellent in trouble shooting the performance and data skew issues.
- Deep knowledge in partitioning, bucketing concepts of data ingestion.
- Working knowledge on the implementation of data lake ETL using AWS glue, Databricks etc.
- Proficiency in SQL, relational and non-relational databases, query optimization and data modelling.
- Experience with source code control systems like Gitlab.
- Experience with large scale distributed relational and NoSQL database systems.
- Expertise in designing technical solutions using object-oriented design concepts
- Provide recommendations and design optimal configurations for large-scale deployments.
- Be passionate about resolving user pain points through great design.
Nice to have:
- Experience in Healthcare, Teradata Customer Journey, Data & Analytics.
Education:
- Bachelor's degree in computer science or related field.
How to Apply:
Apply online at https://www.cgi.com/en/careers
Visit Site to Apply
Location: Lafayette, LA
Date Posted: July 29, 2024
Application Deadline: September 30, 2024
Job Type: Full-time