Job Portal

We are seeking a highly skilled Data Engineers to join our dynamic team. In this role, you will be responsible for managing and optimizing the data infrastructure, implementing data governance frameworks, and developing real-time data streaming solutions. This role requires expertise in a variety of data management tools and technologies, including Collibra, Apache Iceberg, Jira, Kafka, Microsoft Power BI, and Snowflake. If you are passionate about data and have a strong background in data architecture and AI/ML, we would love to hear from you.
Join this exciting new initiative as a Senior Data Engineering Consultant.

Your future duties and responsibilities:

• Database Management: Model, administer, secure, and maintain the Global Data Asset databases.
• Hands-on experience with SQL databases, query optimization, and schema design.
• Data Pipeline Development: Design and implement data pipelines to efficiently collect, process, and store data.
• Data Publishing: Enable data distribution through outbound streams, queues, and APIs.
• API Integration: Implement API mutations to facilitate data updates from external systems.
• Replication Management: Build and oversee replication stores to support data consistency and availability.
• Software engineering: Developing, deploying, and supporting backend data services, pipelines, and platforms.
• Direct experience with event-driven architecture using Apache Kafka or GCP Pub/Sub.
• Strong understanding of microservices architecture, cloud platforms (GCP), and observability tools (e.g. Google Cloud Monitoring).
• Software Development Practices:
• Familiarity with agile methodologies
• Experience in Continuous Integration/Continuous Deployment (CI/CD) pipelines.
• Knowledge of testing strategies and automation frameworks.
• Cloud and Infrastructure:
• Proficiency in public cloud services and concepts, including IAM, networking, and storage (e.g., Google Cloud Storage).
• Experience containerizing and deploying applications with Docker and Kubernetes.

Required qualifications to be successful in this role:

• This is a hybrid position, requiring working between 2-3 days a week from either of CGI Atlantic offices (Halifax, NS, Moncton or Fredericton, NB, Stratford, PE, or St. John’s, NL).
• More than 10 years of experience in data management and data engineering space
• Experienced in ETL
• Experienced in Scala
• Experienced in pipeline development, data publishing
• Hands on experience in event-driven architecture using Apache Kafka or GCP Pub/Sub
• Experienced in microservices architecture, cloud platforms (GCP), and observability tools (e.g. Google Cloud Monitoring)
• Strong SQL expertise, Oracle, Postgres
• Experienced in Docket, Kubernetes
• Excellent customer and stakeholder management skills
• Strong analytical skills
• Experienced in AWS – Fargate, Cloud Formation, Cloud Watch, Lambda,
• Experienced in Node.js
• Experienced in GraphQl – Apollo Framework
• Experienced in GCP (Big Query) – Data Replication and Reporting
• Experienced in CI/CD