ETL Developer
Position Description:
We are looking for Azure ETL Developers to join our team as we make our journey to Azure. We expect you to have great technical skills but just as important, we are looking for someone who can develop a creative solution to a problem by applying critical thinking and past experience.
• Roles are based in Atlantic Canada (NS, NB, PEI, NL). One must be based in any of these provinces or must be willing to relocate from day one to Halifax (NS), Moncton (NB), Fredericton (NB) or Charlottetown (PEI)
• This is a Hybrid role with two days working out of any of the above offices.
Your future duties and responsibilities:
• Work on a variety of project and enhancements in Cloud native applications
• Work with Product Owners and Analysts to understand business requirements and define technical solutions
• Design, develop, maintain and take ownership of code
• Implement re-usable data-integration/ETL code
• Design and Develop ETL Pipeline
• Support testing teams in translating requirements and use cases into test conditions and expected results for product, performance, user acceptance, and operational acceptance testing; participate in the testing of developed systems/solutions
• Perform complex applications programming activities. Code, test, debug, document, maintain, and modify complex applications program
• Examine and solve the performance bottlenecks in the ETL processes
Required qualifications to be successful in this role:
• University degree in Computer Engineering or Computer Science.
• 6+ years’ experience designing, developing, implementing and supporting Enterprise Complex projects.
• 4+ years’ experience crafting solutions for data lakes, data integrations, data warehouses/marts.
• Experience in Language: (Python, PySpark, SparkSQL), Databases, Azure Cloud, ETL (Databricks, Azure Data Factory, Talend). Tools (source control/issue management: Azure DevOps, Git, Jenkins, JIRA).
• Strong in the domain of container ecosystems (Kubernetes, AKS, OpenShift, Nomad, Docker, rkt, Swarm, etc.)
• Deep knowledge on performance tuning of ETL Jobs
• Experience in writing Shell scripts
• Solid understanding of designing & implementing applications for Data Integration in Azure cloud
• Strong knowledge of Agile methodology and experience working in a Scrum team
• Strong SQL skills
• Hands on experience with Bash, PowerShell, groovy, Python or other high-level scripting languages
• Experience with software practices such as TDD, CI/CD, etc
• Related experience with tools including Hive, Scala, Spark, PySpark and Sqoop is an asset
• Experience and knowledge of data architecture and concepts of relational and dimensional databases
• Strong troubleshooting skills, ability to multi-task and prioritize for self and team member
• Demonstrate good understanding of the Software Development Life Cycle
• Excellent writing skills, oral communication skills, strong process skills, and leadership ability.
*LI-AD1
Skills:
- Kubernetes
- Python
- Shell Script
- SQL
What you can expect from us:
Together, as owners, let’s turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.
Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
At CGI, we recognize the richness that diversity brings. We strive to create a work culture where all belong and collaborate with clients in building more inclusive communities. As an equal-opportunity employer, we want to empower all our members to succeed and grow. If you require an accommodation at any point during the recruitment process, please let us know. We will be happy to assist.
Come join our team—one of the largest IT and business consulting services firms in the world.