Save time and effort sourcing top tech talent
hackajob is partnering with CGI to fill this position. Create a profile to be automatically considered for this role—and others that match your experience.
Senior Data Engineer (Databricks)
Position Description
Do you want to take your career to the next level? Are you ready for the responsibility of working with high-profile clients? CGI is looking for a talented, driven, and experienced Senior Data Engineer (Databricks) with a passion for solving business problems to join our team in Salt Lake City, UT.
This position is located at our client site in Salt Lake City, UT.
At CGI, you will solve challenging business and technical problems as a full-time consultant serving local, enterprise clients. You’ll be part of a team of smart, dedicated people like yourself and make an impact with both internal and client stakeholders. You also can work on cutting edge technologies and cloud native development. Tired of the same old thing? Take your talents to a world class consulting firm that inspires personal and professional growth and values your ideas.
Your future duties and responsibilities
Play key role in establishing and implementing migration patterns for the Data Lake Modernization project
• Actively migrate use cases from our on-premises Data Lake to Databricks on GCP
• Collaborate with Product Management and business partners to understand case requirements and reporting
• Adhere to internal development best practices/lifecycle (e.g. Testing, Code Reviews, CI/CD, Documentation)
• Document and showcase feature designs/workflows
• Participate in team meetings and discussions around product development
• Stay up to date on industry, the latest trends and design patterns
Required qualifications to be successful in this role
• 5+ years of development experience with Spark (PySpark), Python and SQL
• Extensive knowledge building data pipelines
• Hands on experience with Databricks Development
• Strong experience developing on Linux OS
• Experience with scheduling and orchestration (e.g. Databricks Workflows,airflow, prefect, control-m)
• Solid understanding of distributed systems, data structures, design principles
• Comfortable communicating with teams via showcases/demos
• Agile Development Methodologies (e.g. SAFe, Kanban, Scrum)
• Experience with Databricks Unity Catalogue
• Experience in developing metadata driven framework on Databricks
• Bachelor’s in computer science, Computer Engineering or related field
Desired qualifications/non-essential skills:
• 3+ years’ experience with GIT
• 3+ years’ experience with CI/CD (e.g. Azure Pipelines)
• Experience with streaming technologies, such as Kafka and Spark
• Experience building applications on Docker and Kubernetes
• Cloud experience (e.g. Azure, Google)
hackajob is partnering with CGI to fill this position. Create a profile to be automatically considered for this role—and others that match your experience.