Software Engineer III - Databricks, Python

Job Description
Unlock the power of data with our expert Databricks Developer, transforming complex datasets into actionable insights with seamless efficiency. Elevate your business intelligence and drive innovation through cutting-edge data engineering solutions.

As a Databricks Developer at JPMorgan Chase within our Corporate Technology division, you will play a pivotal role in our cloud transformation journey. You will design, develop, and implement cloud-based solutions to replace our existing SQL/On Prem infrastructure, enhancing our data processing capabilities and empowering end users to swiftly access data and derive insights.

Job Responsibilities:

• Collaborate with cross-functional teams to understand business requirements and design cloud-based solutions.
• Lead the migration of existing SQL databases/ETL Layer and applications to Databricks and other cloud platforms.
• Drive the development and deployment of processes using the DBX framework.
• Develop, test, and deploy scalable and efficient cloud applications.
• Optimize data processing workflows while ensuring data integrity and security.
• Provide technical guidance and support to team members and stakeholders.
• Stay abreast of the latest cloud technologies and best practices.

Required Qualifications, Capabilities, and Skills:

• Formal training or certification on software engineering concepts and 3+ years applied experience
• Proficiency with hands-on experience in programming languages such as Python and Big Data technologies like Spark, Kafka.
• Strong expertise in Databricks and cloud platforms such as AWS Cloud.
• Proven experience in SQL database management and development.
• Experience with data integration, ETL processes, and data warehousing.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills. Ability to work independently and efficiently.

Preferred Qualifications, Capabilities, and Skills:

• Certification in cloud technologies (e.g., AWS Certified Solutions Architect).
• Knowledge of ETL technologies like Abinitio/Informatica/Prophecy.
• Knowledge of DevOps practices and CI/CD pipelines, containerization - Docker, Kubernetes.
• Databricks certified Data Engineer or equivalent.
• Strong financial and business analytical skills.