Senior Data Engineer II

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career.

Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express.

Joining Amex Tech means discovering and shaping your contribution to something big. Here, you can work alongside talented tech teams and build a unique career with the Powerful Backing of American Express. With a range of opportunities to work with the latest technologies, and a commitment to back the broader engineering community through open source, our mission is to power your success. Because Amex Tech is powered by our technology, our culture, and our colleagues.

Who we are:

The Finance Data Engineering group at American Express is entering into a new phase of technology transformation driven by opportunities to simplify processes, deepen business intelligence, analytics and reporting, and raise operational efficiency. If you have the talent and desire to deliver innovative products and services at a rapid pace, with hands on experience and strategic thinking, in areas of data management and analytics, cloud computing, and modern software engineering, join our leadership team to be part of our transformation journey.

Minimum Qualifications:

• Over 12 years of experience in application development using Java and related technologies.
• More than 5 years of experience in creating enterprise-scale technical product requirements and delivering public cloud services, with a strong preference for Google Cloud.
• Proficient in application development across multiple programming languages (Java, .NET, Go, Python, etc.) and skilled in driving developer requirements for cloud product services.
• Sufficient knowledge of Linux to assist with infrastructure maintenance.
• Extensive practical experience in resolving performance bottlenecks.
• Extensive hands-on experience in application migration and cloud infrastructure, particularly with Google Cloud Platform (GCP).
• Expertise in designing, developing, and optimizing large-scale data pipelines for processing, transformation, and analysis using GCP technologies.
• Strong Object-Oriented Programming skills with a solid understanding of design patterns.
• Knowledgeable in integrating Continuous Integration and Continuous Delivery (CI/CD) tools with cloud services.
• Experienced in distributed (multi-tiered) systems, relational database design, development, troubleshooting, and automated testing.
• Comprehensive understanding of enterprise infrastructure technologies, including Compute, Storage, and Networking.
• Skilled in analyzing complex data engineering challenges, proposing effective solutions, and implementing them efficiently.
• Capable of leading reviews of individual or team contributions.
• Focused on delivering prioritized or assigned features during ongoing sprints.

• Effective communicator, collaborating with business and development teams to support changes and implementations.

   

Preferred Qualifications:

• Certifications in cloud platform (GCP Professional Data Engineer) is a plus.
• Expertise with GCP Big Query, Query Optimization strategies, and parsing.
• RESTful API development experience.
• Proven experience in SQL and familiarity with relational database technologies such as Yellowbrick, Oracle, MS SQL, SingleStore (MemSQL), DB2, PostgreSQL.
• Lead as an active member of an agile team through consistent administration and development practices (tools, components, and documentation).
• Strong analytical and problem-solving, coupled with a continuous improvement mindset.
• Excellent communication skills, capable of explaining complex issues in simple terms to a diverse audience.
• Lead team members in the completion of assigned tasks.
• Knowledge of real time framework and processing.
• Lead training sessions and create comprehensive documentation to empower end users to leverage the Business Intelligence capabilities effectively.
• Ability to in simple scripting commands using programming languages such as Shell or Python.