Save time and effort sourcing top tech talent

Data Engineer

Jersey City, Hudson, USA
Data Engineer
Verisk US
Actively hiring

Sign up for the chance to get matched to this role, and similar opportunities.

Company Description

We help the world see new possibilities and inspire change for better tomorrows. Our analytic solutions bridge content, data, and analytics to help business, people, and society become stronger, more resilient, and sustainable.

Job Description

Join our Enterprise Data Management team as a Data Engineer. Preferably, role will be located in our Jersey City, NJ global headquarters which has a flexible hybrid work model. 

  • Developmaintain, and optimize ETL (Extract, Transform, Load) processes using ETL technologies to ensure efficient data integration and transformation workflows.
  • Write clean, optimized code to efficiently process large volumes of data.
  • Conduct data analysis to troubleshoot and aid in resolving data-related issues.
  • Develop and implement data processing systems using SQL, Python, and big data technologies.
  • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver actionable insights.
  • Ensure data quality, consistency, and security by implementing data validation, cleansing, and access control mechanisms.
  • Continuously monitor and optimize data infrastructure performance, ensuring high availability, scalability, and reliability.
  • Conduct SQL querying and analysis to validate and enhance data quality.
  • Prepare monthly data quality reports / metrics to track deviations in data.
  • Provide afterhours or weekend support for ETL processes and troubleshoot any issues that may arise to ensure data integrity and timely completion of ETL tasks.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering or a related STEM field.
  • 2 to 5 years of hands-on experience in data engineering.
  • Minimum 2 years of experience with Amazon Web Services (AWS) – EC2, ECS, S3, SQS, Athena, RDS, Dynamo DB, Cloud Watch, IAM and Lambda.
  • Strong proficiency in SQL and experience working with relational databases (e.g., PostgreSQL, MySQL).
  • 2+ years of expertise in Python programming and familiarity with data manipulation libraries such as Pandas and NumPy.
  • Familiarity with data pipeline orchestration tools like Step Functions, AirFlow or similar.
  • 2+ years of experience with CI/CD, CloudFormation, Changeset execution and rollback.
  • Excellent problem-solving skills and the ability to work independently in a fast-paced environment.
  • Experience with entity resolution or similar technology is plus.

Sign up for the chance to get matched to this role, and similar opportunities.

Upskill

Level up the hackajob way. Verify your skills, learn brand new ones and test your ability with Pathways, our learning and development platform.

Ready to reach your potential?