Data Engineer

Job Title: Data Engineer

Location: New York City

Hybrid: 3 days onsite

Skills Needed:

Responsibilities:

• Manage and maintain multi-terabyte datasets on Dataverse, utilizing platforms like Azure SQL and Azure Cosmos DB.
• Design and implement scalable data models (both relational and non-relational) with a focus on optimization and performance tuning.
• Perform data archival processes and support reconciliation of large datasets.
• Develop and maintain data warehousing solutions, ideally with experience in tools such as:
• Microsoft Fabric (preferred)
• Snowflake (nice to have)
• Build and maintain ETL pipelines using:
• Azure Data Factory
• Azure Databricks
• Other Azure-native integration services
• Collaborate with cross-functional teams including developers, architects, and business analysts to deliver scalable data solutions.

Requirements

• 5+ years of experience in data engineering and database optimization.
• Strong hands-on experience with Azure cloud data services.
• Deep understanding of Dataverse and Microsoft Dynamics 365 data architecture.
• Proficiency in SQL and Python for data manipulation and pipeline development.
• Familiarity with data governance, security, and compliance in cloud environments.
• Excellent problem-solving and communication skills.

Nice to have

• Experience with Microsoft Fabric or Snowflake.
• Exposure to Power Platform, especially Power Apps and Power Automate.
• Knowledge of data visualization tools like Power BI.