Lead Engineer, Data & Analytics

Comcast Business offers a suite of Connectivity, Communications, Networking, Cybersecurity, Wireless, and Managed Solutions to help global organizations of all sizes prepare for what’s next. Powered by the nation’s largest Gig-speed broadband network and backed by 24/7 customer support, Comcast Business is the nation’s largest technology provider to small businesses and one of the leading service providers to the Enterprise market. Comcast Business has been consistently recognized by industry analysts and associations as a leader and innovator, and one of the fastest growing providers of Ethernet services.

Job Summary

Responsible for designing, building and overseeing the deployment and operation of technology architecture, solutions and software to capture, manage, store and utilize structured and unstructured data from internal and external sources. Establishes and builds processes and structures based on business and technical requirements to channel data from multiple inputs, route appropriately and store using any combination of distributed (cloud) structures, local databases, and other applicable storage forms as required. Develops technical tools and programming that leverage artificial intelligence, machine learning and big-data techniques to cleanse, organize and transform data and to maintain, defend and update data structures and integrity on an automated basis. Creates and establishes design standards and assurance processes for software, systems and applications development to ensure compatibility and operability of data connections, flows and storage requirements. Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs. Work with data modelers/analysts to understand the business problems they are trying to solve then create or augment data assets to feed their analysis. Integrates knowledge of business and functional priorities. Acts as a key contributor in a complex and crucial environment. May lead teams or projects and shares expertise.

Job Description

Core Responsibilities

• Develops data structures and pipelines aligned to established standards and guidelines to organize, collect, standardize and transform data that helps generate insights and address reporting needs.
• Focuses on ensuring data quality during ingest, processing as well as final load to the target tables.
• Creates standard ingestion frameworks for structured and unstructured data as well as checking and reporting on the quality of the data being processed.
• Creates standard methods for end users / downstream applications to consume data including but not limited to database views, extracts and Application Programming Interfaces.
• Develops and maintains information systems (e.g., data warehouses, data lakes) including data access Application Programming Interfaces.
• Participates in the implementation of solutions via data architecture, data engineering, or data manipulation on both on-prem platforms like Kubernetes and Teradata as well as Cloud platforms like Databricks. 
• Determines the appropriate storage platform across different on-prem (minIO and Teradata) and Cloud (AWS S3, Redshift) depending on the privacy, access and sensitivity requirements.
• Understands the data lineage from source to the final semantic layer along with the transformation rules applied to enable faster troubleshooting and impact analysis during changes. 
• Collaborates with technology and platform management partners to optimize data sourcing and processing rules to ensure appropriate data quality as well as process optimization.
• Creates and establishes design standards and assurance processes for software, systems and applications development to ensure compatibility and operability of data connections, flows and storage requirements. Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs.
• Develops strategies for data acquisition, archive recovery, and database implementation.
• Manages data migrations/conversions and troubleshooting data processing issues.
• Understands the data sensitivity, customer data privacy rules and regulations and applies them consistently in all Information Lifecycle Management activities.
• Identifies and reacts to system notification and log to ensure quality standards for databases and applications. Solves abstract problems beyond single development language or situation by reusing data file and flags already set. 
• Solves critical issues and shares knowledge such as trends, aggregate, quantity volume regarding specific data sources. 
• Consistent exercise of independent judgment and discretion in matters of significance. 
• Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary. 
• Other duties and responsibilities as assigned.

About the Team 

Our Business Intelligence organization is structured across PMO, Analytics, Development, and DevOps; operating as a unified, crossfunctional team that delivers highquality, trusted, and scalable data products for Comcast Business. The Solutions Architecture workstream lives in our DevOps team and serves as a strategic connector across the department. In this role, you’ll collaborate daily with our data engineers, analysts, PMO, infrastructure, and production support to ensure our solutions are consistent, resilient, and ready for longterm success. 

How We Work 

We balance speed with intentional design, operating in a fastpaced, iterative environment grounded in discipline and strong engineering fundamentals. Our culture emphasizes autonomy, thorough documentation, predictable delivery, and a “measure twice, cut once” approach to solution design. We take pride in being a lowego, highownership team where coaching, mentoring, and continuous improvement are embedded in how we operate. We also prioritize sustainable work/life balance 

What Makes This Team Special 

We are a mature, stable organization with welldefined processes, but we are also a place where innovation thrives. As part of BDI, you’ll have direct visibility with leadership and meaningful influence over our futurestate architecture, standards, frameworks, and best practices. You’ll be key in shaping how data flows, how BI works, how platforms scale, and how we maintain trust in the data that powers business decisions across the company. 

What We Expect 

This role is ideal for someone who: 

• Brings architectural rigor and a longterm, systemsthinking mindset 

• Thrives on crossteam coordination and being the connective tissue across engineering, DevOps, and support 

• Enjoys coaching, guiding, and raising the bar for engineers and analysts 

• Can simplify complex systems and provide clarity in ambiguous situations 

• Is comfortable making balanced architectural decisions and saying “no” when needed 

• Is forwardthinking and passionate about designing for scale, stability, and maintainability 

• This role does no development/data engineering in the day-to-day responsibilities 

If you’re looking for a place where your architectural leadership can have departmentwide impact, and where you can help shape a scalable data ecosystem, this is the role for you. 

Solutions Architecture – Team Responsibilities  

Solution Architecture Leadership & Accountability 

• Accountable for consistent endtoend designs that adhere to Data Warehousing and BDI best practices across all teams and workstreams. 

• Ensure all architectural designs meet business, functional, technical, privacy, and compliance requirements, including alignment to Comcast Secure Development Lifecycle (SDL). 

• Ensure designs allow for simple, longterm support from DevOps and Production Support teams. 

• Responsible for a holistic architectural approach across BDI; recommend optimal design solutions that support longterm maintainability, consistent frameworks, scalability, and alignment to data model and toolset standards. 

Design Governance, Reviews & Standards 

• Lead solution design review meetings, Ensure requirements and architectural documentation is complete.  

• Conduct solution design and code walkthroughs for ETL pipelines and reporting solutions. 

• Ensure consistency in execution across teams; code standards, report lookandfeel, common dimensions, and elimination of duplicative efforts. 

• Ensure all designs follow established Data Warehousing, BDI principles, and architectural patterns. 

• Establish and support design approaches for database design and selfservice BI capabilities. 

• Ensure connects are scheduled during established meeting blocks with agendas defined in advance to avoid adhoc interruptions and respect workload capacity. 

Best Practices, Frameworks & Continuous Improvement 

• Recommend standards, frameworks, and best practices that support longterm maintainability, scalability, evolving business needs, and evolving technologies within Comcast. 

• Participate in crossBDI, DevOps, platform, and technology discussions (including TCO) to define and refine best practices. 

• Ensure recommendations support BDI as a whole and align across Development, Infrastructure, and Production Support teams. 

• Support the implementation and adoption of recommended best practices and architectural improvements. 

• Stay uptodate on new technologies, platforms, and engineering patterns that could benefit BDI’s futurestate architecture. 

Collaboration & Engagement Model 

• Facilitate structured working sessions with SMEs and stakeholders 

• Participate as part of a crossfunctional team with representation from Development, Infrastructure, and Production Support. 

• Support Data Governance and Data Management initiatives, providing architectural insight and ensuring compliance requirements are met. 

Skills & Competencies 

Technical & Architectural Skills – Must Have 

ETL/ELT Pipeline Design & Patterns 

• Strong design skills for full load, incremental load, and CDCbased ingestion patterns in an OLAP environment. 

• Experience building metadatadriven ingestion and transformation frameworks for scale. 

• Proficiency in SQL/TSQL for pipeline development and optimization. 

• Experience building resilient data pipelines with proper logging, auditing, and lineage. 

OnPrem Data Systems 

• Experience with SQL Server onprem and SSIS, Stored Procedures. 

BI, SelfService & Semantic Layer 

• Designing BIready data products for Tableau and OAS including extracts, live connections, semantic models, RLS, and governed datasets. 

• Expertise in semantic layer modeling and supporting certified datasets for enterprise analytics consumption. 

Security, Privacy & Compliance 

• Ensure designs align to secure coding practices, threat modeling, and enterprise privacy expectations. 

DevOps, SDLC/STLC & Deployment Practices 

• Deep understanding of SDLC and STLC within data engineering and BI workflows. 

• Experience with Source Control 

• Ensures deployments are stable, repeatable, and maintain environment consistency across dev/uat/prod. 

Performance, Scalability & Reliability 

• Designs data pipelines and models capable of handling largescale data volumes with performance SLAs. 

• Ensures architectures support daytoday operational ease: observability, alerting, runbooks, job dependencies, and troubleshooting workflows. 

• Incorporates resilience, fault tolerance, and system stability into all designs. 

Leadership & Influence Skills 

• Leads complex, crossteam initiatives and serves as the primary architectural authority for projects. 

• Establishes and enforces architectural standards, coding frameworks, and best practices used across teams. 

• Guides teams through largescale migrations (e.g., onprem SQL/SSIS to cloud/Databricks; BI/semantic refactors). 

• Integrates business priorities, functional objectives, governance requirements, and platform constraints into holistic solution designs. 

• Coaches and mentors engineers and developers across the team; builds reusable patterns and architectural guardrails. 

• Represents department in architecture councils, review boards, workshops, and crossdepartment forums. 

• Makes balanced architectural decisions (performance, cost/TCO, security/privacy, supportability, scalability, timelines). 

Collaboration, Communication & Behaviors 

• Strong communicator that produces clear design docs, ADRs, standards, and recommendations consumable by technical and nontechnical stakeholders. 

• Facilitates structured connects and multistakeholder meetings; documents decisions and actions; respects calendar capacity (nonadhoc). 

• Systems thinker with a longterm lens: simplicity, predictability, consistency, and sustainability. 

• Reliability & ownership mindset that ensures solutions meet expectations for stability, supportability, and ease of daytoday operations. 

Technical & Architectural Skills – Preferred but not required additional skills 

ETL/ELT Pipeline Design & Patterns 

• Proficiency in Spark and Python  

Cloud, Hybrid & OnPrem Data Systems 

• Handson experience with AWS S3 for storage layer design (partitioning, layout, security, lifecycle policies). 

• Databricks expertise: Delta Lake, cluster/job optimization 

• Familiarity with Kubernetes/EKS and Docker for containerized data workloads 

• Skilled in designing solutions that operate across onprem + cloud hybrid ecosystems. 

BI, SelfService & Semantic Layer 

• Designing BIready data products for Tableau and OAS including extracts, live connections, semantic models, RLS, and governed datasets. 

• Expertise in semantic layer modeling and supporting certified datasets for enterprise analytics consumption. 

Security, Privacy & Compliance 

• Strong working knowledge of PII handling, privacy standards, SDL, and secure architecture patterns (encryption, IAM, RLS/CLS). 

DevOps, SDLC/STLC & Deployment Practices 

• Experience with GitHub, PR reviews, branch strategies, and CI/CD pipelines for data platforms. 

Performance, Scalability & Reliability 

• Skilled in Spark, SQL, and Delta optimization techniques to reduce time, cost, and resource utilization. 

Primary Tools & Technologies 

SQL Server (onprem); SSIS; AWS S3; EKS; Databricks (Workflows/Jobs); Tableau; Oracle Analytics Server (OAS); GitHub; Python; Spark (PySpark/SQL); PowerShell; SQL/TSQL; Kubernetes; Docker. 

Employees at all levels are expected to:
Understand our Operating Principles; make them the guidelines for how you do your job.
Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.
Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.
Win as a team - make big things happen by working together and being open to new ideas.
Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.
Drive results and growth.
Support a culture of inclusion in how you work and lead.
Do what's right for each other, our customers, investors and our communities.
Disclaimer:This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.
 

Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.

Skills:

Data Engineering; Collaboration; Data Analytics

Salary:

Pay Range: This job can be performed in Illinois with a Pay Range of $116,475.35 - $192,184.33

Comcast intends to offer the selected candidate base pay within this range, dependent on job-related, non-discriminatory factors such as experience. The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.

Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality - to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.

Education

Bachelor's Degree

While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

Relevant Work Experience

7-10 Years