Data Engineer III

Data Engineer III

Are you a Data Engineer with a keen interest of keeping up to date with new technologies?

Are you a highly skilled data engineer looking to drive innovation?

About our Team:

LexisNexis is seeking a Data Engineer to perform research, design, and data engineering assignments collaborating with other data engineers and scientists to focus on search and the creation of next-generation relevance techniques.

About the Role:

The Data Engineer role collaborates across all teams and will help us tackle new problems as we continue to push technology forward.

Responsibilities:

• Design and build scalable data ingestion and enrichment pipelines (machine learning inference) infrastructure that powers batch and real-time data processing of billions of records

• Automate and handle life cycle of the systems and platforms that process our data

• Provide visibility into the health of our data platform (comprehensive view of data flow, resources usage, data lineage, etc.)

• Mentor teammates on algorithms, data structures, design patterns

• Evolve maturity of our data quality and monitoring systems

• Implement development processes, coding best practices, and code reviews

• Information Retrieval (search) esp. on Elastic or Solr

• Familiar with core text analytics tasks like classification, clustering, LDA, NER, and Relationship Extraction.

• Knowledge Bases, Taxonomies, Graph Databases, knowledge of Open Data sets like Wikidata, Yago, DBPedia, etc.

• Graph Algorithms (shortest path, connected components, message passing, PageRank, triangle counting, etc.)

Requirements:

• Own specific set or group of data transfers in various capacities including collection setup, data transfer setup, contributor/customer setup, etc.

• Interface with other technical personnel or team members to document, interpret, and finalize requirements.

• Produce code that is efficient, repeatable, without defects, and adherent to best practices such as naming conventions, encapsulation, etc.

• Write and review portions of detailed specifications for the development of data components.

• Complete data engineering bug fixes and issues, researching and identifying root causes as appropriate.

• Identify opportunities to apply automation or other tools to improve effectiveness or efficiency.

• Innovate process improvements that enable efficient delivery and maintenance.

• Oversee specific database management ensuring structure and dataflow adheres to department standards.

• Utilize various data workflow management and analysis tools.

• Good level of intimacy within a specific data content area.

• Participate in process improvement and compliance to successfully and consistently deliver high quality services on time, and to specification, resulting in flexibility to react quickly to changes in priorities or circumstances to meet business needs.

• Operate in various development environments (Agile, Kanban, etc.) while collaborating with key stakeholders.

• Participate in project reviews.

• 3+ years’ experience performing ETL (extraction, transform, loading)

• Master’s in computer science or equivalent practical experience

• Expertise with the following programming language: SQL, Python, Scala

• Experience working with data technologies that power analytics – Spark, Databricks

• Experience with any cloud solutions (AWS, GCP, Azure)

• NoSQL and Document Oriented models (familiar with)

• Data quality testing (like Deequ)

• Experience in Devops (Jenkins / CloudFormation templates/ Azure pipelines)

• Visualization / dashboard tools like Tableau, PowerBI, and other reporting tools

Work in a way that works for you:

We promote a healthy work/life balance across the organisation. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals. Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive

Working for you:

We know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer: Comprehensive Health Insurance: Covers you, your immediate family, and parents. Enhanced Health Insurance Options: Competitive rates negotiated by the company.

Group Life Insurance: Ensuring financial security for your loved ones. Group Accident Insurance: Extra protection for accidental death and permanent disablement. Flexible Working Arrangement:

 Achieve a harmonious work-life balance. Employee Assistance Program: Access support for personal and work-related challenges. Medical Screening: Your well-being is a top priority. Modern Family Benefits:

Maternity, paternity, and adoption support. Long-Service Awards: Recognizing dedication and commitment.

New Baby Gift: Celebrating the joy of parenthood. Subsidized Meals in Chennai: Enjoy delicious meals at discounted rates. Various Paid Time Off: Take time off with Casual Leave, Sick Leave, Privilege Leave, Compassionate Leave, Special Sick Leave, and Gazetted Public Holidays. Free Transport pick up and drop from the home -office - home (applies in Chennai)