We are seeking a highly skilled Senior Data Engineer with expertise in Retrieval-Augmented Generation (RAG) and strong Python programming skills to join our innovative team. The ideal candidate will have a deep understanding of AI and machine learning principles, experience with RAG models, and a passion for developing cutting-edge AI solutions.
Responsibilities:
- Test, evaluate and implement AI models with a focus on Retrieval-Augmented Generation (RAG).
- Strong prompt engineering and prompt testing skills to derive the desired outcome
- Collaborate with cross-functional teams to integrate AI solutions into existing systems.
- Optimize and fine-tune RAG models for performance and scalability cost saving.
- Conduct research and stay up-to-date with the latest advancements in AI and machine learning.
- Write clean, efficient, and maintainable code in Python.
- Perform data preprocessing, feature engineering, and model evaluation.
- Troubleshoot and debug AI models and applications in a mono-repo settings.
- Document AI models, processes, and workflows.
- Train entry-level data engineers as directed by department management, ensuring they are knowledgeable in critical aspects of their roles.
- Keep abreast of new technology developments.
- Design and works with complex data models.
- Identify opportunities to apply automation or other tools to improve effectiveness or efficiency.
- Work closely with other development team members to understand complex product requirements and translate them into data engineering and/or data management designs.
- Mentor less senior data engineers on methodologies and optimization techniques.
- All other duties as assigned
Requirements
- Proven experience as a Data Engineer/ AI Engineer or similar role.
- Strong proficiency in Python programming.
- In-depth knowledge of Retrieval-Augmented Generation (RAG) models.
- Proven experience in prompt engineering
- Experience with machine learning frameworks and libraries(e.g., TensorFlow, PyTorch).
- Proficiency in data preprocessing and feature engineering techniques.
- Excellent problem-solving skills and attention to detail.
- Strong communication and teamwork abilities.
Preferred Skills:
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud).
- Knowledge of natural language processing(NLP) techniques.
- Familiarity with version control systems(e.g., Git).
- Experience with deploying AI models in production environments.
hackajob is partnering with LexisNexis to fill this position. Create a profile to be automatically considered for this role—and others that match your experience.
