DevOps Engineering Lead

Why this job matters

One of the key pillars of BT’s strategy is the security and the ‘safe to connect’ of the services we offer to our customers, alongside the security and protection of our infrastructure, networks and information.

The Security Engineering unit delivers and deploys end-to-end cyber and security capabilities across BT, as platform owners.

Your role as a Big Data Infrastructure Administrator in the Cyber Platform team is integral to the build and configuration of our threat hunting and intelligence solutions, used to maintain and protect BT’s customers and core network. These platforms are actively used to detect and stop potential threats to our customers and BT as an organization.

Join our high performing, efficient and adaptable software team to be at the forefront of Big Data as we look to build the next generation big data platform to identify cyber threats and provide our customers the data they require to protect BT. The Software Engineering Specialist independently executes advanced activities to deliver the engineering strategy and roadmap that supports BT's commercial strategy through cross functional business partnering and the participation of a team that pursues innovation as well as engineering excellence.
 

What you’ll be doing

Skills Needed

• Manage and optimize big data platforms (e.g., Hadoop, Spark).
• Administer, upgrade and maintain the Big Data Platform
• Write Puppet modules for deployment management.
• Proficient in shell scripting, and be able to automate complex tasks
• Familiarity with GIT and CI/CD pipelines.
• Proficiency working with SSL certificates
• Ensure the uptime of the platform
• Proactively look for issues in the platform and perform timely remedial steps.
• Maintain security across the platform
• Monitor and troubleshoot performance issues within big data environments.
• Implement data storage solutions.
• Automate and document repetitive tasks
• Strong communication skills including presentation and documentation writing (to both technical and business audiences)
• An aptitude for autonomous learning as required by the demands of the business
• Demonstratable understanding of network technologies, especially from security perspective
• Proven problem-solving abilities
• Assertiveness, and the ability to drive through change
• Excellent team working skills including the ability to work effectively within a geographically disparate team
• Strong knowledge of security policy/regulatory frameworks

 
Advantageous:

• Knowledge of Cloudera’s open-source tools and ecosystem.
• Familiarity with the Elastic (ELK) stack
• Certification in Hadoop Administration
• Python programming experience

 
What you'll be doing

• Managing and maintenance/upgrades of the development environment ensuring all hosts, modules, certificates and tools are up to date.
• Monitor the status of the development environments
• Automating all repetitive tasks
• Installing and upgrading Development Environment technologies:(Hadoop, Spark, Kafka, NiFi, ELK, Jupyter, Zeppelin)
• Proficiency in Linux, Windows and shell scripting.
• Managing the Repository (GitLab) and the CI/CD pipelines
• Advise team on platform/infrastructure/Dev Ops best practices
• Lead on a number of complex technical deliverables ensuring work is completed on time and within budget
• Monitoring and resolving the vulnerabilities across the platform
• To own / provide input into development and implementation of operational, processes policies and procedures, including platform and secops processes.
• Proactively drive forward continuous improvement within the team
• Provide effective technology coaching and mentoring both inside and outside the team.
• Where required to provide 2nd and 3rd line support to maintain service availability when necessary