UK Data ArchiveBased at the UK Data Archive, the Smart Meter Energy Research Lab (SERL) is a five year multimillion pound project intended to give researchers access to smart meter data from up to 100,000 UK households. We are going into production soon and need someone to care for and nurture a petabyte scale Hadoop infrastructure. As well as getting exposure to big data technology in a real-world production environment, you will acquire skills around other cutting edge tech stacks like Red Hat OpenShift and ElasticSearch.
Duties of the RoleThe Hadoop Systems Engineer is the lynchpin of the SERL data and research infrastructure and ensures that the services that the SERL team provides for researchers are performant and reliable. The scope of responsibility is considerable: proactively monitoring the ingest and egress of data to and from the system, analysing and reporting the health and performance of a petabyte-scale big data ecosystem, ensuring that the development team have the optimal microservice deployment pathways and ensuring that researchers have an optimal secure lab experience.
A full list of duties and responsibilities can be found within the job pack.
Qualifications and Skills requiredWe are looking for a candidate with an undergraduate or first degree in a computer-related or data-related discipline, who possesses good all-round data skills and programming experience who has had some exposure to big data technology.
You will have previous experience of administrating Linux/Unix environments and the Hadoop stack, particularly HDP and HDF; and an understanding of networking concepts and of relational and graph data models.
What we really value is intellectual curiosity and the willingness to rapidly acquire new skills.
A full list of essential requirements for this role can be found under the Person Specification of the job pack.
This is a fixed-term, full-time post for 12 months, due to the nature of the project funding. This post involves access to Government systems, information or data and will be subject to the staff vetting process. Further information can be found in the job pack.Further information can be found in the job pack.
At the University of Essex internationalism is central to who we are and what we do. We are committed to being a cosmopolitan, internationally-oriented university that is welcoming to staff and students from all countries and a university where you can find the world in one place.
Please see the further detail link below for a full job description and person specification which outlines the full duties, skills, qualifications and experience needed for this role plus more information relating to the post. We recommend you read this information carefully before making an application. Applications should be made on-line, but if you would like advice or help in making an application, or need information in a different format, please telephone the Resourcing Team (01206 876559).
*Further detail: Hadoop Systems Engineer job pack*More information: Working at the University