Senior Storage/Platform Engineer

Senior Storage/Platform Engineer London, England

Millennium Management LLC
Full Time London, England 78000 - 104248 GBP ANNUAL Today
Job description

Senior Storage/Platform Engineer
The team is comprised of extremely talented multidisciplinary individuals with unrestricted access across a large environment. We believe that one cannot build a truly great service without the ability to make changes across the stack. We take great care in focusing on solving real business problems, reducing operational overhead and working together as a team.
The platform and infrastructure team is responsible for managing World Quant’s infrastructure – both engineering and operations:
  • Storage platform engineering, performance and capacity management and operations
  • Data modelling, database tuning & query optimization
  • HPC job scheduling
  • Container orchestration
  • POSIX and object storage systems
  • On premise:
    • bare metal compute (linux)
      • system tuning
      • configuration management
      • performance tuning
    • network configuration management
    • compute, storage, network system purchases / evaluations
  • Cloud:
    • Environment provisioning and management
    • Storage engineering and performance
    • Data backups and restores
Qualifications/Skills Required
We are looking for individuals with extensive experience in parallel file systems, particularly GPFS/Spectrum Scale:
  • GPFS/Spectrum Scale - required
    • Minimum five years of experience in storage environments at scale (eg. billions of files/inodes)
    • Experience deploying and managing petabyte scale systems supporting varied workloads
    • Mature approach to accessing price/performance, tiering and backup requirements
    • Ability to understand business processes and correlate them with storage management and performance tuning.
    • Broad experience with storage products like
      GPFS
      , NetApp, Pure, Lightbits,
      GCP PDs
      or other
      nvme
      specific
      products
  • Linux - required
    • Experience using configuration management systems (eg.
      saltstack
      ,
      ansible
      )
    • Understanding of linux kernel components (eg. VFS, scheduler, memory mgmt., network)
    • Solid troubleshooting experience using gdb, OS & application tracing/profiling mechanisms
    • Experience with some of docker, lxd/lxc, kerberos, ebpf and virtualization technologies
  • Container Orchestration (Kubernetes) – nice to have
    • Experience with: PSPs, helm, admission/mutation controllers, PVs/PVCs, kube-router, BGP – generally demonstrated ability dig deep into the k8s projects to solve hard problems
    • Mature approach to dealing with operational complexities and gaps of the kubernetes platform
  • Workflow management and batch processing – nice to have
    • Experience in the challenges of workflow management in heavily multi-tenant environments
    • Mature approach to dealing with/avoiding task failure and system failure
    • experience with products like
      airflow
      ,
      nifi
      ,
      gnubatch
      ,
      GCP cloud composer
      ,
      AWS sagemaker
  • Software Engineering – nice to have
    • Proficient in OO development (we use python), git and CI/CD concepts
    • Comfortable contributing to a large code-base with varied technologies
In addition to the above, the following qualifications always apply:
  • Comfortable working with business stakeholders to fully understand their applications, business processes, and priorities, and translate them into technical solutions.
  • Ability to review and/or extend open source platforms to satisfy business requirements
  • A passion for technology and automation, deep sense of curiosity and willingness to always question
  • A passion for in-depth understanding of technology, and building large-scale systems.
  • Excellent verbal and written communication skills.
  • Collaborative mindset – comfortable working with a team of engineers.

Senior Storage/Platform Engineer
Millennium Management LLC

https://www.mlp.com
New York, United States
Israel Alexander Englander
Unknown / Non-Applicable
1001 to 5000 Employees
Company - Private
Investment & Asset Management
Finance
1989
Related Jobs

All Related Listed jobs

Commis Chef Required for Dover, Kent
International Master Chefs LTD Dover Today

Ready for an epic adventure? We are a leading Back of House recruiting agency that specialise in providing permanent and temporary Chefs across the UK to some of the well-executed Establishments. We...

Tesco Colleague - Trowbridge Extra
Tesco Trowbridge, England Today

Making decisions that are right for customers, delivering routines in store that meet the needs of customers at the right time.

Warehouse Partner PM
Waitrose London, England 11.72 - 12.75 GBP HOURLY Today

Our Distribution Centres are made up of 3 separate internal Warehouses, each holding our Chilled, Fresh or Ambient product, and you may be required to work

Director, International Healthcare Product Management
Nuance London, England 52988 - 63385 GBP ANNUAL Today

Engage with customers and the healthcare community for feedback and usage information to develop product insights; and.

Pharmacy Delivery and Collection Service Driver
Boots Newton Abbot, England 21000 - 21505 GBP ANNUAL Today

At times there will be challenges as the day unfolds; customers not at home; traffic jams; flat tyres, in addition to these , there is also a fair degree of