Boson AI is a startup building large language tools for everyone to use. Our
founders (Alex Smola [https://alex.smola.org/], Mu Li [https://github.com/mli]),
and a team of Deep Learning, Optimization, NLP, AutoML and Statistics scientists
and engineers are working on high quality generative AI models for language,
audio, and entertainment.
About The Role
We are looking for a Senior Software Engineer with deep expertise in managing
Ceph for our deep learning datacenter in Toronto. The ideal candidate needs to
have strong problem solving skills and an ability to learn new tools. Experience
with Slurm, MAAS, Infiniband, NVIDIA deepops, Layer 3 networking and related
tools are a big plus. You should be comfortable performing some amount of
hardware configuration.
You will have the opportunity to work with NVIDIA H100 and A100 GPUs, over 25PB
of disk and over 5PB flash storage, Terabit networking and hundreds of
computers. You will be responsible for deploying and operating Ceph and its
integration with a broad range of infrastructure technologies and hardware
systems.
You MUST have prior Ceph experience in order to qualify for the job. If you
don't, please don't spam the ATS.
\n
A day in the life:
- Design, manage and maintain large storage arrays
- Integrate them with Deep Learning infrasturcture
- Support troubleshooting for MAAS, Slurm and Kubernetes as needed
- Configure and automate on-premises Linux-based systems at scale using
infrastructure-as-code practices
- Learn about new tools and deploy them
You might be a great fit if you have:
- Strong background in maintaining Ceph clusters
- Experience with high performance computing is highly desirable
- Experience with with on-premises Data Center operations and technologies
- Experience in managing a large hardware cluster
- Proficiency in at least one programming language (e.g. Python) and ability to
write clean, maintainable code
- Experience with managing firmware / systems updates for systems, e.g. on
SuperMicro
\n
$150,000 - $250,000 a year
\n
The ability to solve problems and to learn new techniques is key.