Senior Platform Engineer - ClickHouse

Senior Software Engineer (Data Platform, ClickHouse)

We are seeking a highly motivated and talented Senior Software Engineer to work on Qualys’ next-generation Data Platform and middleware. For this position, we are looking for someone with expertise in ClickHouse. Working alongside a very talented team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable SaaS based cloud security Data Platform. This is a great opportunity to be an integral part of a team building Qualys’ next generation microservices based technology platform processing over a 100 million transactions and terabytes of data per day, leverage open source technologies, and work on challenging and business-impacting projects.

Responsibilities For this position, we are especially looking for someone with below capabilities:

• Brings deep expertise in ClickHouse internals and architecture, various ClickHouse engines, partitioning, ordering keys, indexing, and query execution.
• Design and review schemas against real-world read/write patterns, optimizing ingestion, query performance, and storage efficiency.
• Operate ClickHouse at scale on premise or cloud, including replication, sharding, workload management, performance tuning, and production troubleshooting.
• Drive capacity planning across CPU, memory, storage I/O, and network resources, accounting for workload growth, concurrency, background merges, and reliability requirements.
• You will be responsible for engineering of services running data stored with millions of transactions per second, scaling to 100s of terabytes of data. You will be responsible for driving the data source and providing data platform as a service to various applications built in Qualys.
• Be the face and developer advocate of the technology stack you own and contribute back to open-source community if any enhancement needed to fit in Qualys ecosystem.
• You will be instrumenting both day 1 and day 2 operations on these data technologies keeping the 100s of thousands if not millions of operations per second. Migrate, burst into cloud and scale the stack with zero or least amount of downtime.
• You will be responsible for delivering resilient client SDKs to the applications to communicate with the data source you are responsible for.
• You will be constantly in the hunt for better solutions out there to resolve the current scaling, availability, and cost-effective alternative solutions.

…