AI Runtime Engineer

About the Role

As a Runtime Engineer, you will be responsible for the execution layer of our platform, ensuring the code generated by our compiler runs with maximum efficiency and accuracy on varied hardware architectures. This role demands deep, low-level systems expertise covering thread scheduling, parallel workload distribution, hardware benchmarking, and cross-functional engineering partnerships.

Key Responsibilities

• Architecture Development: Architect, implement, and support our multi-platform execution engine.
• Workload Optimization: Utilize advanced partitioning and concurrent execution strategies to automate instruction scheduling and leverage high-performance hardware paths.
• Profiling & Analysis: Measure and evaluate compiled binaries directly on physical hardware to guarantee top performance.
• Diagnostics: Create internal tools and telemetry to pinp...