Hybrid job

Hybrid

Research Engineer, Model Inference & Serving - Paris

H Company

Hybrid Paris · Check country restrictionsPublished on Apr 14, 2026Confirmed active on Nov 16, 2026
Full-timeTechnology1-50

Job briefing

Read from the posting and checked against our job index

Office in
Hybrid Paris
Work model
Hybrid, partly on site
Salary
Not stated

Your tasks

  • Build and operate the inference stack for multimodal agentic models
  • Improve latency, throughput, and model-serving costs
  • Research and implement inference techniques for agent workloads
  • Co-design training-time decisions that affect inference with the Models team
  • Evaluate inference, serving, and hardware platforms and communicate findings
  • vLLM
  • SGLang
  • Python
  • Rust
  • C++
  • Go
  • PyTorch
  • JAX
  • Kubernetes
  • TensorRT-LLM

What they expect

Required skills

  • Strong software engineering track record, proficiency in Python and at least one of Rust, C++, or Go
  • Hands-on experience with PyTorch or JAX, preferably in an industry setting
  • Solid distributed systems fundamentals and experience with cloud environments and production ML infrastructure
  • Working knowledge of modern ML, including transformers and multimodal architectures
  • Advanced degree with research output, or relevant publications, research internships, or substantive open-source contributions
  • Preferred: experience with inference frameworks, GPU kernels, edge inference, quantization, or multimodal and agentic systems

Mindset

  • Excellent communication and presentation skills
  • Strong collaboration and teamwork skills
  • Passion for inference and AI

Good to know

Listed with us since
November 11, 2026
Employer
15 more open roles at H Company in our index.
Benefits in the posting
Professional growth opportunities, Continuous learning, Career development

Before you apply

These terms appear word for word in the posting. If you have these skills, they belong in your CV too.

  • Strong software engineering track record
  • Solid distributed systems fundamentals
  • multimodal architectures
  • quantization
  • speculative decoding
  • disaggregated inference
  • KV-cache compression
Is this job a fit for you? Ask the AI advisor

Generated automatically by nomado24 from the posting and our index. Not an employer statement. The original posting is authoritative.

Job description

RESEARCH ENGINEER, MODEL INFERENCE & SERVING

About H: H exists to push the boundaries of superintelligence with agentic AI. By automating complex, multi-step tasks typically performed by humans, AI agents will help unlock full human potential. H is hiring the world's best AI talent, seeking those who are dedicated as much to building safely and responsibly as to advancing disruptive agentic capabilities. We promote a mindset of openness, learning, and collaboration, where everyone has something to contribute.

About the Team: The Inference team builds and operates the systems that serve H's foundational models in production. We focus on multimodal inference and serving for Computer Use Agents, optimizing across both the inference engine layer (e.g., vLLM, SGLang) and the model serving layer (e.g., disaggregated inference, intelligent routing). Agentic inference brings constraints around context length, multimodality, and tool calls, which we address by co-designing with the Models team on training-time choices and with the agent teams on how models are deployed. We operate at the intersection of research and production, translating cutting-edge inference techniques into the systems that power H's next generation of agents. We are looking for strong engineers excited about inference to join the team and help shape the systems behind superintelligent AI.

KEY RESPONSIBILITIES:

  • Build and operate the inference stack that serves H's multimodal agentic models
  • Improve latency, throughput, and cost of model serving across the stack
  • Research and implement inference techniques tailored to agent workloads
  • Co-design with the Models team on training-time decisions that affect inference
  • Collaborate with cross-functional teams to integrate inference into agentic AI products
  • Evaluate inference, serving, and hardware platforms, and communicate findings to stakeholders
  • Stay current with advancements in inference, model serving, and accelerator technology

REQUIREMENTS:

  • Technical skills:
  • Strong software engineering track record
  • Proficient in Python and at least one systems language (Rust, C++, or Go)
  • Hands-on experience with deep learning frameworks (PyTorch, JAX), preferably in an industry setting
  • Solid distributed systems fundamentals
  • Experience working in a modern cloud environment and with production ML infrastructure (Kubernetes, etc.)
  • Working knowledge of modern ML, including transformers and multimodal architectures
  • Research skills:
  • Research engagement: an advanced degree with research output, or publications at top-tier AI or systems venues (e.g., NeurIPS, ICML, MLSys, OSDI), research internships, or substantive open-source contributions
  • Soft skills:
  • Excellent communication and presentation skills
  • Strong collaboration and teamwork skills
  • Passion for inference and AI
  • Preferred qualifications:
  • Startup experience
  • Hands-on experience with inference frameworks (vLLM, SGLang, TensorRT-LLM)
  • Writing or modifying GPU kernels (CUDA, Triton, etc.)
  • Edge or on-device inference experience (llama.cpp, MLX, ONNX Runtime, etc.)
  • Experience with quantization, speculative decoding, disaggregated inference or KV-cache compression
  • Experience with multimodal models and/or agentic systems

LOCATION:

  • Paris or London.
  • This role is hybrid, and you are expected to be in the office 3 days a week on average.
  • Please expect some travel between offices on a reasonable cadence (e.g., every 4-6 weeks).

WHAT WE OFFER:

  • Join the exciting journey of shaping the future of AI
  • Collaborate with a fun, dynamic and multicultural team, working alongside world-class AI talent in a highly collaborative environment
  • Enjoy a competitive salary
  • Unlock opportunities for professional growth, continuous learning, and career development

If you want to change the status quo in AI, join us.

ashbyResearchInferenceHybrid

This role is provided by an external source. Applications are handled on the source website.

New remote jobs like “Research Engineer” by email

Free, and only when something fitting appears.

Confirm by email. Unsubscribe anytime. Privacy Policy.

Latest remote jobs

Matching job categories

Not the right job?

Matches for your profile: two are free, with Nomado24 Pro you see up to 24. See Pro