Backend Engineer
US · Menlo Park · Ho Chi Minh City · Remote · Full-time
Salary not stated
AI summary
About the company
Menlo开发的Jan是开源AI助手，作为ChatGPT的离线替代方案，支持本地运行开源模型或连接GPT、Claims等前沿模型，秉持AI应开放、私密、可控的理念。
Role overview
你将负责从零构建企业级LLM网关Jan Router，负责架构设计、首次生产部署，打造兼具正确性与性能的计费级代理，同时参与Jan Agent的开发，对接路由、计量与控制逻辑，与前沿研究团队协作，以敏捷方式推进AI服务落地。
Responsibilities
- 构建统一的OpenAI兼容API网关
- 负责提供商路由与可靠性（负载均衡、故障转移等）
- 开发正确的计费与计量系统
- 实现组织级控制（API密钥、配额、RBAC等）
- 处理流处理与性能优化
- 对接Jan Agent的模型与工具调用
- 权衡速度与正确性，优先保障核心业务正确性
Requirements
- 以代理原生方式工作，并行运行多个代理
- 熟悉LLM API系统与相关基础设施
- 有从零到生产部署的能力
- 开放务实，能权衡速度与正确性
- 具备代码审查与防护机制的自律性
Nice to have
- 有处理真实流量的生产后端服务开发经验
- 有支付、计费或计量系统开发经验
- 熟悉高吞吐量代理、网关与流处理
- 掌握PostgreSQL、Redis等数据存储
- 熟悉Jan.ai生态或其他OSS LLM工具
Pay & benefits
- 负责端到端真实产品
- 与前沿研究团队协作
- 以敏捷方式推进项目
- 打造行业领先的代理原生后端架构
Register to apply directly, open the original posting and save jobs
Sign up freeThis is not an official page of Menlo. The listing is gathered automatically from the employer's official careers page or a job board's public feed (see sources on the right). Fintegrity has no agency relationship with this employer and has not verified its credentials. Chinese titles and summaries are AI-generated; the original text prevails. Apply on the source page. We never charge job seekers. Ranking & display rules
Excerpt
About Jan Jan is an open source AI assistant built by Menlo. It began as a private, offline alternative to ChatGPT and has grown into a general purpose agent that runs open models locally on your own hardware, or connects to frontier models like GPT, Claude, and Gemini when you want them. Give Jan…
Sign up freeThe summary and highlights are AI-generated and may contain errors; the original posting prevails.
Sources or employers who want a posting removed or corrected can email contact@fintegrity.cn; we act within 24 hours.