AI Orchestration Engineer
NOTE: This role is open to US-based candidates only.
Engineering | Mid-Level | US Remote
Company Overview
Firebrand.ai is creating a technology platform that empowers enterprises to build, operate, and support Generative AI applications more effectively. Our unique orchestration technology enhances the intelligence, manageability, and reliability of Generative AI applications, giving forward-thinking enterprises a competitive edge in the AI Age.
Job Overview
We are seeking an AI Orchestration Engineer to join our team and help build the core infrastructure that drives our AI platform. This is a software engineering role focused on developing the orchestration layers that enable multiple AI models to work together efficiently. You will be responsible for designing and developing orchestration tools, APIs, and middleware components that connect and manage AI models in a scalable way. The ideal candidate will have experience in backend development, system integration, and a passion for orchestrating advanced AI technologies to create intelligent workflows. You will work closely with other engineering teams to ensure that our orchestration solutions meet the highest standards of performance and reliability. PLEASE NOTE: THIS IS A SOFTWARE ENGINEERING POSITION, NOT A DATA SCIENCE OR ML OPS POSITION. CANDIDATES WITHOUT THE NECESSARY SOFTWARE ENGINEERING EXPERIENCE WILL NOT BE CONSIDERED.
Job Responsibilities
- Design and Develop AI Orchestration Components: Develop software components that manage the coordination and interaction between different AI models, ensuring smooth operation and optimal performance.
- Create Middleware for Model Integration: Build middleware that connects various AI models, focusing on optimizing model selection and efficient utilization of resources.
- Develop APIs for Orchestrated AI Workflows: Design and implement APIs to enable seamless interaction between AI services and enterprise applications, facilitating orchestrated AI workflows.
- Enhance Orchestration Framework: Contribute to the ongoing improvement of the orchestration framework, adding features for error handling, state management, and context sharing between models.
- Integrate External Services: Work on integrating external data sources and services into the AI orchestration system, enabling more enriched AI capabilities.
- Implement Monitoring and Optimization: Develop tools to monitor the performance of AI workflows and implement optimizations to improve throughput, latency, and overall system efficiency.
- Collaborate with Cross-functional Teams: Work closely with other engineers and stakeholders to develop scalable solutions for orchestrating AI services across various business domains.
Required Qualifications
- 5+ years of experience in software engineering with a focus on integration of complex systems.
- Strong programming skills in TypeScript and Node.js, particularly in building and integrating complex systems.
- Experience with asynchronous programming, distributed systems, and middleware development.
- Knowledge of API development and integration, including RESTful APIs.
- Experience with cloud platforms (Azure, AWS, and/or GCP) and container orchestration technologies such as Kubernetes.
- Understanding of Large Language models, inference, and the challenges of model orchestration.
- Bachelor's or Master's degree in Computer Science.
Preferred Qualifications
- Experience with AI model orchestration and deployment frameworks.
- Familiarity with cloud-based AI services (e.g., OpenAI, Google Gemini, or Anthropic).
- Experience building systems that utilize multiple AI models to solve complex problems.
- Strong problem-solving skills and the ability to work independently as well as in a collaborative environment.
- Proficiency in using AI tools such as GPT-4 Canvas or GitHub Copilot in software development.
- Excellent communication and teamwork skills, with a proactive approach to driving projects to completion.
Travel Expectations: Quarterly travel for in-person team meetings is required.
Firebrand is an Equal Opportunity Employer. At this time we are unable to offer immigration assistance or sponsorship. While we fully support the use of AI tools, candidates who use such tools during a live interview will be disqualified.