Senior AI Platform/Backend Software Engineer- Remote

Job Title: Senior AI Platform/Backend Software Engineer- Remote

Location: Remote, East coast preferred.

Duration: 6-12 months

Job Description
• Design and deploy agentic AI workflows that connect Large Language Models (LLMs) and custom machine learning models into backend architectures, using frameworks like LangChain, LangGraph, PydanticAI or SemanticKernel.
• Design systems for multi-agent coordination and multi-step reasoning loops/memory management.
• Build and maintain data ingestion pipelines and vector databases (e.g., Pinecone, Weaviate) to support Retrieval-Augmented Generation for AI agents.
• Implement tracing (e.g., LangSmith, Langfuse) and build evaluation pipelines to measure accuracy, latency, and cost.
• Design testing strategies for non-deterministic AI outputs, including the implementation of guardrails and safety constraints.
• Deploy and orchestrate containerized services using Docker and Kubernetes on cloud platforms like AWS, Google Cloud Platform, or Azure (Azure preferred)
• Preferred: Experience with Azure Foundry/ Azure OpenAI

Qualifications
• University degree in Computer Science or a related discipline.
• 12+ years of professional experience in software engineering or backend systems.
• 2 3 years relevant experience in AI technologies building APIs, integrating LLMs, designing RAG pipelines, and deploying scalable microservices.
• Strong applied expertise with frameworks like LangChain, FastAPI, CrewAI, and cloud platforms.

Regards,

Harjeet Singh

Marlabs Inc. | One Corporate Place South | Piscataway, NJ 08854

Tel: X1496 | Mobile: | Fax: |