Solution Architect - LangGraph & Agentic AI

We are looking for an experienced Solution Architect with hands-on experience designing and deploying LangGraph-based AI solutions to lead the architecture of enterprise agentic AI platforms and applications.

You will work with business and technology stakeholders to identify high-value AI opportunities and translate them into secure, scalable, and production-ready architectures.

The role combines AI architecture, enterprise integration, cloud engineering, agentic AI, security, governance, and stakeholder leadership.

You will be expected to understand LangGraph at a practical level and be able to challenge architectural decisions, guide engineering teams, and ensure that AI solutions can operate reliably at enterprise scale.

Requirements

AI Solution Architecture

• Lead the architecture and design of enterprise AI agent and agentic workflow solutions.
• Design LangGraph-based architectures for single-agent and multi-agent applications.
• Translate business requirements, processes, SLAs, security requirements, and technical constraints into solution architectures.
• Evaluate architectural alternatives and document key technical decisions and trade-offs.
• Define reusable architecture patterns for agentic AI solutions.

Enterprise Agent Architecture

• Design architectures incorporating:
• LLMs
• LangGraph
• RAG
• Enterprise data
• APIs and business systems
• Workflow engines
• Human approval processes
• Observability
• Security and governance
• Define appropriate boundaries between AI reasoning and deterministic business logic.
• Design state management, persistence, recovery, and long-running agent workflows.
• Determine when to use single-agent, multi-agent, or conventional application architectures.

Cloud and Platform Architecture

• Design scalable AI application architectures on AWS, Azure, or GCP.
• Define compute, networking, storage, API, security, and platform requirements.
• Design architectures suitable for enterprise-scale production workloads.
• Evaluate cloud services and AI platform capabilities based on performance, security, scalability, and cost.
• Work with platform engineering and DevOps teams to establish deployment standards.

Integration Architecture

• Design integration between AI agents and enterprise applications, APIs, databases, and SaaS platforms.
• Define secure mechanisms for agent tool access and business-system interactions.
• Design authentication, authorisation, secrets management, and access-control approaches.
• Ensure AI-driven actions are traceable, auditable, and appropriately governed.

AI Security and Governance

• Establish security and governance principles for enterprise AI agents.
• Address risks including:
• Prompt injection
• Data leakage
• Unauthorised tool usage
• Excessive agent permissions
• Inaccurate or unsafe actions
• Sensitive-data exposure
• Define appropriate human-in-the-loop controls.
• Ensure solutions comply with organisational security, privacy, regulatory, and responsible-AI requirements.

AI Evaluation and Observability

• Define architecture for AI application monitoring and observability.
• Establish approaches for evaluating agent accuracy, reliability, latency, cost, and task completion.
• Define appropriate logging, tracing, metrics, and alerting.
• Establish operational processes for monitoring and continuously improving production agents.

Stakeholder and Technical Leadership

• Work directly with senior business and technology stakeholders to define AI strategies and roadmaps.
• Lead architecture workshops and technical design sessions.
• Communicate complex AI concepts and architectural trade-offs to technical and non-technical audiences.
• Provide technical direction to AI engineers, developers, data teams, and platform engineers.
• Review solution designs and ensure alignment with enterprise architecture standards.
• Mentor engineering teams and promote reusable AI architecture patterns.

Required Experience

• Significant experience in solution architecture, software architecture, AI architecture, or a related role.
• Hands-on experience designing and deploying LangGraph-based AI applications or agentic workflows.
• Strong understanding of LLM application architectures.
• Experience with enterprise AI/ML solutions in production.
• Strong understanding of RAG, tool calling, agent orchestration, and human-in-the-loop patterns.
• Strong experience with at least one major cloud platform: AWS, Azure, or GCP.
• Strong understanding of enterprise integration patterns and APIs.
• Experience with security, governance, observability, and operational requirements for production systems.
• Strong technical understanding of Python and modern software engineering practices.

Desirable Experience

• LangChain / LangSmith
• Multi-agent architectures
• Enterprise RAG platforms
• Vector databases
• Kubernetes
• Event-driven architectures
• Microservices
• Infrastructure as Code
• CI/CD
• MLOps / LLMOps
• AI security
• Responsible AI
• Large-scale enterprise transformation
• Experience working directly with senior client stakeholders

Find Jobs in Germany on Arbeitnow