Senior Java Backend Engineer – GenAI / LLM

Original job posting

Design and develop high-performance backend services using Java and Spring Boot within a microservices architecture. Integrate and optimize Generative AI and LLM capabilities, including RAG services and prompt orchestration, into enterprise workflows.

Job details

Senior Java Backend Developer – Java 17+, Spring Boot, Microservices & GenAI/LLM Toronto, ON - Hybrid (4 Days WFO) Experience Required: 7+ years Role Descriptions: Key Responsibilities • Design, develop, and maintain high-performance backend services using Java (17+), Spring Boot, and Microservices architecture. • Build and expose RESTful and event-driven APIs supporting enterprise-scale applications. • Integrate Generative AI / LLM capabilities (e.g., text generation, summarization, Q&A, classification) into backend workflows. • Design, test, and optimize prompts and prompt orchestration strategies to ensure accuracy, determinism, and performance. • Develop AI-aware backend components such as: • Prompt templates and prompt pipelines • Retrieval-Augmented Generation (RAG) services • AI inference orchestration layers • Implement secure API integrations with AI platforms and internal data sources, ensuring compliance with enterprise security standards. • Apply prompt versioning, evaluation, and monitoring techniques to improve AI output quality over time. • Ensure nonfunctional requirements: scalability, resiliency, performance, and observability. • Contribute to CI/CD pipelines, containerization, and cloud-native deployments. • Participate in code reviews, architecture discussions, and technical design decisions. • Support production systems and troubleshoot complex backend or AI-integration issues. Required Technical Skills Core Backend Engineering • 5+ years of strong hands-on experience in Java backend development. • Expertise in Java 11/17+, Spring Boot, Spring MVC, Spring Security. • Solid experience in Microservices, REST APIs, and API design (OpenAPI/Swagger). • Experience with containers and cloud platforms (Docker, Kubernetes, OpenShift, Azure/AWS). • Strong knowledge of SQL and NoSQL databases (e.g., DB2, PostgreSQL, MongoDB). • Experience in CI/CD, DevOps practices, and automated testing. AI & Prompt Engineering • Hands-on experience integrating Large Language Models (LLMs) into backend systems. • Strong understanding of prompt engineering techniques, including: • Zero-shot, few-shot, and chain-of-thought prompting • Prompt templates and dynamic prompt generation • Guardrails, validation, and hallucination reduction • Experience building RAG-based solutions using vector stores and embeddings. • Familiarity with AI orchestration frameworks or SDKs (enterprise or open-source). • Ability to evaluate prompt and model responses for quality, bias, and consistency. Security & Compliance • Experience implementing OAuth2.0, JWT, SSL/TLS, and secure API patterns. • Awareness of data privacy, PII handling, and AI governance in regulated environments (BFSI preferred).

What you’ll do

Design and develop high-performance backend services using Java and Spring Boot within a microservices architecture. Integrate and optimize Generative AI and LLM capabilities, including RAG services and prompt orchestration, into enterprise workflows.

Requirements

Requires over 7 years of experience in Java backend development with expertise in cloud platforms and containerization. Must have hands-on experience with LLM integration, prompt engineering techniques, and secure API implementation.

Listed skills

• Microsoft Azure · Preferred
• Kubernetes · Preferred
• SQL · Preferred
• REST APIs · Preferred
• CI/CD · Preferred
• Docker · Preferred
• Amazon Web Services · Preferred
• prompt engineering · Preferred
• Spring Boot · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Java 17+
• Spring Boot
• Microservices
• Generative AI
• Large Language Models
• Prompt Engineering
• Retrieval-Augmented Generation
• REST APIs
• Docker
• Kubernetes
• Azure
• AWS
• SQL
• NoSQL
• CI/CD
• OAuth2.0

Job areas

• Software
• Technology
• Engineering
• Consulting
• Data & Analytics