LLM Engineer (AI Software Engineer) at Rollstack

About the Role

As an AI Software Engineer at Rollstack, you’ll build core features that automate how companies share data through slides and documents. You’ll work across the stack on integrations, AI insights, and performance optimization. This role is ideal for engineers who thrive on impact, autonomy, and fast-paced product development.

As a LLM Engineer, you will

• Build AI-Powered Features: Combine industry best practices with innovative thinking to develop our product's first AI capabilities.

• Utilize Existing Frameworks: Leverage libraries like LangChain, RAG, and LlamaIndex to create scalable, production-ready solutions for data analysis and content generation.

• Enhance System Performance: Improve reliability and speed up time-to-market by optimizing software performance to meet customer needs.

• Collaborate with Teams: Work closely with designers and software engineers to boost user adoption and engagement.

• Innovate with AI Technologies: Pioneer best practices using cutting-edge AI tools and techniques.

Tech Stack

• TypeScript + React frontend with Tailwind CSS and Shadcn/UI, using modern hooks for composable UI and fast iteration.

• Node.js backend with a sync engine using Prisma ORM and Temporal workflows, powering internal services.

• K8s platform on AWS, deployed with Argo CD for zero-downtime releases and easy rollbacks.

• Logs in SigNoz, application tracing in Sentry, and product analytics in PostHog.

• Generative-AI layer powered by OpenAI API, Gemini, LangChain, and Langfuse to deliver automated insights.

• Issue tracking with Linear.

Who We Are Looking For

• Experience with LLM Frameworks: Proficiency in current large language model frameworks like LangChain, Retrieval-Augmented Generation (RAG), and LlamaIndex.

• Machine Learning and NLP Expertise: 3+ years of experience in machine learning and natural language processing, focusing on generative models.

• Strong Python Skills: Advanced programming skills in Python.

• LLM Agents Development (Bonus): Bonus points for experience in building LLM agents for data analysis and content generation.

• Production Experience with LLMs: Proven experience in researching, building, and fine-tuning large language models in production environments.