Senior AI Engineer (LLM Systems)
Eagle Point Credit
Skills
About the Role
Eagle Point is an innovative investment manager focused on private credit strategies in inefficient markets, including Portfolio Debt Securities, Regulatory Capital Relief transactions, Infrastructure Credit, Strategic Credit investments and CLO securities. Founded by Thomas Majewski in partnership with Stone Point Capital in 2012, Eagle Point manages over $14 billion on behalf of institutional and retail investors. The firm employs over 120 professionals and is based in Greenwich, CT.
At Eagle Point, we aim to recruit, develop and retain talented professionals while promoting an environment that exemplifies integrity, inclusion, teamwork and respect for others.
We’re hiring a Senior AI Engineer to build and own production-grade LLM systems. You’ll design and operate core AI capabilities, model integrations, agentic workflows, retrieval, and evaluation, partnering with Business Intelligence and UX engineers
This is a hands-on role for engineers who have shipped real LLM systems and want deeper ownership and technical impact (not management).
\n- Own end-to-end LLM systems (RAG, agents, internal tools) from design to production
- Make key decisions on prompting, retrieval, model selection, and system design
- Build shared infrastructure (evals, prompt/versioning, pipelines, guardrails)
- Define and run evals to measure quality and prevent regressions
- Own latency, cost, reliability, and production incidents
- Partner with frontend engineers on clean system interfaces
- Raise the bar through code reviews, mentorship, and technical direction
- 5+ years SWE experience, including 2+ years shipping LLM systems
- Strong Python + one backend language (TS, Go, or Java)
- Hands-on with LLM APIs (tool use, structured outputs, streaming, token trade-offs)
- Experience with RAG (embeddings, vector DBs, chunking, ranking)
- Strong evaluation mindset — you measure, not guess
- Solid backend fundamentals (APIs, testing, CI/CD, observability)
- Comfortable owning production trade-offs (cost, latency, reliability)
- Clear communicator across technical and non-technical audiences
This position is an in-office position located in Greenwich, CT.
Eagle Point is an equal opportunity employer.
Similar Jobs
Senior AI Engineer
Senior AI Engineer
Sr. AI Engineer
Sr. AI Engineer
AI Engineer - Everest
Staff AI Engineer, StockStory
