Junior Software Engineer – AI/LLM Systems at Epiq in New ... | Findjobs
Junior Software Engineer – AI/LLM Systems
Epiq
Location
🇺🇸 New York, United States
Type
Full-time
Salary
Undisclosed
Posted
0mo ago
Job Description
At Epiq , your work contributes to complex, global legal outcomes. You’ll join a values‑driven community where integrity guides decisions, relentless service sets the bar, and we thrive on big challenges together. We invest in your growth with enterprise‑wide learning and mobility. We celebrate
who you are
, and we respect life beyond work with flexibility that’s recognized externally. Enabled by modern platforms and AI, you’ll do the most meaningful work of your career and see your impact at scale.
Job Description
: Job Summary We’re building cutting‑edge AI‑powered products and need a junior engineer who is eager to learn about large‑language‑model (LLM) technology while helping us ship new features. If you enjoy working on real‑world products and want to grow your skills in AI, this role is for you. Essential Job
Responsibilities
Build and ship AI features with LLMs, retrieval‑augmented generation (RAG) pipelines, embeddings, and simple multi‑model workflows under guidance from senior teammates.
Help design low‑latency, high‑accuracy systems that can scale reliably in production.
Support cloud operations on AWS/Azure, learning how to keep costs under control.
Create prompt libraries and participate in evaluation pipelines, guardrails, and automated quality checks.
Collaborate with product and linguistics experts to translate user stories into concrete rules and domain logic.
Cloud‑native development – Hands‑on experience with cloud platforms (AWS, GCP, or Azure), including IaC (Terraform, CloudFormation), serverless functions, container orchestration (Kubernetes), and CI/CD pipelines.
Basic ML/LLM awareness – A foundational grasp of machine‑learning concepts and large‑language‑model principles, paired with a genuine curiosity to dive deeper.
Observability & performance – Familiarity with monitoring, logging, and tracing in distributed systems (Prometheus, Grafana, ELK stack, OpenTelemetry).
Optional advanced exposure – Experience with vector databases, retrieval‑augmented generation, or prompt engineering is a plus, but not mandatory.
Product‑oriented mindset – Ability to translate technical ideas into user‑centric features that delight customers.
Growth‑oriented teamwork – Eager to learn, proactive, and thrives in a collaborative environment where mentorship and support for junior talent are core values. The Compensation range for this role is 80,000 to 95,000 USD annually and may be eligible for an annual bonus. In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire. Must be authorized to work in the United States for any employer. Your specific salary will be determined based on several factors:
Location-based market rate for
the role
Your abilities in relation to the job specification
Performance during screening and interview
Pay parity with the wider team in the considered location Further details about the package will be provided during the initial screening call with the Talent Acquisition Team. Click Here To Learn About Epiq's
Benefits
. Epiq Leadership Compass Fosters Relationships & Collaboration Builds trust and alignment through open communication, shared goals, and strong partnerships to drive collective success. • Build trust-based partnerships • Nurture long-term relationships • Remove collaboration barriers • Celebrate cross-team success Engages & Influences Inspires action and alignment through clear communication, purposeful influence, and a compelling vision. • Use storytelling to build buy-in • Align communication with organ