Job Summary
Ogesoft Technologies Ltd is looking for a mid-level Data Scientist / Python Developer – LLM & RAG Platform to help us bring a RAG–agentic platform from “works in dev” to “works in the real world”. You’ll be the person who: Puts the LLM & RAG platform under real-life scenarios, Evaluates how it behaves with LLMs and different data sources.
- Minimum Qualification : Degree
- Experience Level : Mid level
- Experience Length : 3 years
Job Description/Requirements
Responsibilities:
- Design and run realistic usage scenarios to evaluate the RAG / agentic platform (simulate real users, edge cases, tricky queries, etc.).
- Measure and analyze platform performance (quality of responses, latency, failure modes, regressions) using logs, metrics, and your own experiments.
- Prototype and extend system functionality in Python (new tools/agents, prompts, pipelines, evaluation scripts, small services) that can be integrated into the platform.
- Collaborate with the core engineering team to report findings, suggest improvements, and iterate on system behavior.
- Work with LLMs and RAG pipelines: prompt and retrieval tuning, evaluating different models/configurations, and testing integrations with external data sources.
- Build and maintain test/evaluation suites that can be reused to validate new platform versions.
- Write clean, well-documented, and testable Python code for experiments, internal tools, and platform extensions.
Requirements:
- Minimum of 2–5 years of experience
- Minimum of a BSc
Important Safety Tips
- Do not make any payment without confirming with the Jobberman Customer Support Team.
- If you think this advert is not genuine, please report it via the Report Job link below.