Senior Software Engineer
Job summary
We are looking for experienced Senior Software Engineer – LLM Evaluation & Repository Validation to help evaluate AI performance using real-world open-source code repositories. Candidates should be comfortable working with popular GitHub projects with 500+ stars.
Job descriptions & requirements
- Review and troubleshoot issues in open-source GitHub repositories.
- Set up development environments using Git and Docker.
- Evaluate unit test coverage and code quality.
- Modify and test code locally to assess AI bug-fixing performance.
- Work with researchers to identify challenging coding tasks.
- Mentor junior engineers when required.
- Strong programming skills in at least one language: Python, JavaScript, Java, Go, Rust, C/C++, C#, or Ruby.
- Experience with Git, Docker, and software development workflows.
- Ability to understand and navigate complex codebases.
- Comfortable running, modifying, and testing real-world software projects.
- Open-source contribution or evaluation experience is an advantage.
- Experience with LLM research or AI evaluation projects.
- Experience building or testing developer tools and automation agents.
- Technical leadership or mentoring experience.
Important safety tips
- Do not make any payment without confirming with the Jobberman Customer Support Team.
- If you think this advert is not genuine, please report it via the Report Job link below.