Senior Software Engineer
Job summary
We are seeking an experienced Senior Software Engineer LLM Evaluation to contribute to the development and improvement of advanced AI systems.
Job descriptions & requirements
Responsibilities:
- Create and curate high-quality datasets for training, benchmarking, and evaluating large language models.
- Develop code examples, reference solutions, and technical corrections across multiple programming languages.
- Evaluate AI-generated code for correctness, efficiency, scalability, maintainability, and reliability.
- Review and improve model-generated software engineering solutions.
- Collaborate with researchers and cross-functional teams to improve AI coding systems.
- Design evaluation frameworks and verification mechanisms for software engineering tasks.
- Build tools and agents that assess code quality and identify common error patterns.
- Assess AI performance across various stages of the software development lifecycle, including: Prototyping, Architecture design, API development, Production implementation, Testing and deployment, Monitoring and maintenance
- Provide structured technical feedback and evaluation reports.
- Contribute to the continuous improvement of AI model performance and coding capabilities.
Requirements:
- Several years of professional software engineering experience.
- At least 2 years of continuous full-time experience at a recognized product-focused technology company.
- Strong experience building full-stack applications and scalable software systems.
- Proficiency in one or more of the following languages: Python, JavaScript, C/C++, Java, Rust, Go
- Strong understanding of software architecture, system design, debugging, testing, and code review processes.
- Experience working with production-grade applications and modern development tools.
- Ability to evaluate code quality, performance, and engineering best practices.
- Excellent written and verbal communication skills.
- Ability to provide clear, structured technical reasoning and evaluation feedback.
Preferred Skills:
- Experience with AI, machine learning, or large language models (LLMs).
- Experience evaluating or reviewing software engineering solutions.
- Familiarity with AI model training, benchmarking, or evaluation frameworks.
- Experience building developer tools, testing frameworks, or automation systems.
- Experience working in research-driven or data-driven engineering environments.
Required Technologies:
- Python
- JavaScript
- Modern Software Engineering Tools and Frameworks
Work Commitment:
- Flexible schedule
- Minimum commitment: 10 hours per week
- Maximum commitment: 40 hours per week
- Partial overlap with PST working hours is required
Contract Details:
- Remuneration: NGN 700,000 monthly
- Engagement Type: Contractor
- Duration: 1 month initially
- Start Date: Expected to begin next week
- Extension: Potential contract extensions based on performance and project requirements
- Benefits: This contractor role does not include medical insurance or paid leave
Important safety tips
- Do not make any payment without confirming with the Jobberman Customer Support Team.
- If you think this advert is not genuine, please report it via the Report Job link below.