Data Engineer
Job summary
We are seeking a skilled Data Engineer experienced in ETL/ELT pipelines, database management, cloud technologies, and data infrastructure. Candidates must be able to manage complex datasets, build scalable solutions, troubleshoot technical issues, and independently support international client projects.
Job descriptions & requirements
Responsibilities:
- Design, develop, maintain, and optimize scalable data pipelines.
- Build and manage ETL/ELT processes for data extraction, transformation, and loading.
- Write advanced SQL queries for data manipulation, transformation, and performance optimization.
- Develop Python scripts for data processing, automation, and pipeline development.
- Work with relational and non-relational databases.
- Integrate data from APIs, databases, cloud platforms, and other sources.
- Implement data validation, quality checks, and error-handling processes.
- Troubleshoot pipeline failures, database performance issues, and data inconsistencies.
- Develop and maintain data warehouses and data lakes.
- Collaborate with technical teams to deliver reliable data solutions.
- Document technical processes, architecture, and workflows.
- Participate in technical meetings and communicate solutions clearly.
Requirements:
- Minimum 3 years of professional data engineering experience.
- Bachelor’s degree in Computer Science, Engineering, Information Technology, Mathematics, or a related discipline preferred.
- Demonstrable experience working on real-world data engineering projects.
- Strong analytical thinking and problem-solving abilities.
- Ability to troubleshoot technical issues independently.
- Excellent spoken and written English.
- Ability to communicate confidently with international technical teams.
- Strong understanding of data architecture and engineering best practices.
- Must currently reside in Lagos, Nigeria.
- Must be available for an in-person technical interview in Lagos.
Required Technical Skills:
Candidates must demonstrate practical proficiency in the following core technologies:
Python:
- Advanced Python programming
- Pandas and NumPy
- Data processing and transformation
- API integration
- Automation and scripting
- Error handling and debugging
SQL & Database Management:
- Advanced SQL queries
- Complex joins, CTEs, and window functions
- Query optimization
- Database design and normalization
- PostgreSQL, MySQL, or Microsoft SQL Server
Data Engineering & ETL/ELT:
- ETL/ELT pipeline development
- Apache Airflow or similar orchestration tools
- Data ingestion and transformation
- Data modeling
- Data validation and quality assurance
- Pipeline monitoring and troubleshooting
Cloud Technologies:
Hands-on experience with at least one major cloud platform:
- AWS (S3, Glue, Redshift, Lambda)
- Microsoft Azure (Data Factory, Synapse, Databricks)
- Google Cloud Platform (BigQuery, Cloud Storage, Dataflow)
Data Warehousing & Big Data:
Experience with relevant technologies such as:
- Snowflake
- Databricks
- Apache Spark / PySpark
- Amazon Redshift
- Google BigQuery
- Delta Lake
Additional Technical Skills:
- Git and version control
- REST APIs
- JSON and CSV processing
- Linux command line
- Docker
- CI/CD fundamentals
- Data security and access management
Important safety tips
- Do not make any payment without confirming with the Jobberman Customer Support Team.
- If you think this advert is not genuine, please report it via the Report Job link below.