Big Data Engineer (Databricks, SQL, Hadoop, Python, Pyspark, Kafka) at Interswitch
Big Data Engineer (Databricks, SQL, Hadoop, Python, Pyspark, Kafka) at Interswitch.
Interswitch is an Africa-focused integrated digital payments and commerce company that facilitates the electronic circulation of money as well as the exchange of value between individuals and organisations on a timely and consistent basis. We started operations in 2002 as a transaction switching and electronic payments processing, and have progressively evolved into an integrated payment services company, building and managing payment infrastructure as well as delivering innovative payment products and transactional services throughout the African continent. At Interswitch, we offer unique career opportunities for individuals capable of playing key roles and adding value in an innovative and fun environment.
We are recruiting to fill the position below:
Job Title: Big Data Engineer (Databricks, SQL, Hadoop, Python, Pyspark, Kafka)
Location: Lagos
Department: Indeco – Industry Ecosystem & Platforms
Job type: Permanent
How to get a Canadian Visa and Work Permit for Free for International Students
MTN Nigeria Job Vacancies (10 Positions)
Secretary needed at the European Union Delegation to the Federal Republic of Nigeria and ECOWAS
Job Description
- Collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.
- You will also be responsible for integrating them with the architecture used across the company. You are at the intersection of data, engineering and product.
Responsibilities
- Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
- Implementing ETL processes
- Design, build, maintain and test robust data pipelines for different types of data streams
- Monitoring performance and advising any necessary infrastructure changes
- Analyzing and defining data retention policies.
Requirements
- BSc in Computer Science / Engineering or related field
- Big Data-related certifications/qualifications are required
- 3+ years of industry experience in the area of technical expertise.
Application Closing Date
6th December, 2027.
How to Apply
Interested and qualified candidates should:
Click here to apply online
FAQs
1. What does a Big Data Engineer at Interswitch do?
A Big Data Engineer at Interswitch is responsible for designing, developing, and maintaining data pipelines and big data systems. The role involves working with technologies such as Databricks, SQL, Hadoop, Python, PySpark, and Kafka to process, transform, and manage large volumes of data efficiently.
2. What qualifications are required for the Big Data Engineer role at Interswitch?
Candidates typically need a degree or equivalent experience in Computer Science, Engineering, Information Technology, Data Science, or a related field. Strong knowledge of Python, SQL, PySpark, Hadoop, Kafka, Databricks, data engineering concepts, and distributed data processing is also highly valuable.
3. What skills are important for a Big Data Engineer at Interswitch?
Important skills include data pipeline development, ETL/ELT processes, SQL, Python programming, PySpark, Apache Kafka, Hadoop, Databricks, data warehousing, cloud technologies, and troubleshooting. Good analytical, communication, and problem-solving skills are also important.
4. How can I apply for the Big Data Engineer position at Interswitch?
Interested candidates should check Interswitch’s official careers or recruitment platform for current vacancies and follow the application instructions provided for the Big Data Engineer position. Applicants should ensure their CV highlights relevant experience with Databricks, SQL, Hadoop, Python, PySpark, Kafka, and other required technologies.
