Description:
Neftec Solutions, a leading IT services company, specializes in designing and implementing scalable data processing pipelines to help businesses maximize their data potential. We are currently seeking a Data Processing Pipeline Specialist on a project-based contract to build and optimize data infrastructures that support advanced analytics and business intelligence.
Key Responsibilities:
- Design, implement, and maintain efficient data pipelines for processing, integrating, and transforming data.
- Collaborate with teams to build and optimize ETL workflows ensuring seamless data flow across systems.
- Develop cloud-based data architectures and deploy scalable infrastructure solutions on AWS, GCP, or Azure.
- Support data integration while ensuring data quality throughout the pipeline.
- Troubleshoot and resolve data processing, integration, and performance issues.
- Provide recommendations for scaling and optimizing existing data pipelines.
- Document pipeline architecture, best practices, and troubleshooting guidelines.
Required Skills & Qualifications:
- 3+ years of experience in building and managing data pipelines and ETL processes.
- Proficiency in cloud platforms such as AWS, GCP, or Azure.
- Strong expertise in data integration, ETL, and data warehousing.
- Proficiency in Python, SQL, or Java.
- Solid understanding of data models and data processing frameworks.
- Strong analytical and problem-solving skills.
- Ability to work independently and meet deadlines in a project-based setting.
Preferred Skills:
- Experience with real-time data processing and data stream management.
- Knowledge of data security and compliance standards (e.g., GDPR).
- Familiarity with machine learning integrations into data pipelines.
Why Join Us?
- Remote work opportunity.
- Competitive compensation based on experience.
- Work on cutting-edge projects in data engineering.
- Be part of a growing and innovative company.
- Potential for future project-based or full-time opportunities.