Data Engineer

Description:

We are seeking a highly motivated and skilled Data Engineer to join our team in Lahore. As a Data Engineer at Venture Data, you will play a pivotal role in designing, developing, and maintaining data pipelines, databases, and infrastructure to support our data analytics projects. You will work closely with cross-functional teams and collaborate with global clients, contributing to the success of data-driven initiatives.

Key Responsibilities:

Data Integration: Develop and maintain data pipelines to efficiently extract, transform, and load (ETL) data from various sources into our data warehouses.

Database Management: Design and optimize databases to ensure data reliability, integrity, and performance. Implement data partitioning, indexing, and caching strategies.

Data Modeling: Create and maintain data models that support reporting, analytics, and visualization needs. Work with data scientists and analysts to design efficient data structures.

ETL Automation: Implement automation scripts and workflows to streamline data extraction, transformation, and loading processes.

Quality Assurance: Perform data quality checks, data validation, and ensure data consistency across different systems.

Infrastructure Management: Collaborate with the IT team to manage and scale our data infrastructure, including cloud-based solutions.

Documentation: Maintain comprehensive documentation of data pipelines, workflows, and data models.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer or similar role, with a strong background in data warehousing and ETL processes.
• Proficiency in programming languages such as Python, SQL, and scripting languages.
• Experience with DBT and Snowflake is a plus
• Familiarity with data warehouse technologies (e.g., Snowflake, Redshift) and cloud platforms (e.g., AWS, Azure, GCP).
• Strong database design and optimization skills.
• Knowledge of data integration tools and frameworks.
• Strong communication and teamwork skills.