Data Engineer

Description:

This role is responsible for the development and implementation of big data & data warehouse solutions for company-wide application and managing large sets of structured and unstructured data. The candidate will be expected to analyze complex customer requirements and work with data architect to gather, define and document data transformation rules and its implementation. Data Engineers will be expected to have a broad understanding of the data acquisition and integration space and be able to weigh the pros and cons of different architectures and approaches. You will have a chance to learn and work with multiple technologies and Thought Leaders in the domain.
Responsibility • Translate the business requirements into technical requirements
• ETL development using native and 3rd party tools and utilities
• Write and optimize complex SQL and shell scripts
• Design and develop code, scripts, and data pipelines that leverage structured and unstructured data
• Data ingestion pipelines and ETL processing, including low-latency data acquisition and stream processing
• Design and develop processes/procedures for integration of data warehouse solutions in an operative IT environment.
• Monitoring performance and advising any necessary configurations & infrastructure changes.
• Create and maintain technical documentation that is required in supporting solutions.
• Coordinate with customers to understand their requirements Skills and
Qualifications • BS. / M.S. in Computer Sciences or related field
Experience: 2–5 Years of experience in relevant domain.
• Strong expertise in PL/SQL queries
• Hands on experience with Big Data technologies such Hive, Impala, Nifi, Airflow is plus.
• Working experience with one or more Cloud environments like Oracle Cloud, AWS, Azure or GCP along with hands on experience with different cloud services.
• Software development experience, working with a variety of programming languages such as Python, Scala etc.
• Excellent Knowledge of one or more ETL tools like Oracle ODI, Informatica, Talend etc.
• Strong concepts/experience of designing and developing ETL architectures.
• Strong RDBMS concepts and SQL development skills
• Strong knowledge of data warehousing, data modeling and mapping techniques.
• Experience with Data Integration from multiple data sources
• Excellent communication and presentation skills, both verbal and written
• Ability to solve problems using a creative and logical mind set
• Must be self-motivated, analytical, detail oriented, organized and pursue excellence on all tasks.