Data Collection And Preparation Specialist

Description:

We are seeking a motivated Data Collection and Preparation Specialist to support our AI-driven projects by collecting, processing, and preparing large volumes of data from multiple high-value public sources. The ideal candidate will be responsible for developing and maintaining an automated data pipeline, ensuring that the data is clean, structured, and optimized for AI applications.

Key Responsibilities:

• Data Collection & Integration: Automate the collection of structured and unstructured data from multiple online sources, including legal databases, financial APIs, scientific repositories, and news platforms.
• Data Processing & Cleaning: Ensure the collected data is properly formatted and free of duplicates or inconsistencies.
• Data Organization & Storage: Store and maintain data in a well-structured file system or database.
• Automation & Maintenance: Set up and maintain cron-jobs or scheduling tools to automate data updates.
• Backup & Security: Regularly back up all collected data and ensure that it is secure and accessible.
• Collaboration & Reporting: Work closely with the AI team to understand data requirements for different projects.

Key Requirements:

• Technical Skills: Strong understanding of web scraping and API integration.
• Preferred Experience: Previous experience with large-scale data collection projects.
• Soft Skills: Ability to work independently and manage time efficiently.