Senior Data Engineer

8 Job Postings

2024-09-19 - 2025-09-19
Responsibility Job Growth Skills Requirement Skills Distribution Statistics

Responsibility

The common responsibilities for this position include scraping large-scale data from the internet for training and optimizing foundational models, performing large-scale cleaning of external data, and building and maintaining automated data update pipelines. The role involves collaborating with the algorithm team to understand requirements, handling internally generated data, and processing data from external sources using data warehousing techniques. Additionally, the position entails the development, implementation, and ongoing support of data-driven solutions, as well as collaborating with teams to implement advanced analytics solutions. Responsibilities also include leveraging generative AI technologies, integrating with third-party APIs, and following best practices in data architecture and processing. The role requires driving the development of new data platform initiatives, conducting proof-of-concept testing, and collaborating with stakeholders for data preparation and cleansing. Furthermore, the position involves building models to measure and leverage data insights, designing Service Platform Architecture, and engaging in strategic planning and execution while aligning IT architecture with business goals.

Job Growth

Loading...

Skills Requirement

The percentages next to each skill reflect the sector’s demands in these respective skills. E.g., 30% means this skill has been listed in 30% of all the job postings in this sector.

Loading...
Loading...

Skills Distribution

The skills distribution tells you what specific skill sets are in demand. E.g., Skills with a distribution of “More than 50%” means that these skills are wanted in more than 50% of the job postings.

N/A
ChineseEnglish
SparkData AnalyticsData MiningAzureAmazon Web ServicesQlikTableauPower BIHadoopFinancial KnowledgePython
JavaScriptJavaProblem-solvingCommunicationSQLHTMLNode.jsCloud TechnologiesHTMLPrototypeDatabasesETLGoogle Cloud

Statistics

Job classifications that have advertised a position

Loading...

Academic degree required as indicated by all job postings

Loading...

Job subclassifications that have advertised a position

Loading...