Required Skills & Qualifications
Palantir Foundry: Proven experience building data pipelines, managing datasets, and deploying applications within Foundry. Specifics required are as follows:
o Practical skills required to build and maintain production-grade data pipelines, data connections, and ontologies
o General knowledge of platform capabilities and specific applications within the Foundry suite that are useful for performing the job of data engineer
o DATA PIPELINE DEVELOPMENT IN FOUNDRY
Develop transforms on structured (tabular) and unstructured datasets in Foundry
Apply best practices when building data pipelines
o DATA PIPELINE MAINTENANCE IN FOUNDRY
Effectively investigate and fix common issues in data pipelines
Contribute to logic changes and performance improvements to transform pipelines feeding mission critical workflows
Familiarity with recommended support structures
o DATA CONNECTION AND INTEGRATION IN FOUNDRY
Familiarity with architecture and capabilities of Data Connection
Set up sources and syncs ingesting tabular data or raw files from external systems to Foundry
o ONTOLOGY DESIGN AND DEVELOPMENT IN FOUNDRY
Provide data engineering context during ontology design and implement pipelines backing ontology objects and links based on application requirements
Spark/Pyspark: Strong expertise in distributed data processing and transformation using Spark/Pyspark.
Python: Proficiency in Python for scripting, automation, and data wrangling tasks.
SQL: Advanced skills in writing efficient SQL queries for complex data manipulation and reporting.
Familiarity with data modeling, ETL processes, and best practices in data engineering.
Experience working with large and complex data sets from multiple sources.
Excellent problem-solving, communication, and collaboration skills.