Duties: Responsible for the technical leadership for data ingestion and processing engagements. Support all our businesses across product, sales, leadership, and marketing teams. Adept at architecting and implementing data-driven cloud-based solutions. Work with a wide range of stakeholders and functional teams. Implement enterprise solutions, in a cloud environment, using a vast range of data engineering and cloud technologies. Work on tasks independently and seek guidance from leaders as needed. Help design and build multiple critical components on more complex data projects. Serve as a critical resource for medium-large teams. Deliver ETL pipelines while coordinating with other ETL engineers onshore and offshore. Design documentation, test cases/tests ensuring reliability and mitigation strategy. Work on shared ownership of teams’ agenda and goals while implementing required governance, monitors health. 100% telecommuting position. Will consider applicants resident in the U.S.
Requirements: Requires a Bachelor’s degree or foreign equivalent in Computer Science, Computer Engineering, Information Technology, or a closely related field, and five (5) years of experience in a Software Development role or related position.
Experience must include: Big data Tools: Spark, hdfs, Sqoop, hive, Impala, Oozie, Flume, Kafka, Streamset, DMXSynch Sort, Splunk, Python (Numpy, Pandas, matplotlib, scikitlearn), Denodo(data virtualization), RProgramming; Cloud Technology: AWS, Azure, Databricks, and Snowflake; RDBMS: Teradata, Oracle, DB2, SQL Server; Scripting & Automation: Unix Shell Scripting and PL/SQL; Job Scheduling tools: CONTROLM, CIS Task Scheduler, IBM Tivoli Workstation.