Senior Big Data Engineer

In ACL Tech we are seeking a highly skilled Senior Big Data Engineer to join our talented team!
Join our talented team and enjoy a market-competitive salary. You'll work alongside a passionate, professional team committed to delivering exceptional results. Don't miss the opportunity to work with our US client.
Job: Senior Big Data EngineerLocation: Latin America (Remote)
We provide USD Payment!
Job Summary:
As a Senior Big Data Engineer, collaborating with a prestigious international client serving diverse industries such as Health, Legal, and Automotive. If you're a self-reliant problem solver with excellent communication skills and a meticulous eye for detail, this role is tailored for you. 

Responsibilities

• Develop and execute ETL/ELT processes utilizing a range of tools and programming languages, including Scala and Python, to interface with MPP databases such as StarRocks, Vertica, and Snowflake.
• Take on the multifaceted role of a Data Engineer, encompassing not only development but also the maintenance and administration of our MPP ecosystem, optimizing hardware performance across OS, network, and storage layers.
• Collaborate with the Hadoop team to enhance the efficiency of Hive and Iceberg tables, conducting POCs to evaluate different table formats.
• Contribute to ongoing initiatives related to the Data Lake and Data Warehouse, leveraging technologies like Hive, Spark, Iceberg, and Presto/Trino to meet evolving business requirements and implement robust data models.

Requirements

• Bachelor's degree in Computer Science or a related field.
• Minimum of 2 years of hands-on experience with MPP databases (e.g., StarRocks, Vertica, Snowflake) and 5+ years of experience with RDBMS databases (e.g., Oracle, MSSQL, PostgreSQL).
• At least 2 years of experience managing or developing within the Hadoop ecosystem.
• Proficiency in programming languages such as Scala, Python, Java, or C/C++.
• Familiarity with Elasticsearch or ELK stack and streaming technologies like Kafka.
• Strong command of Linux distributions (e.g., RHEL, CentOS, Fedora) and expertise in shell scripting, scheduling, and monitoring processes.
• Experience working across OLAP and OLTP environments, with exposure to both on-prem and cloud environments.

Preferred Requirements

• Familiarity with data unification and setup using Presto/Trino.
• Experience with orchestration tools like Oozie and Airflow, as well as Spark technologies such as PySpark, SparkSQL, and Spark Streaming.
• Proficiency in ETL tools like Informatica, Talend, or Pentaho.
• Understanding of Healthcare data and a background in Data Analysis or Business Intelligence would be advantageous.

Explore a career with us, where innovation meets expertise. Join ACL's team of specialists and contribute to shaping the future of technology. For over 30 years, we have been providing the best of the best in Latam to Canada and the US, showcasing our experience and expertise in the field.
We are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
If you're interested in this exciting opportunity, please submit your resume soon. We're looking forward to hearing from you!
www.aclti.com#JoinACL #InnovativeSolutions #TechExpertise 🚀🌐