Data Engineer (hp)

About Us:

HP's Data and Analytics organization is seeking experienced Data Engineers to join our "Data Engineering for Data Science" team. As a forward-thinking and innovative organization, we are dedicated to harnessing data to drive impactful business decisions.

Role Description:

In this role, you will engage in some of the most exciting and cutting-edge projects in Data Engineering, AI/ML, and Generative AI within HP. The Data Engineer will be instrumental in designing and building robust data engineering solutions that support our AI/ML initiatives. You will collaborate closely with data scientists, data architects, and data product owners to develop these solutions.

We seek dynamic professionals with a strong foundation in computer programming, experience in large enterprise platforms, and a willingness to learn new technologies.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes using Python, SQL, Databricks and Azure Data Factory.
• Implement and optimize complex SQL queries and Python scripts for data processing.
• Develop and maintain data models and architecture to ensure high data quality and performance.
• Work closely with cross-functional teams to understand data requirements and provide technical solutions.
• Monitor, troubleshoot, and improve data pipelines to ensure data accuracy and reliability.
• Collaborate with teams across different time zones (Americas and Asia) to ensure seamless project execution and delivery.
• Stay up-to-date with the latest industry trends and technologies to continuously improve data engineering practices.

Qualifications:

• 4-6 years of experience as a Data Engineer or in a similar role.
• Strong proficiency in ETL, Data processing using Python programming and SQL.
• Extensive experience working in the Databricks environment.
• Solid understanding of Apache Spark and its applications in data processing.
• Proven experience in data warehousing, data modeling, data architecture, and building data pipelines.
• Hands-on experience with Azure Data Factory.
• Excellent problem-solving skills and the ability to troubleshoot data-related issues.
• Strong communication and collaboration skills to work effectively with global teams.
• A proactive mindset and willingness to learn new technologies and methodologies.
• Four-year or Graduate Degree in Computer Science, Software Engineering or any other related discipline or commensurate work experience or demonstrated competence.

Preferred Qualifications:

• Experience with cloud platforms such as Microsoft Azure.
• Familiarity with other big data technologies and tools.
• Understanding of data governance and security best practices.
• Knowledge of Agile and DevOps practices.
• Familiarity with latest AI/ML, Generative AI technologies

Why Join Us:

• Opportunity to work with cutting-edge technologies and tools.
• Collaborative and inclusive work environment.
• Professional growth and development opportunities.
• Competitive salary and benefits package.

Disclaimer:
This job description describes the general nature and level of work performed in this role. It is not intended to be an exhaustive list of all duties, skills, responsibilities, knowledge, etc. These may be subject to change and additional functions may be assigned as needed by management.