Lead - Data Engineer - Hadoop, HDFS, Spark, Python; (mastercard)

Job Description

Our Purpose

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Title and Summary

Lead - Data Engineer - Hadoop, HDFS, Spark, Python;

Overview
We are the global technology company behind the world’s fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless®. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities.

Our team within Mastercard – Data & Services:
The Data & Services team is a key differentiator for Mastercard, providing the cutting-edge services that are used by some of the world's largest organizations to make multi-million dollar decisions and grow their businesses. Focused on thinking big and scaling fast around the globe, this agile team is responsible for end-to-end solutions for a diverse global customer base. Centered on data-driven technologies and innovation, these services include payments-focused consulting, loyalty and marketing programs, business Test & Learn experimentation, and data-driven information and risk management services.

Advance Analytics Program:
Within the D&S Technology Team, the Advance Analytics program is a program that is comprised of a rich set of products that provide accurate perspectives on Portfolio Optimization, Acquire Optimizer, Test & Learn, Credit Risk, and Ad Insights. Currently, we are enhancing our customer experience with new user interfaces, moving to API-based data publishing to allow for seamless integration in other Mastercard products and externally, utilizing new data sets and algorithms to further analytic capabilities, and generating scalable big data processes.

Position Responsibilities:
We are looking for an experienced and innovative Software - Data Engineering Lead to design and develop AI/ML , Big Data solutions as Paas Platform.
As a Lead Data Engineer Software Engineer, you will:
• Lead the scoping, design and implementation of complex features
• Lead and push the boundaries of analytics and powerful, scalable applications
• Design and implement intuitive, responsive UIs that allow Customers to better understand data and analytics
• Build and maintain analytics and data models to enable performant and scalable products
• Ensure a high-quality code base by writing and reviewing performant, well-tested code
• Drive innovative improvements to team development processes
• Partner with Product Managers and Customer Experience Designers to develop a deep understanding of users and use cases and apply that knowledge to scoping and building new modules and features
• Collaborate across teams with exceptional peers who are passionate about what they do

Ideal Candidate Qualifications:
• 10+ years of full stack engineering experience in an agile production environment
• Experience leading the design and implementation of large, complex features in full-stack applications
• Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it
• Experience leveraging open source tools, predictive analytics, machine learning, Advanced Statistics, and other data techniques to perform analyses
• High proficiency in using Python and/or Scala, Spark, Hadoop platforms & tools (Hive, Impala, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
• Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting
• Experience coaching and mentoring junior teammates
• Experience leading a large technical effort that spans multiple people and teams
• Proficiency with Java/Spring Boot, and / or .NET/C# and SQL Server, front-end frameworks, and/or relational database technologies
• Good to have understanding of React, Redux, Typescript
• Strong technologist with proven track record of learning new technologies and frameworks
• Customer-centric development approach
• Passion for analytical / quantitative problem solving
• Experience identifying and implementing technical improvements to development processes
• Collaboration skills with experience working with people across roles and geographies
• Motivation, creativity, self-direction, and desire to thrive on small project teams
• Superior academic record with a degree in Computer Science or related technical field
• Strong written and verbal English communication skills
 

Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

• Abide by Mastercard’s security policies and practices;

• Ensure the confidentiality and integrity of the information being accessed;

• Report any suspected information security violation or breach, and

• Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.