The Senior Data Engineer role involves building and delivering data assets and solutions, coordinating with other teams to manage and prioritize projects, and driving the strategy, roadmap, and execution of key data engineering initiatives. The role requires understanding and translating business needs into data solutions, creating robust data pipelines, and developing and maintaining data assets. It also involves implementing and maintaining CI/CD pipelines for data solutions. The candidate should be able to define and manage data load procedures, implement data strategies, and ensure robust operational data management systems. Collaborating with stakeholders across the organization to understand their data needs and deliver solutions is also a key part of this role. The ideal candidate will be proficient in big data tools and technologies including Hadoop, Hive, and Spark, Python, SQL, and have strong analytical skills related to working with structured and unstructured datasets.

This position is based in Visa's offices in Bangalore, India, and presents an excellent opportunity for those looking to make a significant impact in the field of Data Engineering.

Essential Functions:

Experience in Requirement Gathering, Estimating, Managing large scale Data Engineering Projects.
Requirement Analysis: Understand and translate business needs into data models supporting long-term solutions.
Data Modeling: Work with the Business team to implement data strategies, build data flows and develop conceptual data models.
Data Pipeline Design: Create robust and scalable data pipelines and data products in a variety of domains.
Data Integration: Develop and maintain data lakes by acquiring data from primary and secondary sources and build scripts that will make our data evaluation process more flexible or scalable across data sets.
Testing: Define and manage the data load procedures to reject or discard datasets or data points that do not meet the defined business rules and quality thresholds.
Deployment: Implement data strategies and develop physical data models, along with the development teams, data analyst teams and information system team to ensure robust operational data management systems.
Understanding of and ability to Implement Data Engineering principles and best practices.
Coordinate with other teams to manage and prioritize projects. Drive strategy, roadmap, and execution of key data engineering initiatives.
Stakeholder Management: Collaborate with stakeholders across the organization to understand their data needs and deliver solutions.
Continuous Integration and Continuous Deployment (CI/CD): Implement and maintain CI/CD pipelines for data solutions, ensuring rapid, reliable, and streamlined updates to the data environment.

This is a hybrid position. Expectation of days in the office will be confirmed by your Hiring Manager.