Summary
In this role you will be responsible for connecting with multiple stakeholders, developing new DQ pipelines in Ataccama, migration of legacy DQ jobs in Ataccama.
About the Role
Major Accountabilities
- Drive planning, design, development and delivery of system solutions for a specific business or technology area, in alignment with design and architectural standards and business requirements.
- Support scoping, fit-gap workshops for projects/enhancements, propose solutions for key gaps, provide effort estimations and alignment with business teams.
- Good understanding on Data Quality concepts and end to end implementation of Data Quality life cycle. Proficiency in Data Base concepts, writing complex SQL queries and performance tuning. Experience in developing products and understanding of product management philosophy.
- Fair knowledge of DQ in Big Data space with good understanding of cloud computing and Data Lake, especially AWS tech stack (S3, Snowflake, Databricks, Glue Data Catalog, Unity Data Catalog etc.,).
- Experience to work on AWS data lakes to store and process both structured and unstructured data sets. Good understanding of larger data management and data governance space will be an added advantage. Ensure that project/enhancements work is delivered to agreed time, cost and quality constraints following the release calendars.
- Create robust data engineering pipelines using Python, Databricks, Spark to ingest, process, and transform data, ensuring it is ready for analytics and reporting. Be proficient in writing scripting or programming language to handle large volume of data processing. Adopt DevOps methodologies and tools for continuous integration and deployment (CI/CD) and automate to enhance data engineering processes.
- Take complete accountability and ownership of large data quality projects with limited guidance. Contribute to development of best practices for Data Engineering and Data Quality space.
- Provide guidance and mentorship juniors and team members by sharing best practices and knowledge. Ensure adherence to stringent Data Security and Access Control policies of Novartis while deploying and delivering a data quality solution. Ability to work in Agile develop methodology.
Minimum Requirements
- Bachelor's degree or related field 15+ years exp
- Exposure to software engineering principles and hands on experience in Ataccama, DQ tools, Databricks, Python, Spark, Pyspark and DevOps tools.
- Excellent problem solving, communication, and organizational skills.
- Advanced SQL skills and experience with relational Database concepts and performance tuning.
- Strong understanding of Data Integration patterns, Data Modelling and Visualization concepts.
- Proficiency in at least one programming language, such as JAVA, Python, Spark, PySpark.
- Experience with cloud platforms such as AWS or Azure, Docker & Kubernetes.
Why consider Novartis?
Our purpose is to reimagine medicine to improve and extend people’s lives and our vision is to become the most valued and trusted medicines company in the world. How can we achieve this? With our people. It is our associates that drive us each day to reach our ambitions. Be a part of this mission and join us!
Learn more here:
https://www.novartis.com/about/strategy/people-and-culture
Commitment to Diversity and Inclusion:
Novartis is committed to building an outstanding, inclusive work environment and diverse teams' representative of the patients and communities we serve.
Join our Novartis Network: If this role is not suitable to your experience or career goals but you wish to stay connected to hear more about Novartis and our career opportunities, join the Novartis Network here:
https://talentnetwork.novartis.com/network
Why Novartis: Helping people with disease and their families takes more than innovative science. It takes a community of smart, passionate people like you. Collaborating, supporting and inspiring each other. Combining to achieve breakthroughs that change patients’ lives. Ready to create a brighter future together? https://www.novartis.com/about/strategy/people-and-culture
Join our Novartis Network: Not the right Novartis role for you? Sign up to our talent community to stay connected and learn about suitable career opportunities as soon as they come up: https://talentnetwork.novartis.com/network
Benefits and Rewards: Read our handbook to learn about all the ways we’ll help you thrive personally and professionally: https://www.novartis.com/careers/benefits-rewards
