Data QA

Job Description

Key Responsibilities

• Strong Pyspark, Databricks and SQL skills, with experience in at least one tool (dbt-core, soda-core, greatexpectations)
• Ability to write complex queries for data validation and reconciliation
• Understanding of relational semantic model design, ETL processes, AWS / Azure cloud and data modeling concepts
• Experience testing data products or platforms built on Microsoft fabric and/or Databricks
• Familiarity with testing concepts such as QA, UAT, regression, EDA, and post-production deployment testing
• Ability to work with datasets of varying complexity, volume, and sensitivity
• High attention to detail and ability to detect inconsistencies or inaccuracies in data

Requirements

• 5-7 years of experience
• Pyspark: 6 years (Preferred)
• Databricks: 6 years (Preferred)
• Azure / AWS: 5 years (Preferred)
• SQL: 5 years (Preferred)
• ETL: 5 years (Preferred)
• Work Location: Remote