#careersContent #searchButtonIndicator { display: none !important; height: 0 !important; }
back Back to Jobs

Big Data Engineer with experience developing DB schemas, creating ETLs, and familiar with Hadoop/MPP systems.

Location: San Diego, CA
Job # 10086581
Role: Big Data Engineer with experience developing DB schemas, creating ETLs, and familiar with Hadoop/MPP systems.
Location: San Diego, CA
Duration: 18+ Months
 
Responsibilities
 
  • Gathering functional requirements, developing technical specifications, and project & test planning.
  • Helps to align to overall strategies and reconcile competing priorities across organization.
  • Designing/developing schema definitions.
  • Act in a technical leadership capacity: Mentoring junior engineers, new team members, and applying technical expertise to challenging data and design problems.
  • Designing/developing ETL jobs across multiple platforms and tools including Hadoop, Vertica,
  • Roughly 70-80% hands-on coding.
  • Resolve defects/bugs during QA testing, pre-production, production, and post-release patches.
  • Work cross-functionally with various Intuit teams: Product Management, Project Management, Data Architects, Data Scientists, Data Analysts, Software Engineers, and other Data Engineers.
  • Contribute to the design and architecture of project across the data landscape.
  • Experience with Agile Development, SCRUM, or Extreme Programming methodologies.
 
Must Have Skills
 
  • BS/MS in computer science or equivalent work experience.
  • 5-8 years’ experience developing DB schemas, creating ETLs, and familiar with Hadoop/MPP systems.
  • Strong experience in one of the Columnar and MPP database (Vertica, Teradata, Netezza, etc.) is a must have
  • Advanced experience in writing complex SQL, ETL batch processes, SQL tuning is a must have
  • Hands on experience with Hadoop stack of technologies – Hive, Pig, pig-udf
  • Advanced experience with scripting language – Python or Shell is a must have
  • Experience with Amazon web services: EC2, S3, and EMR (Elastic Map Reduce) or equivalent cloud computing approaches
  • Strong expertise in Data Warehousing and analytic architecture
  • Experience working with large data volumes
  • The ability to get code in to production
  • Be a part of fast moving development teams using agile methodologies
  • A pro-active go get it attitude
  • Requirement gathering and good communication skills
Kind regards,
Raju
510.795.4800 X 159  
http://etouch.catsone.com/careers/ 
View my profile on LinkedIn
this job portal is powered by CATS