Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

NG5tZFg3WW1xWU1XbWxIRkJrV09qY1QwTVE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Johnson Security Bureau, Inc.

Airport Security Guard Job at Johnson Security Bureau, Inc.

 ...About ROC Airport: ROC serves over 2.6 million passengers annually and operates 21 gates with major carriers like JetBlue, Delta, United, Southwest, and more. The airport runs as an Origin & Destination facility, with peak activity during early morning departures and... 

Brainlab, Inc.

Biomedical Engineer (Regional Clinical Specialist) Job at Brainlab, Inc.

 ...product issues through detailed analysis and utilization of engineering expertise Direct and assist Radiology staff in performing...  ...including operating staff, Radiology, Central Sterile Processing, Biomedical and Information Technologies staff, on the use of IGS... 

Farm Job Search

Dairy Farm Assistant Manager Job at Farm Job Search

 ...Dairy Farm Assistant Manager (5911) Location: Nebraska JobNumber: 5911 Dairy Calf Farm Manager Position available on a modern 3500 to 4000 head calf operation, with new facility and equipment, located in south central Nebraska. Dairy calves arrive at the facility... 

NVS Transportation LLC

Class A Driver - Car Hauling Job Job at NVS Transportation LLC

Class A Driver - Car Hauling JobNVS Transports has a great opportunity for a Car Hauler driver to be part of our amazing team. Our main focus is on providing quality work, safety, and especially professional growth for all our employees.Come and join us!NVS Transportation... 

Red Robin

Host / Hostess Job at Red Robin

 ...deliver unprecedented service to Guests. NOW HIRING FULL TIME & PART TIME: Hosts / Hostesses If you are: A strong Team Player...  ...Organized with a great attention to detail At least 16 years old When you bring your great attitude and work ethic to Red Robin...