DurhamRecruiter Since 2001
the smart solution for Durham jobs

Data Engineer

Company: TEKsystems, Inc
Location: Durham
Posted on: January 10, 2021

Job Description:

Description:---Good knowledge and Hands on Scala Programming ---Good skills on modular program development in Scala ---Data pipeline using Spark Scala---Load disparate data sets by leveraging Kafka consumers---Ability to utilize Hive, Spark, Cassandra, Mesos and Kafka---Experience with AWS components and services, particularly EMR, S3, and Lambda---Good understanding of file formats including JSON, Parquet, Avro, and others---Experience with open source NoSQL technologies such as Cassandra---Experience with messaging and complex event-processing systems such as Kafka and Storm---Extensive hands on Data frame and Dataset operations of Spark ---Basic Understanding of Bigdata Technologies and Hadoop ---Good knowledge on Hive and HiveQL ---Knowledge on Cassandra Architecture and CQL is desirable ---Build reusable code, with the ability to scale with very large data volumes ---Knowledge on Java Programming is desirable ---Data Migration/ETL knowledge is desirable---Expert knowledge of software development tools, practices, and lifecycle methodologies---Extensive experience with legacy and modern data warehouse concepts and implementations---Extensive experience with data integration concepts and implementations including ETL, ELT, CDC, streaming, pub/sub---Able to produce high quality design documentation and provide thorough reviews of design documentation produced by others Ability to establish and maintain effective working relationships with co-workers, managers and clients ---Flexibility, ability to simultaneously juggle multiple complex projects and adapt to rapidly changing prioritiesSkills:Scala, Spark, Hive, Impala, Kafka, DAISS, hadoopTop Skills Details:1) 3+ years of using spark 2) 1+ years of scala and have used it in the past 2 years. 7+ years of software development overall required.3) Currently working with kafka and has ability to describe working with dynamic data as opposed to static data.Additional Skills & Qualifications:Data engineering candidates are accepted. Looking for candidates who have worked with Dynamic data as opposed to static data , can easily describe the difference and tell when they have done such. We are not looking for people who simply process batch data.Experience Level:Mid-LevelAbout TEKsystems:We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company. The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

Keywords: TEKsystems, Inc, Durham , Data Engineer, Engineering , Durham, North Carolina

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Other Engineering Jobs

12N Horizontal Construction Engineers
Description: AGE REQUIREMENTS: Must be between the ages of 17 and 35 br br Before a road, airfield, or a building can be constructed, all obstacles must be removed from the site. As a Horizontal Construction Engineer (more...)
Company: Army National Guard
Location: Butner
Posted on: 01/16/2021

Big Data Engineer
Description: Hello, We have a consulting firm that we are working with exclusively for their managed and professional services team at a major bank. They are looking for a Senior Data Engineer that has experience (more...)
Company: FRG Technology Consulting
Location: Raleigh
Posted on: 01/16/2021

Mac Tools Seeking Mechanics - Technicians - Training Provided
Description: Build a Great Career and a Quality Life with Mac Tools. br br Feel the freedom and independence of working on your own, in a stress free environment - with no one to answer to, except yourself Join (more...)
Company: Mac Tools
Location: Louisburg
Posted on: 01/16/2021

Principal IT Modern Workplace Engineer
Description: Parexel is hiring a Principal IT Modern Workplace Engineer in Durham, NC to work closely with other IT Management and technical staff to promote, evaluate and test modern workplace solutions. This Engineer (more...)
Company: PAREXEL
Location: Hurdle Mills
Posted on: 01/16/2021

Shop & Mobile Tractor Trailer Mechanic
Description: br br br br Shop Mobile Tractor Trailer Mechanic Call 844 301-7081 for more details br The Tractor Trailer Mechanic is responsible for diagnosing and repairing medium to heavy-duty trucks (more...)
Company: Brown Fleet Services
Location: Wake Forest
Posted on: 01/16/2021

Chief Building Engineer
Description: Nature Scope The Chief Building Engineer provides and manages day to day maintenance services throughout all facilities managed by the organization. This position is also responsible for providing leadership (more...)
Company: Veritas Collaborative
Location: Raleigh
Posted on: 01/16/2021

Diesel Mechanic - Truck Care
Description: Req ID: 196202 Address: 1850 North Mecklenburg Ave South Hill , VA , 23970 Welcome to Love's Where People are the Heart of Our Success Diesel Mechanic At Love's, our values go beyond our name. We look (more...)
Company: Loves Travel Stops & Country Store
Location: South Hill
Posted on: 01/16/2021

Diesel Mechanic - Flextech - Pick Your assignments! - Kenly, NC
Description: Cummins FlexTech Do you want to be in command, working when you want and on assignments you choose If so, Cummins FlexTech might be right for you. Cummins FlexTech is designed to connect technicians (more...)
Company: Cummins Inc.
Location: Butner
Posted on: 01/16/2021

Reliability Maintainability and Safety (RMS) Engineering Intern (Summer 2021)
Description: Date Posted:2020-08-10-07:00Country:United States of AmericaLocation:HNC14: Kidde Aerospace - Raleigh 3120 Highwoods Blvd, Suite 300, Raleigh, NC, 27604 USAOur Avionics team advances aviation electronics (more...)
Company: Raytheon Technologies
Location: Raleigh
Posted on: 01/16/2021

Senior Roadway Engineer
Description: DescriptionArcadis seeks a Senior Roadway Engineer to join our Infrastructure Business Line to work on infrastructure projects for roadways, including intersections, collector streets, urban arterials, (more...)
Company: Arcadis
Location: Raleigh
Posted on: 01/16/2021

Log In or Create An Account

Get the latest North Carolina jobs by following @recnetNC on Twitter!

Durham RSS job feeds