DurhamRecruiter Since 2001
the smart solution for Durham jobs

Senior Big Data Engineer

Company: Software Guidance & Assistance
Location: Durham
Posted on: February 16, 2020

Job Description:

Software Guidance & Assistance, Inc., (SGA), is searching for a Senior Big Data Engineer for a Contract assignment with one of our premier Financial Services clients in Raleigh, NC. Responsibilities: You'll work on a high impact and high visibility project that enables data availability, encompasses data analytics, machine learning, and petabyte scale datasets, and provides reliable and timely access to thousands of data sources. Design, architect and support new and existing data and ETL pipelines and recommend improvements and modifications. Create optimal data pipeline architecture and systems using Apache Airflow Assemble large, complex data sets that meet functional and non-functional business requirements. Be responsible for ingesting data into our data lake and providing frameworks and services for operating on that data including the use of Spark & Databricks. Analyze, debug and correct issues with data pipelines Operate on or build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Spark and Azure technologies. Required Skills: You have 8+ years of experience building high performance scalable enterprise analytics or data centric solutions Experience architecting Azure frameworks. Azure Cloud is their platform - Azure or AWS or Google Cloud OK Expertise building and managing python libraries You have at least 5 years of experience implementing complex ETL pipelines preferably in connection with Hadoop or Spark Experience working with Spark data pipeline and or streaming experience You have exceptional coding and design skills in Java/Scala or C#. You are an expert in Python, or can demonstrate your ability to readily learn new languages and your affinity for them. You understand the nature of distributed systems design. You have hands-on experience with Azure. You have a BS in Computer Science / Software Engineering or equivalent experience. You have a strong understanding & usage of algorithms and data structures. You work well in a team environment, and are a self-starter. You have the ability to lead, or have led teams before. Preferred Skills: Azure Data Lake experience Machine Learning expertise Experience with Apache Airflow Experience with C# .NET Core Experience with traditional data marts/warehouses SGA is a Certified Women's Business Enterprise (WBE) celebrating over thirty years of service to our national client base for both permanent placement and consulting opportunities. For consulting positions, we offer a variety of benefit options including but not limited to health & dental insurance, paid vacation, timely payment via direct deposit. SGA accepts transfers of H1 sponsorship for most contracting roles. We are unable to sponsor for Right-to-Hire, Fulltime, or Government roles. All parties authorized to work in the US are encouraged to apply for all roles. Only those authorized to work for government entities will be considered for government roles. Please inquire about our referral program if you would like to submit a candidate for any of our open or future job opportunities. SGA is an EEO employer. We encourage Veterans to apply. To view all of our available job postings and/or to learn more about SGA please visit us online at www.sgainc.com . - provided by Dice

Keywords: Software Guidance & Assistance, Durham , Senior Big Data Engineer, Engineering , Durham, North Carolina

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Other Engineering Jobs

Data Analytics Engineer - FVV
Description: SunIRef:Manu:title Data Analytics Engineer - FVV Volvo Group 2,512 reviews - Greensboro, NC 27409 Volvo Group 2,512 reviews Read what people are saying about working here. United States Position Description (more...)
Company: Volvo Group
Location: Greensboro
Posted on: 02/22/2020

Auto Body Technician
Description: OverviewBUSY SHOPS GREAT EARNINGS AND BENEFITS STATE OF THE ART TECHNOLOGY br br GERBER is adding accounts and searching for TOP NOTCH Body Technicians for our FAYETTEVILLE - RAEFORD RD body shop (more...)
Company: Gerber Collision & Glass
Location: Fayetteville
Posted on: 02/22/2020

Sr Information Cloud Security Engineer
Description: Q2 Solutions is a leading clinical trial laboratory services organization with end-to-end laboratory services and secure, enterprise-wide biospecimen and consent management solutions. With a relentless (more...)
Company: Q2 Solutions
Location: Durham
Posted on: 02/22/2020

Info Security Engineer 5
Description: Job DescriptionImportant Note: During the application process, ensure your contact information email and phone number is up to date and upload your current resume prior to submitting your application (more...)
Company: Wells Fargo Bank
Location: Raleigh
Posted on: 02/22/2020

Consulting Engineer - ACI
Description: Provide Planning, Designing, Implementation, Operation and Optimization services to Cisco Advanced Services Customers around Cisco s Data Center products and solutions. Participate in the preparation (more...)
Company: Cisco
Location: Raleigh
Posted on: 02/22/2020

Engineer, Technology Governance
Description: DescriptionAlign is the industry leader and innovator in medical devices which focuses on revolutionizing the dental and orthodontic industry. Align is looking for an Engineer, Technology Governance for (more...)
Company: Align Technology
Location: Raleigh
Posted on: 02/22/2020

Diesel Mechanic - Raleigh
Description: Join us as a Diesel Mechanic and discover why Brown does it better. Period. Earn 25-33 per hour depending upon experience/qualifications.Our
Company: Brown Trucking
Location: Raleigh
Posted on: 02/22/2020

Network Engineer - II
Description: Reference : 20-00416 Title : Network Engineer - II Location : Greensboro, NC Position Type : Contract Experience Level : Start Date / End Date : 03/02/2020 / 02/28/2021 Description Description: Join (more...)
Company: Crossfire Consulting
Location: Greensboro
Posted on: 02/22/2020

Process Engineer (Bottle Packaging) - OFP
Description: SunIRef:Manu:title Process Engineer Bottle Packaging - OFP Novo Nordisk 811 reviews - Durham, NC Novo Nordisk 811 reviews Read what people are saying about working here. Engineering Durham About the (more...)
Company: Novo Nordisk
Location: Durham
Posted on: 02/22/2020

Senior Business Intelligence Engineer
Description: At Red Hat, we connect an innovative community of customers, partners, and contributors to deliver an open source stack of trusted, high-performing solutions. We offer cloud, Linux, middleware, storage, (more...)
Company: Red Hat
Location: Raleigh
Posted on: 02/22/2020

Log In or Create An Account

Get the latest North Carolina jobs by following @recnetNC on Twitter!

Durham RSS job feeds