DurhamRecruiter
the smart solution for Durham jobs

Data Engineer

Company: Digital Intelligence Systems, LLC
Location: Durham
Posted on: May 19, 2019

Job Description:

Data Engineer 9-12 months role Durham, North Carolina 27703 Role We are looking for senior software engineers with expertise in data integration and hands on experience in enterprise Hadoop based environments (specifically in AWS Elastic Map Reduce) to help design and build a new platform to ingest data from a variety of backend sources, transform, analyze, and expose views of the data to reporting and visualization tools such as Tableau. Responsibilities The primary focus will be working with architects and other developers to design develop and deploy the new platform to support reporting analytic needs. However, the work will include an element of data architecture and governance, for example finding ways to understand data lineage, suitable methods to catalog each attribute defined in the system, documenting its meaning. Lastly, the role will involve an element of initial support and operational handover, especially during the first release. Role Requirements Hands on design and development Ability to work independently or in small teams to design and implement Hadoop based data extraction, transformation processing for load presentation into visualization reporting tools The solution will ingest data from traditional databases data warehouses (predominantly Oracle), flat files, web services, MongoDb sources process transform and augment the data structuring it into views suitable for integration with visualization and reporting tools (e.g. Tableau, OBIEE) Knowledge and experience of the tools, frameworks and language platforms relevant to the components. tools and techniques relating to Hadoop implementations, e.g. Hadoop, HDFS, Sqoop, Spark, Presto Notebook platforms Scala, Python or Java (and specifics of integration with the Hadoop libraries components) Amazon Web Services Elastic Map Reduce architecture and operation Additionally, experience and knowledge of key data integration points as well as technologies present in the broader environment is strongly desired Oracle, SQL, Mongo DB RHEL Linux, basic shell scripting, operating AWS instances and environments ETL (Informatica) and data warehouse design Public hybrid Cloud platforms and practices (ideally AWS) An understanding of client reporting tools (Tableau, Oracle OBIEE) Java JEE Web services (REST, JSON, HTTP) CRM . Salesforce DevOps and deployment models Data integration architecture An understanding of data architecture and how to design and implement suitable systems to track and document data entities attributes An understanding of data integration patterns and approaches Understanding of security patterns and practices relevant to data storage and integration Working with business and technology teams Strong communication and collaboration skills Ability to communicate effectively with a mix of people technical non-technical A self-starter who can lead and take ownership Experience in agile environments used to iterative delivery Flexible and able to work across a mix of modern and legacy systems

Keywords: Digital Intelligence Systems, LLC, Durham , Data Engineer, Engineering , Durham, North Carolina

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


Temp Undergrad Lab/Greenhouse Technician
Description: Position Details Position Information Vacancy Type Temporary Is Internal Transfer Only No Working Title Temp Undergrad Lab/Greenhouse Technician Salary Range Anticipated Hiring Range 10/hr Position Number (more...)
Company: NC State University
Location: Raleigh
Posted on: 05/19/2019

Automotive Mechanic
Description: MV Transportation is seeking experienced A, B, and C Level Automotive Mechanics. Successful candidates will perform preventative maintenance, diagnosis, service and repair of steering, suspension, brakes, (more...)
Company: MV Transportation
Location: Raleigh
Posted on: 05/20/2019

Data Engineer
Description: Data Engineer 9-12 months role Durham, North Carolina 27703 Role We are looking for senior software engineers with expertise in data integration and hands on experience in enterprise Hadoop based environments (more...)
Company: Digital Intelligence Systems, LLC
Location: Durham
Posted on: 05/19/2019


QA Engineer
Description: HCL is a next-generation global technology company that helps enterprises reimagine their businesses for the digital age. Our technology products, services and engineering are built on four decades of (more...)
Company: HCL America Inc.
Location: Raleigh
Posted on: 05/19/2019

Lead Platform Integrations Engineer
Description: Map My Customers is looking for an analytical, results-driven platform integrations engineer who will be responsible for building enterprise-level integrations between Map My Customers and CRM platforms (more...)
Company: Map My Customers
Location: Raleigh
Posted on: 05/20/2019

Cloud Engineer - Azure/Automation
Description: Strong Python Development Skills: Candidates must
Company: Eateam
Location: Durham
Posted on: 05/19/2019

Technician Trainee
Description: Position Description Are you looking for an excellent place to work that offers great pay, benefits and incentives Do you want to work on new trucks using state of the art tools Do you want a rewarding (more...)
Company: Ryder.
Location: Winston Salem
Posted on: 05/20/2019

Principal Engineer- Converged Infrastructure
Description: Principal Engineer- Converged Infrastructure Job Location: Cary, NC Role Value Proposition: This Principal Engineer will use their unique experience in Data Center and Cloud technologies to complete the (more...)
Company: Met Life
Location: Cary
Posted on: 05/20/2019

Intern - Civil Engineering (Durham, NC)
Description: Kimley-Horn, one of Fortune Magazine s 100 Best Companies to Work For, is looking for a Civil Engineering student to join our Durham, NC team for a summer internship.As an intern, you will perform a variety (more...)
Company: Kimley Horn and Associates, Inc
Location: Durham
Posted on: 05/20/2019

Manufacturing Mechanic - Interior Fabrication
Description: Overview br br APPRENTICE LEVEL:The Mfg Apprentice IF is an entry level position that to be utilized as a training role for inexperienced employees hired to learn the Interior Fabrication craft. (more...)
Company: HAECO Americas
Location: Greensboro
Posted on: 05/20/2019

Log In or Create An Account

Get the latest North Carolina jobs by following @recnetNC on Twitter!

Durham RSS job feeds