RaleighRecruiter Since 2001
the smart solution for Raleigh jobs

Data Pipeline Developer

Company: Connvertex Technologies Inc.
Location: Raleigh
Posted on: October 17, 2020

Job Description:

Connvertex is seeking a Data Pipeline Developer with our direct client. (BIDP) solution. The position has accountability around providing technical expertise to ensure the quality and accuracy of that data, then process, design and present it in ways to help those leveraging the BIDP. The ETL Developer is responsible for Working with Data Architects, Analysts, and Scientist to aid in BIDP data pipeline efforts Configure ingestion and format validation of the new workstreams Verify initial and incremental data uploads and maintain the workstreams Implement data pipeline-based technologies within and associated with the BIDP environment Preform data pipeline testing Conducting data pipeline optimization, troubleshooting and debugging, report regularly on health and performance of jobs Maintain ownership of release activities interacting with pipeline projects Support and improve data pipeline automation Assist in discovering, evaluating, and qualifying new technologies around BIDP data pipeline functions Partner with BIDP stakeholders to establish and maintain policies, procedures, operational standards around the data pipeline functions Help business in leveraging the BIDP through the data pipeline process 15 Preform data pipeline process management and lifecycle support by outlining the process and setting the boundaries for data consumption and processing within the BIDP. Provide architecture and data flows for the data pipelines. Document the requirements of the data pipeline process, and tools, and manage its development. Work with stakeholder in the development and maintenance of all data pipeline-based documentation. Take part in the development and implementation of data consumption tools within the BIDP environment. Ensure that data pipelines comply with all regulatory standards. Prepare and report on activities and utilization around data pipelines. 65 Develop data pipelines, processes and designs for data being consumed within the BIDP. Identify trends and opportunities for growth through analysis of complex data sets. Evaluate methods and provide source-to-target mappings and information-model specification documents for data sets. Work directly with stakeholders to gather requirements for data pipelines for the BIDP. Work closely with business understand and maintain focus on their analytical needs, including identifying critical metrics and KPIs, and deliver actionable insights to relevant stakeholders. Define and implement data acquisition and integration logic, selecting appropriate combination of methods and tools within defined technology stack to ensure optimal scalability and performance of the solution 20 Conduct testing of tools and data pipelines. Perform root cause analysis on all processes and resolve all production issues and validate all data and perform routine tests on data sets and provide support to all data pipeline connections. Document all test procedures for BIDP data pipeline tools and processes, and coordinate with stakeholders and exchange partners to resolve issues and maintain quality. Competencies, Knowledge, Skills and Abilities Required in this Position Strong knowledge and hands-on experience with data pipeline tools Experience in data modeling Knowledge of compliance frameworks PCI, SOX, SOC 2, ISO 27001 and the ability to apply their requirements and concepts to a complex environment Experience in supporting a data warehouse in identifying and revising reporting requirements Knowledge and hands-on expertise with processing confidential data and information according to guidelines Strong interpersonal communication and ability to solve complex problems Hands-on experiences with databases e.g., SQL, MYSQL, Oracle, Redshift (preferred), etc. Experience in model design, segmentation techniques, and ETL Frameworks Knowledge and understanding of micro-services architecture Strong analytic skills, including mining, evaluation, analysis, and visualization AWS, Azure or Google Cloud Platform background (preferably all three) Experience with enterprise level cloud-based development, deployment, and auditing, including PAAS, IAAS, and SAAS. (preferred) Proficiency in scripting languages e.g., XML, JavaScript, etc. Education and Experience Required Bachelor's degree in Computer Science, Computer Information Systems, Computer Engineering, Or other related technical degree from an appropriately accredited institution and 3 years of progressive expertise as a data analystscientist Or bachelor's degree from an appropriately accredited institution and eight years progressive experience in the field of information technology or an equivalent combination of education and experience. Connvertex is a trusted System Integration Partner for providing innovative mobility, system integration and modernization solutions to global clients in Health Human Services, Child Welfare, Healthcare Workforce Services. Connvertex has a decade-long history in IT Professional Service industry servicing several clients across U.S. We bridge the IT talent demand-supply gap through an innovative, best-in-class recruiting engine, backed by a dedicated client-centric service focus. Thanks and Regards, Piyush Kharpate

Keywords: Connvertex Technologies Inc., Raleigh , Data Pipeline Developer, IT / Software / Systems , Raleigh, North Carolina

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other IT / Software / Systems Jobs


McAfee Security Specialist (Job #5590)
Description: SLAIT Consulting is currently seeking a McAfee Security Specialist for a client in the Raleigh, NC area. br br Customer Comments: br bull Contract position is open for a candidate
Company:
Location: Raleigh
Posted on: 10/22/2020

Entry Level Software Engineer
Description: Job DescriptionAs a leader in recruiting emerging technology talent across the country, Revature is looking forward to hiring over 300 new Entry Level Software Engineers in the next 4 weeks. One day someone (more...)
Company: Revature
Location: Durham
Posted on: 10/24/2020

Junior CSS/HTML Developer
Description: Job DescriptionAre you ready to get hired in the next 4 weeks Revature is the fastest growing employer of emerging tech talent and has over 300 new Junior CSS/HTML Developer positions available. One (more...)
Company: Revature
Location: Greenville
Posted on: 10/24/2020


Entry Level Software Developer
Description: Job DescriptionRevature is the fastest growing employer of emerging technology talent. We will hire over 300 Entry Level Software Developers across the country in the next 4 weeks. One day someone is (more...)
Company: Revature
Location: Jacksonville
Posted on: 10/24/2020

25B Information Technology Specialist
Description: AGE REQUIREMENTS: Must be between the ages of 17 and 35 br br If you've ever considered a job in IT, become an Information Technology Specialist in the Army National Guard and expand your skills and (more...)
Company: Army National Guard
Location: Durham
Posted on: 10/24/2020

Mobile Medicine Nurse Practitioner or Physician Assistant - Raleigh, NC
Description: Correctional Medicine opening in Raleigh, North Carolina. This and other nurse practitioner jobs brought to you by NursingJobCafe.com Fast growing medical group
Company: Northeast Healthcare Recruitment, Inc.
Location: Raleigh
Posted on: 10/24/2020

SOP Writer - Up to $45K
Description: Immediate need for a SOP Writer br br Solid written and oral communication skills. Strong interpersonal skills Proven ability to handle multiple priorities and tasks. Must have familiarity
Company:
Location: Raleigh
Posted on: 10/22/2020

Technical Lead Analyst, Supply Chain Systems
Description: br br Logistics done differently.Are you ready to take your career to the next level with a rapidly growing global company Transport Topics ranked XPO Logistics 1 in North America, and Forbes named (more...)
Company: XPO Logistics
Location: High Point
Posted on: 10/24/2020

Software Developer
Description: Type of Requisition:RegularClearance Level Must Currently Possess:OtherClearance Level Must Be Able to Obtain:NoneSuitability:Agency SpecificPublic Trust/Other Required:OtherJob Family:Software DevelopmentJob (more...)
Company: General Dynamics Information Technology
Location: Durham
Posted on: 10/24/2020

Field Support Technician
Description: SmartSource is looking for a Field Support Technician for a 4 week opportunity in Raleigh, NC. br br br br Job Type: Contract br br Duration: 4 weeks br br Location: Raleigh, NC (more...)
Company:
Location: Raleigh
Posted on: 10/22/2020

Log In or Create An Account

Get the latest North Carolina jobs by following @recnetNC on Twitter!

Raleigh RSS job feeds