Big Data Engineer

Company: FRG Technology Consulting
Location: Raleigh
Posted on: January 14, 2021

Job Description:

Hello, We have a consulting firm that we are working with exclusively for their managed and professional services team at a major bank. They are looking for a Senior Data Engineer that has experience in Big Data.Please let me know if you're available by sending your resume and the best time to reach you.12 month Contract - RemotePossible permanent employee conversion at the end of the contract.Big Data Engineer Ideal Candidate* The ideal candidate will come with hands-on experience as a Data Engineer with experience in Big Data technologies who will interact with Business users to get the requirements and translate the same into technical specs. This person will have a proven track record of delivering successful technology solutions to business clients in financial services.Requirements* 8-12 years of experience in a Data Engineer role with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field. * In-depth knowledge of Big Data technologies - Spark, HDFS, Hive, Kudu, Impala* Solid programming experience in Python, Java, Scala, or another statically typed programming languageProduction experience in core Hadoop technologies including HDFS, Hive, and YARN* Strong working knowledge of SQL and the ability to write, debug and optimize distributed SQL queries* Having advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases including NoSQL.* Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.* Having experience building and optimizing 'big data' data pipelines, architectures, and data sets.* Build processes supporting data transformation, data structures, metadata, dependency, and workload management.* Excellent attention to detail and communication/presentation skills* Experience in working in a highly collaborative environment with a heavy emphasis on teamwork* Experience in working in Agile scrum methodology* Experience working through all phases of SDLC including Project Management, Business Analysis, Data Analysis, Architecture Design, Development, Testing and Implementation* Having strong project management and organizational skills.* Proficient in process modeling, business process flow, and data flow diagrams * Extensive experience working in a data warehouse environment.* Excellent understanding of data warehouse concepts, data marts, Extraction Transformation and Loading (ETL), Autosys, feed processing, batch processing, and data modeling - ER diagrams, RDBMS* Expert in SQL for data analysis, data integrity, data accuracy, data mining, and data mapping across various database platforms like Oracle and SQL Server* Proficient in System integration testing (SIT), Functional Testing, and User Acceptance Testing (UAT).Good to have an understanding of various financial products like Repos, Stock Loan and Borrows (SLB), Fixed Income, Credit Derivatives, Swaps, Futures, Options, and Cash SecuritiesJob Requirements:Spark, HDFS, Hive, Kudu, ImpalaSDL2017

Keywords: FRG Technology Consulting, Raleigh , Big Data Engineer, Engineering , Raleigh, North Carolina