Sr. Data Engineer (Nifi)

Location: McLean, VA


 Job Description
•    Responsible for delivery in the areas of: big data engineering mainly data acquisition technology implementations (Nifi & Kafka)
•    Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes ( Nifi/Kafka/ Storm)
•    Construct data staging layers and fast real-time systems 
•    Utilize expertise in models that leverage the newest data sources, technologies, and tools, such as machine learning, Python, Hadoop, Spark, AWS, as well as other cutting-edge tools and applications for Big Data
•    Investigate the impact of new technologies, applications, and data sources on the future secondary mortgage business
•    Demonstrated ability to quickly learn new tools and paradigms to deploy cutting edge solutions.
•    Develop both deployment architecture and scripts for automated system deployment in AWS
•    Create large scale deployments using newly researched methodologies.
•    Work in Agile environment
•    Experience mentoring junior engineers

Basic Qualifications
•    Bachelor’s degree in Mathematics, Statistics, Computer Science
•    4+ years of experience with Nifi & Kafka 
•    4+ years of experience with Hadoop including Hive and Spark
•    At least 3 years’ experience in Python & PySpark
•    At least 10+ years of overall experience in Java 

Preferred Qualifications
•    Master’s Degree in Computer Science
•    3+ years of experience working with AWS
•    2+ years of experience working with financial data
•    2+ years of experience with NoSQL databases
•    Strong communication skills, with the ability to work both independently and in project teams

Other Skills: Nifi - 4+ years