Senior Big Data Developer

Location: McLean, VA


Job Description:

              Additional Notes:

Location: This position will require the candidate to be on-site in McLean following COVID
 

Technical Must Haves:  At minimum of 3 years of Spark, Python, Hadoop, and Hive. 
 

Soft Skill Must Haves: Excellent written communication and oral communication - 8/10 communication minimum. Excellent analytical skills.
 

Schedule: Standard 40 hours. No on call 

 

Senior Big Data Developer

Freddie Mac’s Single Family Division is currently seeking a Senior Big Data Developer to implement BigData tools and methods of data processing

and ingestion as a member of the Credit Analytics and Reporting team.

 

Responsibilities include:

  • Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform.
  • Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.
  • Manage and implement data processes (Data Quality reports)
  • Develop data profiling, deduping logic, matching logic for analysis
  • Programming Languages experience in Python, PySpark and Spark for data ingestion
  • Programming experience in BigData platform using Hadoop platform
  • Present ideas and recommendations on Hadoop and other technologies best use to management

 

Qualifications :

• 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs)

• 3+ years of programming experience in Hadoop, Spark, Python for data processing and analysis.

• Strong SQL experience is a must

• 3+ years of experience – using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work

• Detail oriented. Excellent communication skills (verbal and written)

• Must be able to manage multiple priorities and meet deadlines

• Degree in Statistics, Economics, Business, Mathematics, Computer Science or related field