Position Overview
We are seeking an experienced Data Engineer to design, develop, and optimize enterprise-scale data solutions using the Databricks Lakehouse Platform. The ideal candidate is a hands-on engineer with strong expertise in Databricks, Apache Spark, and SQL, excellent analytical and problem-solving skills, and experience building scalable data pipelines in cloud environments.
Required Qualifications
- U.S. Citizenship is required.
- Top Secret (TS) Security Clearance OR Public Trust Clearance Preferred.
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field (or equivalent experience).
- Hands-on experience developing and implementing data engineering solutions using Databricks.
- Strong hands-on experience with the Databricks Lakehouse Platform.
- Strong programming experience with Apache Spark (PySpark/Spark SQL).
- Expert-level SQL skills with experience writing, optimizing, and troubleshooting complex SQL queries.
- Strong analytical, critical thinking, and problem-solving skills.
- Experience designing, developing, and supporting ETL/ELT pipelines.
- Strong understanding of data modeling, data warehousing, and Delta Lake.
- Experience using Git or other version control systems.
- Excellent verbal and written communication skills.
Preferred Qualifications
- Strong analytical and problem-solving skills.
- Strong SQL query writing, optimization, and performance tuning skills.
- Experience with Azure, AWS, or Google Cloud Platform.
- Knowledge of CI/CD pipelines and DevOps practices.
- Experience with Databricks Delta Live Tables (DLT) and Unity Catalog.
- Nice to have: Experience with PL/SQL.
Key Responsibilities
- Design, develop, and maintain scalable data engineering solutions using Databricks and Apache Spark.
- Build and optimize high-performance ETL/ELT pipelines for processing large volumes of structured and unstructured data.
- Develop, tune, and optimize complex SQL queries for data transformation and analytics.
- Analyze business requirements and translate them into scalable technical solutions.
- Troubleshoot production issues and optimize data pipeline performance.
- Ensure data quality, integrity, security, and governance across enterprise data platforms.
- Collaborate with data architects, software engineers, analysts, and business stakeholders.
- Participate in code reviews and follow software engineering best practices.
- Create and maintain technical documentation for solutions, deployments, and operational support.
- Support production releases and provide operational support as needed.
Desired Skills
- Strong attention to detail and commitment to delivering high-quality solutions.
- Ability to work independently and collaboratively within Agile teams.
- Excellent organizational, communication, and interpersonal skills.
- Passion for learning new technologies and continuously improving data engineering practices.
Pay Range: Negotiable
Pay: $100,000.00 - $150,000.00 per year
Application Question(s):
- This is Federal Project and requires US Citizenship. Are you US Citizen?
Work Location: Hybrid remote in Herndon, VA 20192