Senior Platform Engineer - Databricks Integration
Job Description
Everforth ECS is seeking a Senior Platform Engineer – Databricks Integration to work in the National Capital Region covering the Pentagon, Falls Church, and Fairfax. Please Note: This position is contingent upon contract award.
The War Data Platform (WDP) is a key initiative within the U.S. Department of War's (DoW) AI-First strategy introduced in early 2026. The WDP focuses on operational warfighting data and aims to accelerate the deployment of artificial intelligence (AI) on the battlefield. The WDP extends to Unclassified, Secret, and Top Secret environments, and supports collaboration between Combatant Commands, Joint Staff directorates, Senior Executive Service leaders, and operational analysts.
• The Senior Platform Engineer – Databricks Integration provides senior-level technical leadership for the integration and operational advancement of Databricks capabilities across WDP's full multi-enclave architecture, spanning Unclassified/NIPRNet, Secret/SIPRNet, and Top Secret/JWICS environments. This role is central to enabling high-performance distributed data processing, MLOps maturity, and mission-aligned data exploitation in direct support of WDP Core Integration objectives.
• Leads the integration, configuration, and operational advancement of Databricks platform capabilities supporting War Data Platform (WDP) Core Integration mission requirements across Unclassified and NIPR, Secret and SIPR, and Top Secret and JWICS enclaves.
• Designs distributed data pipeline architectures that ingest, transform, and process high-volume structured and unstructured data using Databricks Workflows, Delta Lake storage patterns, Unity Catalog governance rules, and medallion-layered data modeling aligned with enterprise architecture objectives.
• Implements MLOps frameworks using Databricks Model Registry, Feature Store, and automated training pipelines to strengthen machine learning reproducibility, deployment readiness, and mission analytics responsiveness.
• Optimizes Databricks cluster performance, auto-scaling behaviors, job concurrency, and cloud cost allocations using monitoring utilities, workload metrics dashboards, and predictive capacity planning.
• Integrates the Databricks environment with existing WDP Core Integration platform components including API gateways, cross-domain data movement tools, orchestration systems, data governance platforms, and enclave security controls.
• Conducts technical assessments of emerging commercial and open-source technologies and leads structured tool evaluations to determine suitability for integration into the WDP Core Integration ecosystem.
• Provides senior-level engineering mentorship to data engineers, analytic developers, and artificial intelligence teams, raising maturity in distributed computing practices, performance tuning, and data security.
• Produces architectural diagrams, integration guides, performance reports, and compliance documentation that advance platform interoperability, scalability, and mission-aligned data exploitation capabilities.
• Performs other duties as assigned.