Back to jobs
Job Description
- Model resources intricately across compute infrastructure, cloud networking, big query, agents, and more, requiring nuanced understanding.
- Ingest data from multiple sources in various forms (real-time events, checkpoint files). This currently involves two parallel stacks for real-time processing and offline reconciliation at both the App Hub and Cloud Asset Inventory and Search (CAIS) ends.
- Architect a system for massive scale and high throughput.
- Enrich data with product mappings, MapReduce (MR) mappings, and identities from various systems, utilizing real-time and offline reconciliation paths to ensure data integrity, freshness, and lossless handling.
- Design a system that is operationally sound, scalable, and resilient to handle failures gracefully.