Neura Market
prompt logo

prompt

Free

Senior Data Platform Architect system prompt for modern data architectures

FreeFree tier
Inputs: textOutputs: text
Type
Open Source
Visit Website GitHub (40 stars)

About prompt

A comprehensive system prompt designed for AI language models to act as a Senior Data Platform Architect with 15+ years of experience. It provides detailed context covering 2026 industry trends such as data mesh, lakehouse architectures, real-time streaming, and AI-driven governance. The prompt instructs the AI to design a complete data platform for a mid-to-large enterprise, including architecture overview, data ingestion, storage lakehouse design, processing compute, AI/ML integration, and data governance with quality monitoring. It includes specific technology recommendations (e.g., Kafka, Flink, Delta Lake, DataHub) and addresses cost optimization, compliance, and AI-readiness.

Key Features

Role-specific system prompt for Senior Data Platform Architect
Covers modern data stack: lakehouse, stream processing, AI/ML, governance
Context updated to 2026 trends (data mesh, real-time, privacy compliance)
Structured deliverables: architecture overview, ingestion, storage, processing, AI/ML, governance
Recommends specific technologies: Delta Lake, Kafka, Flink, DataHub, etc.
Addresses multi-cloud deployment, cost optimization, and PII detection

Pros & Cons

Pros
  • Comprehensive coverage of all major aspects of modern data platform design
  • Based on latest 2026 industry trends and technologies
  • Well-structured with specific deliverables for each architectural layer
  • Includes real-world constraints such as cost, compliance, and AI-readiness
Cons
  • Requires deep domain knowledge in data engineering and architecture to implement effectively
  • May be too detailed for simple or small-scale projects
  • Assumes cloud-native environment (AWS/GCP/Azure) and may not suit on-premise setups
  • Length of prompt may exceed context limits of some AI models

Best For

Designing a comprehensive data platform for mid-to-large enterprises (500+ employees)Planning a data mesh implementation with federated domain ownershipEvaluating lakehouse table formats (Delta Lake, Apache Iceberg, Apache Hudi)Building AI/ML pipelines including feature stores, model serving, and RAG integrationImplementing data governance frameworks with lineage, quality monitoring, and access control

FAQ

What is the purpose of this prompt?
To have an AI language model assume the role of a Senior Data Platform Architect and generate a comprehensive data platform design for a mid-to-large enterprise, covering ingestion, storage, processing, AI/ML, and governance.
What technologies does the prompt recommend?
It suggests modern technologies such as Apache Kafka/Pulsar for streaming, Delta Lake/Iceberg/Hudi for lakehouse storage, Apache Flink/Spark Streaming for stream processing, and DataHub/Collibra for data governance, among others.
Is this prompt suitable for small businesses?
It is explicitly designed for mid-to-large enterprises with 500+ employees. Smaller organizations may need to adapt the scope and scale of the design.
What are the main deliverables requested in the prompt?
The prompt asks for an architecture overview, data ingestion layer design, lakehouse storage design, processing compute framework, AI/ML integration plan, and data governance quality strategy.