Prophecy’s AI Assistant Brings Revolutionary Data Pipeline Automation

California-based data engineering startup Prophecy has launched a generative artificial intelligence (AI) tool that enables trusted data pipelines to be created from natural language prompts. Data copilot and its accompanying platform suggest transformations and expressions to improve the pipeline quality with increased test coverage for higher quality data products. The system’s capability maximises time for more pressing tasks while providing consistent outputs and saving on expensive data engineers’ time. To achieve this, Prophecy uses the user’s natural language queries to produce a performant data pipeline, relying on historical queries, code executed on SQL, Spark, or Airflow to learn and improve.