Collect Dagster data into your data warehouse or ours. The Matatika pipelines will take care of the data collection and preparation for your analytics and BI tools.
Dagster is an open-source data orchestrator for machine learning, analytics, and ETL.
Dagster provides a unified framework for building data pipelines that allows developers to define the inputs, outputs, and dependencies of each step in the pipeline, making it easier to test, maintain, and scale complex data workflows. It also includes features such as data validation, error handling, and monitoring to ensure the reliability and quality of data processing. Dagster supports a variety of data sources and execution environments, including local development, cloud-based services, and containerized deployments.
A token used for authentication when connecting to the Dagster API.
The date from which to start streaming data.
The URL of the Dagster API.
A list of stream maps to use when streaming data.
Configuration settings for the stream maps.
Whether or not to flatten the data when streaming.
The maximum depth to which the data should be flattened.
Extract, Transform, and Load Dagster data into your data warehouse or ours.