How to Use the HydroServer Job Orchestration System
HydroServer includes a task automation system called the "Job Orchestration System" that can be used to set up and run automation tasks for loading data, transforming data, and monitoring the quality of incoming data. The following guides will help you understand the functionality of each of these different task types:
Setting Up Data Ingestion Tasks: Get instructions for setting up automated tasks for loading data from external files or APIs available on the Internet
Setting Up Data Aggregation and Transformation Tasks: Get instructions for setting up automated tasks aggregating high-frequency data to lower-frequency products along with other transformations like applying mathematical expressions to inputs for deriving new outputs (e.g., performing units conversions) and applying rating curve transformations to input values to create new outputs (e.g., deriving discharge from stage).
Setting Up Automated Data Quality Monitoring Tasks: Get instructions for setting up automated tasks for monitoring the quality of data that are being loaded into HydroServer to ensure that technicians can be notified when something goes wrong.