Skip to main content

Workflow Orchestration

Welcome to the OpsHub Workflows documentation. This section covers OpsHub’s powerful workflow orchestration system built on Temporal Cloud.

What is Temporal?

Temporal is a durable workflow orchestration platform that enables OpsHub to run complex, long-running business processes reliably. Workflows survive system failures, restarts, and upgrades while maintaining their state.

Key Capabilities

Durable Execution

  • Fault-tolerant - Workflows survive service restarts and crashes
  • Automatic retries - Failed activities are retried with exponential backoff
  • Long-running - Workflows can run for days, weeks, or months
  • Event-driven - React to signals and external events

Workflow Features

  • Dynamic composition - Create workflows at runtime based on business rules
  • Child workflows - Compose complex workflows from simpler ones
  • Scheduled execution - Cron-based scheduling for recurring tasks
  • Human-in-the-loop - Support for approval workflows
  • Cancellation - Graceful cancellation and cleanup

Activity Management

  • Idempotent - Activities can be safely retried
  • Heartbeats - Long-running activities report progress
  • Timeouts - Configurable execution and retry timeouts
  • Local activities - Optimized for fast, deterministic operations

Core Workflows

Daily NAV Workflow

Automated daily Net Asset Value calculation workflow:
  • Market data collection
  • Position valuation
  • Performance calculation
  • Report generation
  • Distribution to stakeholders

Pricing Workflow

Automated security pricing workflow:
  • Price data ingestion from multiple sources
  • Price validation and quality checks
  • Fair value calculation
  • Price distribution
  • Audit trail generation

Reconciliation Workflow

Automated data reconciliation workflow:
  • Data collection from multiple systems
  • Matching and comparison logic
  • Break identification and classification
  • Exception handling
  • Notification and reporting

Workflow Activities

Workflows are composed of reusable activities:

Data Fetch Activities

  • Retrieve data from external systems
  • Database queries
  • API calls
  • File processing

Validation Activities

  • Data quality checks
  • Business rule validation
  • Compliance verification
  • Schema validation

Calculation Activities

  • NAV calculations
  • Performance metrics
  • Risk analytics
  • Valuation models

Notification Activities

  • Email notifications
  • Slack/Teams messages
  • Webhook calls
  • Dashboard updates

Workflow Architecture

┌─────────────────────────────────────────────┐
│         Temporal Cloud                       │
│  (Workflow Orchestration Engine)             │
└─────────────────────────────────────────────┘

┌─────────────────────────────────────────────┐
│      OpsHub Workflow Workers                 │
│  - Daily NAV Worker                          │
│  - Pricing Worker                            │
│  - Reconciliation Worker                     │
│  - Integration Workers                       │
└─────────────────────────────────────────────┘

┌─────────────────────────────────────────────┐
│      Activity Implementations                │
│  - Database Operations                       │
│  - External API Calls                        │
│  - Calculations                              │
│  - Notifications                             │
└─────────────────────────────────────────────┘

Development

Workflow Definition

Workflows are defined in Python using the Temporal SDK:
  • Type-safe workflow definitions
  • Deterministic execution
  • Versioning support
  • Testing utilities

Local Development

  • Temporal local server for testing
  • Workflow replay for debugging
  • Unit testing with mocks
  • Integration testing

Deployment

  • Temporal Cloud for production
  • Auto-scaling workers
  • Monitoring and observability
  • Error tracking

Monitoring & Operations

Workflow Visibility

  • Real-time workflow status
  • Execution history
  • Activity retry tracking
  • Performance metrics

Operations

  • Manual workflow triggers
  • Workflow cancellation
  • Signal injection
  • Schedule management

Getting Started

  1. Temporal Cloud Setup - Configure Temporal Cloud connection
  2. Core Workflows - Explore pre-built workflows
  3. Workflow Activities - Learn about reusable activities
  4. Developer Guide - Build custom workflows
Use the sidebar to explore:
  • Workflows Overview - Introduction and Temporal Cloud setup
  • Core Workflows - Daily NAV, pricing, reconciliation
  • Workflow Activities - Data fetch, validation, calculation, notification

For workflow integration and development, see the Developer Docs section.