Skip to main content

Custom datasource

Custom/Other datasources are specialized integrations developed specifically for unique requirements that cannot be met by standard data source types. These project-specific solutions handle complex authentication scenarios, multi-API coordination, legacy system integration, and proprietary protocols that fall outside the scope of standard JSON, XML, RSS, or other built-in data source capabilities.

Prerequisites​

Before requesting a Custom/Other datasource, ensure you have:

  • Clear documentation of the integration requirements that cannot be met by standard data sources
  • Understanding of the external system's authentication methods and API structure
  • Access credentials and permissions for the target system
  • Knowledge of data formats, update frequencies, and business logic requirements
  • Budget and timeline approval for custom development work
  • Technical contact person familiar with the external system
  • Compliance and security requirements for the integration
  • Sample data and API documentation from the target system

When Custom Development Is Required​

Custom/Other datasources are developed when standard data source types cannot handle specific requirements:

Complex Authentication Scenarios:

Standard OAuth insufficient for:
- Multi-step authentication processes
- Certificate-based authentication systems
- Custom token exchange mechanisms
- Legacy authentication without modern OAuth
- WS-Security headers for enterprise SOAP services
- Proprietary authentication protocols
- Time-based token generation systems

Multi-API Coordination Requirements:

Single data source needing:
- Coordinated authentication across 8+ different APIs
- Sequential API calls with dependency chains
- Data aggregation from multiple heterogeneous sources
- Complex data transformation during retrieval
- Cross-reference data validation between systems
- Orchestrated authentication workflows

Legacy and Proprietary Systems:

Integration challenges including:
- On-premise systems with custom protocols
- University-specific authentication systems
- Government systems with specialized security
- Banking/financial systems with strict requirements
- Manufacturing systems with proprietary interfaces
- Healthcare systems with HIPAA-compliant protocols

Advanced Data Processing:

Beyond standard HTTP requests:
- Real-time data streaming protocols
- Binary data format conversion
- Custom encryption/decryption requirements
- Complex business logic during data retrieval
- Multi-format data consolidation
- Advanced error handling and retry logic

Specialized Industry Requirements:

Industry-specific integrations:
- Educational institution student information systems
- Healthcare electronic health record systems  
- Financial trading and market data systems
- Manufacturing execution systems (MES)
- Transportation management systems
- Energy and utility management platforms

Custom Data Source Architecture​

Custom datasources integrate with Wallboard's existing infrastructure while providing specialized functionality:

Standard Infrastructure Integration​

Universal JSON Storage:

{
  "customData": {
    "processedResults": "Custom processing output",
    "sourceSystem": "Legacy ERP System",
    "lastUpdate": "2024-03-15T10:30:00Z",
    "dataQuality": {
      "recordsProcessed": 1250,
      "validRecords": 1248,
      "errorCount": 2
    }
  }
}

Standard Datasource Features:

  • Automatic refresh scheduling (cron expressions or intervals)
  • Error counter and deactivation logic
  • Usage-based lifecycle management
  • Team-based access control
  • External resource caching capabilities
  • Standard monitoring and alerting integration

Custom Processing Components​

Authentication Layer:

Custom authentication module handles:
- Specialized login flows and token management
- Certificate validation and exchange
- Multi-system credential coordination
- Session management and renewal
- Security protocol implementation

Data Processing Pipeline:

Custom data pipeline provides:
- Multi-source data aggregation
- Format conversion and transformation
- Business logic application
- Data validation and quality checks
- Error handling and recovery
- Performance optimization

Integration Interface:

Standard Wallboard integration:
- JSON output format for widget consumption
- Refresh scheduling and lifecycle management
- Team permissions and access control
- Monitoring and alerting capabilities
- Documentation and support resources

Configuration and Management​

Custom datasources appear in the Wallboard interface as "Other" type datasources:

Basic Configuration​

1. Custom Datasource Selection

  • Navigate to Datasources > Add new > External datasource
  • Select "Other" type from available options
  • Choose the specific custom implementation from dropdown
  • Enter custom datasource name and description
Custom Update Patterns

Custom datasources may have specialized update requirements based on the source system's capabilities and data patterns. Consult implementation documentation for optimal refresh frequency recommendations.