Documentation

Documentation

Everything you need to operate BARRY — from installing the server and registering your first client to change data capture, governance and the developer tools. Pick a chapter, or start with Getting started.

Getting started

IntroductionWhat BARRY is and the core concepts.Getting startedRegister a client and run your first transport, end to end.ArchitectureHow the server and client fit together.ClientsThe on-prem agent: install, register, monitor.

Core concepts

ConnectionsOne system you can talk to — source, sink, trigger or alert.Connector catalogueEvery source, sink, trigger and alert channel.Output formatsFile format, compression and folder layout for object-store sinks.TransportsThe central object: move this table, this way, to here.Transport groupsOrganise and operate transports together.TriggersStart a run on a schedule, message, file, chain or sensor.Monitoring & runsLive throughput, run history and data freshness.AlertsNotify a channel when a run reaches an outcome.SecretsVault-backed references for connection credentials.FirewallAllow/deny rules between sources and destinations.

Governance & access

Authentication & rolesOIDC sign-in and role-based access.Keycloak setupConfigure Keycloak or a generic OIDC provider.Microsoft Entra ID setupConfigure sign-in with Microsoft Entra ID.Runtime settings & administrationRetention, concurrency and performance.Schema registryA catalog of every dataset and its versions.PII detection & maskingServer-side detection and anonymization.Git integrationConfig-as-code and promotion between environments.Public API & MCPDrive the runtime programmatically and from AI assistants.

Databases

SQL ServerSQL Server and Azure SQL as source or sink.PostgreSQLPostgreSQL as source or sink, with logical-replication CDC.MySQLMySQL as a source, with binlog change capture.MariaDBMariaDB as a source, MySQL-compatible.Oracle DatabaseOracle as a relational source.IBM Db2Db2 as a relational source.ODBC (generic)Reach anything with an ODBC driver.ClickHouseClickHouse as a sink.Apache DorisApache Doris as a sink.

Warehouses & lakehouses

SnowflakeLoad into Snowflake.Google BigQueryLoad into BigQuery.Databricks managed DeltaManaged Delta tables under Unity Catalog.Databricks managed Delta (ADBC)The direct-streaming route into Databricks.Microsoft Fabric LakehouseWrite into a Fabric lakehouse.Microsoft Fabric WarehouseWrite into a Fabric warehouse.Microsoft OneLakeLand files in OneLake.Apache IcebergWrite Iceberg tables against your catalog.AWS S3 TablesManaged Iceberg on S3.Databricks LakeflowServe BARRY data to Databricks on demand.

Object storage & files

Azure Data Lake Gen2Land Parquet/CSV in ADLS Gen2.Azure Blob StorageLand files in Blob storage.Amazon S3Land files in S3.Google Cloud StorageLand files in GCS.FTPLand files on an FTP server.SFTPLand files on an SFTP server.

Applications & APIs

SAP (OData / CDS)Read SAP through Gateway OData and CDS views.SAP (RFC / table CDC)Extract SAP tables over RFC.REST APIRead a generic JSON REST API.ODataRead a generic OData v4 service.

Streaming & messaging

Apache KafkaKafka as a sink and messaging trigger.Azure Event HubsEvent Hubs as a sink and trigger.RabbitMQStart transports from RabbitMQ messages.Azure Event GridStart transports from Event Grid events.

Alert channels

Microsoft TeamsSend alerts to Teams.SlackSend alerts to Slack.WebexSend alerts to Webex.Email (SMTP)Send alerts over SMTP.Microsoft 365 MailSend alerts via Microsoft 365.Azure Logic AppsTrigger a Logic App on an alert.Azure DevOpsRaise Azure DevOps work items on an alert.WebhookSend alerts to any HTTP endpoint.

Developer tools

VS Code extensionBuild and operate BARRY from your editor.PySpark connectorRead BARRY data from Spark.Python wheelInstall the BARRY Python package.Mobile appMonitor running transports from your phone.